I flew ASE for several years, and the answer is - it depends. Completely dependent upon the weather up there. For getting into ASE, it’s typically less weight restricted (if at all).
Getting out of ASE is another matter. If the weather is good and the winds are light, a full boat is no problem. If there’s a strong TW and Eng + Wing A/I are required, it will be big time weight restricted.