I usually do the same thing. If there is any shake on the bottom i smoke that first, then the small buds to the big buds.