Size isn't so much the issue as ripeness.
Are the hairs ALL brown? Are the trichs cloudy and turning amber?
If so, it's time to chop anyway.