A little less simple than that.
After they turn milky, they are harvest-able, but the effect will be quite "uppity".
Wait for amber, less, head, more body.

No law says you must harvest all at once, ya know.

Take a few buds,
Dry n try,
Make some notes.
Wait a week.
Repeat.
That works well with any first-run harvest.

Aloha,
Weezard