Botrytis concern

I had some medicinal sour d's outdoor, already harvested since it rained earlier than it usually does and botrytis attacked.

Now I'm seeing two distinct things: Most of (90-95%) the buds are mostly healthy and green leaves, buds and stems, with a small amount of brown leaves and bud hairs.

The other 5-10% are obviously being devastated by the mold, so they get thrown out.

I want to know about the first group. Could these brown leaves be safe to use, to smoke, make butter or oil? Is this early botrytis, or could it be sun burn or dryness. They may have been underwatered.

Sorry this is the clearest possible photo I can get.

Thanks for the help.

Think you may find those leaves are brown because they were attacked by mold at the stem, in side the bud. Can be used as first indication of possible problem