Don't trim. But if you tug on them and they come off easily it's ok. Will not effect bud growth. The only plant matter that take nutes and energy From the top canopy are those little branches that don't get light, not the leaves. It's good to clean the leafs off on the bottom cause pests attack those and will cause poor bottom air circulation