Some like to, some don't. I feel if they're still green then leave them because they are absorbing light and giving the plant more energy than if they were gone. Like perp said though, you can trim the little scraggly buds from the bottom because they aren't doing anything really but using the energy that could be better directed elsewhere.