I would only take leaves out if they are too squashed to be doing any good. If they're free and clear, let em breathe.