How about some light pruning? I'm not only gonna remove some leaves but also the smaller bud sites above the lower branches. If you have some smaller branches shading above them, clip them so the energy will concentrate on fewer bud sites and help them grow bigger. I rather have fewer branches and more light to the buds.