I've taken them from lower branches so not to disrupt the newer growth. FWIW