i wait till they fall off to the touch but i dont like harming the plant so i let it die off...