If the leaves are more than 50% "dead" then take them off, otherwise let them go.