I only trim off fan leaves when they are 50% dead, as in half of the leaf is shot and not producing. Another good way to tell is if you tug on it and it comes off with no resistance, then it is safe to remove. If it doesn't want to come off don't force it.