Damaged or dying leaves are fine to clip, although if the leaf still has any green on it, the plant DOES take some benefit from stripping it of stored nutrients before it is shed.
I almost never clip leaves. I'll remove entire low, scruffy stems, but not leaves, unless I see that a particular leaf is hosting a whole mess of pests or something.