Pull them off or leave them alone.

Like my father told me long ago.

Those fan leaves are "feeder" leaves and like Hardddon said they serve a purpose. They provide valuable growing energy to the plant. You want to pull them when they are just starting to yellow because they start draining energy away from the plant. Of course you can pull them selectively if they are blocking several lower branches but that is all up to you.