the only thing i worry about when removing leafs is clean tools ,fingers and nails> you dont want to give a bacteria/disease to your plants. And dont remove just any leaf, just the ones pumping up juice for nothing!
Oh yeah if it's facing down and does not see any light at all usually means it"s a removable leaf! it's like first little starter branchs at the bottom of the plant they suck juice from the plant for nothing! So removing them is good. When the plant is strong and ready!!!