Yes, remove them immediately and keep picking them off as they appear.

If you want to avoid hermies in the future, buy some "Dutch Master Reverse." It has to be applied on days 1 and 10 of 12/12, so I'm afraid it's too late this time around.