Its a tough one bredrin,depends if you can cope with the fact you fucked up big time and just take the chance your neighbour didnt see your ladies.Me personally I would get rid just to be on the safe side especially if you don't get along with them because I know about neighbours from hell and it aint no fun lol!

You can move them elsewhere if you have that luxury or as I said get rid and start up again when all is well!!

Sorry for your troubles but you'l be more careful next time!