The biggest problem i found growing outdoors are rabbits.
I got a pet rabbit and i give it all my males and it goes nuts for em , it realy loves em.