Honestly its all in your head, cuz if weed was bad for your muscle growth it would effect your whole body not just a certain area. You might already be doing this, but don't lift weights everyday, always skip a day.