Age and weight? Also what's your daily diet consist of? Sounds like you're just not eating enough, try to eat 5 or 6 meals a day. Pretty simple really, train+eat+rest=growth

You should be eating 1g+ of protein for each pound of bodyweight.