Some lower leaves may yellow and die but it sounds like you have leaves all over the plant dying. Now when you said you haven't fertilized much then it made sense. You gotta feed your plant, bro. Get some bloom formula on those suckas, now.