Remember, leaves often fall off into late flowering aswell. If the leaves start yellowing and dying from the bottom up, then thats fine. If it starts all over the plant though, its probably a deficiency of some kind.