You could.

But you'll definitly want to repot and flush. Not neccissarily into a BIGGER pot but more or less just to get it out of the soil it's currently in. You will have an overfertilization situation if you don't...That's the way I see it but I don't know. Pictures help.

Goodluck.