I quit YOU, how about them peaches and gravy? MMMM...Peaches and gravy.

Quitting something means you cease to use it, or you give up because you are weak. So, yes, you can literally quit using pot.