Yes your tolerance will drop for sure,I think you would notice a difference if you stopped for at least 1-2 weeks.