are they your firends or just people that you kinda know?
my guess is that you dont really stick into their minds because they dont know you. just think, the people that you talk to probably get asked that same question many times a day, they cant be expected to remember everyone. either that or theyre just telling you that so you leave them alone