I don't think it'll do anything to you, man.

Since I started smoking (something about half a year ago) I kept increasing my smoking time, and now I smoke about every other day, once at night.

I've noticed no change in memory or anything except when I'm high and a short time after the high is gone. The day after I'm back to normal.

So don't worry about that and enjoy.