Not a bad idea depending upon how you feel and where you live. You're only really carrying it for self-defense so I don't see why you seem (at least, seems to me) like you have a negative attitude towards it.

I don't carry a knife around with me, but I'll be conscious of whatever neighborhood I might be walking through, just being alert and street smart. But then again, I don't have a dog with me so it's different for me.

I'd say yeah, take it with you if it makes you feel safe. Worst comes to worst, unless someone is trying stab you or has a gun (basically a situation where your life is in immediate danger), don't go for the throat. If you just show the knife and keep your cool, they'll probably run. If you need to use it, try to stab their thigh or something. They can't chase you, you'll get your point across to: don't fuck with me, I'm not afraid to kill to defend myself if I have to.

But you'll probably be fine.