Yeah you definitely need a good exhaust fan, and you can get ones that are pretty quiet. Also, you might want to look at getting an air cooled enclosed reflector or even a cool tube for your light since you're in such a small space. That would solve your heat issue guranteed. Get a small oscilating fan for inside the room too, the plants need air moving past the leaves and the breeze will help strenghten up the stems.

You mentioned having neighbors too, so you might want to look at getting a carbon filter for you exhaust fan (or making your own, use the search at top to find out how) to eliminate the odors. Hope that helps man, if not just ask