In the world we live in today, don't bother him. Growing is a personal matter.
Your neighbor is minding his business in his own home. Ask him if he tokes and maybe you'll have a connection for some nice buds, but other then that 'keep ya eye brows down'. if my neighbor asked me if i grew, not only would i say no, if i didn't shut down the operation, i would avoid all contact.