Welcome to club paranoia. You'll never know if he's setting you up until it actually happens, whether you're willing to take that chance... its up to you.
Hopefully you have another source.