I dont really think its your brothers fault.

Your his older brother and in his eyes you are "Cool".He probably was telling people my bro is so cool he is growing pot.

As Stinkyattic said sit him down without anger and talk to him.