so long as there's NO trace of cannabis in the bag, even a tiny bit of leaf, you'll be ok.

to avoid any hassle i'd use different luggage though.