If they're truly going to kick you out, tell them to go fuck themselves.

If they're just being assholes and threatening, print some info from reliable sources on the effects of marijuana usage, NORML has plenty of links to sources. Good luck!