Cannabis has to be 'activated' before it can have an impact on your body in the way you want. Also, stems typically contain far less psychoactive ingredients than the buds (try smoking a bowl of stem - you'll probably just get a headache). You can save your stems and brew a nice tea, etc.