Maybe there's some kind of crack in between the pipe and compartment? If smoke is getting in their, that would def make it taste like shit. Or it could be that you're storring weed in a non-airtight space. That would also dry your weed out, and make it harsher.