DEFINITELY take out the stems, but save them. If the grinder is a good one and has a screen bottom and kief chamber, once you're done grinding the weed, take it out and put the stems in. Grind them and the kief will collect in the bottom. Unscrew the bottom and sprinkle the kief (pure THC powder) over the weed for an extra kick.