What he^ said. Replace the fat in the recipe, whether butter or oil, with your olive oil. If you don't have as much oil as the recipe calls for, make up the difference with regular stuff.

Olive oil & butter behave differently, especially in baking, so they're not exactly interchangeable, but for the purposes of a batch of brownies... close enough for rock&roll.