I don't think either one is really the best amendment for most outdoor soil types. What kind of soil is it? Describe the texture, color, water holdig properties, PH, etc. What grows there naturally? How much rain do you get? In most conditions organic amendments like composted pine bark, composted manure, mushroob compost etc. will do more good than perlite or vermiculite.