Good lookin' dirt

See, I planted a seed in a small pot so it can sprout. When it gets time to transplant it, would it be alright if I put it in some moist and dark dirt that's in my backyard? Earthworms live in it if that makes any difference.

The reason I'm asking is because I don't have one of those huge pots and I'm also running low on potting soil. :(

Shit...I just saw the thread asking the exact same question. My bad. I don't know how to delete this.

If you are planting it in backyard dirt, leave it in the backyard, not in a pot. And you still need to loosen the soil and possibly amend it.
If you want to plant it in a pot, buy potting soil.