Seed size and initial hardiness are related. A larger seed contains more stored energy for the seedling and I've found that the seedling from a small seed requires closer observation and better conditions to really thrive.
Once the plant has leaves and is fully rooted, it doesn't matter where it came from- vigor/resistance to abuse from this point on is dependent on strain.