The rule of thumb is when the 5th node is starting. You shouldn't go by the cotyledons turning yellow because some plants grow very large and keep them nice and green.