Turning lights off during light cycle is stress free for plants as it is just like an overcast day for them. The only consequence is lost grow time but its not a big deal at all. Maybe it was stuffy for awhile for them if the fan was off but that's not nearly as much of a dealbreaker as light.

So you and your lady are fine.