Yeah, but REM occurs more often later in a night of sleep. So, wouldn't the effects have (mostly) worn off by the time most of the REM sleep happens?