Response time for unattended access increases when no monitor attached

Response time for unattended access increases when no monitor attached

I want to run a headless Linux machine.  When I have a monitor plugged into it, the response time with unattended access is great. When I unplug the monitor from the machine, lag time goes to 5-6 seconds.

Has anyone seen this before?

Thank you.