IMAP Not Working Consistently

IMAP Not Working Consistently

I have an IMAP configuration with our users' Outlook email. While it's working properly and the sync is updated, it is inconsistent in the emails displayed in the record. Some emails appear and others don't. What might be causing this?