Exclude Users from being added as Contacts

Exclude Users from being added as Contacts

Users have enabled IMAP email sync. When e-mails are imported, other (internal) users are automatically added as Contacts in Zoho CRM. Is there a way to exclude my own domain users from being added to Contacts?