I have a Macbook with Mail.app and an iPhone with iOS Mail, both configured with IMAP to access my email on Zoho.

However the iPhone keeps downloading all email (thousands)

How can I stop this behaviour?

It only does it with the Zoho IMAP server and not with other providers (like gmail) even though they are also using IMAP

Thanks