new contacts not adding

My understanding is that when I send an email to someone, or reply to an email sent to me, that persons email address should add automatically to My Contacts list?
This doesn't seem to be happening for me at all - I have a lot of new contacts that just haven't added. I'm using Zoho via IMAP with Applemail if that makes any difference.