How do you stop all email contacts being put in contact list

How do you stop all email contacts being put in contact list

It appears every email received automatically places the senders contact details into my contact list. Although, there is an option to add contact however, it appears that this happens automatically.

It even appears to add contacts that have already been added. Is there an option to switch on/off this functionality?

regards

AL