Receiving email from a contact is not appearing in the contact record. Only the sent email

I want to see both sent mail and received mail from a contact. What do I have to configure to ensure I receive emails as well?