I have recently setup POP3 account with MS Outlook as client. 

I have multiple verified domains setup with ZOHO for receiving emails.

I am using outlook to receive all the emails and for sending the replies. While replying for each of those domains, I would like to setup the appropriate "From" section of the outlook separately for different domain.

When I manually put "From" email in the outlook for replies, the mail doesn't get delivered.

Please advise.

I am the only person in my company for my matrimony business and I have 15 domains for different castes.

There is no point for me to have 15 different accounts as number of emails are very limited for each domain.