Create Event - Organized by ...

Create Event - Organized by ...

Where do Calendar get the e-mail address associated with the 'Organized by' display.  I changed by Primary e-mail address to my Zoho account, but it still shows the account I changed to be a 'Secondary' account.  This is a backup e-mail account and I don't want users that I invite via Calendar to see that account name.

What am I doing wrong?  Does it take some time to change before I assign Zoho e-mail as my primary account?