Changing Domains

I want to change my domain name and I don't want to retain the old name as an alias. What will happen if I delete my domain in my mail account and setup the new domain? Will I lose my old emails?