Change categories

I need to delete a contact from a category without deleting the contact. I see how to add to a different category, but can't delete from the old category. Can anyone help me?