Can't remove/add fields in Contacts

Can't remove/add fields in Contacts

After I have added/removed fields from Contacts and save it, all returns to default again.
There are many fields within the default template, we do not need + there are fields missing that we do need.
How can we edit them to our liking and keep the changes without it ignoring the changes after save?