How can I remove a sort on a pivot table

How can I remove a sort on a pivot table

I have created a project pivot view that includes "last update" and "start date".  I can't get the sort on the "Start date" to go away.  I just want to sort by last update.  How do I remove the sort on Start Date but keep the column in the view?