[Feedback] Sort on hidden field

Why can I not set a sort on a hidden field?

e.g. I have a field in a view that is hidden, but I want the list view to be sorted by this.

The hidden field in this case is actually a value which is a special sort priority and not relevant to the viewer.

Whenever I set the field as hidden it does not appear as a field to sort by.