Is there a way to sort a view on a field that is not displayed?

Is there a way to sort a view on a field that is not displayed?

I added a numeric field to a file in order to explicitly control the sort order in a view.

I don't want the user to see that field, but if I remove it from the view, it is not available to sort on.

Is there a work around for this?