User logs in (about 75 users). For each "round" of ranking, users are presented with a scrollable matrix, or a form that looks like one. The first two columns of the matrix consist of nested category labels, the next two columns are a pair of elements we want scored, the rows of this matrix are specific to each user, there would be a table that stores the usernames and their categories and elements. 

There would be 5-30 pairs (each with its own row) per user. The next five columns in the matrix are for the ranking scores, the user would enter a % in each of these fields, these scores must add to 100% across the five fields, and there would be some indication to the user if they did not. The user would be able to leave and return to the matrix to fishing/edit. Once they are done, they would hit a "done" button. Results would be summarized in a pivot table (optional, we many do this via exel). Another "round" of scoring could then be started, scorers would log in again, and make any changes to their scores. Scorer could also view what others had scored that pair in previous/current rounds. 

Historical scores would be retained. 

Matrix would look something like:

Category1 CategoryA Element 1 Element A [score1] ..[score5] 100% 

Category1 CategoryA Element 1 Element B [score1] ..[score5] 100% 

Category1 CategoryA Element 2 Element C [score1] ..[score5] 100% 

Category1 CategoryB Element 3 Element D [score1] ..[score5] 100% 

Hierarchy looks like: 

Category 1… 

 Category A… 

 Element 1… 

 Element A…