Speed Performance of Query Tables

Speed Performance of Query Tables

 We are doing a query table as a join between two tables using a positive number column to join on. One table is 36420 rows and the other54214 rows. When ever an update is done to the underlying tables the Query table refreshes, great, but the refresh takes minutes and data from the query table are not available during this.

Are there know limits to keep within for Query tables to perform or any tricks that can help speeding this up?