Why not have a delete feature on right hand side panel where participants/invites are listed?
Once you scroll over a participant it gives you an option to delete the participant.
This question relates to my last post about IP restriction.
Regards,
David