It will be very nice if the Followers can be added/removed in a similar fashion as you can add/remove Owners in tasks.

Right now it is hard because you have to open task by task, which it is too much work and very inefficient for the Project Manager. 

Also it is very inconvenient the fact that you have no way to remove a follower from a task....