Assign Client Without Giving Access to all Project Task lists

Assign Client Without Giving Access to all Project Task lists

Is there a way to assign a client to a project task list with out giving them access to other tasks lists within the project. We are running around 10 projects teams who look after a specific task list (area). We don't want all project teams to be able to see or access other Task List and only see the Task List they have access to under the one Project. 

As far as I can see, with out that, We would be creating multiple projects by team for their specific task list.  Not very user friendly.

Thanks!