Project ownership and assignment question

Project ownership and assignment question

On our project management process, we have the following requirement.
  1. Project has a project owner. This is currently used for admin purposes.
  2. Project is assign to a team. Currently we dont use team, because we dont want all users of a team to see all projects for that team.
  3. Once a team leader takes ownershop they assoign the project to a project manager on their team
  4. Once a PM is assigned they will get 1 or 2 resources people assigned to the project.
I Would like to make sure that the PM has control over project plan but can not remove team leader.

How can i achoeve it?