You can have a maximum 5000 leads or contacts for a user license. In this case, your email limit in Campaigns is 25000 (5000 x 5). If you downgrade one user license, you will have four user licenses, restricting your email limit to 20000 (5000 x 4).