Not all of my lists I have added to "exclude" in Campaigns are being excluded only a select few.

Not all of my lists I have added to "exclude" in Campaigns are being excluded only a select few.

I have three lists that I want to exclude from a campaign because they are not relevant to who I am targeting with this email campaign. When I select to exclude these lists only part of the list is being excluded. I know it is based on previous campaign interactions but how can I exclude all recipients of a list. I do not want them to receive the email campaign. Thanks