Not all emails in category being added

I've setup a category in mail that has about 38 contacts. When I goto reference the category I get about 14 emails that only come up. Why is this happening?