Linking between Modules

I'm trying to create a simple report that pulls all my notes, both from Accounts and Contacts into one report. Account seems to trump contacts, and I can't make a report on contacts and show the account! I can't believe there's no way to do that!