I sell financial services. Most of my "leads" come from referrals. Some of which must be nurtured over time prior to converting. I don't do much with specific automated email campaigns. I also spend a lot of time following up with industry contacts and other consultants. I would like to keep track of when I speak with them, be able to sort by last follow up, etc.  

Which tool would be best for me? CRM or Contact Manager?

Thank you, 

Avi