All users see task notes for all tasks?

I'm wondering how I can get certain users to see notes for tasks that are just assigned to me. Thanks