Make attachment download a customization option

I'd like to allow some users in my organization to download attachments without having to make them an administrator. It would be ideally if this option could be enabled via the security features.

Thanks!

Brett