How to rename or delete folders

How does one rename or delete folders? I have some organizing to do. Dragging to the trash doesn't seem to do it.

Please help

Will Knapp