To delete a tag, Navigate to the Settings page by clicking on the gear icon on the right top. On the left pane, click on Tags. Now click on the delete icon against the name of the tag. Confirm the action on the popup that opens.
This will delete the tag permanently from the account and all its association with contacts. Contacts will remain but the corresponding tag will be deleted.