One can also delete the category be clicking 
icon and the following confirmatory message is displayed.
Message box
Click OK and the following message is displayed. One can click Cancel if the category is not required to be deleted.
Message box
Click OK and the category is deleted successfully.