Categories aren't like pages, they are created dynamically, when a random category is added to an article, MW would create that category.
The only option to delete categories as a whole is to either manually remove them from all the pages, or use scripts like MassEdit.
Or if you are talking about Category description pages, delete them like a normal page