Forum:Category select showing old categories

Our wiki is still relatively young and we've had a lot of category changes to get the organisation right. But the category select button keep suggesting categories that have been emptied, taken out of the Content section and been deleted. How can I stop them showing up? What is the most approriate way to delete an unwanted category?