Start, run, type:
Edit, Find... Type:
Press F3 until you see the list that represents your IE address bar drop down list.
Right click the ones you want to delete and choose delete.
To add them back you would need to Export the registry key.
File, Export, Choose a name, Save.
To add it back double click the saved file.
Export first and then delete.