They're in the registry and stuck for some reason - the easiest way to get rid of them is to d/l Ad-Aware from and do a full scan of your pc for spyware - a useful bi-product is that it also lists all the mru entries from the registry of recently played items - just let it delete them.
You could also run regedit and locate them yourself and delete them, but Ad0Aware is easier.