Here is what I do..I just tried it and it worked for me.
Right click on what you want to remove
Click on delete
A message appears saying that the shortcut icon will be removed but not the program and if I want the program removed I have to goto Add/Remove Programs.
I have Windows XP so I dont know if this works with them all.