For files, it's not that wrong – copying can be seen as a two step process of selecting what to copy and then where to copy it to, at which point the copy is actually performed. Undoing only the first part wouldn't undo the copy. Still, "Undo Paste" would be a clearer name.
Undo copy should only remove the copied thing from the clipboard.