I agree. Also, what modern icon could be used to replace the floppy disk that would be immediately recognizable as meaning "save this file"? And if it represents a currently-used device, like a USB thumb drive, how long before that one becomes obsolete? And would we end up with each product having a different icon?
Some could argue that even USB sticks are pretty obsolete. Most mere mortals don't really use them anymore, and the only time I use them at home is when I need to boot off an installation .iso or something. They are rarely, if ever, part of my work day.