Ice cubes always taste funny if used without good ice forms, absorbing the fridge odors. Use the ones with silicone cover. Not a hint of the freezer in the made ice.
I got these mostly because space is a luxury in our freezer (very tiny) and wanted to vertically stack them. I love them. It's such a weird thing to throw praise on, but I've literally told friends to get the silicon cover ice trays and never look back.