No. You can usually buy physical at spot + 1 or 2% max. In the UK, coins like Sovereigns or Britannias are capital gains tax free, so you typically pay a bit more for them, like 4 or 5% above spot. But then you won't have the headache of remembering what you bought them for when you sell them (aside from the pleasure of saving CGT-free).