They're playing up that it's a myth to make you assume he doesn't own the swans at all, then assert that in reality, he doesn't own all the swans, so they're technically correct.

You could claim that he's really just licensing the swans to anyone with a swan mark, so it's really just the Shetland and Orkney swans he doesn't own.