This is an incorrect interpretation of the AGPL. You do have the freedom to keep forks to yourself. You're only required to present source code to people who can use your program (directly or via the network).