In fact, the paper mentions that the policy network (without MCTS) alone performs reasonably well and can beat most other Go bots.