You're right--chess is a decidedly finite game. Even so, we have not "solved" this simple, finite game--not even close! If we're not close to solving such a trivial game, how can we be close to the limit of the knowledge of the universe?
A googolplex is "too big to be contained" in our universe yet here we are talking about it. We can perform operations on this number, compare it to other numbers, and even come up with mathematical proofs showing that it's too big to exist. There are an infinite amount of numbers larger than a googolplex and we could have an infinite amount of conversations about them. The material limit of the universe does not limit our ability to create information, to learn things.
There isn't enough space in the universe for an infinite series, either, yet we can (and do) still use them, we reason about them, we learn from them. We can even reduce some infinite series to a finite number. The material bounds of the universe are not a limit of knowledge.
I think you're mistaking the map for the territory. A googolplex is a representation of a number, but not the number itself, although it's simple enough that we can get away with using the representation as it's obvious what the form of the number would be. However a number such as tree(3) is unimaginably bigger, but more crucially, we don't know anything about the form of the number beyond its size and we can't sensibly use it in calculations.
Now both of those numbers are finite and we could try to figure out how many numbers we could "describe" such as tree(3), but that would be limited by the number of symbols (i.e numbers, operators, letters and words) that could be used (i.e we would have less than a googolplex different numbers that could be represented using maths, language and thought). That's still going to be a finite number.
If the Universe is the territory than Knowledge is the map. I'm not at all mistaking the map for the territory: I'm pointing out that the set of maps that can describe a given territory are virtually infinite. Asimov is saying the map is almost complete and I'm saying there are an infinite number of maps left to go.
Cartographers in the 18th centuries were "basically done" mapping out the Earth. In the 20th century we were able to use satellite imagery to get the "full picture". Does that mean we have perfect knowledge of the Earth? Absolutely not. There is never a final frontier of knowledge.
A googolplex is "too big to be contained" in our universe yet here we are talking about it. We can perform operations on this number, compare it to other numbers, and even come up with mathematical proofs showing that it's too big to exist. There are an infinite amount of numbers larger than a googolplex and we could have an infinite amount of conversations about them. The material limit of the universe does not limit our ability to create information, to learn things.
There isn't enough space in the universe for an infinite series, either, yet we can (and do) still use them, we reason about them, we learn from them. We can even reduce some infinite series to a finite number. The material bounds of the universe are not a limit of knowledge.