"reality is so limiting compared to what we can imagine"
This is actually a central theme of the Zones of Thought novels by Vernon Vinge where a character in the far future describes our current time as the "Age of Failed Dreams" (GAI, nanotech etc.) - turns out that he is wrong but for rather neat reasons....
Hamilton’s The Reality Dysfunction was the stupidest book I’ve ever read and took hundreds of pages to expose itself. Are his others any more grounded (like your other suggestions)?
Yeah the Night’s dawn series was a bit out there compared to the genre average. The Commonwealth series is considerably closer to baseline, and his best books IMO. The void trilogy (and the newer trilogy whose name escapes me) follow on from the Commonwealth books, and while good, don’t hold up to the first three.
Definitely. I still have some series to read, especially the dark tower from Stephen King which I already started, but I think I'll re-read the whole commonwealth saga in the near future.