Oort Cloud objects as in [0]? Getting to asteroids takes way to long already. Yeah, Oort cloud won't happen unless we have a magical breakthrough in propulsion as depicted in The Expanse. And at that point current intuition around gravity wells will probably not apply anymore as well.
[0] https://en.wikipedia.org/wiki/File:PIA17046_-_Voyager_1_Goes...