Hardware drivers that deal with hardware acceleration are written by hardware companies. Libraries and applications only call their functions as defined in the documentation. Game programmers in most cases have no clue about the low-level specifics of hardware that accelerate their games.
Maybe low level hardware access is not the right term, versus excessive privileges that the hardware acceleration libraries require?