It’s pretty trivial to commit a variety of frauds against you, and moderate difficult to get valid ID impersonating you. I worked with a non-federal US government entity that employed many investigators who spent 80% of their time looking into what you’re talking about. With the exception of simple frauds addressed with facial recognition (usually people impersonating dead or disabled relatives to avoid consequences of DWI or divorce), they felt that they weren’t scratching the surface.

The US is plagued by stupid right wing people who think that ID is satanic, and stupid left wing people who think that ID by nature will marginalize poor people. Because we’ve allowed the federal government to outsource ID to the states, the US is stuck with inadequate identity framework for a long time.