Pretty much, yeah, because the whole point of unsafe Rust is to drop all the usual safety guarantees, at which point it's explicitly no safer than any other language with dangling pointers.
I get the point of unsafe. But if people replace C code with Rust code using unsafe, then the argument that this "eliminates a whole class of issues" is wrong. It is as simple as this.