Make sure you actually authenticate the key fingerprints.
Note, doing this over video chat (if you know what the other person looks like and sounds like) with a fresh key pair is a decent way.*
* Assuming you believe no one has the resources to impersonate your chat partner in near real time.
* Assuming you believe no one has the resources to impersonate your chat partner in near real time.