I pasted in the question I typically ask candidates at $dayjob. It did better than the vast majority of candidates. (It’s a very open ended architectural question that’s specific to the industry I’m in.)
At the end I said “write it in Rust” and it wrote a plausibly good implementation.
I’m not sure I can trust remote interviews any more…
That's close to answering a question from a bit over a year ago: "in 5 years will there be an AI that's better than 90% of unassisted working programmers at solving new leetcode-type coding interview questions posed in natural language?" https://news.ycombinator.com/item?id=29020401
It didn't get a very welcoming reception -- "highly unlikely", and the tenor of other opinions in those comments then tended the same way. But I was being too conservative. (I thought so at the time but it felt sort of outside an Overton window of reasonable technology opinions.)
But if it's a remote job, won't that same developer do great by just delegating all their tasks to the AI, just like they did in the interview? Crazy stuff.
At the end I said “write it in Rust” and it wrote a plausibly good implementation.
I’m not sure I can trust remote interviews any more…