Despite Fermat's brilliance, it's barely feasible that such a proof exists after 300 years of attempts by professionals and amateurs alike.
Ironically though, the tantalising idea of the existence of a simple proof - motivated by that infamous quote - contributed massively (along with the simplicity of the conjecture itself) to the theorem's notoriety and the myriad attempts to solve it.
He wrote the note to himself, a long time before he died. He then publicly announced a proof for the n=4 case, and nothing about the general case. It strongly suggests that he realized his proof was wrong.
Ironically though, the tantalising idea of the existence of a simple proof - motivated by that infamous quote - contributed massively (along with the simplicity of the conjecture itself) to the theorem's notoriety and the myriad attempts to solve it.