Only AltGr + [the key] would be a dead key, not the bare key itself. Perhaps a tool could be made to convert compose files into Windows keyboard layout definitions with this strategy

That's a good point about non-character keys though, I don't think that could be supported with this method.