Read the Sundar's letter. They're saying James was wrong, not that he not that James didn't fit the culture.

You cannot prove either ways on whether James was right or wrong, because his memo was a scattering of everything. But, his idea proves to be a serious obstacle for fellow google engineers especially women to collaborate with him. This is good enough reason for Google to fire him.