Sure but selection only works on events that have happened. Loss of function isn't that common especially if the benefit of the gene is resistance to flu, which is far more important than improved memory on an evolutionary scale. Purging selection trumps almost anything more rational.