My thoughts exactly. Another problem with RNA is that it is a few orders of magnitude too slow (minutes versus fractions of a second) to account for memory formation. Which is not to say that gene expression is not involved in memory consolidation; that's been known for a long time.
Genetic storage is a form of "memory" generally speaking. Some state can be stored and transferred, obviously. It's okay to recognize that biological systems have multiple, diverse, and sometimes redundant subsystems operating simultaneously.
It could account for some amount of long term memory formation— or it could ‘color’ our memories in someway— associating them with pain or trauma— or happiness and joy.