> I had friends who learned how to read when they were toddlers and it had literally no effect on them later in life other than that they were bored in school until everyone else had the chance to learn who did not have their parents expose them to this.

It sounds like the issue was putting them through school, not teaching them to read early.