If I had to apply an "aggravation factor", air travel is worse. The train just doesn't seem to bug me as much. One difference is that when the train arrives I'm in the city center. When the plane arrives I'm at the airport.
When you travel by train you are treated like an adult, air travel treats you like a child and herd you around like cattle.
Getting a 100 dollar fine because you didn't click a button on a website, being commanded by uniformed people to "show your papers" over and over, standing in line waiting to stand in another line. Being forced to stand in crowded "designated areas". It's super creepy, gives me the heebie jeebies, like I'm being shipped off somewhere..