When I move my mouse wheel, both scrollbars show up, if the window is horizontally scrollable at the moment.

Horizontal scrolling with the mouse wheel is done by moving the mouse wheel with the shift key down.

Note that just touching the trackpad with two fingers, as if you're about to scroll, also brings up both scrollbars.