I actually have the opposite opinion. I like their UI, with the drag-down feature to select options, etc etc. Though I liked the very early Sailfish version on my old Jolla phone even better (it was upgraded on the Jolla phone as well, but yeah, the old one felt better. But not everybody agreed with me on that).
The issues I have with my current Sony Xperia w/Sailfish is a) Nearly impossible to get a Japanese SIM card to function (as a second SIM), and when it worked it did so only sporadically. Basically useless. Same SIM worked fine in an Android phone and an iPhone (both brought over from Europe). And the camera.. it works, but it can take many seconds before the photo is actually taken, and all the features of the camera(s) aren't available. Not that I use it much for photos (though the ones I do take look good), but..
(And of course I also hate the long narrow super-slick easy-to-drop Xperia phones, but they're just like nearly every other phones these days, and the only option for an Android-enabled Sailfish phone now)