The answer is always "it depends", which is exactly why I prefer the median in most cases. Once you choose to use the median, there are no more choices/degrees of freedom - it's just the median. On the other hand, "mean without outliers" requires you to make a subsequent value judgement on what exactly is an "outlier".
> "mean without outliers" requires you to make a subsequent value judgement
Do you think that comparison of outliers to interquartile range is not a relatively objective method of determining outliers?
The interquartile range is a number that indicates the spread of the middle half, or the middle 50 percent of the data. It is the difference between the third quartile (Q3) and the first quartile (Q1) . . . The IQR can help to determine potential outliers. A value is suspected to be a potential outlier if it is less than 1.5 × IQR below the first quartile or more than 1.5 × IQR above the third quartile. Potential outliers always require further investigation.