The commonly cited downsides include (a) rent seeking among protected industries and (b) prices of domestically produced goods are higher. How true these are in practice is probably somewhat controversial and difficult to measure.