The smaller the polity, the less practical it is to produce everything. Most towns aren't going to be growing wine grapes or olives at all, so tariffs would just raise local prices and lower imports rather than shifting local production. But they could also induce people to drive to the next town over for shopping.