I'm a t-shirt and jeans person but I will never go to an in-person interview without a button-down shirt. If a company judges me negatively for wearing that then it's not a place I want to work.