That's like saying "no I don't shop for 'electronics' whatever that means, I buy phones and TVs and computers." The umbrella term is what it is, whether you know it or not.
If you completely ignore the context of the conversation, sure. The way "textiles" was thrown out implied that by shopping for textiles, one should know and care about the actual material. The reply was asserting that they judge the individual items by their quality, not by knowing the material.
