I asked around and a few people seem to have no problem "visualizing" tastes and smells, especially for common ones. I can imagine sense of touch too, I just assumed it's normal to be able to imagine all senses.

I can see, taste and touch in my mind. Smell not so much. Its weird because food taste is strongly related to smell. But a fragance alone is very difficult to me.

There's a theory that people are in general bad at doing this with taste and smell because we don't have a lot of words specifically for taste/smell to attach the concepts to. Colors, for example, have their own words, but tastes and smells are in the context of objects they come from instead of standing on their own.