My wording is confusing, by "not taking a performance hit" I mean that the performance of the 32GB stick is not limited to the lesser 8GB stick, like it would have been with dual channel.

Of course, dual channel is always better than single channel, and it gives you a performance boost if you have 2 of the same stick.