Would you mind sharing a link to a proof of the second law using Markov chains and information theory? I'd like to learn more about this approach.
I'm surprised that Markov chains would be involved when the laws of physics are deterministic.
The Poincare recurrence theorem has always suggested to me that the second law is not as fundamental as other laws. For a finite system with finite phase space, the state of a system will traverse closed loops, repeating forever with no steady increase or decrease in entropy. (Edit: to be clear, I'm not claiming that what I just described is the Poincare recurrence theorem or that it applies to our universe. But it is worth considering systems where the second law doesn't apply and trying to figure out how and if they differ critically from reality.)
Not that my background is worth anything, but just so you know where I'm coming from, I have a PhD in physics, spent years thinking about the entropy of computation, and wrote parts of the Wikipedia entry on Maxwell's demon. I think much of the disagreement over entropy and the second law comes from how we frame the problem.
I am on mobile now, and can't provide a simple link, but it is given in Cover&Thomas "Elements of Information Theory", in the episode that discusses entropy of markov processes. I can find pages in google books but they won't zoom big enough to read...
IIRC, the proof requires the markov chain be irreducible, and extends to the general case by summing over the irreducible parts; and that entropy will stay the same or increase while converging to the stationary distribution over states.
(Although it has now been 20 years since I dealt with these things so I might be misremembering. Time to retread Cover&Thomas I guess...)
Cover & Thomas, 2nd Edition, Jul 2006, pg 81, section 4.4 - entropy rate of markov processes, I did not remember all the conditions needed for this to hold, please read if you are interesting.
[0] staff.ustc.edu.cn/~cgong821 /Wiley.Interscience.Elements.of.Information.Theory.Jul.2006.eBook-DDU.pdf seems to have a copy indexed by Google. I suspect it is not legitimate
I'm surprised that Markov chains would be involved when the laws of physics are deterministic.
The Poincare recurrence theorem has always suggested to me that the second law is not as fundamental as other laws. For a finite system with finite phase space, the state of a system will traverse closed loops, repeating forever with no steady increase or decrease in entropy. (Edit: to be clear, I'm not claiming that what I just described is the Poincare recurrence theorem or that it applies to our universe. But it is worth considering systems where the second law doesn't apply and trying to figure out how and if they differ critically from reality.)
https://en.wikipedia.org/wiki/Poincar%C3%A9_recurrence_theor...
Not that my background is worth anything, but just so you know where I'm coming from, I have a PhD in physics, spent years thinking about the entropy of computation, and wrote parts of the Wikipedia entry on Maxwell's demon. I think much of the disagreement over entropy and the second law comes from how we frame the problem.