Lovely article. The subjective nature of entropy and information immediately makes me think of the IIT theory (integrated information theory) of consciousness and its foundational futility. Information cannot be discussed without perspective. Someone has to define the states. A die have 6 states only to us humans. What about an ant that's likely to have the die land on it? Bringing the observer back into discussions of information is fascinating because it then begs the question: How is the observer put together? And how does a perspective, an I, emerge in a multi-trillion-cell entity? For those interested in this detour, you might like reading this and our book (mentioned in there)

https://saigaddam.medium.com/consciousness-is-a-consensus-me...