Uniformity increases entropy
The Endeavour 2025-06-23
Summary:
Suppose you have a system with n possible states. The entropy of the system is maximized when all states are equally likely to occur. The entropy is minimized when one outcome is certain to occur. You can say more. Starting from any set of probabilities, as you move in the direction of more uniformity, you increase […]
The post Uniformity increases entropy first appeared on John D. Cook.