Information-Theory
What is Entropy?
There are many mathematical definitions of entropy. The mental picture I find most useful is to imagine the following: you are put in a room and your job is to label everything in the room with a sharpy indelible marker and masking tape. You are asked to label everything in Read more…