Shannon formulated information and facts entropy as being a measure of the knowledge information in a concept, that's a evaluate of uncertainty lessened by the message. In so carrying out, he in essence invented the sphere of data theory. It displays a volume of genuine comprehension we haven