Information refers to the objects transmitted and processed through audio, news and communication systems, and generally refers to all the contents spread by human society. People can distinguish different things by obtaining and identifying different information from nature and society, so as to understand and transform the world.
Shannon, the founder of information, thinks that "information is used to eliminate random uncertainty", which is regarded as a classic definition and quoted by people.
Norbert wiener, the founder of cybernetics, thinks that "information is the content and name that people exchange with the outside world in the process of adapting to the outside world and making this adaptation react to the outside world", which is also cited as a classic definition.
Information characteristics:
1, the greater the probability P(x) of message appearance, the smaller the amount of information; Conversely, the smaller the probability of occurrence, the greater the amount of information. As you can see, the amount of information (which we refer to as I) is inversely proportional to the probability of message occurrence.
2. When the probability is 1, everyone in the world knows what happened, so the amount of information is 0.
3. When a message consists of several independent small messages, the information contained in this message should be equal to the sum of the information contained in each small message.
Baidu Encyclopedia-Information