Definition of information theory in English:

information theory


  • The mathematical study of the coding of information in the form of sequences of symbols, impulses, etc., and of how rapidly such information can be transmitted, e.g., through computer circuits or telecommunications channels.

    • ‘In fact the framework and terminology for information theory he developed remains standard today.’
    • ‘With his work on information theory and boolean logic, he created the theoretical underpinnings of both the networks and the devices that make up the Information Age we live in today.’
    • ‘Shannon first gave the basics of information theory a probabilistic basis.’
    • ‘Over the course of his career, he has taught electromagnetics, communication and information theory, circuit syntheses, and coherent optics.’
    • ‘Well, the field that I invented in 1965, and which I call algorithmic information theory, provides a possible solution for the problem of how to measure complexity.’
    • ‘This paper founded the subject of information theory and he proposed a linear schematic model of a communications system.’
    • ‘Pattern-recognition research is linked to information theory, control theory, statistical physics, dynamical systems theory, and mathematical optimization theory.’
    • ‘We will compare these models by using statistical information theory to measure the evidence supporting each model given the data set.’
    • ‘His fundamental paper on this topic appeared in 1950 and with this he started a new subject within information theory.’
    • ‘Quantum mechanics and information theory both demonstrate that in any assessment of reality, the observer has to be taken into consideration.’
    • ‘Alternatively, efforts are being made to predict the native structure from the sequence using information theory methods that do not necessarily involve the physics of the folding process.’
    • ‘We were thinking about molecular biology and information theory.’
    • ‘I used to be very critical of this state of affairs, until I finally realized that what I'm asking for is a step roughly as profound as the invention of calculus, or of information theory.’
    • ‘In information theory, the sending and receiving channels themselves can be considered strange attractors.’
    • ‘Kay shows how efforts by scientists using computer analyses, information theory, linguistics and cryptanalysis to break the genetic code in the 1950s yielded no results.’
    • ‘Since 1999, there is not a single reference to that alleged new law in scientific publications on information theory or physics.’
    • ‘The above disputes ultimately turn on a combination of technical arguments about information theory and philosophical positions that largely arise from taste and faith.’
    • ‘It simply isn't possible to tell the story of information theory, for example, without invoking the history of computation.’
    • ‘His hunch is that they are the same, but he is keen to start a research programme that uses algorithmic information theory to address these questions.’
    • ‘You don't need a specialist in measure theory or information theory to understand the actual mathematics in the paper.’


information theory

/ˌɪnfərˈˌmeɪʃən ˈθɪəri/