Definition of information theory in English:

information theory


  • The mathematical study of the coding of information in the form of sequences of symbols, impulses, etc., and of how rapidly such information can be transmitted, e.g., through computer circuits or telecommunications channels.

    • ‘Alternatively, efforts are being made to predict the native structure from the sequence using information theory methods that do not necessarily involve the physics of the folding process.’
    • ‘The above disputes ultimately turn on a combination of technical arguments about information theory and philosophical positions that largely arise from taste and faith.’
    • ‘It simply isn't possible to tell the story of information theory, for example, without invoking the history of computation.’
    • ‘Quantum mechanics and information theory both demonstrate that in any assessment of reality, the observer has to be taken into consideration.’
    • ‘I used to be very critical of this state of affairs, until I finally realized that what I'm asking for is a step roughly as profound as the invention of calculus, or of information theory.’
    • ‘Pattern-recognition research is linked to information theory, control theory, statistical physics, dynamical systems theory, and mathematical optimization theory.’
    • ‘Over the course of his career, he has taught electromagnetics, communication and information theory, circuit syntheses, and coherent optics.’
    • ‘This paper founded the subject of information theory and he proposed a linear schematic model of a communications system.’
    • ‘His hunch is that they are the same, but he is keen to start a research programme that uses algorithmic information theory to address these questions.’
    • ‘Kay shows how efforts by scientists using computer analyses, information theory, linguistics and cryptanalysis to break the genetic code in the 1950s yielded no results.’
    • ‘You don't need a specialist in measure theory or information theory to understand the actual mathematics in the paper.’
    • ‘With his work on information theory and boolean logic, he created the theoretical underpinnings of both the networks and the devices that make up the Information Age we live in today.’
    • ‘His fundamental paper on this topic appeared in 1950 and with this he started a new subject within information theory.’
    • ‘Well, the field that I invented in 1965, and which I call algorithmic information theory, provides a possible solution for the problem of how to measure complexity.’
    • ‘Since 1999, there is not a single reference to that alleged new law in scientific publications on information theory or physics.’
    • ‘In information theory, the sending and receiving channels themselves can be considered strange attractors.’
    • ‘Shannon first gave the basics of information theory a probabilistic basis.’
    • ‘In fact the framework and terminology for information theory he developed remains standard today.’
    • ‘We will compare these models by using statistical information theory to measure the evidence supporting each model given the data set.’
    • ‘We were thinking about molecular biology and information theory.’


information theory

/ˌɪnfərˈˌmeɪʃən ˈθɪəri/