Topology of Statistical Systems: A Cohomological Approach to Information Theory, 2019.
The thesis focuses on the cohomological interpretation of entropy and other related quantities, e.g. multinomial coefficients. It shows that information has topological meaning and topology serves as a unifying framework. I developed a combinatorial analogue of the fundamental equation of information theory (which provides a new characterization of generalized multinomial coefficients) and introduced a cohomological characterization of differential entropy for gaussian variables (that generalizes the axiomatic approach of Shannon, Khinchin…).
The following short note complements the results of the thesis. It uses the same notations.
Addendum. Cup products in information cohomology
Papers (also on Google Scholar)
J.P. Vigneaux, “A characterization of generalized multinomial coefficients related to the entropic chain rule”, in Aequat. Math. (2023). https://doi.org/10.1007/s00010-022-00938-7. arXiv:2003.02021.
J.P. Vigneaux, “Entropy under disintegrations,” to appear in F. Nielsen, F. Barbaresco (eds.),
Geometric Science of Information: 5th International Conference, GSI 2021, Paris, France, 2021, Proceedings. Lecture Notes in Computer Science 12829, Springer 2021. arXiv:2102.09584.
J.P. Vigneaux, “Information cohomology of classical vector-valued observables,” to appear in F. Nielsen, F. Barbaresco (eds.), Geometric Science of Information: 5th International Conference, GSI 2021, Paris, France, 2021, Proceedings. Lecture Notes in Computer Science 12829, Springer 2021. arXiv:2107.04377.
D. Bennequin and J.P. Vigneaux, “A functional equation related to generalized entropies and
the modular group,” in Aequat. Math. (2020). https://doi.org/10.1007/s00010-020-00717-2
J.P. Vigneaux, “Information structures and their cohomology,” in Theory and Applications of Categories, Vol. 35, 2020, No. 38, pp 1476-1529.
J.P. Vigneaux, “Information theory with finite vector spaces,” in IEEE Transactions on Information Theory, vol. 65, no. 9, pp. 5674-5687, Sept. 2019. [arXiv]
J.P. Vigneaux, “Typicality for stratified measures”, arXiv:2212.10809
D. Bennequin. G. Sergeant-Perthuis, O. Peltre, and J.P. Vigneaux, “Extra-fine sheaves and interaction decompositions”, arXiv:2009.12646.
Noncommutative probability theory: Independence and Central Limit Theorems, MPI MiS, September, 2020
Sheaves on graphs and their homological invariants, MPI MiS, Leipzig, June, 2020
Slides used at my PhD defense, June 2019.
Presentation at OASIS Seminar: “Information cohomology: an overview.” Oxford, England, 2019.
Presentation at LAWCI 2018: “Information theory for Tsallis 2-entropy.” Latin American Week on Coding and Information, Campinas, Brazil, 2018.
Poster: “A combinatorial interpretation for Tsallis 2-entropy” at Entropy 2018, Barcelona.
Presentation at AAT 2017: “Information topology and probabilistic graphical
models.” Conference Applied Algebraic Topology, Sapporo, Japan, 2017.
Presentation at Séminaire de Géométrie et Physique Mathématique: “Information cohomology. “ (IMJ), 2017.
Presentation IHES: “”Variations on information theory: categories, cohomology, entropy.” Slides for my talk at the conference Les Probabilités de Demain, 2016.