國立高雄大學圖資館 |

Language: English

Back to Search results for [ author_sort:"ellerman, david." ]

New foundations for information theo...

Ellerman, David.

New foundations for information theorylogical entropy and Shannon entropy /

Record Type:	Electronic resources : Monograph/item
Title/Author:	New foundations for information theoryby David Ellerman.
Reminder of title:	logical entropy and Shannon entropy /
Author:	Ellerman, David.
Published:	Cham :Springer International Publishing :2021.
Description:	xiii, 113 p. :ill., digital ;24 cm.
Contained By:	Springer Nature eBook
Subject:	Entropy (Information theory)
Online resource:	https://doi.org/10.1007/978-3-030-86552-8
ISBN:	9783030865528$q(electronic bk.)

New foundations for information theorylogical entropy and Shannon entropy /
Ellerman, David.

New foundations for information theorylogical entropy and Shannon entropy /[electronic resource] :by David Ellerman. - Cham :Springer International Publishing :2021. - xiii, 113 p. :ill., digital ;24 cm. - SpringerBriefs in philosophy,2211-4556. - SpringerBriefs in philosophy..

- Logical entropy -- The relationship between logical entropy and Shannon entropy -- The compound notions for logical and Shannon entropies -- Further developments of logical entropy -- Logical Quantum Information Theory -- Conclusion -- Appendix: Introduction to the logic of partitions.

This monograph offers a new foundation for information theory that is based on the notion of information-as-distinctions, being directly measured by logical entropy, and on the re-quantification as Shannon entropy, which is the fundamental concept for the theory of coding and communications. Information is based on distinctions, differences, distinguishability, and diversity. Information sets are defined that express the distinctions made by a partition, e.g., the inverse-image of a random variable so they represent the pre-probability notion of information. Then logical entropy is a probability measure on the information sets, the probability that on two independent trials, a distinction or "dit" of the partition will be obtained. The formula for logical entropy is a new derivation of an old formula that goes back to the early twentieth century and has been re-derived many times in different contexts. As a probability measure, all the compound notions of joint, conditional, and mutual logical entropy are immediate. The Shannon entropy (which is not defined as a measure in the sense of measure theory) and its compound notions are then derived from a non-linear dit-to-bit transform that re-quantifies the distinctions of a random variable in terms of bits--so the Shannon entropy is the average number of binary distinctions or bits necessary to make all the distinctions of the random variable. And, using a linearization method, all the set concepts in this logical information theory naturally extend to vector spaces in general--and to Hilbert spaces in particular--for quantum logical information theory which provides the natural measure of the distinctions made in quantum measurement. Relatively short but dense in content, this work can be a reference to researchers and graduate students doing investigations in information theory, maximum entropy methods in physics, engineering, and statistics, and to all those with a special interest in a new approach to quantum information theory.

ISBN: 9783030865528$q(electronic bk.)

Standard No.: 10.1007/978-3-030-86552-8doiSubjects--Topical Terms:

199046
Entropy (Information theory)

LC Class. No.: Q370 / .E45 2021

Dewey Class. No.: 003.54

New foundations for information theorylogical entropy and Shannon entropy /
LDR:03357nmm a2200337 a 4500 001 610765
003 DE-He213
005 20211030150051.0
006 m d
007 cr nn 008maaau
008 220330s2021 sz s 0 eng d
020 $a 9783030865528$q(electronic bk.)
020 $a 9783030865511$q(paper)
024 7 $a 10.1007/978-3-030-86552-8 $2 doi
035 $a 978-3-030-86552-8
040 $a GP $c GP
041 0 $a eng
050 4 $a Q370 $b .E45 2021
072 7 $a HP $2 bicssc
072 7 $a PHI000000 $2 bisacsh
072 7 $a QD $2 thema
082 0 4 $a 003.54 $2 23
090 $a Q370 $b .E45 2021
100 1 $a Ellerman, David. $3 894840
245 1 0 $a New foundations for information theory $h [electronic resource] : $b logical entropy and Shannon entropy / $c by David Ellerman.
260 $a Cham : $b Springer International Publishing : $b Imprint: Springer, $c 2021.
300 $a xiii, 113 p. : $b ill., digital ; $c 24 cm.
490 1 $a SpringerBriefs in philosophy, $x 2211-4556
505 0 $a - Logical entropy -- The relationship between logical entropy and Shannon entropy -- The compound notions for logical and Shannon entropies -- Further developments of logical entropy -- Logical Quantum Information Theory -- Conclusion -- Appendix: Introduction to the logic of partitions.
520 $a This monograph offers a new foundation for information theory that is based on the notion of information-as-distinctions, being directly measured by logical entropy, and on the re-quantification as Shannon entropy, which is the fundamental concept for the theory of coding and communications. Information is based on distinctions, differences, distinguishability, and diversity. Information sets are defined that express the distinctions made by a partition, e.g., the inverse-image of a random variable so they represent the pre-probability notion of information. Then logical entropy is a probability measure on the information sets, the probability that on two independent trials, a distinction or "dit" of the partition will be obtained. The formula for logical entropy is a new derivation of an old formula that goes back to the early twentieth century and has been re-derived many times in different contexts. As a probability measure, all the compound notions of joint, conditional, and mutual logical entropy are immediate. The Shannon entropy (which is not defined as a measure in the sense of measure theory) and its compound notions are then derived from a non-linear dit-to-bit transform that re-quantifies the distinctions of a random variable in terms of bits--so the Shannon entropy is the average number of binary distinctions or bits necessary to make all the distinctions of the random variable. And, using a linearization method, all the set concepts in this logical information theory naturally extend to vector spaces in general--and to Hilbert spaces in particular--for quantum logical information theory which provides the natural measure of the distinctions made in quantum measurement. Relatively short but dense in content, this work can be a reference to researchers and graduate students doing investigations in information theory, maximum entropy methods in physics, engineering, and statistics, and to all those with a special interest in a new approach to quantum information theory.
650 0 $a Entropy (Information theory) $3 199046
650 1 4 $a Philosophy, general. $3 731263
650 2 4 $a Coding and Information Theory. $3 273763
710 2 $a SpringerLink (Online service) $3 273601
773 0 $t Springer Nature eBook
830 0 $a SpringerBriefs in philosophy. $3 560618
856 4 0 $u https://doi.org/10.1007/978-3-030-86552-8
950 $a Mathematics and Statistics (SpringerNature-11649)