PlanetMath (more info)
 Math for the people, by the people.
Encyclopedia | Requests | Forums | Docs | Wiki | Random | RSS  
Login
create new user
name:
pass:
forget your password?
Main Menu
Owner confidence rating: Medium Entry average rating: No information on entry rating
Shannon's entropy (Definition)
AlphaThLevel

"Shannon's entropy" is owned by kshum. [ full author list (2) | owner history (2) ]
(view preamble)

View style:

See Also: logarithm, conditional entropy, mutual information, differential entropy, Hartley function

Other names:  entropy, Shannon entropy
Also defines:  joint entropy
Keywords:  entropy, shannon, uncertainty, information
Log in to rate this entry.
(view current ratings)

Cross-references: differential entropy, equivalent, limit, integral, mean-value theorem, domain, infinite, width, size, finite, discrete, positive, distribution function, conditional probability, summing, real numbers, Jensen inequality, distribution, event, variables, function, continuous, contained, average, Hartley information, expectation, functional, joint distribution, random variables, base, logarithm, probability distribution function, finite set, discrete random variable
There are 7 references to this entry.

This is version 21 of Shannon's entropy, born on 2001-11-19, modified 2006-06-28.
Object id is 968, canonical name is ShannonsTheoremEntropy.
Accessed 41057 times total.

Classification:
AMS MSC94A17 (Information and communication, circuits :: Communication, information :: Measures of information, entropy)

Pending Errata and Addenda
None.
[ View all 5 ]
Discussion
Style: Expand: Order:
forum policy
proof by drummond on 2001-11-19 23:11:17
I suppose I should post the proof as well...later.
[ reply | up ]

Interact
post | correct | update request | add derivation | add example | add (any)