PlanetMath (more info)
 Math for the people, by the people. Sponsor PlanetMath
Encyclopedia | Requests | Forums | Docs | Wiki | Random | RSS  
Login
create new user
name:
pass:
forget your password?
Main Menu
Owner confidence rating: High Entry average rating: No information on entry rating
Bennett inequality (Theorem)

Theorem:(Bennett inequality, 1962):

Let $\{X_{i}\}_{i=1}^{n}$ be a collection of independent random variables satisfying the conditions:

a) $E[X_{i}^{2}]<\infty $ $\forall i$ , so that one can write $% \sum_{i=1}^{n}E[X_{i}^{2}]=v^{2}$
b) $\Pr\left\{\left\vert X_{i}\right\vert \leq M\right\} =1$ $\forall i$ .

Then, for any $\varepsilon \geq 0$ , $$ \Pr\left\{ \sum_{i=1}^{n}\left( X_{i}-E[X_{i}]\right) >\varepsilon \right\} \leq \exp \left[ -\frac{v^{2}}{M^{2}}\theta \left( \frac{\varepsilon M}{v^{2}% }\right) \right] \leq \exp \left[ -\frac{\varepsilon }{2M}\ln \left( 1+\frac{% \varepsilon M}{v^{2}}\right) \right] $$ where $$ \theta \left( x\right) =\left( 1+x\right) \ln \left( 1+x\right) -x $$

Remark: Observing that $\left( 1+x\right) \ln \left( 1+x\right) -x\geq 9\left( 1+% \frac{x}{3}-\sqrt{1+\frac{2}{3}x}\right) \geq \frac{3x^{2}}{2\left( x+3\right) }$ $\ \ \forall x\geq 0$ , and plugging these expressions into the bound, one obtains immediately the Bernstein inequality under the hypotheses of boundness of random variables, as one might expect. However, Bernstein inequalities, although weaker, hold under far more general hypotheses than Bennett one.




"Bennett inequality" is owned by Andrea Ambrosio.
(view preamble | get metadata)

View style:


Attachments:
proof of Bennett inequality (Proof) by Andrea Ambrosio
Log in to rate this entry.
(view current ratings)

Cross-references: Bernstein inequality, bound, expressions, random variables, independent, collection, theorem
There is 1 reference to this entry.

This is version 7 of Bennett inequality, born on 2006-08-27, modified 2006-09-16.
Object id is 8302, canonical name is BennettInequality.
Accessed 6537 times total.

Classification:
AMS MSC60E15 (Probability theory and stochastic processes :: Distribution theory :: Inequalities; stochastic orderings)

Pending Errata and Addenda
None.
[ View all 2 ]
Discussion
Style: Expand: Order:
forum policy

No messages.

Interact
post | correct | update request | prove | add result | add corollary | add example | add (any)