PlanetMath (more info)
 Math for the people, by the people. Sponsor PlanetMath
Encyclopedia | Requests | Forums | Docs | Wiki | Random | RSS  
Login
create new user
name:
pass:
forget your password?
Main Menu
Viewing Version 8 of 'Bernoulli distribution'
[ view 'Bernoulli distribution' | back to history ]

Title of object: Bernoulli distribution
Canonical Name: BernoulliDistribution2
Type: Definition

Created on: 2002-09-13 22:46:55.44697-04
Modified on: 2002-10-23 22:17:27.228785-04

Creator: drini
Modifier: drini
Author: drini

Classification: msc:60E05
Synonyms: Bernoulli distribution=binomial distribution
Bernoulli distribution=binomial random variable
Bernoulli distribution=binomial probability function
Bernoulli distribution=Bernoulli random variable

Revision comment (for changes between this and next version):

f

Preamble:

\usepackage{graphicx}
%\usepackage{xypic}
\usepackage{bbm}
\newcommand{\Z}{\mathbbmss{Z}}
\newcommand{\C}{\mathbbmss{C}}
\newcommand{\R}{\mathbbmss{R}}
\newcommand{\Q}{\mathbbmss{Q}}
\newcommand{\mathbb}[1]{\mathbbmss{#1}}
\newcommand{\figura}[1]{\begin{center}\includegraphics{#1}\end{center}}
\newcommand{\figuraex}[2]{\begin{center}\includegraphics[#2]{#1}\end{center}}
Content:

Consider an experiment with two possible outcomes (success and failure), which happen randomly. Let $p$ be the probability of success. If the experiment is repeated $n$ times, the probability of having exactly $x$ successes is
$$f(x)=\left({n\atop x}\right)p^x(1-p)^{(n-x)}.$$
The distribution function determined by the probability function $f(x)$ is called a \emph{Bernoulli distribution} or \emph{binomial distribution}.
Here are some plots for $f(x)$ with $n=20$ and $p=0.3$, $p=0.5$.
\figuraex{binom10p3}{scale=0.75}
\figuraex{binom10p5}{scale=0.75}
The corresponding distribution function is
$$F(n)=\sum_{k\leq x}\left({n\atop k}\right)p^k q^{n-k}$$
where $q=1-p$. Notice that if we calculate $F(n)$ we get the binomial expansion for $(p+q)^n$, and this is the reason for the distribution being called binomial.
We will use the moment generating function to calculate the mean and variance for the distribution. The mentioned function is
$$G(t)=\sum_{x=0}^n e^{tx}\left({n\atop x}\right)p^x q^{n-x}$$
wich simplifies to
$$G(t)=(pe^t+q)^n.$$
Differentiating gives us
$$G'(t)=n(pe+q)^{n-1}pe^t$$
and therefore the mean is
$$\mu = E[X]=G'(0)=np.$$
Now for the variance we need the second derivative
$$G''(t)=n(n-1)(pe^t+q)^{n-2} + n(pe^t+q)^{n-1}pe^t$$
so we get $$E[X^2]=G''(0)=n(n-1)p^2 + np$$
and finally the variance (recall $q=1-p$):
$$\sigma^2 = E[X^2] - E[X]^2 = npq.$$
For large values of $n$, the binomial coefficients are hard to compute, however in this cases we can use either the Poisson distribution or the normal distribution to approximate the probabilities.