PlanetMath (more info)
 Math for the people, by the people. Sponsor PlanetMath
Encyclopedia | Requests | Forums | Docs | Wiki | Random | RSS  
Login
create new user
name:
pass:
forget your password?
Main Menu
Owner confidence rating: High Entry average rating: No information on entry rating
stochastic process (Definition)

Let $(\Omega,\mathcal{F},{P})$ be a probability space. A stochastic process is a collection $$\lbrace X_t \mid t\in T \rbrace$$ of random variables $X_t$ defined on $(\Omega,\mathcal{F},{P})$ where $T$ is a set, called the index set of the process $\lbrace X_t \mid t\in T \rbrace$ $T$ is usually (but not always) a subset of $\mathbb{R}$ $X$ is sometimes known as a random function.

Given any $t$ the possible values of $X_t$ are called the states of the process at $t$ The set of all states (for all $t$ of a stochastic process is called its state space.

If $T$ is discrete, then the stochastic process is a discrete-time process. If $T$ is an interval of $\mathbb{R}$ then $\lbrace X_t \mid t\in T \rbrace$ is a continuous-time process. If $T$ can be linearly ordered, then $t$ is also known as the time.

A stochastic process $X$ with state space $S$ can be thought of in either of following three ways.

  • As a collection of random variables, $X_t$ for each $t$ in the index set $T$
  • As a function in two variables $t\in T$ and $\omega\in\Omega$ \begin{equation*} X\colon T\times\Omega\rightarrow S,\ (t,\omega)\mapsto X_t(\omega). \end{equation*}The process is said to be measurable, or, jointly measurable if it is $\mathcal{B}(T)\otimes\mathcal{F}/\mathcal{B}(S)$ measurable. Here, $\mathcal{B}(T)$ and $\mathcal{B}(S)$ are the Borel $\sigma$ algebras on $T$ and $S$ respectively.
  • In terms of the sample paths. Each $\omega\in\Omega$ maps to a function \begin{equation*} T\rightarrow S,\ t\mapsto X_t(\omega). \end{equation*}Many common examples of stochastic processes have sample paths which are either continuous or cadlag.

Examples. The following list is some of the most common and important stochastic processes:

  1. a random walk, as well as its limiting case, a Brownian motion, or a Wiener process
  2. Poisson process
  3. Markov process; a Markov chain is a Markov process whose state space is discrete
  4. renewal process

Remarks.

  • Sometimes, a stochastic process is also called a random process, although a stochastic process is generally linked to any ``time'' dependent process. In a random process, the index set may not be linearly ordered, as in the case of a random field, where the index set may be, for example, the unit sphere $S^2\subseteq\mathbb{R}^3$
  • In statistics, a stochastic process is often known as a time series, where the index set is a finite (or at most countable) ordered sequence of real numbers.




"stochastic process" is owned by gel. [ full author list (3) | owner history (1) ]
(view preamble | get metadata)

View style:

See Also: distributions of a stochastic process

Other names:  random process
Also defines:  discrete-time process, continuous-time process, state, time series, state space, random function, jointly measurable

Attachments:
stopping time (Definition) by gel
sample function (Definition) by gel
filtered probability space (Definition) by gel
filtration of $\sigma$-algebras (Definition) by gel
measurability of stochastic processes (Theorem) by gel
Log in to rate this entry.
(view current ratings)

Cross-references: real numbers, sequence, countable, finite, statistics, unit sphere, field, Markov chain, Poisson process, Brownian motion, random walk, cadlag, continuous, maps, sample paths, variables, function, linearly ordered, interval, discrete, subset, index set, random variables, collection, probability space
There are 63 references to this entry.

This is version 11 of stochastic process, born on 2004-09-28, modified 2008-12-21.
Object id is 6244, canonical name is StochasticProcess.
Accessed 34863 times total.

Classification:
AMS MSC60G05 (Probability theory and stochastic processes :: Stochastic processes :: Foundations of stochastic processes)
 60G60 (Probability theory and stochastic processes :: Stochastic processes :: Random fields)

Pending Errata and Addenda
None.
[ View all 2 ]
Discussion
Style: Expand: Order:
forum policy
Markov jump processes by bongani on 2005-05-05 10:50:07
Please I'm really stuck on this,

Suppose that { Xt; t 0 } is a Markov jump process with three possible states namely state 0 if a person is an active member of a pension fund, state 1 if the person has died before retirement and state 2 if the person has retired from the fund.
Assume that the process is time-homogenous and that the transition rate from state 0 to state 1 is mean1 state 0 to state 2 is mean2 . Assume also that the transition rates out of states 1 and 2 are all 0. Show that
 P oo (s,t) =exp(-(mean1 +mean2)(t-s) and then determine all the transition probabilities P ij (s,t) = P[ Xt=j|Xs=i]
 and show that your solution satisfies all the necessary conditions.

[ reply | up ]

Interact
post | correct | update request | add derivation | add example | add (any)