PlanetMath (more info)
 Math for the people, by the people.
Encyclopedia | Requests | Forums | Docs | Wiki | Random | RSS  
Login
create new user
name:
pass:
forget your password?
Main Menu
Owner confidence rating: Very high Entry average rating: No information on entry rating
stochastic process (Definition)

Let $ (\Omega,\mathcal{F},\textbf{P})$ be a probability space. A stochastic process is a collection

$\displaystyle \lbrace X(t) \mid t\in T \rbrace$
of random variables $ X(t)$ defined on $ (\Omega,\mathcal{F},\textbf{P})$, where $ T$ is a set, called the index set of the process $ \lbrace X(t) \mid t\in T \rbrace$. $ T$ is usually (but not always) a subset of $ \mathbb{R}$. One can also think of a stochastic process as a function $ X(=X(t,\omega))$ in two variables: $ t\in T$ and $ \omega \in\Omega$, such that for each $ t$, $ X_t(\omega)\colon=X(t,\omega)$ is a random variable on $ (\Omega,\mathcal{F},\textbf{P})$. $ X$ is sometimes known as a random function.

Given any $ t$, the possible values of $ X(t)$ are called the states of the process at $ t$. The set of all states (for all $ t$) of a stochastic process is called its state space.

If $ T$ is discrete, then the stochastic process is a discrete-time process. If $ T$ is an interval of $ \mathbb{R}$, then $ \lbrace X(t) \mid t\in T \rbrace$ is a continuous-time process. If $ T$ can be linearly ordered, then $ t$ is also known as the time.

Examples. The following list is some of the most common and important stochastic processes:

  1. Wiener process, or Brownian motion
  2. random walk, which is the limiting case of a Brownian motion
  3. Poisson process
  4. Markov process; a Markov chain is a Markov process whose state space is discrete
  5. renewal process

Remarks.

  • Sometimes, a stochastic process is also called a random process, although a stochastic process is generally linked to any “time” dependent process. In a random process, the index set may not be linearly ordered, as in the case of a random field, where the index set may be, for example, the unit sphere $ S^2\subseteq\mathbb{R}^3$.
  • In statistics, a stochastic process is often known as a time series, where the index set is a finite (or at most countable) ordered sequence of real numbers.



Anyone with an account can edit this entry. Please help improve it!

"stochastic process" is owned by CWoo. [ full author list (2) ]
(view preamble)

View style:

See Also: distributions of a stochastic process

Other names:  random process
Also defines:  discrete-time process, continuous-time process, state, time series, state space, random function
Log in to rate this entry.
(view current ratings)

Cross-references: real numbers, sequence, countable, finite, statistics, unit sphere, field, Markov chain, Poisson process, random walk, Wiener process, linearly ordered, interval, discrete, variables, function, subset, index set, random variables, collection, probability space
There are 40 references to this entry.

This is version 8 of stochastic process, born on 2004-09-28, modified 2006-08-11.
Object id is 6244, canonical name is StochasticProcess.
Accessed 26908 times total.

Classification:
AMS MSC60G05 (Probability theory and stochastic processes :: Stochastic processes :: Foundations of stochastic processes)
 60G60 (Probability theory and stochastic processes :: Stochastic processes :: Random fields)

Pending Errata and Addenda
None.
Discussion
Style: Expand: Order:
forum policy
Markov jump processes by bongani on 2005-05-05 10:50:07
Please I'm really stuck on this,

Suppose that { Xt; t 0 } is a Markov jump process with three possible states namely state 0 if a person is an active member of a pension fund, state 1 if the person has died before retirement and state 2 if the person has retired from the fund.
Assume that the process is time-homogenous and that the transition rate from state 0 to state 1 is mean1 state 0 to state 2 is mean2 . Assume also that the transition rates out of states 1 and 2 are all 0. Show that
 P oo (s,t) =exp(-(mean1 +mean2)(t-s) and then determine all the transition probabilities P ij (s,t) = P[ Xt=j|Xs=i]
 and show that your solution satisfies all the necessary conditions.

[ reply | up ]

Interact
post | correct | update request | add derivation | add example | add (any)