PlanetMath (more info)
 Math for the people, by the people.
Encyclopedia | Requests | Forums | Docs | Wiki | Random | RSS  
Login
create new user
name:
pass:
forget your password?
Main Menu
Owner confidence rating: Very high Entry average rating: Very high
[parent] general linear model (Definition)

In statistical modeling of $ N$ data observations ($ N<\infty$), two types of variables are usually defined. One is the response variable or variate, usually denoted by $ Y$, and the other is the explanatory variable or covariate $ X$. While there is only one response variable, there may be one or more than one explanatory variables. The response variable is considered random, where as the explanatory variable(s) may or may not be random.

Based on the above setup, a general linear model, or normal linear model, is a statistical model with the following assumptions:

  1. the response variable $ Y$ is a continuous random variable
  2. the response variable $ Y$ can be expressed as a linear combination of functions $ z_i(\textbf{X})$, of the explanatory variables, plus a random error term $ \varepsilon$:
    $\displaystyle Y=\beta_0z_0(\textbf{X})+\cdots+\beta_kz_k(\textbf{X})+\varepsilon.$
    The portion of $ Y$ without the error term is known as the systematic component of $ Y$.
  3. the error component and the systematic component are independent
  4. random error variables $ \varepsilon_i$ for the $ N$ observations are iid normal with mean 0 and variance $ \sigma^2$

Remarks

  • Conditioning on the explanatory variables, the random variables $ Y_i$ corresponding to the individual responses are independent, normally distributed, with mean
    $\displaystyle \mu=\operatorname{E}[Y\mid\textbf{X}=\boldsymbol{x}]=\beta_0z_0(\textbf{X})+\cdots+\beta_kz_k(\textbf{X})$
    and variance $ \sigma^2$.
  • A linear regression model is a special case of the general linear model where all explanatory variables are assumed to be continuous.
  • Analysis of variance model, or ANOVA, is another special case of the general linear model, where all of the explantory variables are categorical in nature (for example, gender, marital status, etc..).
  • Analysis of covariance, or ANCOVA, sits between a linear regression model and the ANOVA, where some of the explanatory variables are continuous and some are categorical.
  • The general linear model is a special case of the generalized linear model, where the assumption that the response variable $ Y$ has a normal distribution is dropped.



"general linear model" is owned by CWoo. [ full author list (2) ]
(view preamble)

View style:

Other names:  normal linear model
Also defines:  analysis of variance, ANOVA, analysis of covariance, ANCOVA

This object's parent.
Log in to rate this entry.
(view current ratings)

Cross-references: normal distribution, generalized linear model, categorical, continuous, linear regression model, random variables, variance, mean, normal, iid, independent, component, term, plus, functions, linear combination, continuous random variable, statistical model, explanatory variable, response variable, variables, types, observations
There are 6 references to this entry.

This is version 3 of general linear model, born on 2004-08-03, modified 2006-09-18.
Object id is 6064, canonical name is GeneralLinearModel.
Accessed 14726 times total.

Classification:
AMS MSC62J05 (Statistics :: Linear inference, regression :: Linear regression)
 62J10 (Statistics :: Linear inference, regression :: Analysis of variance and covariance)

Pending Errata and Addenda
None.
Discussion
Style: Expand: Order:
forum policy

No messages.

Interact
post | correct | update request | add derivation | add example | add (any)