Unbiased Analysis of Today's Healthcare Issues

Generalized Linear Models (GLM)

Written By: Jason Shafrin - Jul• 20•10

The generalized linear model (GLM) is a flexible generalization of ordinary least squares regression. OLS restricts the regression coefficients to have a constant effect on the dependent variable. GLM allows for the this effect to vary along the range of the explanatory variables.

The basic structure of GLM estimator is as follows:

  • g(Y) = + ε
  • E(Y) = μ = g-1()

To estimate the model, one needs three components:

  1. Random component, specifying the conditional distribution of the
    response variable, given the explanatory variables.  Typically, this distribution is from the exponential family.
  2. A linear predictor which is a linear function of the regressors: η = β0 + β1X1 +…+ βkXk =
  3. A link function which transforms the expectation of the response to the linear predictor.  In other words, the link function describes the relationship between the linear predictor and the mean of the distribution function.  The link function must be invertible.

The table below lists commonly used link functions and their inverse: (source)

Link ηi=g(μi) μi=g-1i)
Identity μi ηi
Log ln(μi) exp(ηi)
Inverse μi-1 ηi-1
Inverse-Square μi-2 ηi-0.5
Square Root μi0.5 ηi2
Logit ln[μi/(1- μi)] exp(ηi)/[1+ exp(ηi)]
Probit Φ-1i) Φ(ηi)
Log-log -ln[-ln(μi)] exp[-exp(-ηi)]

To estimate the coefficients for a GLM model, most researchers use a maximum likelihood method although Bayesian approaches can also be used. In Stata, the glm command estimates the coefficients from a generalized linear model.  In SAS the procedure GENMOD can be used.

You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

One Comment

  1. [...] The authors estimate the first equation with a logit specification and the second equation with a GLB model with a Poisson distribution and a log link (for more information on GLM models, see this post). [...]

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>