g02ha performs bounded influence regression (-estimates). Several standard methods are available.
Syntax
C# |
---|
public static void g02ha( int indw, int ipsi, int isigma, int indc, int n, int m, double[,] x, double[] y, double cpsi, double h1, double h2, double h3, double cucv, double dchi, double[] theta, ref double sigma, double[,] c, double[] rs, double[] wgt, double tol, int maxit, int nitmon, double[] stat, out int ifail ) |
Visual Basic |
---|
Public Shared Sub g02ha ( _ indw As Integer, _ ipsi As Integer, _ isigma As Integer, _ indc As Integer, _ n As Integer, _ m As Integer, _ x As Double(,), _ y As Double(), _ cpsi As Double, _ h1 As Double, _ h2 As Double, _ h3 As Double, _ cucv As Double, _ dchi As Double, _ theta As Double(), _ ByRef sigma As Double, _ c As Double(,), _ rs As Double(), _ wgt As Double(), _ tol As Double, _ maxit As Integer, _ nitmon As Integer, _ stat As Double(), _ <OutAttribute> ByRef ifail As Integer _ ) |
Visual C++ |
---|
public: static void g02ha( int indw, int ipsi, int isigma, int indc, int n, int m, array<double,2>^ x, array<double>^ y, double cpsi, double h1, double h2, double h3, double cucv, double dchi, array<double>^ theta, double% sigma, array<double,2>^ c, array<double>^ rs, array<double>^ wgt, double tol, int maxit, int nitmon, array<double>^ stat, [OutAttribute] int% ifail ) |
F# |
---|
static member g02ha : indw : int * ipsi : int * isigma : int * indc : int * n : int * m : int * x : float[,] * y : float[] * cpsi : float * h1 : float * h2 : float * h3 : float * cucv : float * dchi : float * theta : float[] * sigma : float byref * c : float[,] * rs : float[] * wgt : float[] * tol : float * maxit : int * nitmon : int * stat : float[] * ifail : int byref -> unit |
Parameters
- indw
- Type: System..::..Int32On entry: specifies the type of regression to be performed.
- Mallows type regression with Maronna's proposed weights.
- Huber type regression.
- Schweppe type regression with Krasker–Welsch weights.
- ipsi
- Type: System..::..Int32On entry: specifies which function is to be used.
- , i.e., least squares.
- Huber's function.
- Hampel's piecewise linear function.
- Andrew's sine wave.
- Tukey's bi-weight.
Constraint: .
- isigma
- Type: System..::..Int32On entry: specifies how is to be estimated.
- is estimated by median absolute deviation of residuals.
- is held constant at its initial value.
- is estimated using the function.
- indc
- Type: System..::..Int32
- n
- Type: System..::..Int32On entry: , the number of observations.Constraint: .
- m
- Type: System..::..Int32On entry: , the number of independent variables.Constraint: .
- x
- Type: array<System..::..Double,2>[,](,)[,][,]An array of size [dim1, m]Note: dim1 must satisfy the constraint:On entry: the values of the matrix, i.e., the independent variables. must contain the th element of , for and .If , then during calculations the elements of x will be transformed as described in [Description]. Before exit the inverse transformation will be applied. As a result there may be slight differences between the input x and the output x.On exit: unchanged, except as described above.
- y
- Type: array<System..::..Double>[]()[][]An array of size [n]On entry: the data values of the dependent variable.must contain the value of for the th observation, for .If , then during calculations the elements of y will be transformed as described in [Description]. Before exit the inverse transformation will be applied. As a result there may be slight differences between the input y and the output y.On exit: unchanged, except as described above.
- cpsi
- Type: System..::..DoubleOn entry: if , cpsi must specify the parameter, , of Huber's function.If on entry, cpsi is not referenced.Constraint: if , .
- h1
- Type: System..::..DoubleOn entry: if , h1, h2, and h3 must specify the parameters , , and , of Hampel's piecewise linear function. h1, h2, and h3 are not referenced if .Constraint: if , and .
- h2
- Type: System..::..DoubleOn entry: if , h1, h2, and h3 must specify the parameters , , and , of Hampel's piecewise linear function. h1, h2, and h3 are not referenced if .Constraint: if , and .
- h3
- Type: System..::..DoubleOn entry: if , h1, h2, and h3 must specify the parameters , , and , of Hampel's piecewise linear function. h1, h2, and h3 are not referenced if .Constraint: if , and .
- cucv
- Type: System..::..DoubleOn entry: if , must specify the value of the constant, , of the function for Maronna's proposed weights.If , must specify the value of the function for the Krasker–Welsch weights.If , is not referenced.Constraints:
- if , ;
- if , .
- dchi
- Type: System..::..DoubleOn entry: , the constant of the function. dchi is not referenced if , or if .Constraint: if and , .
- theta
- Type: array<System..::..Double>[]()[][]An array of size [m]On entry: starting values of the parameter vector . These may be obtained from least squares regression. Alternatively if and or if and sigma approximately equals the standard deviation of the dependent variable, , then , for may provide reasonable starting values.On exit: contains the M-estimate of , for .
- sigma
- Type: System..::..Double%On entry: a starting value for the estimation of . sigma should be approximately the standard deviation of the residuals from the model evaluated at the value of given by theta on entry.Constraint: .On exit: contains the final estimate of if or the value assigned on entry if .
- c
- Type: array<System..::..Double,2>[,](,)[,][,]An array of size [dim1, m]Note: dim1 must satisfy the constraint:On exit: the diagonal elements of c contain the estimated asymptotic standard errors of the estimates of , i.e., contains the estimated asymptotic standard error of the estimate contained in .The elements above the diagonal contain the estimated asymptotic correlation between the estimates of , i.e., , contains the asymptotic correlation between the estimates contained in and .The elements below the diagonal contain the estimated asymptotic covariance between the estimates of , i.e., , contains the estimated asymptotic covariance between the estimates contained in and .
- rs
- Type: array<System..::..Double>[]()[][]An array of size [n]
- wgt
- Type: array<System..::..Double>[]()[][]An array of size [n]On exit: the vector of weights. contains the weight for the th observation, for .
- tol
- Type: System..::..DoubleOn entry: the relative precision for the calculation of (if ), the estimates of and the estimate of (if ). Convergence is assumed when the relative change in all elements being considered is less than tol.If and , tol is also used to determine the precision of .It is advisable for tol to be greater than .Constraint: .
- maxit
- Type: System..::..Int32On entry: the maximum number of iterations that should be used in the calculation of (if ), and of the estimates of and , and of (if and ).A value of should be adequate for most uses.Constraint: .
- nitmon
- Type: System..::..Int32On entry: the amount of information that is printed on each iteration.
- No information is printed.
- The current estimate of , the change in during the current iteration and the current value of are printed on the first and every iterations.
Also, if and then information on the iterations to calculate is printed. This is the current estimate of and the maximum value of (see [Description]).When printing occurs the output is directed to the current advisory message unit (see (X04ABF not in this release)).
- stat
- Type: array<System..::..Double>[]()[][]An array of size []On exit: the following values are assigned to stat:
- if , or if .
- number of iterations used to calculate .
- number of iterations used to calculate final estimates of and .
- , the rank of the weighted least-squares equations.
- ifail
- Type: System..::..Int32%On exit: unless the method detects an error or a warning has been flagged (see [Error Indicators and Warnings]).
Description
For the linear regression model
where | is a vector of length of the dependent variable, |
is a by matrix of independent variables of column rank , | |
is a vector of length of unknown parameters, | |
and | is a vector of length of unknown errors with , |
g02ha calculates the M-estimates given by the solution, , to the equation
or as the solution to
for suitable weight function , where and are constants, chosen so that the estimator of is asymptotically unbiased if the errors, , have a Normal distribution. Alternatively may be held at a constant value.
(1) |
where | is the th residual, i.e., the th element of , | ||
is a suitable weight function, | |||
are suitable weights, | |||
and | may be estimated at each iteration by the median absolute deviation of the residuals
|
The above describes the Schweppe type regression. If the are assumed to equal for all then Huber type regression is obtained. A third type, due to Mallows, replaces (1) by
This may be obtained by use of the transformations
(see Section 3 of Marazzi (1987a)).
For Huber and Schweppe type regressions, is the 75th percentile of the standard Normal distribution. For Mallows type regression is the solution to
where is the standard Normal cumulative distribution function (see s15ab).
is given by
where is the standard Normal density, i.e.,
The calculation of the estimates of can be formulated as an iterative weighted least squares problem with a diagonal weight matrix given by
where is the derivative of at the point .
The value of at each iteration is given by the weighted least squares regression of on . This is carried out by first transforming the and by
and then
using (F04JGF not in this release).
If is of full column rank then an orthogonal-triangular () decomposition is used; if not, a singular value decomposition is used.
The following functions are available for and in g02ha.
where , , , , and are given constants.
(a) | Unit Weights
This gives least squares regression. |
||||
(b) | Huber's Function
|
||||
(c) | Hampel's Piecewise Linear Function
|
||||
(d) | Andrew's Sine Wave Function
|
||||
(e) | Tukey's Bi-weight
|
Several schemes for calculating weights have been proposed, see Hampel et al. (1986) and Marazzi (1987a). As the different independent variables may be measured on different scales, one group of proposed weights aims to bound a standardized measure of influence. To obtain such weights the matrix has to be found such that:
and
where | is a vector of length containing the th row of , |
is an by lower triangular matrix, | |
and | is a suitable function. |
The weights are then calculated as
for a suitable function .
Two weights are available in g02ha:
(i) | Krasker–Welsch Weights
|
||||||||||
(ii) | Maronna's Proposed Weights
|
Finally the asymptotic variance-covariance matrix, , of the estimates is calculated.
For Mallows and Schweppe type regressions is of the form
where and .
is a diagonal matrix such that the th element approximates in the Schweppe case and in the Mallows case.
is a diagonal matrix such that the th element approximates in the Schweppe case and in the Mallows case.
Two approximations are available in g02ha:
1. | Average over the
|
||
2. | Replace expected value by observed
|
See Hampel et al. (1986) and Marazzi (1987b).
Note: there is no explicit provision in the method for a constant term in the regression model. However, the addition of a dummy variable whose value is for all observations will produce a value of corresponding to the usual constant term.
g02ha is based on routines in ROBETH; see Marazzi (1987a).
References
Hampel F R, Ronchetti E M, Rousseeuw P J and Stahel W A (1986) Robust Statistics. The Approach Based on Influence Functions Wiley
Huber P J (1981) Robust Statistics Wiley
Marazzi A (1987a) Weights for bounded influence regression in ROBETH Cah. Rech. Doc. IUMSP, No. 3 ROB 3 Institut Universitaire de Médecine Sociale et Préventive, Lausanne
Marazzi A (1987b) Subroutines for robust and bounded influence regression in ROBETH Cah. Rech. Doc. IUMSP, No. 3 ROB 2 Institut Universitaire de Médecine Sociale et Préventive, Lausanne
Error Indicators and Warnings
Note: g02ha may return useful information for one or more of the following detected errors or warnings.
Errors or warnings detected by the method:
Some error messages may refer to parameters that are dropped from this interface
(LDX, LDC, WORK) In these
cases, an error in another parameter has usually caused an incorrect value to be inferred.
On entry, , or , or ,
On entry, , or .
On entry, , or and , or and , or and , or and , or and , or and and , or and , or and .
On entry, , or .
- The number of iterations required to calculate the weights exceeds maxit. (Only if .)
- The number of iterations required to calculate exceeds maxit. (Only if and .)
- Either the number of iterations required to calculate and exceeds maxit (note that, in this case on exit), or the iterations to solve the weighted least squares equations failed to converge. The latter is an unlikely error exit.
- The weighted least squares equations are not of full rank.
- If then is almost singular.If then is singular or almost singular. This may be due to too many diagonal elements of the matrix being zero, see [Further Comments].
- In calculating the correlation factor for the asymptotic variance-covariance matrix either the value ofSee [Further Comments]. In this case c is returned as .(Only if .)
- The estimated variance for an element of .In this case the diagonal element of c will contain the negative variance and the above diagonal elements in the row and column corresponding to the element will be returned as zero.This error may be caused by rounding errors or too many of the diagonal elements of being zero, where is defined in [Description]. See [Further Comments].
- The degrees of freedom for error, (this is an unlikely error exit), or the estimated value of was during an iteration.
Accuracy
The precision of the estimates is determined by tol. As a more stable method is used to calculate the estimates of than is used to calculate the covariance matrix, it is possible for the least squares equations to be of full rank but the matrix to be too nearly singular to be inverted.
Parallelism and Performance
None.
Further Comments
In cases when it is important for the value of sigma to be of a reasonable magnitude. Too small a value may cause too many of the winsorized residuals, i.e., , to be zero or a value of , used to estimate the asymptotic covariance matrix, to be zero. This can lead to errors or (if ), (if ) and .
Example
The number of observations and the number of variables are read in followed by the data. The option parameters are then read in (in this case giving Schweppe type regression with Hampel's function and Huber's function and then using the ‘replace expected by observed’ option in calculating the covariances). Finally a set of values for the constants are read in.
After a call to g02ha, , its standard error and are printed. In addition the weight and residual for each observation is printed.
Example program (C#): g02hae.cs