g02hff calculates an estimate of the asymptotic variance-covariance matrix for the bounded influence regression estimates (M-estimates). It is intended for use with g02hdf.

2 Specification

Fortran Interface

Subroutine g02hff (

psi, psp, indw, indc, sigma, n, m, x, ldx, rs, wgt, c, ldc, wk, ifail)

Integer, Intent (In)	::	indw, indc, n, m, ldx, ldc
Integer, Intent (Inout)	::	ifail
Real (Kind=nag_wp), External	::	psi, psp
Real (Kind=nag_wp), Intent (In)	::	sigma, x(ldx,m), rs(n), wgt(n)
Real (Kind=nag_wp), Intent (Inout)	::	c(ldc,m)
Real (Kind=nag_wp), Intent (Out)	::	wk(m(n+m+1)+2n)

C Header Interface

#include <nag.h>

void

g02hff_ (
double (NAG_CALL *psi)(const double *t),
double (NAG_CALL *psp)(const double *t),
const Integer *indw, const Integer *indc, const double *sigma, const Integer *n, const Integer *m, const double x[], const Integer *ldx, const double rs[], const double wgt[], double c[], const Integer *ldc, double wk[], Integer *ifail)

The routine may be called by the names g02hff or nagf_correg_robustm_user_varmat.

3 Description

For a description of bounded influence regression see g02hdf. Let

θ

be the regression parameters and let

C

be the asymptotic variance-covariance matrix of

\hat{θ}

. Then for Huber type regression

C = f_{H} {(X^{T} X)}^{−1} {\hat{σ}}^{2},

where

f_{H} = \frac{1}{n - m} \frac{\sum_{i = 1}^{n} ψ^{2} (r_{i} / \hat{σ})}{{(\frac{1}{n} \sum ψ^{'} (\frac{r_{i}}{\hat{σ}}))}^{2}} κ^{2}

κ^{2} = 1 + \frac{m}{n} \frac{\frac{1}{n} \sum_{i = 1}^{n} {(ψ^{'} (r_{i} / \hat{σ}) - \frac{1}{n} \sum_{i = 1}^{n} ψ^{'} (r_{i} / \hat{σ}))}^{2}}{{(\frac{1}{n} \sum_{i = 1}^{n} ψ^{'} (\frac{r_{i}}{\hat{σ}}))}^{2}},

see Huber (1981) and Marazzi (1987).

For Mallows and Schweppe type regressions,

C

is of the form

{\frac{\hat{σ}}{n}}^{2} S_{1}^{−1} S_{2} S_{1}^{−1},

where

S_{1} = \frac{1}{n} X^{T} D X

and

S_{2} = \frac{1}{n} X^{T} P X

D

is a diagonal matrix such that the

i

th element approximates

E (ψ^{'} (r_{i} / (σ w_{i})))

in the Schweppe case and

E (ψ^{'} (r_{i} / σ) w_{i})

in the Mallows case.

P

is a diagonal matrix such that the

i

th element approximates

E (ψ^{2} (r_{i} / (σ w_{i})) w_{i}^{2})

in the Schweppe case and

E (ψ^{2} (r_{i} / σ) w_{i}^{2})

in the Mallows case.

Two approximations are available in g02hff:

1.Average over the $r_{i}$

$\begin{matrix} Schweppe & Mallows \\ D_{i} = (\frac{1}{n} \sum_{j = 1}^{n} ψ^{'} (\frac{r_{j}}{\hat{σ} w_{i}})) w_{i} & D_{i} = (\frac{1}{n} \sum_{j = 1}^{n} ψ^{'} (\frac{r_{j}}{\hat{σ}})) w_{i} \\ P_{i} = (\frac{1}{n} \sum_{j = 1}^{n} ψ^{2} (\frac{r_{j}}{\hat{σ} w_{i}})) w_{i}^{2} & P_{i} = (\frac{1}{n} \sum_{j = 1}^{n} ψ^{2} (\frac{r_{j}}{\hat{σ}})) w_{i}^{2} \end{matrix}$
2.Replace expected value by observed

$\begin{matrix} Schweppe & Mallows \\ D_{i} = ψ^{'} (\frac{r_{i}}{\hat{σ} w_{i}}) w_{i} & D_{i} = ψ^{'} (\frac{r_{i}}{\hat{σ}}) w_{i} \\ P_{i} = ψ^{2} (\frac{r_{i}}{\hat{σ} w_{i}}) w_{i}^{2} & P_{i} = ψ^{2} (\frac{r_{i}}{\hat{σ}}) w_{i}^{2} \end{matrix}$

See Hampel et al. (1986) and Marazzi (1987).

In all cases

\hat{σ}

is a robust estimate of

σ

g02hff is based on routines in ROBETH; see Marazzi (1987).

4 References

Hampel F R, Ronchetti E M, Rousseeuw P J and Stahel W A (1986) Robust Statistics. The Approach Based on Influence Functions Wiley

Huber P J (1981) Robust Statistics Wiley

Marazzi A (1987) Subroutines for robust and bounded influence regression in ROBETH Cah. Rech. Doc. IUMSP, No. 3 ROB 2 Institut Universitaire de Médecine Sociale et Préventive, Lausanne

5 Arguments

1: $psi$ – real (Kind=nag_wp) Function, supplied by the user. External Procedure

psi must return the value of the

ψ

function for a given value of its argument.

The specification of psi is:

Fortran Interface

Function psi (

Real (Kind=nag_wp)	::	psi
Real (Kind=nag_wp), Intent (In)	::	t

C Header Interface

double

psi (const double *t)

1: $t$ – Real (Kind=nag_wp) Input: On entry: the argument for which psi must be evaluated.

psi must either be a module subprogram USEd by, or declared as EXTERNAL in, the (sub)program from which g02hff is called. Arguments denoted as Input must not be changed by this procedure.

Note: psi should not return floating-point NaN (Not a Number) or infinity values, since these are not handled by g02hff. If your code inadvertently does return any NaNs or infinities, g02hff is likely to produce unexpected results.

2: $psp$ – real (Kind=nag_wp) Function, supplied by the user. External Procedure

psp must return the value of

ψ^{'} (t) = \frac{d}{d t} ψ (t)

for a given value of its argument.

The specification of psp is:

Fortran Interface

Function psp (

Real (Kind=nag_wp)	::	psp
Real (Kind=nag_wp), Intent (In)	::	t

C Header Interface

double

psp (const double *t)

1: $t$ – Real (Kind=nag_wp) Input: On entry: the argument for which psp must be evaluated.

psp must either be a module subprogram USEd by, or declared as EXTERNAL in, the (sub)program from which g02hff is called. Arguments denoted as Input must not be changed by this procedure.

Note: psp should not return floating-point NaN (Not a Number) or infinity values, since these are not handled by g02hff. If your code inadvertently does return any NaNs or infinities, g02hff is likely to produce unexpected results.

3: $indw$ – Integer Input

On entry: the type of regression for which the asymptotic variance-covariance matrix is to be calculated.

$indw < 0$: Mallows type regression.
$indw = 0$: Huber type regression.
$indw > 0$: Schweppe type regression.

4: $indc$ – Integer Input

On entry: if

indw \neq 0

, indc must specify the approximation to be used.

indc = 1

, averaging over residuals.

indc \neq 1

, replacing expected by observed.

indw = 0

, indc is not referenced.

5: $sigma$ – Real (Kind=nag_wp) Input

On entry: the value of

\hat{σ}

, as given by g02hdf.

Constraint:

sigma > 0.0

6: $n$ – Integer Input

On entry:

n

, the number of observations.

Constraint:

n > 1

7: $m$ – Integer Input

On entry:

m

, the number of independent variables.

Constraint:

1 \leq m < n

8: $x (ldx, m)$ – Real (Kind=nag_wp) array Input

On entry: the values of the

X

matrix, i.e., the independent variables.

x (i, j)

must contain the

i j

th element of

X

, for

i = 1, 2, \dots, n

and

j = 1, 2, \dots, m

9: $ldx$ – Integer Input

On entry: the first dimension of the array x as declared in the (sub)program from which g02hff is called.

Constraint:

ldx \geq n

10: $rs (n)$ – Real (Kind=nag_wp) array Input

On entry: the residuals from the bounded influence regression. These are given by g02hdf.

11: $wgt (n)$ – Real (Kind=nag_wp) array Input

On entry: if

indw \neq 0

, wgt must contain the vector of weights used by the bounded influence regression. These should be used with g02hdf.

indw = 0

, wgt is not referenced.

12: $c (ldc, m)$ – Real (Kind=nag_wp) array Output

On exit: the estimate of the variance-covariance matrix.

13: $ldc$ – Integer Input

On entry: the first dimension of the array c as declared in the (sub)program from which g02hff is called.

Constraint:

ldc \geq m

14: $wk (m \times (n + m + 1) + 2 \times n)$ – Real (Kind=nag_wp) array Output

On exit: if

indw \neq 0

wk (i)

, for

i = 1, 2, \dots, n

, will contain the diagonal elements of the matrix

D

and

wk (i)

, for

i = n + 1, \dots, 2 n

, will contain the diagonal elements of matrix

P

The rest of the array is used as workspace.

15: $ifail$ – Integer Input/Output

On entry: ifail must be set to

0

−1

1

to set behaviour on detection of an error; these values have no effect when no error is detected.

A value of

0

causes the printing of an error message and program execution will be halted; otherwise program execution continues. A value of

−1

means that an error message is printed while a value of

1

means that it is not.

If halting is not appropriate, the value

−1

1

is recommended. If message printing is undesirable, then the value

1

is recommended. Otherwise, the value

0

is recommended. When the value $- 1$ or $1$ is used it is essential to test the value of ifail on exit.

On exit:

ifail = 0

unless the routine detects an error or a warning has been flagged (see Section 6).

6 Error Indicators and Warnings

If on entry

ifail = 0

−1

, explanatory error messages are output on the current error message unit (as defined by x04aaf).

Errors or warnings detected by the routine:

$ifail = 1$: On entry, $m = ⟨ value ⟩$ .
Constraint: $m \geq 1$ .

On entry, $m = ⟨ value ⟩$ and $ldc = ⟨ value ⟩$ .
Constraint: $ldc \geq m$ .

On entry, $n = ⟨ value ⟩$ .
Constraint: $n \geq 2$ .

On entry, $n = ⟨ value ⟩$ and $ldx = ⟨ value ⟩$ .
Constraint: $ldx \geq n$ .

On entry, $n = ⟨ value ⟩$ and $m = ⟨ value ⟩$ .
Constraint: $n > m$ .

$ifail = 2$: On entry, $sigma = ⟨ value ⟩$ .
Constraint: $sigma \geq 0.0$ .

$ifail = 3$: $S_{1}$ matrix is singular or almost singular.

$X^{T} X$ matrix not positive definite.

$ifail = 4$: Either the value of $\frac{1}{n} \sum_{i = 1}^{n} ψ^{'} (\frac{r_{i}}{\hat{σ}}) = 0$ ,

or $κ = 0$ ,

or $\sum_{i = 1}^{n} ψ^{2} (\frac{r_{i}}{\hat{σ}}) = 0$ .

In this situation g02hff returns $C$ as ${(X^{T} X)}^{−1}$ .

$ifail = - 99$: An unexpected error has been triggered by this routine. Please contact NAG.
See Section 7 in the Introduction to the NAG Library FL Interface for further information.

$ifail = - 399$: Your licence key may have expired or may not have been installed correctly.
See Section 8 in the Introduction to the NAG Library FL Interface for further information.

$ifail = - 999$: Dynamic memory allocation failed.
See Section 9 in the Introduction to the NAG Library FL Interface for further information.

7 Accuracy

In general, the accuracy of the variance-covariance matrix will depend primarily on the accuracy of the results from g02hdf.

8 Parallelism and Performance

Background information to multithreading can be found in the Multithreading documentation.

g02hff is threaded by NAG for parallel execution in multithreaded implementations of the NAG Library.

g02hff makes calls to BLAS and/or LAPACK routines, which may be threaded within the vendor library used by this implementation. Consult the documentation for the vendor library for further information.

Please consult the X06 Chapter Introduction for information on how to control and interrogate the OpenMP environment used within this routine. Please also consult the Users' Note for your implementation for any additional implementation-specific information.

9 Further Comments

g02hff is only for situations in which

X

has full column rank.

Care has to be taken in the choice of the

ψ

function since if

ψ^{'} (t) = 0

for too wide a range then either the value of

f_{H}

will not exist or too many values of

D_{i}

will be zero and it will not be possible to calculate

C

10 Example

The asymptotic variance-covariance matrix is calculated for a Schweppe type regression. The values of

X

\hat{σ}

and the residuals and weights are read in. The averaging over residuals approximation is used.

g02hf: FL CL CPP AD PY MB

NAG FL Interfaceg02hff (robustm_​user_​varmat)

▸▿ Contents

1 Purpose

2 Specification

3 Description

4 References

5 Arguments

6 Error Indicators and Warnings

7 Accuracy

8 Parallelism and Performance

9 Further Comments

10 Example

10.1 Program Text

10.2 Program Data

10.3 Program Results

NAG FL Interface
g02hff (robustm_user_varmat)