g02de: FL CL CPP AD PY MB

NAG CL Interface
g02dec (linregm_var_add)

Keyword Search:

NAG Library Manual, Mark 30.1

Interfaces: FL CL CPP AD PY MB

NAG CL Interface Introduction

G02 (Correg) Chapter Contents

G02 (Correg) Chapter Introduction

g02de: FL CL CPP AD PY MB

▸▿ Contents

1 Purpose

2 Specification

3 Description

4 References

5 Arguments

6 Error Indicators and Warnings

7 Accuracy

8 Parallelism and Performance

9 Further Comments

▸▿ 10 Example

10.1 Program Text

10.2 Program Data

10.3 Program Results

Settings help

CL Name Style:
Short (a00aac)
Long (impl_details)
Full (nag_info_impl_details)

1 Purpose

g02dec adds a new independent variable to a general linear regression model.

2 Specification

#include <nag.h>

void	g02dec (Integer n, Integer ip, double q[], Integer tdq, double p[], const double wt[], const double x[], double rss, double tol, NagError fail)

The function may be called by the names: g02dec, nag_correg_linregm_var_add or nag_regsn_mult_linear_add_var.

3 Description

A linear regression model may be built up by adding new independent variables to an existing model. g02dec updates the

Q R

decomposition used in the computation of the linear regression model. The

Q R

decomposition may come from g02dac or a previous call to g02dec. The general linear regression model is defined by:

y = X β + ε

where

y

is a vector of

n

observations on the dependent variable,

X

is an

n \times p

matrix of the independent variables of column rank

k

β

is a vector of length

p

of unknown arguments, and

ε

is a vector of length

n

of unknown random errors such that var

ε = V σ^{2}

, where

V

is a known diagonal matrix.

V = I

, the identity matrix, then least squares estimation is used.

V \neq I

, then for a given weight matrix

W \propto V^{−1}

, weighted least squares estimation is used.

The least squares estimates,

\hat{β}

of the arguments

β

minimize

{(y - X β)}^{T} (y - X β)

while the weighted least squares estimates minimize

{(y - X β)}^{T} W (y - X β)

The parameter estimates may be found by computing a

Q R

decomposition of

X

(or

W^{\frac{1}{2}} X

in the weighted case), i.e.,

X = {Q R}^{*} (or ​ W^{\frac{1}{2}} X = {Q R}^{*})

where

R^{*} = (\begin{matrix} R \\ 0 \end{matrix})

and

R

is a

p \times p

upper triangular matrix and

Q

is an

n \times n

orthogonal matrix. If

R

is of full rank, then

\hat{β}

is the solution to:

R \hat{β} = c_{1}

where

c = Q^{T} y

(or

Q^{T} W^{\frac{1}{2}} y

) and

c_{1}

is the first

p

elements of

c

R

is not of full rank a solution is obtained by means of a singular value decomposition (SVD) of

R

To add a new independent variable,

x_{p + 1}

R

and

c

have to be updated. The matrix

Q_{p + 1}

is found such that

Q_{p + 1}^{T} [R : Q^{T} x_{p + 1}]

(or

Q_{p + 1}^{T} [R : Q^{T} W^{\frac{1}{2}} x_{p + 1}]

) is upper triangular. The vector

c

is then updated by multiplying by

Q_{p + 1}^{T}

The new independent variable is tested to see if it is linearly related to the existing independent variables by checking that at least one of the values

{(Q^{T} x_{p + 1})}_{i}

, for

i = p + 2, p + 3, \dots, n

is nonzero.

The new parameter estimates,

\hat{β}

, can then be obtained by a call to g02ddc.

The function can be used with

p = 0

, in which case

R

and

c

are initialized.

4 References

Draper N R and Smith H (1985) Applied Regression Analysis (2nd Edition) Wiley

Golub G H and Van Loan C F (1996) Matrix Computations (3rd Edition) Johns Hopkins University Press, Baltimore

Hammarling S (1985) The singular value decomposition in multivariate statistics SIGNUM Newsl. 20(3) 2–25

McCullagh P and Nelder J A (1983) Generalized Linear Models Chapman and Hall

Searle S R (1971) Linear Models Wiley

5 Arguments

1: $n$ – Integer Input: On entry: the number of observations, $n$ .

Constraint: $n \geq 1$ .
2: $ip$ – Integer Input: On entry: the number of independent variables already in the model, $p$ .

Constraint: $ip \geq 0$ and $ip < n$ .
3: $q [n \times tdq]$ – double Input/Output: Note: the $(i, j)$ th element of the matrix $Q$ is stored in $q [(i - 1) \times tdq + j - 1]$ .

On entry: if $ip \neq 0$ , then q must contain the results of the $Q R$ decomposition for the model with $p$ arguments as returned by g02dac or a previous call to g02dec.
If $ip = 0$ , then the first column of q should contain the $n$ values of the dependent variable, $y$ .

On exit: the results of the $Q R$ decomposition for the model with $p + 1$ arguments: the first column of q contains the updated value of $c$ , the columns 2 to $ip + 1$ are unchanged, the first $ip + 1$ elements of column $ip + 2$ contain the new column of R, while the remaining $n - ip - 1$ elements contain details of the matrix $Q_{p + 1}$ .
4: $tdq$ – Integer Input: On entry: the stride separating matrix column elements in the array q.

Constraint: $tdq \geq ip + 2$ .
5: $p [ip + 1]$ – double Input/Output: On entry: p contains further details of the $Q R$ decomposition used. The first ip elements of p must contain details of the Householder vector from the $Q R$ decomposition. The first ip elements of array p are provided by g02dac or by previous calls to g02dec.

On exit: the first ip elements of p are unchanged and the ( $ip + 1$ )th element contains details of the Householder vector related to the new independent variable.
6: $wt [n]$ – const double Input: On entry: optionally, the weights to be used in the weighted regression.
If $wt [i - 1] = 0.0$ , then the $i$ th observation is not included in the model, in which case the effective number of observations is the number of observations with nonzero weights.

If weights are not provided then wt must be set to NULL and the effective number of observations is n.

Constraint: if $wt is not NULL$ , $wt [i - 1] = 0.0$ , for $i = 1, 2, \dots, n$ .
7: $x [n]$ – const double Input: On entry: the new independent variable, $x$ .
8: $rss$ – double * Output: On exit: the residual sum of squares for the new fitted model.
Note: this will only be valid if the model is of full rank, see Section 9.
9: $tol$ – double Input: On entry: the value of tol is used to decide if the new independent variable is linearly related to independent variables already included in the model. If the new variable is linearly related then $c$ is not updated. The smaller the value of tol the stricter the criterion for deciding if there is a linear relationship.

Suggested value: $tol = 0.000001$ .

Constraint: $tol > 0.0$ .
10: $fail$ – NagError * Input/Output: The NAG error argument (see Section 7 in the Introduction to the NAG Library CL Interface).

6 Error Indicators and Warnings

NE_2_INT_ARG_GE: On entry, $ip = ⟨ value ⟩$ while $n = ⟨ value ⟩$ . These arguments must satisfy $ip < n$ .
NE_2_INT_ARG_LT: On entry, $tdq = ⟨ value ⟩$ while $ip + 2 = ⟨ value ⟩$ . These arguments must satisfy $tdq \geq ip + 2$ .
NE_INT_ARG_LT: On entry, $ip = ⟨ value ⟩$ .
Constraint: $ip \geq 0$ .

On entry, $n = ⟨ value ⟩$ .
Constraint: $n \geq 1$ .
NE_NVAR_NOT_IND: The new independent variable is a linear combination of existing variables. The $(ip + 1)$ th column of q is, therefore, NULL.
NE_REAL_ARG_LE: On entry, tol must not be less than or equal to 0.0: $tol = ⟨ value ⟩$ .
NE_REAL_ARG_LT: On entry, $wt [⟨ value ⟩]$ must not be less than 0.0: $wt [⟨ value ⟩] = ⟨ value ⟩$ .

7 Accuracy

The accuracy is closely related to the accuracy of the

Q R

decomposition.

8 Parallelism and Performance

Background information to multithreading can be found in the Multithreading documentation.

g02dec makes calls to BLAS and/or LAPACK routines, which may be threaded within the vendor library used by this implementation. Consult the documentation for the vendor library for further information.

Please consult the X06 Chapter Introduction for information on how to control and interrogate the OpenMP environment used within this function. Please also consult the Users' Note for your implementation for any additional implementation-specific information.

9 Further Comments

It should be noted that the residual sum of squares produced by g02dec may not be correct if the model to which the new independent variable is added is not of full rank. In such a case g02ddc should be used to calculate the residual sum of squares.

10 Example

A dataset consisting of 12 observations is read in. The four independent variables are stored in the array x while the dependent variable is read into the first column of q. If the character variable meanc indicates that a mean should be included in the model, a variable taking the value

1.0

for all observations is set up and fitted. Subsequently, one variable at a time is selected to enter the model as indicated by the input value of indx. After the variable has been added the parameter estimates are calculated by g02ddc and the results printed. This is repeated until the input value of indx is 0.

g02de: FL CL CPP AD PY MB

NAG CL Interfaceg02dec (linregm_​var_​add)

▸▿ Contents

1 Purpose

2 Specification

3 Description

4 References

5 Arguments

6 Error Indicators and Warnings

7 Accuracy

8 Parallelism and Performance

9 Further Comments

10 Example

10.1 Program Text

10.2 Program Data

10.3 Program Results

NAG CL Interface
g02dec (linregm_var_add)