NAG FL Interface
g02eef (linregm_fit_onestep)
1
Purpose
g02eef carries out one step of a forward selection procedure in order to enable the ‘best’ linear regression model to be found.
2
Specification
Fortran Interface
Subroutine g02eef ( |
istep, mean, weight, n, m, x, ldx, vname, isx, maxip, y, wt, fin, addvar, newvar, chrss, f, model, nterm, rss, idf, ifr, free, exss, q, ldq, p, wk, ifail) |
Integer, Intent (In) |
:: |
n, m, ldx, isx(m), maxip, ldq |
Integer, Intent (Inout) |
:: |
istep, nterm, idf, ifr, ifail |
Real (Kind=nag_wp), Intent (In) |
:: |
x(ldx,m), y(n), wt(*), fin |
Real (Kind=nag_wp), Intent (Inout) |
:: |
rss, q(ldq,maxip+2), p(maxip+1) |
Real (Kind=nag_wp), Intent (Out) |
:: |
chrss, f, exss(maxip), wk(2*maxip) |
Logical, Intent (Out) |
:: |
addvar |
Character (*), Intent (In) |
:: |
vname(m) |
Character (*), Intent (Inout) |
:: |
model(maxip), free(maxip) |
Character (*), Intent (Out) |
:: |
newvar |
Character (1), Intent (In) |
:: |
mean, weight |
|
C Header Interface
#include <nag.h>
void |
g02eef_ (Integer *istep, const char *mean, const char *weight, const Integer *n, const Integer *m, const double x[], const Integer *ldx, const char vname[], const Integer isx[], const Integer *maxip, const double y[], const double wt[], const double *fin, logical *addvar, char *newvar, double *chrss, double *f, char model[], Integer *nterm, double *rss, Integer *idf, Integer *ifr, char free[], double exss[], double q[], const Integer *ldq, double p[], double wk[], Integer *ifail, const Charlen length_mean, const Charlen length_weight, const Charlen length_vname, const Charlen length_newvar, const Charlen length_model, const Charlen length_free) |
|
C++ Header Interface
#include <nag.h> extern "C" {
void |
g02eef_ (Integer &istep, const char *mean, const char *weight, const Integer &n, const Integer &m, const double x[], const Integer &ldx, const char vname[], const Integer isx[], const Integer &maxip, const double y[], const double wt[], const double &fin, logical &addvar, char *newvar, double &chrss, double &f, char model[], Integer &nterm, double &rss, Integer &idf, Integer &ifr, char free[], double exss[], double q[], const Integer &ldq, double p[], double wk[], Integer &ifail, const Charlen length_mean, const Charlen length_weight, const Charlen length_vname, const Charlen length_newvar, const Charlen length_model, const Charlen length_free) |
}
|
The routine may be called by the names g02eef or nagf_correg_linregm_fit_onestep.
3
Description
One method of selecting a linear regression model from a given set of independent variables is by forward selection. The following procedure is used:
-
(i)Select the best fitting independent variable, i.e., the independent variable which gives the smallest residual sum of squares. If the -test for this variable is greater than a chosen critical value, , then include the variable in the model, else stop.
-
(ii)Find the independent variable that leads to the greatest reduction in the residual sum of squares when added to the current model.
-
(iii)If the -test for this variable is greater than a chosen critical value, , then include the variable in the model and go to (ii), otherwise stop.
At any step the variables not in the model are known as the free terms.
g02eef allows you to specify some independent variables that must be in the model, these are known as forced variables.
The computational procedure involves the use of decompositions, the and the matrices being updated as each new variable is added to the model. In addition the matrix , where is the matrix of variables not included in the model, is updated.
g02eef computes one step of the forward selection procedure at a call. The results produced at each step may be printed or used as inputs to
g02ddf, in order to compute the regression coefficients for the model fitted at that step. Repeated calls to
g02eef should be made until
is indicated.
4
References
Draper N R and Smith H (1985) Applied Regression Analysis (2nd Edition) Wiley
Weisberg S (1985) Applied Linear Regression Wiley
5
Arguments
Note: after the initial call to
g02eef with
all arguments except
fin must not be changed by you between calls.
-
1:
– Integer
Input/Output
-
On entry: indicates which step in the forward selection process is to be carried out.
- The process is initialized.
Constraint:
.
On exit: is incremented by .
-
2:
– Character(1)
Input
-
On entry: indicates if a mean term is to be included.
- A mean term, intercept, will be included in the model.
- The model will pass through the origin, zero-point.
Constraint:
or .
-
3:
– Character(1)
Input
-
On entry: indicates if weights are to be used.
- Least squares estimation is used.
- Weighted least squares is used and weights must be supplied in array wt.
Constraint:
or .
-
4:
– Integer
Input
-
On entry: , the number of observations.
Constraint:
.
-
5:
– Integer
Input
-
On entry: , the total number of independent variables in the dataset.
Constraint:
.
-
6:
– Real (Kind=nag_wp) array
Input
-
On entry: must contain the th observation for the th independent variable, for and .
-
7:
– Integer
Input
-
On entry: the first dimension of the array
x as declared in the (sub)program from which
g02eef is called.
Constraint:
.
-
8:
– Character(*) array
Input
-
On entry:
must contain the name of the independent variable in column
of
x, for
.
-
9:
– Integer array
Input
-
On entry: indicates which independent variables could be considered for inclusion in the regression.
- The variable contained in the
th column of x is automatically included in the regression model, for .
- The variable contained in the
th column of x is considered for inclusion in the regression model, for .
- The variable in the
th column is not considered for inclusion in the model, for .
Constraint:
and at least one value of , for .
-
10:
– Integer
Input
-
On entry: the maximum number of independent variables to be included in the model.
Constraints:
- if , number of values of ;
- if , number of values of .
-
11:
– Real (Kind=nag_wp) array
Input
-
On entry: the dependent variable.
-
12:
– Real (Kind=nag_wp) array
Input
-
Note: the dimension of the array
wt
must be at least
if
.
On entry: if
wt must contain the weights to be used with the model.
If , the th observation is not included in the model, in which case the effective number of observations is the number of observations with nonzero weights.
If
,
wt is not referenced and the effective number of observations is
.
Constraint:
if , , for .
-
13:
– Real (Kind=nag_wp)
Input
-
On entry: the critical value of the statistic for the term to be included in the model, .
Suggested value:
is a commonly used value in exploratory modelling.
Constraint:
.
-
14:
– Logical
Output
-
On exit: indicates if a variable has been added to the model.
- A variable has been added to the model.
- No variable had an value greater than and none were added to the model.
-
15:
– Character(*)
Output
-
On exit: if
,
newvar contains the name of the variable added to the model.
Constraint:
the declared size of
newvar must be greater than or equal to the declared size of
vname.
-
On exit: if
,
chrss contains the change in the residual sum of squares due to adding variable
newvar.
-
17:
– Real (Kind=nag_wp)
Output
-
On exit: if
,
f contains the
statistic for the inclusion of the variable in
newvar.
-
18:
– Character(*) array
Input/Output
-
On entry: if
,
model need not be set.
If
,
model must contain the values returned by the previous call to
g02eef.
Constraint:
the declared size of
model must be greater than or equal to the declared size of
vname.
On exit: the names of the variables in the current model.
-
19:
– Integer
Input/Output
-
On entry: if
,
nterm need not be set.
If
,
nterm must contain the value returned by the previous call to
g02eef.
Constraint:
if , .
On exit: the number of independent variables in the current model, not including the mean, if any.
-
On entry: if
,
rss need not be set.
If
,
rss must contain the value returned by the previous call to
g02eef.
Constraint:
if , .
On exit: the residual sums of squares for the current model.
-
21:
– Integer
Input/Output
-
On entry: if
,
idf need not be set.
If
,
idf must contain the value returned by the previous call to
g02eef.
On exit: the degrees of freedom for the residual sum of squares for the current model.
-
22:
– Integer
Input/Output
-
On entry: if
,
ifr need not be set.
If
,
ifr must contain the value returned by the previous call to
g02eef.
On exit: the number of free independent variables, i.e., the number of variables not in the model that are still being considered for selection.
-
23:
– Character(*) array
Input/Output
-
On entry: if
,
free need not be set.
If
,
free must contain the values returned by the previous call to
g02eef.
Constraint:
the declared size of
free must be greater than or equal to the declared size of
vname.
On exit: the first
ifr values of
free contain the names of the free variables.
-
24:
– Real (Kind=nag_wp) array
Output
-
On exit: the first
ifr values of
exss contain what would be the change in regression sum of squares if the free variables had been added to the model, i.e., the extra sum of squares for the free variables.
contains what would be the change in regression sum of squares if the variable
had been added to the model.
-
25:
– Real (Kind=nag_wp) array
Input/Output
-
On entry: if
,
q need not be set.
If
,
q must contain the values returned by the previous call to
g02eef.
On exit: the results of the
decomposition for the current model:
- the first column of q contains (or where is the vector of weights if used);
- the upper triangular part of columns to contain the matrix;
- the strictly lower triangular part of columns to contain details of the matrix;
- the remaining to columns of contain (or ),
where
, or
if
.
-
26:
– Integer
Input
-
On entry: the first dimension of the array
q as declared in the (sub)program from which
g02eef is called.
Constraint:
.
-
27:
– Real (Kind=nag_wp) array
Input/Output
-
On entry: if
,
p need not be set.
If
,
p must contain the values returned by the previous call to
g02eef.
On exit: the first
elements of
p contain details of the
decomposition, where
, or
if
.
-
28:
– Real (Kind=nag_wp) array
Workspace
-
-
29:
– Integer
Input/Output
-
On entry:
ifail must be set to
,
or
to set behaviour on detection of an error; these values have no effect when no error is detected.
A value of causes the printing of an error message and program execution will be halted; otherwise program execution continues. A value of means that an error message is printed while a value of means that it is not.
If halting is not appropriate, the value
or
is recommended. If message printing is undesirable, then the value
is recommended. Otherwise, the value
is recommended.
When the value or is used it is essential to test the value of ifail on exit.
On exit:
unless the routine detects an error or a warning has been flagged (see
Section 6).
6
Error Indicators and Warnings
If on entry
or
, explanatory error messages are output on the current error message unit (as defined by
x04aaf).
Errors or warnings detected by the routine:
-
On entry, .
Constraint: .
On entry, .
Constraint: .
On entry, and .
Constraint: if , .
On entry, and .
Constraint: .
On entry, and .
Constraint: .
On entry, .
Constraint: .
On entry, .
Constraint: or .
On entry, .
Constraint: .
On entry, .
Constraint: .
On entry, .
Constraint: or .
-
On entry, .
Constraint: , for .
-
Degrees of freedom for error will equal if new variable is added, i.e., the number of variables in the model plus is equal to the effective number of observations.
On entry, number of forced variables .
-
On entry, .
Constraint: , for .
On entry,
, for all
.
Constraint: at least one value of
isx must be nonzero.
On entry,
.
Constraint:
maxip must be large enough to accommodate the number of terms given by
isx.
-
On entry, the variables forced into the model are not of full rank, i.e., some of these variables are linear combinations of others.
-
There are no free variables, i.e., no element of .
-
The value of the change in the sum of squares is greater than the input value of
rss. This may occur due to rounding errors if the true residual sum of squares for the new model is small relative to the residual sum of squares for the previous model.
An unexpected error has been triggered by this routine. Please
contact
NAG.
See
Section 7 in the Introduction to the NAG Library FL Interface for further information.
Your licence key may have expired or may not have been installed correctly.
See
Section 8 in the Introduction to the NAG Library FL Interface for further information.
Dynamic memory allocation failed.
See
Section 9 in the Introduction to the NAG Library FL Interface for further information.
7
Accuracy
As g02eef uses a transformation the results will often be more accurate than traditional algorithms using methods based on the cross-products of the dependent and independent variables.
8
Parallelism and Performance
g02eef is threaded by NAG for parallel execution in multithreaded implementations of the NAG Library.
g02eef makes calls to BLAS and/or LAPACK routines, which may be threaded within the vendor library used by this implementation. Consult the documentation for the vendor library for further information.
Please consult the
X06 Chapter Introduction for information on how to control and interrogate the OpenMP environment used within this routine. Please also consult the
Users' Note for your implementation for any additional implementation-specific information.
None.
10
Example
The data, from an oxygen uptake experiment, is given by
Weisberg (1985). The names of the variables are as given in
Weisberg (1985). The independent and dependent variables are read and
g02eef is repeatedly called until
. At each step the
statistic, the free variables and their extra sum of squares are printed; also, except for when
, the new variable, the change in the residual sum of squares and the terms in the model are printed.
10.1
Program Text
10.2
Program Data
10.3
Program Results