Integer, Intent (In)	::	n, m, ldx, isx(m), nx, ing(n), ng, ldcvm, lde, ldcvx, iwk
Integer, Intent (Inout)	::	ifail
Integer, Intent (Out)	::	nig(ng), ncv, irankx
Real (Kind=nag_wp), Intent (In)	::	x(ldx,m), wt(*), tol
Real (Kind=nag_wp), Intent (Inout)	::	cvm(ldcvm,nx), e(lde,6), cvx(ldcvx,ng-1)
Real (Kind=nag_wp), Intent (Out)	::	wk(iwk)
Character (1), Intent (In)	::	weight

C Header Interface

#include <nag.h>

void

g03acf_ (const char *weight, const Integer *n, const Integer *m, const double x[], const Integer *ldx, const Integer isx[], const Integer *nx, const Integer ing[], const Integer *ng, const double wt[], Integer nig[], double cvm[], const Integer *ldcvm, double e[], const Integer *lde, Integer *ncv, double cvx[], const Integer *ldcvx, const double *tol, Integer *irankx, double wk[], const Integer *iwk, Integer *ifail, const Charlen length_weight)

The routine may be called by the names g03acf or nagf_mv_canon_var.

3 Description

Let a sample of

n

observations on

n_{x}

variables in a data matrix come from

n_{g}

groups with

n_{1}, n_{2}, \dots, n_{n_{g}}

observations in each group,

\sum n_{i} = n

. Canonical variate analysis finds the linear combination of the

n_{x}

variables that maximizes the ratio of between-group to within-group variation. The variables formed, the canonical variates can then be used to discriminate between groups.

The canonical variates can be calculated from the eigenvectors of the within-group sums of squares and cross-products matrix. However, g03acf calculates the canonical variates by means of a singular value decomposition (SVD) of a matrix

V

. Let the data matrix with variable (column) means subtracted be

X

, and let its rank be

k

; then the

k

by (

n_{g} - 1

) matrix

V

is given by:

V = Q_{X}^{T} Q_{g},

where

Q_{g}

is an

n

(n_{g} - 1)

orthogonal matrix that defines the groups and

Q_{X}

is the first

k

rows of the orthogonal matrix

Q

either from the

Q R

decomposition of

X

X = Q R

X

is of full column rank, i.e.,

k = n_{x}

, else from the SVD of

X

X = Q D P^{T} .

Let the SVD of

V

be:

V = U_{x} Δ U_{g}^{T}

then the nonzero elements of the diagonal matrix

Δ

δ_{i}

, for

i = 1, 2, \dots, l

, are the

l

canonical correlations associated with the

l = \min (k, n_{g} - 1)

canonical variates, where

l = \min (k, n_{g})

The eigenvalues,

λ_{i}^{2}

, of the within-group sums of squares matrix are given by:

λ_{i}^{2} = \frac{δ_{i}^{2}}{1 - δ_{i}^{2}}

and the value of

π_{i} = λ_{i}^{2} / \sum λ_{i}^{2}

gives the proportion of variation explained by the

i

th canonical variate. The values of the

π_{i}

's give an indication as to how many canonical variates are needed to adequately describe the data, i.e., the dimensionality of the problem.

To test for a significant dimensionality greater than

i

the

χ^{2}

statistic:

(n - 1 - n_{g} - \frac{1}{2} (k - n_{g})) \sum_{j = i + 1}^{l} \log (1 + λ_{j}^{2})

can be used. This is asymptotically distributed as a

χ^{2}

-distribution with

(k - i) (n_{g} - 1 - i)

degrees of freedom. If the test for

i = h

is not significant, then the remaining tests for

i > h

should be ignored.

The loadings for the canonical variates are calculated from the matrix

U_{x}

. This matrix is scaled so that the canonical variates have unit within-group variance.

In addition to the canonical variates loadings the means for each canonical variate are calculated for each group.

Weights can be used with the analysis, in which case the weighted means are subtracted from each column and then each row is scaled by an amount

\sqrt{w_{i}}

, where

w_{i}

is the weight for the

i

th observation (row).

4 References

Chatfield C and Collins A J (1980) Introduction to Multivariate Analysis Chapman and Hall

Gnanadesikan R (1977) Methods for Statistical Data Analysis of Multivariate Observations Wiley

Hammarling S (1985) The singular value decomposition in multivariate statistics SIGNUM Newsl. 20(3) 2–25

Kendall M G and Stuart A (1969) The Advanced Theory of Statistics (Volume 1) (3rd Edition) Griffin

5 Arguments

1: $weight$ – Character(1) Input

On entry: indicates if weights are to be used.

$weight ='U'$: No weights are used.
$weight ='W'$ or $'V'$: Weights are used and must be supplied in wt.

weight ='W'

, the weights are treated as frequencies and the effective number of observations is the sum of the weights.

weight ='V'

, the weights are treated as being inversely proportional to the variance of the observations and the effective number of observations is the number of observations with nonzero weights.

Constraint:

weight ='U'

'W'

'V'

2: $n$ – Integer Input

On entry:

n

, the number of observations.

Constraint:

n \geq nx + ng

3: $m$ – Integer Input

On entry:

m

, the total number of variables.

Constraint:

m \geq nx

4: $x (ldx, m)$ – Real (Kind=nag_wp) array Input

On entry:

x (i, j)

must contain the

i

th observation for the

j

th variable, for

i = 1, 2, \dots, n

and

j = 1, 2, \dots, m

5: $ldx$ – Integer Input

On entry: the first dimension of the array x as declared in the (sub)program from which g03acf is called.

Constraint:

ldx \geq n

6: $isx (m)$ – Integer array Input

On entry:

isx (j)

indicates whether or not the

j

th variable is to be included in the analysis.

isx (j) > 0

, the variables contained in the

j

th column of x is included in the canonical variate analysis, for

j = 1, 2, \dots, m

Constraint:

isx (j) > 0

for nx values of

j

7: $nx$ – Integer Input

On entry: the number of variables in the analysis,

n_{x}

Constraint:

nx \geq 1

8: $ing (n)$ – Integer array Input

On entry:

ing (i)

indicates which group the

i

th observation is in, for

i = 1, 2, \dots, n

. The effective number of groups is the number of groups with nonzero membership.

Constraint:

1 \leq ing (i) \leq ng

, for

i = 1, 2, \dots, n

9: $ng$ – Integer Input

On entry: the number of groups,

n_{g}

Constraint:

ng \geq 2

10: $wt (*)$ – Real (Kind=nag_wp) array Input

Note: the dimension of the array wt must be at least

n

weight ='W'

'V'

, and at least

1

otherwise.

On entry: if

weight ='W'

'V'

, the first

n

elements of wt must contain the weights to be used in the analysis.

wt (i) = 0.0

, the

i

th observation is not included in the analysis.

weight ='U'

, wt is not referenced.

Constraints:

$wt (i) \geq 0.0$ , for $i = 1, 2, \dots, n$ ;
$\sum_{1}^{n} wt (i) \geq nx + effective number of groups$ .

11: $nig (ng)$ – Integer array Output

On exit:

nig (j)

gives the number of observations in group

j

, for

j = 1, 2, \dots, n_{g}

12: $cvm (ldcvm, nx)$ – Real (Kind=nag_wp) array Output

On exit:

cvm (i, j)

contains the mean of the

j

th canonical variate for the

i

th group, for

i = 1, 2, \dots, n_{g}

and

j = 1, 2, \dots, l

; the remaining columns, if any, are used as workspace.

13: $ldcvm$ – Integer Input

On entry: the first dimension of the array cvm as declared in the (sub)program from which g03acf is called.

Constraint:

ldcvm \geq ng

14: $e (lde, 6)$ – Real (Kind=nag_wp) array Output

On exit: the statistics of the canonical variate analysis.

$e (i, 1)$: The canonical correlations, $δ_{i}$ , for $i = 1, 2, \dots, l$ .
$e (i, 2)$: The eigenvalues of the within-group sum of squares matrix, $λ_{i}^{2}$ , for $i = 1, 2, \dots, l$ .
$e (i, 3)$: The proportion of variation explained by the $i$ th canonical variate, for $i = 1, 2, \dots, l$ .
$e (i, 4)$: The $χ^{2}$ statistic for the $i$ th canonical variate, for $i = 1, 2, \dots, l$ .
$e (i, 5)$: The degrees of freedom for $χ^{2}$ statistic for the $i$ th canonical variate, for $i = 1, 2, \dots, l$ .
$e (i, 6)$: The significance level for the $χ^{2}$ statistic for the $i$ th canonical variate, for $i = 1, 2, \dots, l$ .

15: $lde$ – Integer Input

On entry: the first dimension of the array e as declared in the (sub)program from which g03acf is called.

Constraint:

lde \geq \min (nx, ng - 1)

16: $ncv$ – Integer Output

On exit: the number of canonical variates,

l

. This will be the minimum of

n_{g} - 1

and the rank of x.

17: $cvx (ldcvx, ng - 1)$ – Real (Kind=nag_wp) array Output

On exit: the canonical variate loadings.

cvx (i, j)

contains the loading coefficient for the

i

th variable on the

j

th canonical variate, for

i = 1, 2, \dots, n_{x}

and

j = 1, 2, \dots, l

; the remaining columns, if any, are used as workspace.

18: $ldcvx$ – Integer Input

On entry: the first dimension of the array cvx as declared in the (sub)program from which g03acf is called.

Constraint:

ldcvx \geq nx

19: $tol$ – Real (Kind=nag_wp) Input

On entry: the value of tol is used to decide if the variables are of full rank and, if not, what is the rank of the variables. The smaller the value of tol the stricter the criterion for selecting the singular value decomposition. If a non-negative value of tol less than machine precision is entered, the square root of machine precision is used instead.

Constraint:

tol \geq 0.0

20: $irankx$ – Integer Output

On exit: the rank of the dependent variables.

If the variables are of full rank then

irankx = nx

If the variables are not of full rank then irankx is an estimate of the rank of the dependent variables. irankx is calculated as the number of singular values greater than

tol \times (largest singular value)

21: $wk (iwk)$ – Real (Kind=nag_wp) array Workspace

22: $iwk$ – Integer Input

On entry: the dimension of the array wk as declared in the (sub)program from which g03acf is called.

Constraints:

if $nx \geq ng - 1$ , $iwk \geq n \times nx + \max (5 \times (nx - 1) + (nx + 1) \times nx, n) + 1$ ;
if $nx < ng - 1$ , $iwk \geq n \times nx + \max (5 \times (nx - 1) + (ng - 1) \times nx, n) + 1$ .

23: $ifail$ – Integer Input/Output

On entry: ifail must be set to

0

- 1 or 1

. If you are unfamiliar with this argument you should refer to Section 4 in the Introduction to the NAG Library FL Interface for details.

For environments where it might be inappropriate to halt program execution when an error is detected, the value

- 1 or 1

is recommended. If the output of error messages is undesirable, then the value

1

is recommended. Otherwise, if you are not familiar with this argument, the recommended value is

0

. When the value $- 1 or 1$ is used it is essential to test the value of ifail on exit.

On exit:

ifail = 0

unless the routine detects an error or a warning has been flagged (see Section 6).

6 Error Indicators and Warnings

If on entry

ifail = 0

- 1

, explanatory error messages are output on the current error message unit (as defined by x04aaf).

Errors or warnings detected by the routine:

$ifail = 1$: On entry, $iwk = 〈value〉$
Constraint: $iwk \geq 〈value〉$ .

On entry, $ldcvm = 〈value〉$ and $ng = 〈value〉$ .
Constraint: $ldcvm \geq ng$ .

On entry, $ldcvx = 〈value〉$ and $nx = 〈value〉$ .
Constraint: $ldcvx \geq nx$ .

On entry, $lde = 〈value〉$ and $\min (nx, ng - 1) = 〈value〉$ .
Constraint: $lde \geq \min (nx, ng - 1)$ .

On entry, $ldx = 〈value〉$ and $n = 〈value〉$ .
Constraint: $ldx \geq n$ .

On entry, $m = 〈value〉$ and $nx = 〈value〉$ .
Constraint: $m \geq nx$ .

On entry, $n = 〈value〉$ and $nx + ng = 〈value〉$ .
Constraint: $n \geq nx + ng$ .

On entry, $ng = 〈value〉$ .
Constraint: $ng \geq 2$ .

On entry, $nx = 〈value〉$ .
Constraint: $nx \geq 1$ .

On entry, $tol = 〈value〉$ .
Constraint: $tol \geq 0.0$ .

On entry, $weight = 〈value〉$ .
Constraint: $weight ='U'$ , $'W'$ or $'V'$ .

$ifail = 2$: On entry, $i = 〈value〉$ and $wt (i) < 0.0$ .
Constraint: $wt (i) \geq 0.0$ .

$ifail = 3$: On entry, $i = 〈value〉$ , $ing (i) = 〈value〉$ and $ng = 〈value〉$ .
Constraint: $1 \leq ing (i) \leq ng$ .

$ifail = 4$: On entry, $nx = 〈value〉$ , expected $value = 〈value〉$ .
Constraint: $nx$ must be consistent with isx.

$ifail = 5$: The singular value decomposition has failed to converge. This is an unlikely error exit.

$ifail = 6$: A canonical correlation is equal to $1.0$ . This will happen if the variables provide an exact indication as to which group every observation is allocated.

$ifail = 7$: Less than $2$ groups have nonzero membership.

The effective number of observations is less than the effective number of groups plus number of variables.

$ifail = 8$: The rank of x is $0$ . This will happen if all the variables are constants.

$ifail = - 99$: An unexpected error has been triggered by this routine. Please contact NAG.
See Section 7 in the Introduction to the NAG Library FL Interface for further information.

$ifail = - 399$: Your licence key may have expired or may not have been installed correctly.
See Section 8 in the Introduction to the NAG Library FL Interface for further information.

$ifail = - 999$: Dynamic memory allocation failed.
See Section 9 in the Introduction to the NAG Library FL Interface for further information.

7 Accuracy

As the computation involves the use of orthogonal matrices and a singular value decomposition rather than the traditional computing of a sum of squares matrix and the use of an eigenvalue decomposition, g03acf should be less affected by ill-conditioned problems.

8 Parallelism and Performance

g03acf is threaded by NAG for parallel execution in multithreaded implementations of the NAG Library.

g03acf makes calls to BLAS and/or LAPACK routines, which may be threaded within the vendor library used by this implementation. Consult the documentation for the vendor library for further information.

Please consult the X06 Chapter Introduction for information on how to control and interrogate the OpenMP environment used within this routine. Please also consult the Users' Note for your implementation for any additional implementation-specific information.

9 Further Comments

None.

10 Example

This example uses a sample of nine observations, each consisting of three variables plus a group indicator. There are three groups. An unweighted canonical variate analysis is performed and the results printed.

Interfaces: FL CL AD

NAG FL Interface Introduction

G03 (Mv) Chapter Contents

G03 (Mv) Chapter Introduction

g03ac: FL CL AD

NAG FL Interfaceg03acf (canon_​var)

▸▿ Contents

1 Purpose

2 Specification

3 Description

4 References

5 Arguments

6 Error Indicators and Warnings

7 Accuracy

8 Parallelism and Performance

9 Further Comments

10 Example

10.1 Program Text

10.2 Program Data

10.3 Program Results

NAG FL Interface
g03acf (canon_var)