NAG FL Interface
g02bzf (ssqmat_​combine)

1 Purpose

g02bzf combines two sets of sample means and sums of squares and cross-products matrices. It is designed to be used in conjunction with g02buf to allow large datasets to be summarised.

2 Specification

Fortran Interface
Subroutine g02bzf ( mean, m, xsw, xmean, xc, ysw, ymean, yc, ifail)
Integer, Intent (In) :: m
Integer, Intent (Inout) :: ifail
Real (Kind=nag_wp), Intent (In) :: ysw, ymean(m), yc(*)
Real (Kind=nag_wp), Intent (Inout) :: xsw, xmean(m), xc(*)
Character (1), Intent (In) :: mean
C Header Interface
#include <nag.h>
void  g02bzf_ (const char *mean, const Integer *m, double *xsw, double xmean[], double xc[], const double *ysw, const double ymean[], const double yc[], Integer *ifail, const Charlen length_mean)
The routine may be called by the names g02bzf or nagf_correg_ssqmat_combine.

3 Description

Let X and Y denote two sets of data, each with m variables and nx and ny observations respectively. Let μx denote the (optionally weighted) vector of m means for the first dataset and Cx denote either the sums of squares and cross-products of deviations from μx
Cx= X-e μxT T Dx X-e μxT  
or the sums of squares and cross-products, in which case
Cx = XT Dx X  
where e is a vector of nx ones and Dx is a diagonal matrix of (optional) weights and Wx is defined as the sum of the diagonal elements of D. Similarly, let μy, Cy and Wy denote the same quantities for the second dataset.
Given μx, μy, Cx, Cy, Wx and Wy g02bzf calculates μz, Cz and Wz as if a dataset Z, with m variables and nx+ny observations were supplied to g02buf, with Z constructed as
Z = X Y .  
g02bzf has been designed to combine the results from two calls to g02buf allowing large datasets, or cases where all the data is not available at the same time, to be summarised.

4 References

Bennett J, Pebay P, Roe D and Thompson D (2009) Numerically stable, single-pass, parallel statistics algorithms Proceedings of IEEE International Conference on Cluster Computing

5 Arguments

1: mean Character(1) Input
On entry: indicates whether the matrices supplied in xc and yc are sums of squares and cross-products, or sums of squares and cross-products of deviations about the mean.
mean='M'
Sums of squares and cross-products of deviations about the mean have been supplied.
mean='Z'
Sums of squares and cross-products have been supplied.
Constraint: mean='M' or 'Z'.
2: m Integer Input
On entry: m, the number of variables.
Constraint: m1.
3: xsw Real (Kind=nag_wp) Input/Output
On entry: Wx, the sum of weights, from the first set of data, X. If the data is unweighted then this will be the number of observations in the first dataset.
On exit: Wz, the sum of weights, from the combined dataset, Z. If both datasets are unweighted then this will be the number of observations in the combined dataset.
Constraint: xsw0.
4: xmeanm Real (Kind=nag_wp) array Input/Output
On entry: μx, the sample means for the first set of data, X.
On exit: μz, the sample means for the combined data, Z.
5: xc* Real (Kind=nag_wp) array Input/Output
Note: the dimension of the array xc must be at least m×m+m/2.
On entry: Cx, the sums of squares and cross-products matrix for the first set of data, X, as returned by g02buf.
g02buf, returns this matrix packed by columns, i.e., the cross-product between the jth and kth variable, kj, is stored in xck×k-1/2+j.
No check is made that Cx is a valid cross-products matrix.
On exit: Cz, the sums of squares and cross-products matrix for the combined dataset, Z.
This matrix is again stored packed by columns.
6: ysw Real (Kind=nag_wp) Input
On entry: Wy, the sum of weights, from the second set of data, Y. If the data is unweighted then this will be the number of observations in the second dataset.
Constraint: ysw0.
7: ymeanm Real (Kind=nag_wp) array Input
On entry: μy, the sample means for the second set of data, Y.
8: yc* Real (Kind=nag_wp) array Input
Note: the dimension of the array yc must be at least m×m+m/2.
On entry: Cy, the sums of squares and cross-products matrix for the second set of data, Y, as returned by g02buf.
g02buf, returns this matrix packed by columns, i.e., the cross-product between the jth and kth variable, kj, is stored in yck×k-1/2+j.
No check is made that Cy is a valid cross-products matrix.
9: ifail Integer Input/Output
On entry: ifail must be set to 0, -1 or 1 to set behaviour on detection of an error; these values have no effect when no error is detected.
A value of 0 causes the printing of an error message and program execution will be halted; otherwise program execution continues. A value of -1 means that an error message is printed while a value of 1 means that it is not.
If halting is not appropriate, the value -1 or 1 is recommended. If message printing is undesirable, then the value 1 is recommended. Otherwise, the value 0 is recommended. When the value -1 or 1 is used it is essential to test the value of ifail on exit.
On exit: ifail=0 unless the routine detects an error or a warning has been flagged (see Section 6).

6 Error Indicators and Warnings

If on entry ifail=0 or -1, explanatory error messages are output on the current error message unit (as defined by x04aaf).
Errors or warnings detected by the routine:
ifail=11
On entry, mean=value was an illegal value.
ifail=21
On entry, m=value.
Constraint: m1.
ifail=31
On entry, xsw=value.
Constraint: xsw0.0.
ifail=61
On entry, ysw=value.
Constraint: ysw0.0.
ifail=-99
An unexpected error has been triggered by this routine. Please contact NAG.
See Section 7 in the Introduction to the NAG Library FL Interface for further information.
ifail=-399
Your licence key may have expired or may not have been installed correctly.
See Section 8 in the Introduction to the NAG Library FL Interface for further information.
ifail=-999
Dynamic memory allocation failed.
See Section 9 in the Introduction to the NAG Library FL Interface for further information.

7 Accuracy

Not applicable.

8 Parallelism and Performance

g02bzf makes calls to BLAS and/or LAPACK routines, which may be threaded within the vendor library used by this implementation. Consult the documentation for the vendor library for further information.
Please consult the X06 Chapter Introduction for information on how to control and interrogate the OpenMP environment used within this routine. Please also consult the Users' Note for your implementation for any additional implementation-specific information.

9 Further Comments

None.

10 Example

This example illustrates the use of g02bzf by dividing a dataset into three blocks of 4, 5 and 3 observations respectively. Each block of data is summarised using g02buf and then the three summaries combined using g02bzf.
The resulting sums of squares and cross-products matrix is then scaled to obtain the covariance matrix for the whole dataset.

10.1 Program Text

Program Text (g02bzfe.f90)

10.2 Program Data

Program Data (g02bzfe.d)

10.3 Program Results

Program Results (g02bzfe.r)