NAG C Library Function Document

nag_2d_spline_fit_grid (e02dcc)

1
Purpose

nag_2d_spline_fit_grid (e02dcc) computes a bicubic spline approximation to a set of data values, given on a rectangular grid in the x - y  plane. The knots of the spline are located automatically, but a single argument must be specified to control the trade-off between closeness of fit and smoothness of fit.

2
Specification

#include <nag.h>
#include <nage02.h>
void  nag_2d_spline_fit_grid (Nag_Start start, Integer mx, const double x[], Integer my, const double y[], const double f[], double s, Integer nxest, Integer nyest, double *fp, Nag_Comm *warmstartinf, Nag_2dSpline *spline, NagError *fail)

3
Description

nag_2d_spline_fit_grid (e02dcc) determines a smooth bicubic spline approximation s x,y  to the set of data points x q , y r , f q,r , for q=1,2,, m x  and r=1,2,, m y .
The spline is given in the B-spline representation
s x,y = i=1 n x - 4 j=1 n y - 4 c ij M i x N j y , (1)
where M i x  and N j y  denote normalized cubic B-splines, the former defined on the knots λ i  to λ i+4  and the latter on the knots μ j  to μ j+4 . For further details, see Hayes and Halliday (1974) for bicubic splines and de Boor (1972) for normalized B-splines.
The total numbers n x  and n y  of these knots and their values λ 1 , , λ n x  and μ 1 , , μ n y  are chosen automatically by the function. The knots λ 5 , , λ n x - 4  and μ 5 , , μ n y - 4  are the interior knots; they divide the approximation domain x 1 , x m x × y 1 , y m y  into n x - 7 × n y - 7  subpanels λ i , λ i+1 × μ i , μ i+1 , for i=4,5,, n x - 4 and j=4,5,, n y - 4. Then, much as in the curve case (see nag_1d_spline_fit (e02bec)), the coefficients c ij  are determined as the solution of the following constrained minimization problem:
minimizeη , (2)
subject to the constraint
θ = q=1 m x r=1 m y ε q,r 2 S , (3)
where η  is a measure of the (lack of) smoothness of s x,y . Its value depends on the discontinuity jumps in s x,y  across the boundaries of the subpanels. It is zero only when there are no discontinuities and is positive otherwise, increasing with the size of the jumps (see Dierckx (1982) for details). ε q,r  denotes the residual f q,r - s x q , y r , and S  is a non-negative number to be specified.
By means of the argument S , ‘the smoothing factor’, you will then control the balance between smoothness and closeness of fit, as measured by the sum of squares of residuals in (3). If S  is too large, the spline will be too smooth and signal will be lost (underfit); if S  is too small, the spline will pick up too much noise (overfit). In the extreme cases the function will return an interpolating spline θ=0  if S  is set to zero, and the least squares bicubic polynomial ( η=0 ) if S  is set very large. Experimenting with S  values between these two extremes should result in a good compromise. (See Section 9.3 for advice on choice of S .)
The method employed is outlined in Section 9.5 and fully described in Dierckx (1981) and Dierckx (1982). It involves an adaptive strategy for locating the knots of the bicubic spline (depending on the function underlying the data and on the value of S ), and an iterative method for solving the constrained minimization problem once the knots have been determined.
Values and derivatives of the computed spline can subsequently be computed by calling nag_2d_spline_eval (e02dec), nag_2d_spline_eval_rect (e02dfc) and nag_2d_spline_deriv_rect (e02dhc) as described in Section 9.6.

4
References

de Boor C (1972) On calculating with B-splines J. Approx. Theory 6 50–62
Dierckx P (1981) An improved algorithm for curve fitting with spline functions Report TW54 Department of Computer Science, Katholieke Univerciteit Leuven
Dierckx P (1982) A fast algorithm for smoothing data on a rectangular grid while using spline functions SIAM J. Numer. Anal. 19 1286–1304
Hayes J G and Halliday J (1974) The least squares fitting of cubic spline surfaces to general data sets J. Inst. Math. Appl. 14 89–103
Reinsch C H (1967) Smoothing by spline functions Numer. Math. 10 177–183

5
Arguments

1:     start Nag_StartInput
On entry: start must be set to start=Nag_Cold or Nag_Warm.
start=Nag_Cold, (cold start)
The function will build up the knot set starting with no interior knots. No values need be assigned to splinenx and splineny and memory will be internally allocated to splinelamda, splinemu, splinec, warmstartinfnag_w and warmstartinfnag_iw.
start=Nag_Warm (warm start)
The function will restart the knot-placing strategy using the knots found in a previous call of the function. In this case, all arguments except s must be unchanged from that previous call. This warm start can save much time in searching for a satisfactory value of S .
Constraint: start=Nag_Cold or Nag_Warm.
2:     mx IntegerInput
On entry: m x , the number of grid points along the x  axis.
Constraint: mx4 .
3:     x[mx] const doubleInput
On entry: x[q-1]  must be set to x q , the x  coordinate of the q th grid point along the x  axis, for q=1,2,, m x .
Constraint: x 1 < x 2 < < x m x .
4:     my IntegerInput
On entry: m y , the number of grid points along the y  axis.
Constraint: my4 .
5:     y[my] const doubleInput
On entry: y[r-1]  must be set to y r , the y  coordinate of the r th grid point along the y  axis, for r=1,2,, m y .
Constraint: y 1 < y 2 < < y m y .
6:     f[mx×my] const doubleInput
On entry: f[ m y × q-1 + r - 1 ]  must contain the data value f q,r , for q=1,2,, m x  and r=1,2,, m y .
7:     s doubleInput
On entry: the smoothing factor, S .
If S=0.0 , the function returns an interpolating spline.
If S  is smaller than machine precision, it is assumed equal to zero.
For advice on the choice of S , see Section 3 and Section 9.2.
Constraint: s0.0 .
8:     nxest IntegerInput
9:     nyest IntegerInput
On entry: an upper bound for the number of knots n x  and n y  required in the x  and y  directions respectively.
In most practical situations, nxest = m x / 2  and nyest = m y / 2  is sufficient. nxest and nyest never need to be larger than m x + 4  and m y + 4  respectively, the numbers of knots needed for interpolation ( S=0.0 ). See also Section 9.4.
Constraint: nxest8  and nyest8 .
10:   fp double *Output
On exit: the sum of squared residuals, θ , of the computed spline approximation. If fp=0.0 , this is an interpolating spline. fp should equal S  within a relative tolerance of 0.001 unless splinenx = splineny = 8 , when the spline has no interior knots and so is simply a bicubic polynomial. For knots to be inserted, S  must be set to a value below the value of fp produced in this case.
11:   warmstartinf Nag_Comm *
Pointer to structure of type Nag_Comm with the following members:
nag_wdouble *Input
On entry: if the warm start option is used, the values nag_w[0] , , nag_w[3]  must be left unchanged from the previous call.
nag_iwInteger *Input
On entry: if the warm start option is used, the values nag_iw[0] , , nag_iw[2]  must be left unchanged from the previous call.
Note that when the information contained in the pointers nag_w and nag_iw is no longer of use, or before a new call to nag_2d_spline_fit_grid (e02dcc) with the same warmstartinf, you should free this storage using the NAG macros NAG_FREE. This storage will have been allocated only if this function returns with fail.code=NE_NOERROR , NE_SPLINE_COEFF_CONV, or NE_NUM_KNOTS_2D_GT_RECT.
12:   spline Nag_2dSpline *
Pointer to structure of type Nag_2dSpline with the following members:
nxIntegerInput/Output
On entry: if the warm start option is used, the value of nx must be left unchanged from the previous call.
On exit: the total number of knots, n x , of the computed spline with respect to the x  variable.
lamdadouble *Input/Output
On entry: a pointer to which if start=Nag_Cold, memory of size nxest is internally allocated. If the warm start option is used, the values lamda[0] , lamda[1] , , lamda[nx-1]  must be left unchanged from the previous call.
On exit: lamda contains the complete set of knots λ i  associated with the x  variable, i.e., the interior knots lamda[4] , lamda[5] , , lamda[nx-5]  as well as the additional knots lamda[0] = lamda[1] = lamda[2] = lamda[3] = x[0]  and lamda[nx-4] = lamda[nx-3] = lamda[nx-2] = lamda[nx-1] = x[mx-1]  needed for the B-spline representation.
nyIntegerInput/Output
On entry: if the warm start option is used, the value of ny must be left unchanged from the previous call.
On exit: the total number of knots, n y , of the computed spline with respect to the y  variable.
mudouble *Input/Output
On entry: a pointer to which if start=Nag_Cold, memory of size nyest is internally allocated. If the warm start option is used, the values mu[0] , mu[1] , , mu[ny-1]  must be left unchanged from the previous call.
On exit: mu contains the complete set of knots μ i  associated with the y  variable, i.e., the interior knots mu[4] , mu[5] , , mu[ny-5]  as well as the additional knots mu[0] = mu[1] = mu[2] = mu[3] = y[0]  and mu[ny-4] = mu[ny-3] = mu[ny-2] = mu[ny-1] = y[my-1]  needed for the B-spline representation.
cdouble *Output
On exit: a pointer to which if start=Nag_Cold, memory of size nxest-4 × nyest-4  is internally allocated. c[ n y - 4 × i-1 + j - 1 ]  is the coefficient c ij  defined in Section 3.
Note that when the information contained in the pointers lamda, mu and c is no longer of use, or before a new call to nag_2d_spline_fit_grid (e02dcc) with the same spline, you should free this storage using the NAG macro NAG_FREE. This storage will have been allocated only if this function returns with fail.code=NE_NOERROR , NE_SPLINE_COEFF_CONV, or NE_NUM_KNOTS_2D_GT_RECT.
13:   fail NagError *Input/Output
The NAG error argument (see Section 3.7 in How to Use the NAG Library and its Documentation).

6
Error Indicators and Warnings

If the function fails with an error exit of NE_NUM_KNOTS_2D_GT_RECT or NE_SPLINE_COEFF_CONV, then a spline approximation is returned, but it fails to satisfy the fitting criterion (see (2) and (3)) – perhaps by only a small amount, however.
NE_ALLOC_FAIL
Dynamic memory allocation failed.
NE_BAD_PARAM
On entry, argument start had an illegal value.
NE_ENUMTYPE_WARM
start=Nag_Warm at the first call of this function. start must be set tostart=Nag_Cold at the first call.
NE_INT_ARG_LT
On entry, mx=value.
Constraint: mx4.
On entry, my=value.
Constraint: my4.
On entry, nxest=value.
Constraint: nxest8.
On entry, nyest=value.
Constraint: nyest8.
NE_NOT_STRICTLY_INCREASING
The sequence x is not strictly increasing: x[value] = value, x[value] = value.
The sequence y is not strictly increasing: y[value] = value, y[value] = value.
NE_NUM_KNOTS_2D_GT_RECT
The number of knots required is greater than allowed by nxest or nyest, nxest=value , nyest=value . Possibly s is too small, especially if nxest, nyest>mx/2, my/2. s=value , mx=value , my=value .
NE_REAL_ARG_LT
On entry, s must not be less than 0.0: s=value .
NE_SF_D_K_CONS
On entry, s=value , nxest=value , mx=value .
Constraint: nxest mx + 4  when s=0.0 .
On entry, s=value , nyest=value , my=value .
Constraint: nyest mx + 4  when s=0.0 .
NE_SPLINE_COEFF_CONV
The iterative process has failed to converge. Possibly s is too small: s=value .

7
Accuracy

On successful exit, the approximation returned is such that its sum of squared residuals fp is equal to the smoothing factor S , up to a specified relative tolerance of 0.001 – except that if n x = 8  and n y = 8 , fp may be significantly less than S : in this case the computed spline is simply the least squares bicubic polynomial approximation of degree 3, i.e., a spline with no interior knots.

8
Parallelism and Performance

nag_2d_spline_fit_grid (e02dcc) is not threaded in any implementation.

9
Further Comments

9.1
Timing

The time taken for a call of nag_2d_spline_fit_grid (e02dcc) depends on the complexity of the shape of the data, the value of the smoothing factor S , and the number of data points. If nag_2d_spline_fit_grid (e02dcc) is to be called for different values of S , much time can be saved by setting start=Nag_Warm after the first call.

9.2
Weighting of Data Points

nag_2d_spline_fit_grid (e02dcc) does not allow individual weighting of the data values. If these were determined to widely differing accuracies, it may be better to use nag_2d_spline_fit_scat (e02ddc). The computation time would be very much longer, however.

9.3
Choice of s

If the standard deviation of f q,r  is the same for all q  and r  (the case for which this function is designed – see Section 9.2) and known to be equal, at least approximately, to σ , say, then following Reinsch (1967) and choosing the smoothing factor S  in the range σ 2 m ± 2m , where m = m x m y , is likely to give a good start in the search for a satisfactory value. If the standard deviations vary, the sum of their squares over all the data points could be used. Otherwise experimenting with different values of S  will be required from the start, taking account of the remarks in Section 3.
In that case, in view of computation time and memory requirements, it is recommended to start with a very large value for S  and so determine the least squares bicubic polynomial; the value returned for fp, call it fp 0 , gives an upper bound for S . Then progressively decrease the value of S  to obtain closer fits – say by a factor of 10 in the beginning, i.e., S = fp 0 / 10 , S = fp 0 / 100 , and so on, and more carefully as the approximation shows more details.
The number of knots of the spline returned, and their location, generally depend on the value of S  and on the behaviour of the function underlying the data. However, if nag_2d_spline_fit_grid (e02dcc) is called with start=Nag_Warm, the knots returned may also depend on the smoothing factors of the previous calls. Therefore if, after a number of trials with different values of S  and start=Nag_Warm, a fit can finally be accepted as satisfactory, it may be worthwhile to call nag_2d_spline_fit_grid (e02dcc) once more with the selected value for S  but now using start=Nag_Cold. Often, nag_2d_spline_fit_grid (e02dcc) then returns an approximation with the same quality of fit but with fewer knots, which is therefore better if data reduction is also important.

9.4
Choice of nxest and nyest

The number of knots may also depend on the upper bounds nxest and nyest. Indeed, if at a certain stage in nag_2d_spline_fit_grid (e02dcc) the number of knots in one direction (say n x ) has reached the value of its upper bound (nxest), then from that moment on all subsequent knots are added in the other y  direction. Therefore you have the option of limiting the number of knots the function locates in any direction. For example, by setting nxest=8  (the lowest allowable value for nxest), you can indicate that you want an approximation which is a simple cubic polynomial in the variable x .

9.5
Outline of Method Used

If S=0 , the requisite number of knots is known in advance, i.e., n x = m x + 4  and n y = m y + 4 ; the interior knots are located immediately as λ i = x i-2  and μ j = y j-2 , for i=5,6,, n x - 4 and j=5,6,,n y - 4. The corresponding least squares spline is then an interpolating spline and therefore a solution of the problem.
If S>0 , suitable knot sets are built up in stages (starting with no interior knots in the case of a cold start but with the knot set found in a previous call if a warm start is chosen). At each stage, a bicubic spline is fitted to the data by least squares, and θ , the sum of squares of residuals, is computed. If θ>S , new knots are added to one knot set or the other so as to reduce θ  at the next stage. The new knots are located in intervals where the fit is particularly poor, their number depending on the value of S  and on the progress made so far in reducing θ . Sooner or later, we find that θS  and at that point the knot sets are accepted. The function then goes on to compute the (unique) spline which has these knot sets and which satisfies the full fitting criterion specified by (2) and (3). The theoretical solution has θ=S . The function computes the spline by an iterative scheme which is ended when θ=S  within a relative tolerance of 0.001. The main part of each iteration consists of a linear least squares computation of special form, done in a similarly stable and efficient manner as in nag_1d_spline_fit_knots (e02bac) for least squares curve fitting.
An exception occurs when the function finds at the start that, even with no interior knots n x = n y = 8 , the least squares spline already has its sum of residuals S . In this case, since this spline (which is simply a bicubic polynomial) also has an optimal value for the smoothness measure η , namely zero, it is returned at once as the (trivial) solution. It will usually mean that S  has been chosen too large.
For further details of the algorithm and its use see Dierckx (1982).

9.6
Evaluation of Computed Spline

The values of the computed spline at the points tx r-1 , ty r-1 , for r=1,2,,n, may be obtained in the array ff, of length at least n , by the following code:
e02dec(n, tx, ty, ff, &spline, &fail)
where spline is a structure of type Nag_2dSpline which is an output argument of nag_2d_spline_fit_grid (e02dcc).
To evaluate the computed spline on a kx by ky rectangular grid of points in the x - y  plane, which is defined by the x  coordinates stored in tx q-1 , for q=1,2,,kx, and the y  coordinates stored in ty r-1 , for r=1,2,,ky, returning the results in the array fg which is of length at least kx × ky , the following call may be used:
e02dfc(kx, ky, tx, ty, fg, &spline, &fail)
where spline is a structure of type Nag_2dSpline which is an output argument of nag_2d_spline_fit_grid (e02dcc). The result of the spline evaluated at grid point q,r  is returned in element ky × q-1 + r - 1  of the array fg.

10
Example

This example program reads in values of mx, my, x q , for q=1,2,,mx, and y r , for r=1,2,,my, followed by values of the ordinates f q,r  defined at the grid points x q , y r . It then calls nag_2d_spline_fit_grid (e02dcc) to compute a bicubic spline approximation for one specified value of s, and prints the values of the computed knots and B-spline coefficients. Finally it evaluates the spline at a small sample of points on a rectangular grid.

10.1
Program Text

Program Text (e02dcce.c)

10.2
Program Data

Program Data (e02dcce.d)

10.3
Program Results

Program Results (e02dcce.r)