e02ddf computes a bicubic spline approximation to a set of scattered data. The knots of the spline are located automatically, but a single argument must be specified to control the trade-off between closeness of fit and smoothness of fit.

2 Specification

Fortran Interface

Subroutine e02ddf (

start, m, x, y, f, w, s, nxest, nyest, nx, lamda, ny, mu, c, fp, rank, wrk, lwrk, iwrk, liwrk, ifail)

Integer, Intent (In)	::	m, nxest, nyest, lwrk, liwrk
Integer, Intent (Inout)	::	nx, ny, ifail
Integer, Intent (Out)	::	rank, iwrk(liwrk)
Real (Kind=nag_wp), Intent (In)	::	f(m), w(m), s
Real (Kind=nag_wp), Intent (Inout)	::	x(m), y(m), lamda(nxest), mu(nyest), wrk(lwrk)
Real (Kind=nag_wp), Intent (Out)	::	c((nxest-4)*(nyest-4)), fp
Character (1), Intent (In)	::	start

C Header Interface

#include <nag.h>

void

e02ddf_ (const char *start, const Integer *m, double x[], double y[], const double f[], const double w[], const double *s, const Integer *nxest, const Integer *nyest, Integer *nx, double lamda[], Integer *ny, double mu[], double c[], double *fp, Integer *rank, double wrk[], const Integer *lwrk, Integer iwrk[], const Integer *liwrk, Integer *ifail, const Charlen length_start)

The routine may be called by the names e02ddf or nagf_fit_dim2_spline_sctr.

3 Description

e02ddf determines a smooth bicubic spline approximation

s (x, y)

to the set of data points

(x_{r}, y_{r}, f_{r})

with weights

w_{r}

, for

r = 1, 2, \dots, m

The approximation domain is considered to be the rectangle

[x_{\min}, x_{\max}] \times [y_{\min}, y_{\max}]

, where

x_{\min} (y_{\min})

and

x_{\max} (y_{\max})

denote the lowest and highest data values of

x (y)

The spline is given in the B-spline representation

s (x, y) = \sum_{i = 1}^{n_{x} - 4} \sum_{j = 1}^{n_{y} - 4} c_{i j} M_{i} (x) N_{j} (y),

(1)

where

M_{i} (x)

and

N_{j} (y)

denote normalized cubic B-splines, the former defined on the knots

λ_{i}

λ_{i + 4}

and the latter on the knots

μ_{j}

μ_{j + 4}

. For further details, see Hayes and Halliday (1974) for bicubic splines and de Boor (1972) for normalized B-splines.

The total numbers

n_{x}

and

n_{y}

of these knots and their values

λ_{1}, \dots, λ_{n_{x}}

and

μ_{1}, \dots, μ_{n_{y}}

are chosen automatically by the routine. The knots

λ_{5}, \dots, λ_{n_{x} - 4}

and

μ_{5}, \dots, μ_{n_{y} - 4}

are the interior knots; they divide the approximation domain

[x_{\min}, x_{\max}] \times [y_{\min}, y_{\max}]

into

(n_{x} - 7) \times (n_{y} - 7)

subpanels

[λ_{i}, λ_{i + 1}] \times [μ_{j}, μ_{j + 1}]

, for

i = 4, 5, \dots, n_{x} - 4

and

j = 4, 5, \dots, n_{y} - 4

. Then, much as in the curve case (see e02bef), the coefficients

c_{i j}

are determined as the solution of the following constrained minimization problem:

minimize

η,

(2)

subject to the constraint

θ = \sum_{r = 1}^{m} ε_{r}^{2} \leq S

(3)

where	$η$	is a measure of the (lack of) smoothness of $s (x, y)$ . Its value depends on the discontinuity jumps in $s (x, y)$ across the boundaries of the subpanels. It is zero only when there are no discontinuities and is positive otherwise, increasing with the size of the jumps (see Dierckx (1981b) for details).
	$ε_{r}$	denotes the weighted residual $w_{r} (f_{r} - s (x_{r}, y_{r}))$ ,
and	$s$	is a non-negative number to be specified by you.

By means of the argument

s

, ‘the smoothing factor’, you will then control the balance between smoothness and closeness of fit, as measured by the sum of squares of residuals in (3). If

s

is too large, the spline will be too smooth and signal will be lost (underfit); if

s

is too small, the spline will pick up too much noise (overfit). In the extreme cases the method would return an interpolating spline

(θ = 0)

s

were set to zero, and returns the least squares bicubic polynomial

(η = 0)

s

is set very large. Experimenting with

s

-values between these two extremes should result in a good compromise. (See Section 9.2 for advice on choice of

s

.) Note however, that this routine, unlike e02bef and e02dcf, does not allow

s

to be set exactly to zero: to compute an interpolant to scattered data, e01saf or e01sgf should be used.

The method employed is outlined in Section 9.5 and fully described in Dierckx (1981a) and Dierckx (1981b). It involves an adaptive strategy for locating the knots of the bicubic spline (depending on the function underlying the data and on the value of

s

), and an iterative method for solving the constrained minimization problem once the knots have been determined.

Values and derivatives of the computed spline can subsequently be computed by calling e02def, e02dff or e02dhf as described in Section 9.6.

4 References

de Boor C (1972) On calculating with B-splines J. Approx. Theory 6 50–62

Dierckx P (1981a) An improved algorithm for curve fitting with spline functions Report TW54 Department of Computer Science, Katholieke Univerciteit Leuven

Dierckx P (1981b) An algorithm for surface fitting with spline functions IMA J. Numer. Anal. 1 267–283

Hayes J G and Halliday J (1974) The least squares fitting of cubic spline surfaces to general data sets J. Inst. Math. Appl. 14 89–103

Peters G and Wilkinson J H (1970) The least squares problem and pseudo-inverses Comput. J. 13 309–316

Reinsch C H (1967) Smoothing by spline functions Numer. Math. 10 177–183

5 Arguments

1: $start$ – Character(1) Input

On entry: determines whether calculations are to be performed afresh (Cold Start) or whether knots found in previous calls are to be used as an initial estimate of knot placement (Warm Start).

$start ='C'$: The routine will build up the knot set starting with no interior knots. No values need be assigned to the arguments nx, ny, lamda, mu or wrk.
$start ='W'$: The routine will restart the knot-placing strategy using the knots found in a previous call of the routine. In this case, the arguments nx, ny, lamda, mu and wrk must be unchanged from that previous call. This warm start can save much time in determining a satisfactory set of knots for the given value of s. This is particularly useful when different smoothing factors are used for the same dataset.

Constraint:

start ='C'

'W'

2: $m$ – Integer Input

On entry:

m

, the number of data points.

The number of data points with nonzero weight (see w) must be at least

16

3: $x (m)$ – Real (Kind=nag_wp) array Input

4: $y (m)$ – Real (Kind=nag_wp) array Input

5: $f (m)$ – Real (Kind=nag_wp) array Input

On entry:

x (r)

y (r)

f (r)

must be set to the coordinates of

(x_{r}, y_{r}, f_{r})

, the

r

th data point, for

r = 1, 2, \dots, m

. The order of the data points is immaterial.

6: $w (m)$ – Real (Kind=nag_wp) array Input

On entry:

w (r)

must be set to

w_{r}

, the

r

th value in the set of weights, for

r = 1, 2, \dots, m

. Zero weights are permitted and the corresponding points are ignored, except when determining

x_{\min}

x_{\max}

y_{\min}

and

y_{\max}

(see Section 9.4). For advice on the choice of weights, see Section 2.1.2 in the E02 Chapter Introduction.

Constraint: the number of data points with nonzero weight must be at least

16

7: $s$ – Real (Kind=nag_wp) Input

On entry: the smoothing factor, s.

For advice on the choice of s, see Sections 3 and 9.2.

Constraint:

s > 0.0

8: $nxest$ – Integer Input

9: $nyest$ – Integer Input

On entry: an upper bound for the number of knots

n_{x}

and

n_{y}

required in the

x

- and

y

-directions respectively.

In most practical situations,

nxest = nyest = 4 + \sqrt{m / 2}

is sufficient. See also Section 9.3.

Constraint:

nxest \geq 8

and

nyest \geq 8

10: $nx$ – Integer Input/Output

On entry: if the warm start option is used, the value of nx must be left unchanged from the previous call.

On exit: the total number of knots,

n_{x}

, of the computed spline with respect to the

x

variable.

11: $lamda (nxest)$ – Real (Kind=nag_wp) array Input/Output

On entry: if the warm start option is used, the values

lamda (1), lamda (2), \dots, lamda (nx)

must be left unchanged from the previous call.

On exit: contains the complete set of knots

λ_{i}

associated with the

x

variable, i.e., the interior knots

lamda (5), lamda (6), \dots, lamda (nx - 4)

as well as the additional knots

lamda (1) = lamda (2) = lamda (3) = lamda (4) = x_{\min}

and

lamda (nx - 3) = lamda (nx - 2) = lamda (nx - 1) = lamda (nx) = x_{\max}

needed for the B-spline representation (where

x_{\min}

and

x_{\max}

are as described in Section 3).

12: $ny$ – Integer Input/Output

On entry: if the warm start option is used, the value of ny must be left unchanged from the previous call.

On exit: the total number of knots,

n_{y}

, of the computed spline with respect to the

y

variable.

13: $mu (nyest)$ – Real (Kind=nag_wp) array Input/Output

On entry: if the warm start option is used, the values

mu (1), mu (2), \dots, mu (ny)

must be left unchanged from the previous call.

On exit: contains the complete set of knots

μ_{i}

associated with the

y

variable, i.e., the interior knots

mu (5), mu (6), \dots, mu (ny - 4)

as well as the additional knots

mu (1) = mu (2) = mu (3) = mu (4) = y_{\min}

and

mu (ny - 3) = mu (ny - 2) = mu (ny - 1) = mu (ny) = y_{\max}

needed for the B-spline representation (where

y_{\min}

and

y_{\max}

are as described in Section 3).

14: $c ((nxest - 4) \times (nyest - 4))$ – Real (Kind=nag_wp) array Output

On exit: the coefficients of the spline approximation.

c ((n_{y} - 4) \times (i - 1) + j)

is the coefficient

c_{i j}

defined in Section 3.

15: $fp$ – Real (Kind=nag_wp) Output

On exit: the weighted sum of squared residuals,

θ

, of the computed spline approximation. fp should equal s within a relative tolerance of

0.001

unless

nx = ny = 8

, when the spline has no interior knots and so is simply a bicubic polynomial. For knots to be inserted, s must be set to a value below the value of fp produced in this case.

16: $rank$ – Integer Output

On exit: gives the rank of the system of equations used to compute the final spline (as determined by a suitable machine-dependent threshold). When

rank = (nx - 4) \times (ny - 4)

, the solution is unique; otherwise the system is rank-deficient and the minimum-norm solution is computed. The latter case may be caused by too small a value of s.

17: $wrk (lwrk)$ – Real (Kind=nag_wp) array Communication Array

If the warm start option is used, on entry, the value of

wrk (1)

must be left unchanged from the previous call.

This array is used as workspace.

18: $lwrk$ – Integer Input

On entry: the dimension of the array wrk as declared in the (sub)program from which e02ddf is called.

Constraint:

lwrk \geq (7 \times u \times v + 25 \times w) \times (w + 1) + 2 \times (u + v + 4 \times m) + 23 \times w + 56

,
where

u = nxest - 4

v = nyest - 4

and

w = \max (u, v)

For some problems, the routine may need to compute the minimal least squares solution of a rank-deficient system of linear equations (see Section 3). The amount of workspace required to solve such problems will be larger than specified by the value given above, which must be increased by an amount, lwrk2 say. An upper bound for lwrk2 is given by

4 \times u \times v \times w + 2 \times u \times v + 4 \times w

, where

u

v

and

w

are as above. However, if there are enough data points, scattered uniformly over the approximation domain, and if the smoothing factor s is not too small, there is a good chance that this extra workspace is not needed. A lot of memory might, therefore, be saved by assuming that no additional workspace is required (

lwrk2 = 0

19: $iwrk (liwrk)$ – Integer array Workspace

20: $liwrk$ – Integer Input

On entry: the dimension of the array iwrk as declared in the (sub)program from which e02ddf is called.

Constraint:

liwrk \geq m + 2 \times (nxest - 7) \times (nyest - 7)

21: $ifail$ – Integer Input/Output

On entry: ifail must be set to

0

−1

1

to set behaviour on detection of an error; these values have no effect when no error is detected.

A value of

0

causes the printing of an error message and program execution will be halted; otherwise program execution continues. A value of

−1

means that an error message is printed while a value of

1

means that it is not.

If halting is not appropriate, the value

−1

1

is recommended. If message printing is undesirable, then the value

1

is recommended. Otherwise, the value

0

is recommended. When the value $- 1$ or $1$ is used it is essential to test the value of ifail on exit.

On exit:

ifail = 0

unless the routine detects an error or a warning has been flagged (see Section 6).

6 Error Indicators and Warnings

If on entry

ifail = 0

−1

, explanatory error messages are output on the current error message unit (as defined by x04aaf).

Errors or warnings detected by the routine:

$ifail = 1$: On entry, $liwrk = ⟨ value ⟩$ .
Constraint: $liwrk \geq ⟨ value ⟩$ .

On entry, $lwrk = ⟨ value ⟩$ .
Constraint: $lwrk \geq ⟨ value ⟩$ .

On entry, $MM < 16$ , where $MM$ is the number of points with nonzero weight: $MM = ⟨ value ⟩$ .

On entry, $nxest = ⟨ value ⟩$ .
Constraint: $nxest \geq ⟨ value ⟩$ .

On entry, $nyest = ⟨ value ⟩$ .
Constraint: $nyest \geq ⟨ value ⟩$ .

On entry, $s = ⟨ value ⟩$ .
Constraint: $s > 0.0$ .

On entry, $start \neq'W'$ or $'C'$ : $start = ⟨ value ⟩$ .

$ifail = 2$: On entry, all the values in array x are equal.

On entry, all the values in array y are equal.

$ifail = 3$: The number of knots needed in one direction is greater than nxest or nyest: nxest, $nyest = ⟨ value ⟩, ⟨ value ⟩$ . Possibly s is too small: $s = ⟨ value ⟩$ .

$ifail = 4$: No more knots added; the number of $B$ -spline coefficients already exceeds m. Either m or s is probably too small: $m = ⟨ value ⟩$ and $s = ⟨ value ⟩$ .

$ifail = 5$: No more knots added; the additional knot would coincide with an old one. Possibly an inaccurate data point has too large a weight, or s is too small: $s = ⟨ value ⟩$ .

$ifail = 6$: The iterative process has failed to converge. Possibly s is too small: $s = ⟨ value ⟩$ .

$ifail = 7$: lwrk is too small to compute the minimal least squares solution: $lwrk = ⟨ value ⟩$ . Minimum requested value for lwrk is $⟨ value ⟩$ ; Safe requested value for lwrk is $⟨ value ⟩$ .

$ifail = - 99$: An unexpected error has been triggered by this routine. Please contact NAG.
See Section 7 in the Introduction to the NAG Library FL Interface for further information.

$ifail = - 399$: Your licence key may have expired or may not have been installed correctly.
See Section 8 in the Introduction to the NAG Library FL Interface for further information.

$ifail = - 999$: Dynamic memory allocation failed.
See Section 9 in the Introduction to the NAG Library FL Interface for further information.

7 Accuracy

On successful exit, the approximation returned is such that its weighted sum of squared residuals fp is equal to the smoothing factor

s

, up to a specified relative tolerance of

0.001

– except that if

n_{x} = 8

and

n_{y} = 8

, fp may be significantly less than

s

: in this case the computed spline is simply the least squares bicubic polynomial approximation of degree

3

, i.e., a spline with no interior knots.

8 Parallelism and Performance

e02ddf makes calls to BLAS and/or LAPACK routines, which may be threaded within the vendor library used by this implementation. Consult the documentation for the vendor library for further information.

Please consult the X06 Chapter Introduction for information on how to control and interrogate the OpenMP environment used within this routine. Please also consult the Users' Note for your implementation for any additional implementation-specific information.

9 Further Comments

9.1 Timing

The time taken for a call of e02ddf depends on the complexity of the shape of the data, the value of the smoothing factor

s

, and the number of data points. If e02ddf is to be called for different values of

s

, much time can be saved by setting

start ='W'

after the first call.

It should be noted that choosing

s

very small considerably increases computation time.

9.2 Choice of s

If the weights have been correctly chosen (see Section 2.1.2 in the E02 Chapter Introduction), the standard deviation of

w_{r} f_{r}

would be the same for all

r

, equal to

σ

, say. In this case, choosing the smoothing factor

s

in the range

σ^{2} (m \pm \sqrt{2 m})

, as suggested by Reinsch (1967), is likely to give a good start in the search for a satisfactory value. Otherwise, experimenting with different values of

s

will be required from the start.

In that case, in view of computation time and memory requirements, it is recommended to start with a very large value for

s

and so determine the least squares bicubic polynomial; the value returned for fp, call it

{fp}_{0}

, gives an upper bound for

s

. Then progressively decrease the value of

s

to obtain closer fits – say by a factor of

10

in the beginning, i.e.,

s = {fp}_{0} / 10

s = {fp}_{0} / 100

, and so on, and more carefully as the approximation shows more details.

To choose

s

very small is strongly discouraged. This considerably increases computation time and memory requirements. It may also cause rank-deficiency (as indicated by the argument rank) and endanger numerical stability.

The number of knots of the spline returned, and their location, generally depend on the value of

s

and on the behaviour of the function underlying the data. However, if e02ddf is called with

start ='W'

, the knots returned may also depend on the smoothing factors of the previous calls. Therefore, if, after a number of trials with different values of

s

and

start ='W'

, a fit can finally be accepted as satisfactory, it may be worthwhile to call e02ddf once more with the selected value for

s

but now using

start ='C'

. Often, e02ddf then returns an approximation with the same quality of fit but with fewer knots, which is, therefore, better if data reduction is also important.

9.3 Choice of nxest and nyest

The number of knots may also depend on the upper bounds nxest and nyest. Indeed, if at a certain stage in e02ddf the number of knots in one direction (say

n_{x}

) has reached the value of its upper bound (nxest), then from that moment on all subsequent knots are added in the other

(y)

direction. This may indicate that the value of nxest is too small. On the other hand, it gives you the option of limiting the number of knots the routine locates in any direction. For example, by setting

nxest = 8

(the lowest allowable value for nxest), you can indicate that you want an approximation which is a simple cubic polynomial in the variable

x

9.4 Restriction of the approximation domain

The fit obtained is not defined outside the rectangle

[λ_{4}, λ_{n_{x} - 3}] \times [μ_{4}, μ_{n_{y} - 3}]

. The reason for taking the extreme data values of

x

and

y

for these four knots is that, as is usual in data fitting, the fit cannot be expected to give satisfactory values outside the data region. If, nevertheless, you require values over a larger rectangle, this can be achieved by augmenting the data with two artificial data points

(a, c, 0)

and

(b, d, 0)

with zero weight, where

[a, b] \times [c, d]

denotes the enlarged rectangle.

9.5 Outline of method used

First suitable knot sets are built up in stages (starting with no interior knots in the case of a cold start but with the knot set found in a previous call if a warm start is chosen). At each stage, a bicubic spline is fitted to the data by least squares and

θ

, the sum of squares of residuals, is computed. If

θ > s

, a new knot is added to one knot set or the other so as to reduce

θ

at the next stage. The new knot is located in an interval where the fit is particularly poor. Sooner or later, we find that

θ \leq s

and at that point the knot sets are accepted. The routine then goes on to compute a spline which has these knot sets and which satisfies the full fitting criterion specified by (2) and (3). The theoretical solution has

θ = s

. The routine computes the spline by an iterative scheme which is ended when

θ = s

within a relative tolerance of

0.001

. The main part of each iteration consists of a linear least squares computation of special form, done in a similarly stable and efficient manner as in e02daf. As there also, the minimal least squares solution is computed wherever the linear system is found to be rank-deficient.

An exception occurs when the routine finds at the start that, even with no interior knots (

N = 8

), the least squares spline already has its sum of squares of residuals

\leq s

. In this case, since this spline (which is simply a bicubic polynomial) also has an optimal value for the smoothness measure

η

, namely zero, it is returned at once as the (trivial) solution. It will usually mean that

s

has been chosen too large.

For further details of the algorithm and its use see Dierckx (1981b).

9.6 Evaluation of Computed Spline

Values of the computed spline evaluated at a set of points, or on a rectangular grid, can be obtained by calls of e02def or e02dff respectively.

10 Example

This example reads in a value of m, followed by a set of m data points

(x_{r}, y_{r}, f_{r})

and their weights

w_{r}

. It then calls e02ddf to compute a bicubic spline approximation for one specified value of s, and prints the values of the computed knots and B-spline coefficients. Finally it evaluates the spline at a small sample of points on a rectangular grid.

e02dd: FL CL CPP AD

NAG FL Interfacee02ddf (dim2_​spline_​sctr)

▸▿ Contents

1 Purpose

2 Specification

3 Description

4 References

5 Arguments

6 Error Indicators and Warnings

7 Accuracy

8 Parallelism and Performance

9 Further Comments

9.1 Timing

9.2 Choice of s

9.3 Choice of nxest and nyest

9.4 Restriction of the approximation domain

9.5 Outline of method used

9.6 Evaluation of Computed Spline

10 Example

10.1 Program Text

10.2 Program Data

10.3 Program Results

NAG FL Interface
e02ddf (dim2_spline_sctr)