NAG Library Routine Document
E02DDF
1 Purpose
E02DDF computes a bicubic spline approximation to a set of scattered data. The knots of the spline are located automatically, but a single parameter must be specified to control the trade-off between closeness of fit and smoothness of fit.
2 Specification
SUBROUTINE E02DDF ( |
START, M, X, Y, F, W, S, NXEST, NYEST, NX, LAMDA, NY, MU, C, FP, RANK, WRK, LWRK, IWRK, LIWRK, IFAIL) |
INTEGER |
M, NXEST, NYEST, NX, NY, RANK, LWRK, IWRK(LIWRK), LIWRK, IFAIL |
REAL (KIND=nag_wp) |
X(M), Y(M), F(M), W(M), S, LAMDA(NXEST), MU(NYEST), C((NXEST-4)*(NYEST-4)), FP, WRK(LWRK) |
CHARACTER(1) |
START |
|
3 Description
E02DDF determines a smooth bicubic spline approximation to the set of data points with weights , for .
The approximation domain is considered to be the rectangle , where and denote the lowest and highest data values of .
The spline is given in the B-spline representation
where
and
denote normalized cubic B-splines, the former defined on the knots
to
and the latter on the knots
to
. For further details, see
Hayes and Halliday (1974) for bicubic splines and
de Boor (1972) for normalized B-splines.
The total numbers
and
of these knots and their values
and
are chosen automatically by the routine. The knots
and
are the interior knots; they divide the approximation domain
into
subpanels
, for
and
. Then, much as in the curve case (see
E02BEF), the coefficients
are determined as the solution of the following constrained minimization problem:
minimize
subject to the constraint
where: |
|
is a measure of the (lack of) smoothness of . Its value depends on the discontinuity jumps in across the boundaries of the subpanels. It is zero only when there are no discontinuities and is positive otherwise, increasing with the size of the jumps (see Dierckx (1981b) for details). |
|
|
denotes the weighted residual
, |
and |
|
is a non-negative number to be specified by you. |
By means of the parameter
, ‘the smoothing factor’, you will then control the balance between smoothness and closeness of fit, as measured by the sum of squares of residuals in
(3). If
is too large, the spline will be too smooth and signal will be lost (underfit); if
is too small, the spline will pick up too much noise (overfit). In the extreme cases the method would return an interpolating spline
if
were set to zero, and returns the least squares bicubic polynomial
if
is set very large. Experimenting with
-values between these two extremes should result in a good compromise. (See
Section 8.2 for advice on choice of
.) Note however, that this routine, unlike
E02BEF and
E02DCF, does not allow
to be set exactly to zero: to compute an interpolant to scattered data,
E01SAF or
E01SGF should be used.
The method employed is outlined in
Section 8.5 and fully described in
Dierckx (1981a) and
Dierckx (1981b). It involves an adaptive strategy for locating the knots of the bicubic spline (depending on the function underlying the data and on the value of
), and an iterative method for solving the constrained minimization problem once the knots have been determined.
Values and derivatives of the computed spline can subsequently be computed by calling
E02DEF,
E02DFF or
E02DHF as described in
Section 8.6.
4 References
de Boor C (1972) On calculating with B-splines J. Approx. Theory 6 50–62
Dierckx P (1981a) An improved algorithm for curve fitting with spline functions Report TW54 Department of Computer Science, Katholieke Univerciteit Leuven
Dierckx P (1981b) An algorithm for surface fitting with spline functions IMA J. Numer. Anal. 1 267–283
Hayes J G and Halliday J (1974) The least-squares fitting of cubic spline surfaces to general data sets J. Inst. Math. Appl. 14 89–103
Peters G and Wilkinson J H (1970) The least-squares problem and pseudo-inverses Comput. J. 13 309–316
Reinsch C H (1967) Smoothing by spline functions Numer. Math. 10 177–183
5 Parameters
- 1: START – CHARACTER(1)Input
On entry: determines whether calculations are to be performed afresh (Cold Start) or whether knots found in previous calls are to be used as an initial estimate of knot placement (Warm Start).
- The routine will build up the knot set starting with no interior knots. No values need be assigned to the parameters NX, NY, LAMDA, MU or WRK.
- The routine will restart the knot-placing strategy using the knots found in a previous call of the routine. In this case, the parameters NX, NY, LAMDA, MU and WRK must be unchanged from that previous call. This warm start can save much time in determining a satisfactory set of knots for the given value of S. This is particularly useful when different smoothing factors are used for the same dataset.
Constraint:
or .
- 2: M – INTEGERInput
On entry:
, the number of data points.
The number of data points with nonzero weight (see
W) must be at least
.
- 3: X(M) – REAL (KIND=nag_wp) arrayInput
- 4: Y(M) – REAL (KIND=nag_wp) arrayInput
- 5: F(M) – REAL (KIND=nag_wp) arrayInput
On entry: , , must be set to the coordinates of , the th data point, for . The order of the data points is immaterial.
- 6: W(M) – REAL (KIND=nag_wp) arrayInput
On entry:
must be set to
, the
th value in the set of weights, for
. Zero weights are permitted and the corresponding points are ignored, except when determining
,
,
and
(see
Section 8.4). For advice on the choice of weights, see
Section 2.1.2 in the E02 Chapter Introduction.
Constraint:
the number of data points with nonzero weight must be at least .
- 7: S – REAL (KIND=nag_wp)Input
On entry: the smoothing factor,
S.
For advice on the choice of
S, see
Sections 3 and
8.2.
Constraint:
.
- 8: NXEST – INTEGERInput
- 9: NYEST – INTEGERInput
On entry: an upper bound for the number of knots
and
required in the
- and
-directions respectively.
In most practical situations,
is sufficient. See also
Section 8.3.
Constraint:
and .
- 10: NX – INTEGERInput/Output
On entry: if the warm start option is used, the value of
NX must be left unchanged from the previous call.
On exit: the total number of knots, , of the computed spline with respect to the variable.
- 11: LAMDA(NXEST) – REAL (KIND=nag_wp) arrayInput/Output
On entry: if the warm start option is used, the values must be left unchanged from the previous call.
On exit: contains the complete set of knots
associated with the
variable, i.e., the interior knots
as well as the additional knots
and
needed for the B-spline representation (where
and
are as described in
Section 3).
- 12: NY – INTEGERInput/Output
On entry: if the warm start option is used, the value of
NY must be left unchanged from the previous call.
On exit: the total number of knots, , of the computed spline with respect to the variable.
- 13: MU(NYEST) – REAL (KIND=nag_wp) arrayInput/Output
On entry: if the warm start option is used, the values must be left unchanged from the previous call.
On exit: contains the complete set of knots
associated with the
variable, i.e., the interior knots
as well as the additional knots
and
needed for the B-spline representation (where
and
are as described in
Section 3).
- 14: C() – REAL (KIND=nag_wp) arrayOutput
On exit: the coefficients of the spline approximation.
is the coefficient
defined in
Section 3.
- 15: FP – REAL (KIND=nag_wp)Output
On exit: the weighted sum of squared residuals,
, of the computed spline approximation.
FP should equal
S within a relative tolerance of
unless
, when the spline has no interior knots and so is simply a bicubic polynomial. For knots to be inserted,
S must be set to a value below the value of
FP produced in this case.
- 16: RANK – INTEGEROutput
On exit: gives the rank of the system of equations used to compute the final spline (as determined by a suitable machine-dependent threshold). When
, the solution is unique; otherwise the system is rank-deficient and the minimum-norm solution is computed. The latter case may be caused by too small a value of
S.
- 17: WRK(LWRK) – REAL (KIND=nag_wp) arrayCommunication Array
If the warm start option is used, on entry, the value of must be left unchanged from the previous call.
This array is used as workspace.
- 18: LWRK – INTEGERInput
On entry: the dimension of the array
WRK as declared in the (sub)program from which E02DDF is called.
Constraint:
,
where
,
and
..
For some problems, the routine may need to compute the minimal least squares solution of a rank-deficient system of linear equations (see
Section 3). The amount of workspace required to solve such problems will be larger than specified by the value given above, which must be increased by an amount,
lwrk2 say. An upper bound for
lwrk2 is given by
, where
,
and
are as above. However, if there are enough data points, scattered uniformly over the approximation domain, and if the smoothing factor
S is not too small, there is a good chance that this extra workspace is not needed. A lot of memory might therefore be saved by assuming that no additional workspace is required (
).
- 19: IWRK(LIWRK) – INTEGER arrayWorkspace
- 20: LIWRK – INTEGERInput
On entry: the dimension of the array
IWRK as declared in the (sub)program from which E02DDF is called.
Constraint:
.
- 21: IFAIL – INTEGERInput/Output
-
On entry:
IFAIL must be set to
,
. If you are unfamiliar with this parameter you should refer to
Section 3.3 in the Essential Introduction for details.
For environments where it might be inappropriate to halt program execution when an error is detected, the value
is recommended. If the output of error messages is undesirable, then the value
is recommended. Otherwise, if you are not familiar with this parameter, the recommended value is
.
When the value is used it is essential to test the value of IFAIL on exit.
On exit:
unless the routine detects an error or a warning has been flagged (see
Section 6).
6 Error Indicators and Warnings
If on entry
or
, explanatory error messages are output on the current error message unit (as defined by
X04AAF).
Errors or warnings detected by the routine:
On entry, | or , |
or | the number of data points with nonzero weight , |
or | , |
or | , |
or | , |
or | , where , and , |
or | . |
On entry, either all the , for , are equal, or all the , for , are equal.
The number of knots required is greater than allowed by
NXEST and
NYEST. Try increasing
NXEST and/or
NYEST and, if necessary, supplying larger arrays for the parameters
LAMDA,
MU,
C,
WRK and
IWRK. However, if
NXEST and
NYEST are already large, say
NXEST,
, then this error exit may indicate that
S is too small.
No more knots can be added because the number of B-spline coefficients
already exceeds the number of data points
M. This error exit may occur if either of
S or
M is too small.
No more knots can be added because the additional knot would (quasi) coincide with an old one. This error exit may occur if too large a weight has been given to an inaccurate data point, or if
S is too small.
-
The iterative process used to compute the coefficients of the approximating spline has failed to converge. This error exit may occur if
S has been set very small. If the error persists with increased
S, contact
NAG.
LWRK is too small; the routine needs to compute the minimal least squares solution of a rank-deficient system of linear equations, but there is not enough workspace. There is no approximation returned but, having saved the information contained in
NX,
LAMDA,
NY,
MU and
WRK, and having adjusted the value of
LWRK and the dimension of array
WRK accordingly, you can continue at the point the program was left by calling E02DDF with
. Note that the requested value for
LWRK is only large enough for the current phase of the algorithm. If the routine is restarted with
LWRK set to the minimum value requested, a larger request may be made at a later stage of the computation. See
Section 5 for the upper bound on
LWRK. On soft failure, the minimum requested value for
LWRK is returned in
and the safe value for
LWRK is returned in
.
If
,
,
or
, a spline approximation is returned, but it fails to satisfy the fitting criterion (see
(2) and
(3) in
Section 3 – perhaps only by a small amount, however.
7 Accuracy
On successful exit, the approximation returned is such that its weighted sum of squared residuals
FP is equal to the smoothing factor
, up to a specified relative tolerance of
– except that if
and
,
FP may be significantly less than
: in this case the computed spline is simply the least squares bicubic polynomial approximation of degree
, i.e., a spline with no interior knots.
The time taken for a call of E02DDF depends on the complexity of the shape of the data, the value of the smoothing factor , and the number of data points. If E02DDF is to be called for different values of , much time can be saved by setting after the first call.
It should be noted that choosing very small considerably increases computation time.
If the weights have been correctly chosen (see
Section 2.1.2 in the E02 Chapter Introduction), the standard deviation of
would be the same for all
, equal to
, say. In this case, choosing the smoothing factor
in the range
, as suggested by
Reinsch (1967), is likely to give a good start in the search for a satisfactory value. Otherwise, experimenting with different values of
will be required from the start.
In that case, in view of computation time and memory requirements, it is recommended to start with a very large value for
and so determine the least squares bicubic polynomial; the value returned for
FP, call it
, gives an upper bound for
. Then progressively decrease the value of
to obtain closer fits – say by a factor of
in the beginning, i.e.,
,
, and so on, and more carefully as the approximation shows more details.
To choose
very small is strongly discouraged. This considerably increases computation time and memory requirements. It may also cause rank-deficiency (as indicated by the parameter
RANK) and endanger numerical stability.
The number of knots of the spline returned, and their location, generally depend on the value of and on the behaviour of the function underlying the data. However, if E02DDF is called with , the knots returned may also depend on the smoothing factors of the previous calls. Therefore if, after a number of trials with different values of and , a fit can finally be accepted as satisfactory, it may be worthwhile to call E02DDF once more with the selected value for but now using . Often, E02DDF then returns an approximation with the same quality of fit but with fewer knots, which is therefore better if data reduction is also important.
The number of knots may also depend on the upper bounds
NXEST and
NYEST. Indeed, if at a certain stage in E02DDF the number of knots in one direction (say
) has reached the value of its upper bound (
NXEST), then from that moment on all subsequent knots are added in the other
direction. This may indicate that the value of
NXEST is too small. On the other hand, it gives you the option of limiting the number of knots the routine locates in any direction. For example, by setting
(the lowest allowable value for
NXEST), you can indicate that you want an approximation which is a simple cubic polynomial in the variable
.
The fit obtained is not defined outside the rectangle . The reason for taking the extreme data values of and for these four knots is that, as is usual in data fitting, the fit cannot be expected to give satisfactory values outside the data region. If, nevertheless, you require values over a larger rectangle, this can be achieved by augmenting the data with two artificial data points and with zero weight, where denotes the enlarged rectangle.
First suitable knot sets are built up in stages (starting with no interior knots in the case of a cold start but with the knot set found in a previous call if a warm start is chosen). At each stage, a bicubic spline is fitted to the data by least squares and
, the sum of squares of residuals, is computed. If
, a new knot is added to one knot set or the other so as to reduce
at the next stage. The new knot is located in an interval where the fit is particularly poor. Sooner or later, we find that
and at that point the knot sets are accepted. The routine then goes on to compute a spline which has these knot sets and which satisfies the full fitting criterion specified by
(2) and
(3). The theoretical solution has
. The routine computes the spline by an iterative scheme which is ended when
within a relative tolerance of
. The main part of each iteration consists of a linear least squares computation of special form, done in a similarly stable and efficient manner as in
E02DAF. As there also, the minimal least squares solution is computed wherever the linear system is found to be rank-deficient.
An exception occurs when the routine finds at the start that, even with no interior knots (), the least squares spline already has its sum of squares of residuals . In this case, since this spline (which is simply a bicubic polynomial) also has an optimal value for the smoothness measure , namely zero, it is returned at once as the (trivial) solution. It will usually mean that has been chosen too large.
For further details of the algorithm and its use see
Dierckx (1981b).
The values of the computed spline at the points
, for
, may be obtained in the real array
FF (see
E02DEF), of length at least
, by the following call:
IFAIL = 0
CALL E02DEF(N,NX,NY,X,Y,LAMDA,MU,C,FF,WRK,IWRK,IFAIL)
where
and the coordinates
,
are stored in
,
.
PX and
PY have the same values as
NX and
NY as output from E02DDF, and
LAMDA,
MU and
C have the same values as
LAMDA,
MU and
C output from E02DDF.
WRK is a real workspace array of length at least
, and
IWRK is an integer workspace array of length at least
.
To evaluate the computed spline on a
by
rectangular grid of points in the
-
plane, which is defined by the
coordinates stored in
, for
, and the
coordinates stored in
, for
, returning the results in the real array
FF (see
E02DFF) which is of length at least
, the following call may be used:
IFAIL = 0
CALL E02DFF(KX,KY,NX,NY,TX,TY,LAMDA,MU,C,FG,WRK,LWRK,
* IWRK,LIWRK,IFAIL)
where
,
.
NX,
NY,
LAMDA,
MU and
C have the same values as
NX,
NY,
LAMDA,
MU and
C output from E02DDF.
WRK is a real workspace array of length at least
, where
and
.
IWRK is an integer workspace array of length at least
if
, or
otherwise.
The result of the spline evaluated at grid point is returned in element of the array FG.
9 Example
This example reads in a value of
M, followed by a set of
M data points
and their weights
. It then calls E02DDF to compute a bicubic spline approximation for one specified value of
S, and prints the values of the computed knots and B-spline coefficients. Finally it evaluates the spline at a small sample of points on a rectangular grid.
9.1 Program Text
Program Text (e02ddfe.f90)
9.2 Program Data
Program Data (e02ddfe.d)
9.3 Program Results
Program Results (e02ddfe.r)