PDF version (NAG web site
, 64-bit version, 64-bit version)
NAG Toolbox: nag_fit_glin_linf (e02gc)
Purpose
nag_fit_glin_linf (e02gc) calculates an solution to an over-determined system of linear equations.
Syntax
[
a,
b,
relerr,
x,
resmax,
irank,
iter,
ifail] = e02gc(
n,
a,
b,
relerr, 'm',
m, 'tol',
tol)
[
a,
b,
relerr,
x,
resmax,
irank,
iter,
ifail] = nag_fit_glin_linf(
n,
a,
b,
relerr, 'm',
m, 'tol',
tol)
Description
Given a matrix
with
rows and
columns
and a vector
with
elements, the function calculates an
solution to the over-determined system of equations
That is to say, it calculates a vector
, with
elements, which minimizes the
norm of the residuals (the absolutely largest residual)
where the residuals
are given by
Here is the element in row and column of , is the th element of and the th element of . The matrix need not be of full rank. The solution is not unique in this case, and may not be unique even if is of full rank.
Alternatively, in applications where a complete minimization of the
norm is not necessary, you may obtain an approximate solution, usually in shorter time, by giving an appropriate value to the argument
relerr.
Typically in applications to data fitting, data consisting of
points with coordinates
is to be approximated in the
norm by a linear combination of known functions
,
This is equivalent to finding an
solution to the over-determined system of equations
Thus if, for each value of and the element of the matrix above is set equal to the value of and is set equal to , the solution vector will contain the required values of the . Note that the independent variable above can, instead, be a vector of several independent variables (this includes the case where each is a function of a different variable, or set of variables).
The algorithm is a modification of the simplex method of linear programming applied to the dual formation of the
problem (see
Barrodale and Phillips (1974) and
Barrodale and Phillips (1975)). The modifications are designed to improve the efficiency and stability of the simplex method for this particular application.
References
Barrodale I and Phillips C (1974) An improved algorithm for discrete Chebyshev linear approximation Proc. 4th Manitoba Conf. Numerical Mathematics 177–190 University of Manitoba, Canada
Barrodale I and Phillips C (1975) Solution of an overdetermined system of linear equations in the Chebyshev norm [F4] (Algorithm 495) ACM Trans. Math. Software 1(3) 264–270
Parameters
Compulsory Input Parameters
- 1:
– int64int32nag_int scalar
-
The number of unknowns, (the number of columns of the matrix ).
Constraint:
.
- 2:
– double array
-
lda, the first dimension of the array, must satisfy the constraint
.
must contain
, the element in the
th row and
th column of the matrix
, for
and
, (that is, the
transpose of the matrix). The remaining elements need not be set. Preferably, the columns of the matrix
(rows of the argument
a) should be scaled before entry: see
Accuracy.
- 3:
– double array
-
must contain , the th element of the vector , for .
- 4:
– double scalar
-
Must be set to a bound on the relative error acceptable in the maximum residual at the solution.
If
, then the
solution is computed, and
relerr is set to
on exit.
If
, then the function obtains instead an approximate solution for which the largest residual is less than
times that of the
solution; on exit,
relerr contains a smaller value such that the above bound still applies. (The usual result of this option, say with
, is a saving in the number of simplex iterations).
Optional Input Parameters
- 1:
– int64int32nag_int scalar
-
Default:
the dimension of the array
b.
The number of equations, (the number of rows of the matrix ).
Constraint:
.
- 2:
– double scalar
Default:
.
A threshold below which numbers are regarded as zero. The recommended threshold value is
, where
is the
machine precision. If
on entry, the recommended value is used within the function. If premature termination occurs, a larger value for
tol may result in a valid solution.
Output Parameters
- 1:
– double array
-
.
.
Contains the last simplex tableau.
- 2:
– double array
-
The
th residual
corresponding to the solution vector
, for
. Note however that these residuals may contain few significant figures, especially when
resmax is within one or two orders of magnitude of
tol. Indeed if
, the elements
may all be set to zero. It is therefore often advisable to compute the residuals directly.
- 3:
– double scalar
-
Is altered as described above.
- 4:
– double array
-
If
or
,
contains the
th element of the solution vector
, for
. Whether this is an
solution or an approximation to one, depends on the value of
relerr on entry.
- 5:
– double scalar
-
If
or
,
resmax contains the absolute value of the largest residual(s) for the solution vector
. (See
b.)
- 6:
– int64int32nag_int scalar
-
If
or
,
irank contains the computed rank of the matrix
.
- 7:
– int64int32nag_int scalar
-
If
or
,
iter contains the number of iterations taken by the simplex method.
- 8:
– int64int32nag_int scalar
unless the function detects an error (see
Error Indicators and Warnings).
Error Indicators and Warnings
Note: nag_fit_glin_linf (e02gc) may return useful information for one or more of the following detected errors or warnings.
Errors or warnings detected by the function:
Cases prefixed with W are classified as warnings and
do not generate an error of type NAG:error_n. See nag_issue_warnings.
- W
-
An optimal solution has been obtained but this may not be unique (perhaps simply because the matrix is not of full rank, i.e., ).
-
-
The calculations have terminated prematurely due to rounding errors. Experiment with larger values of
tol or try rescaling the columns of the matrix (see
Further Comments).
-
-
On entry, | , |
or | , |
or | , |
or | . |
-
An unexpected error has been triggered by this routine. Please
contact
NAG.
-
Your licence key may have expired or may not have been installed correctly.
-
Dynamic memory allocation failed.
Accuracy
Experience suggests that the computational accuracy of the solution is comparable with the accuracy that could be obtained by applying Gaussian elimination with partial pivoting to the equations which have residuals of largest absolute value. The accuracy therefore varies with the conditioning of the problem, but has been found generally very satisfactory in practice.
Further Comments
The effects of and on the time and on the number of iterations in the simplex method vary from problem to problem, but typically the number of iterations is a small multiple of and the total time is approximately proportional to .
It is recommended that, before the function is entered, the columns of the matrix
are scaled so that the largest element in each column is of the order of unity. This should improve the conditioning of the matrix, and also enable the argument
tol to perform its correct function. The solution
obtained will then, of course, relate to the scaled form of the matrix. Thus if the scaling is such that, for each
, the elements of the
th column are multiplied by the constant
, the element
of the solution vector
must be multiplied by
if it is desired to recover the solution corresponding to the original matrix
.
Example
This example approximates a set of data by a curve of the form
where
,
and
are unknown. Given values
at
points
we may form the over-determined set of equations for
,
and
nag_fit_glin_linf (e02gc) is used to solve these in the sense.
Open in the MATLAB editor:
e02gc_example
function e02gc_example
fprintf('e02gc example results\n\n');
n = int64(3);
a = zeros(6, 6);
for i = 1:5
a(1, i) = exp((i-1)/5);
a(2, i) = exp(-(i-1)/5);
a(3, i) = 1;
end
b = [4.501; 4.36; 4.333; 4.418; 4.625];
relerr = 0;
[a, b, relerr, x, resmax, irank, iter, ifail] = ...
e02gc(n, a, b, relerr);
fprintf('Resmax = %8.4f Rank = %5d Iterations = %5d\n\n', ...
resmax, irank, iter);
disp('Solution:');
disp(x(1:irank)');
e02gc example results
Resmax = 0.0010 Rank = 3 Iterations = 4
Solution:
1.0049 2.0149 1.4822
PDF version (NAG web site
, 64-bit version, 64-bit version)
© The Numerical Algorithms Group Ltd, Oxford, UK. 2009–2015