For each option, we give a summary line, a description of the optional parameter and details of constraints.
The summary line contains:
- the keywords, where the minimum abbreviation of each keyword is underlined (if no characters of an optional qualifier are underlined, the qualifier may be omitted);
- a parameter value,
where the letters , denote options that take character, integer and real values respectively;
- the default value, where the symbol is a generic notation for machine precision (see x02aj), and denotes the relative precision of the objective function Function Precision, and signifies the value of Infinite Bound Size.
Keywords and character values are case and white space insensitive.
Central Difference Interval | | |
If the algorithm switches to central differences because the forward-difference approximation is not sufficiently accurate, the value of
is used as the difference interval for every element of
. The switch to central differences is indicated by
C at the end of each line of intermediate printout produced by the major iterations (see
[Description of the Printed Output]). The use of finite differences is discussed further under the optional parameter
Difference Interval.
If you supply a value for this optional parameter, a small value between and is appropriate.
This option controls the specification of the initial working set in both the procedure for finding a feasible point for the linear constraints and bounds and in the first QP subproblem thereafter. With a
Cold Start, the first working set is chosen by
e04uc based on the values of the variables and constraints at the initial point. Broadly speaking, the initial working set will include equality constraints and bounds or inequality constraints that violate or ‘nearly’ satisfy their bounds (to within
Crash Tolerance).
With a
Warm Start, you must set the
istate array and define
clamda and
r as discussed in
[Parameters].
istate values associated with bounds and linear constraints determine the initial working set of the procedure to find a feasible point with respect to the bounds and linear constraints.
istate values associated with nonlinear constraints determine the initial working set of the first QP subproblem after such a feasible point has been found.
e04uc will override your specification of
istate if necessary, so that a poor choice of the working set will not cause a fatal error. For instance, any elements of
istate which are set to
,
will be reset to zero, as will any elements which are set to
when the corresponding elements of
bl and
bu are not equal. A warm start will be advantageous if a good estimate of the initial working set is available – for example, when
e04uc is called repeatedly to solve related problems.
This value is used in conjunction with the optional parameter
Cold Start (the default value) when
e04uc selects an initial working set. If
, the initial working set will include (if possible) bounds or general inequality constraints that lie within
of their bounds. In particular, a constraint of the form
will be included in the initial working set if
. If
or
, the default value is used.
This special keyword may be used to reset all optional parameters to their default values.
This parameter indicates which derivatives are provided in user-supplied delegates
objfun and
confun. The possible choices for
are the following.
| Meaning |
3 | All elements of the objective gradient and the constraint Jacobian are provided. |
2 | All elements of the constraint Jacobian are provided, but some elements of the objective gradient are not specified. |
1 | All elements of the objective gradient are provided, but some elements of the constraint Jacobian are not specified. |
0 | Some elements of both the objective gradient and the constraint Jacobian are not specified. |
The value
should be used whenever possible, since
e04uc is more reliable (and will usually be more efficient) when all derivatives are exact.
If
,
e04uc will estimate the unspecified elements of the objective gradient, using finite differences. The computation of finite difference approximations usually increases the total run-time, since a call to
objfun is required for each unspecified element. Furthermore, less accuracy can be attained in the solution (see Chapter 8 of
Gill et al. (1981), for a discussion of limiting accuracy).
If
,
e04uc will approximate unspecified elements of the constraint Jacobian. One call to
confun is needed for each variable for which partial derivatives are not available. For example, if the Jacobian has the form
where ‘
’ indicates an element provided by you and ‘?’ indicates an unspecified element,
e04uc will call
confun twice: once to estimate the missing element in column 2, and again to estimate the two missing elements in column
. (Since columns
and
are known, they require no calls to
confun.)
At times, central differences are used rather than forward differences, in which case twice as many calls to
objfun and
confun are needed. (The switch to central differences is not under your control.)
If or , the default value is used.
This option defines an interval used to estimate derivatives by finite differences in the following circumstances:
(a) |
For verifying the objective and/or constraint gradients (see the description of the optional parameter Verify). |
(b) |
For estimating unspecified elements of the objective gradient or the constraint Jacobian. |
In general, a derivative with respect to the
th variable is approximated using the interval
, where
, with
the first point feasible with respect to the bounds and linear constraints. If the functions are well scaled, the resulting derivative approximation should be accurate to
. See
Gill et al. (1981) for a discussion of the accuracy in finite difference approximations.
If a difference interval is not specified by you, a finite difference interval will be computed automatically for each variable by a procedure that requires up to six calls of
confun and
objfun for each element. This option is recommended if the function is badly scaled or you wish to have
e04uc determine constant elements in the objective and constraint gradients (see the descriptions of
confun and
objfun in
[Parameters]).
If you supply a value for this optional parameter, a small value between and is appropriate.
The scalar
defines the maximum acceptable
absolute violations in linear and nonlinear constraints at a ‘feasible’ point; i.e., a constraint is considered satisfied if its violation does not exceed
. If
or
, the default value is used. Using this keyword sets both optional parameters
Linear Feasibility Tolerance and
Nonlinear Feasibility Tolerance to
, if
. (Additional details are given under the descriptions of these optional parameters.)
This parameter defines , which is intended to be a measure of the accuracy with which the problem functions and can be computed. If or , the default value is used.
The value of
should reflect the relative precision of
; i.e.,
acts as a relative precision when
is large and as an absolute precision when
is small. For example, if
is typically of order
and the first six significant digits are known to be correct, an appropriate value for
would be
. In contrast, if
is typically of order
and the first six significant digits are known to be correct, an appropriate value for
would be
. The choice of
can be quite complicated for badly scaled problems; see Chapter 8 of
Gill et al. (1981) for a discussion of scaling techniques. The default value is appropriate for most simple functions that are computed with full accuracy. However, when the accuracy of the computed function values is known to be significantly worse than full precision, the value of
should be large enough so that
e04uc will not attempt to distinguish between function values that differ by less than the error inherent in the calculation.
This option controls the contents of the upper triangular matrix
(see
[Parameters]).
e04uc works exclusively with the
transformed and reordered Hessian
(6), and hence extra computation is required to form the Hessian itself. If
,
r contains the Cholesky factor of the transformed and reordered Hessian. If
, the Cholesky factor of the approximate Hessian itself is formed and stored in
r. You should select
if a
Warm Start will be used for the next call to
e04uc.
If , defines the ‘infinite’ bound in the definition of the problem constraints. Any upper bound greater than or equal to will be regarded as (and similarly any lower bound less than or equal to will be regarded as ). If , the default value is used.
If , specifies the magnitude of the change in variables that is treated as a step to an unbounded solution. If the change in during an iteration would exceed the value of , the objective function is considered to be unbounded below in the feasible region. If , the default value is used.
The value () controls the accuracy with which the step taken during each iteration approximates a minimum of the merit function along the search direction (the smaller the value of , the more accurate the linesearch). The default value requests an inaccurate search and is appropriate for most problems, particularly those with any nonlinear constraints.
If there are no nonlinear constraints, a more accurate search may be appropriate when it is desirable to reduce the number of major iterations – for example, if the objective function is cheap to evaluate, or if a substantial number of derivatives are unspecified. If or , the default value is used.
Linear Feasibility Tolerance | | |
Nonlinear Feasibility Tolerance | | |
The default value of is if or , and otherwise.
The scalars and define the maximum acceptable absolute violations in linear and nonlinear constraints at a ‘feasible’ point; i.e., a linear constraint is considered satisfied if its violation does not exceed , and similarly for a nonlinear constraint and . If or , the default value is used, for .
On entry to
e04uc, an iterative procedure is executed in order to find a point that satisfies the linear constraints and bounds on the variables to within the tolerance
. All subsequent iterates will satisfy the linear constraints to within the same tolerance (unless
is comparable to the finite difference interval).
For nonlinear constraints, the feasibility tolerance
defines the largest constraint violation that is acceptable at an optimal point. Since nonlinear constraints are generally not satisfied until the final iterate, the value of optional parameter
Nonlinear Feasibility Tolerance acts as a partial termination criterion for the iterative sequence generated by
e04uc (see the discussion of optional parameter
Optimality Tolerance).
These tolerances should reflect the precision of the corresponding constraints. For example, if the variables and the coefficients in the linear constraints are of order unity, and the latter are correct to about decimal digits, it would be appropriate to specify as .
For
e04uc, normally each optional parameter specification is printed as it is supplied. Optional parameter
Nolist may be used to suppress the printing and optional parameter
List may be used to turn on printing.
The value of specifies the maximum number of major iterations allowed before termination. Setting and means that the workspace needed will be computed and printed, but no iterations will be performed. If , the default value is used.
The value of
controls the amount of printout produced by the major iterations of
e04uc, as indicated below. A detailed description of the printed output is given in
[Description of the Printed Output] (summary output at each major iteration and the final solution) and
[Description of Monitoring Information] (monitoring information at each major iteration). (See also the description of the optional parameter
Minor Print Level.)
The following printout is sent to the current advisory message unit (as defined by
(X04ABF not in this release)):
For the other values described below, the parameters used by E04UCF/ E04UCA are displayed in addition to intermediate and final output.
| Output |
| The final solution only. |
| One line of summary output ( characters; see [Description of the Printed Output]) for each major iteration (no printout of the final solution). |
| The final solution and one line of summary output for each major iteration. |
The following printout is sent to the logical unit number defined by the optional parameter
Monitoring File:
| Output |
| No output. |
| One long line of output ( characters; see [Description of Monitoring Information]) for each major iteration (no printout of the final solution). |
| At each major iteration, the objective function, the Euclidean norm of the nonlinear constraint violations, the values of the nonlinear constraints (the vector ), the values of the linear constraints (the vector ), and the current values of the variables (the vector ). |
| At each major iteration, the diagonal elements of the matrix associated with the factorization (5) (see [Overview]) of the QP working set, and the diagonal elements of , the triangular factor of the transformed and reordered Hessian (6) (see [Overview]). |
If
and the unit number defined by the optional parameter
Monitoring File is the same as that defined by
(X04ABF not in this release), then the summary output for each major iteration is suppressed.
The value of specifies the maximum number of iterations for finding a feasible point with respect to the bounds and linear constraints (if any). The value of also specifies the maximum number of minor iterations for the optimality phase of each QP subproblem. If , the default value is used.
The value of
controls the amount of printout produced by the minor iterations of
e04uc (i.e., the iterations of the quadratic programming algorithm), as indicated below. A detailed description of the printed output is given in
[Description of the Printed Output] (summary output at each minor iteration and the final QP solution) and
[Description of Monitoring Information] in
e04nc (monitoring information at each minor iteration). (See also the description of the optional parameter
Major Print Level.) The following printout is sent to the current advisory message unit (as defined by
(X04ABF not in this release)):
| Output |
| No output. |
| The final QP solution only. |
| One line of summary output ( characters; see [Description of the Printed Output] in e04nc) for each minor iteration (no printout of the final QP solution). |
| The final QP solution and one line of summary output for each minor iteration. |
The following printout is sent to the logical unit number defined by the optional parameter
Monitoring File:
| Output |
| No output. |
| One long line of output ( characters; see [Description of the Printed Output] in e04nc) for each minor iteration (no printout of the final QP solution). |
| At each minor iteration, the current estimates of the QP multipliers, the current estimate of the QP search direction, the QP constraint values, and the status of each QP constraint. |
| At each minor iteration, the diagonal elements of the matrix associated with the factorization (5) (see [Overview]) of the QP working set, and the diagonal elements of the Cholesky factor of the transformed Hessian (6) (see [Overview]). |
If
and the unit number defined by the optional parameter
Monitoring File is the same as that defined by
(X04ABF not in this release), then the summary output for each minor iteration is suppressed.
If
and
or
and
, monitoring information produced by
e04uc at every iteration is sent to a file with logical unit number
. If
and/or
and
, no monitoring information is produced.
The parameter
(
) specifies the accuracy to which you wish the final iterate to approximate a solution of the problem. Broadly speaking,
indicates the number of correct figures desired in the objective function at the solution. For example, if
is
and
e04uc terminates successfully, the final value of
should have approximately six correct figures. If
or
, the default value is used.
e04uc will terminate successfully if the iterative sequence of
values is judged to have converged and the final point satisfies the first-order Kuhn–Tucker conditions (see
[Overview]). The sequence of iterates is considered to have converged at
if
where
is the search direction and
the step length from (3). An iterate is considered to satisfy the first-order conditions for a minimum if
and
where
is the projected gradient (see
[Overview]),
is the gradient of
with respect to the free variables,
is the violation of the
th active nonlinear constraint, and
is the
Nonlinear Feasibility Tolerance.
Start Objective Check At Variable | | |
Stop Objective Check At Variable | | |
Start Constraint Check At Variable | | |
Stop Constraint Check At Variable | | |
These keywords take effect only if
. They may be used to control the verification of gradient elements computed by
objfun and/or Jacobian elements computed by
confun. For example, if the first
elements of the objective gradient appeared to be correct in an earlier run, so that only element
remains questionable, it is reasonable to specify
. If the first
variables appear linearly in the objective, so that the corresponding gradient elements are constant, the above choice would also be appropriate.
If or , the default value is used, for . If or , the default value is used, for .
If
specifies the maximum change in variables at the first step of the linesearch. In some cases, such as
or
, even a moderate change in the elements of
can lead to floating-point overflow. The parameter
is therefore used to encourage evaluation of the problem functions at meaningful points. Given any major iterate
, the first point
at which
and
are evaluated during the linesearch is restricted so that
The linesearch may go on and evaluate
and
at points further from
if this will result in a lower value of the merit function (indicated by
L at the end of each line of output produced by the major iterations; see
[Description of the Printed Output]). If
L is printed for most of the iterations,
should be set to a larger value.
Wherever possible, upper and lower bounds on
should be used to prevent evaluation of nonlinear functions at wild values. The default value
should not affect progress on well-behaved functions, but values such as
may be helpful when rapidly varying functions are present. If a small value of
Step Limit is selected, a good starting point may be required. An important application is to the class of nonlinear least squares problems. If
, the default value is used.
Verify Constraint Gradients | | |
Verify Objective Gradients | | |
These keywords refer to finite difference checks on the gradient elements computed by
objfun and
confun. The possible choices for
are as follows:
| Meaning |
| No checks are performed. |
| Only a ‘cheap’ test will be performed. |
| Individual gradient elements will also be checked using a reliable (but more expensive) test. |
It is possible to specify
to
in several ways. For example, the nonlinear objective gradient (if any) will be verified if either
Verify Objective Gradients or
is specified. The constraint gradients will be verified if
or
or
Verify is specified. Similarly, the objective and the constraint gradients will be verified if
or
or
Verify is specified.
If , gradients will be verified at the first point that satisfies the linear constraints and bounds.
If
, only a ‘cheap’ test will be performed, requiring one call to
objfun and (if appropriate) one call to
confun.
If
, a more reliable (but more expensive) check will be made on individual gradient elements, within the ranges specified by the
Start Constraint Check At Variable and
Stop Constraint Check At Variable keywords. A result of the form
OK or
BAD? is printed by
e04uc to indicate whether or not each element appears to be correct.
If , the action is the same as for , except that it will take place at the user-specified initial value of .
If or or , the default value is used.
We suggest that be used whenever a new function method is being developed.