NAG Library Routine Document

-dimensional vectors. Note that upper and lower bounds are specified for all the variables. This form allows full generality in specifying various types of constraint. In particular, the

j

th variable may be fixed by setting

l_{j} = u_{j}

. If certain bounds are not present, the associated elements of

l_{x}

u_{x}

may be set to special values that are treated as

- \infty

+ \infty

. See the description of the optional parameter Infinite Bound Size which is common among all solvers in the suite. Its value is denoted as

bigbnd

further in this text. Note that the bounds are interpreted based on its value at the time of calling this routine and any later alterations to Infinite Bound Size will not affect these constraints.

See e04raf for more details.

4

References

Candes E and Recht B (2009) Exact matrix completion via convex optimization Foundations of Computation Mathematics (Volume 9) 717–772

5

Arguments

1: $handle$ – Type (c_ptr)Input

On entry: the handle to the problem. It needs to be initialized by e04raf and must not be changed.

2: $nvar$ – IntegerInput

On entry:

n

, the number of decision variables

x

in the problem. It must be unchanged from the value set during the initialization of the handle by e04raf.

3: $bl (nvar)$ – Real (Kind=nag_wp) arrayInput

4: $bu (nvar)$ – Real (Kind=nag_wp) arrayInput

On entry:

l_{x}

, bl and

u_{x}

, bu define lower and upper bounds on the variables, respectively. To fix the

j

th variable, set

bl (j) = bu (j) = β

, where

|β| < bigbnd

. To specify a nonexistent lower bound (i.e.,

l_{j} = - \infty

), set

bl (j) \leq - bigbnd

; to specify a nonexistent upper bound (i.e.,

u_{j} = \infty

), set

bu (j) \geq bigbnd

. Note that models with fixed variables are not allowed with solver e04svf in this release, however, the limitation will be removed in a future release.

Constraints:

$bl (j) \leq bu (j)$ , for $j = 1, 2, \dots, nvar$ ;
$bl (j) < bigbnd$ , for $j = 1, 2, \dots, nvar$ ;
$bu (j) > - bigbnd$ , for $j = 1, 2, \dots, nvar$ .

5: $ifail$ – IntegerInput/Output

On entry: ifail must be set to

0

- 1 or 1

. If you are unfamiliar with this argument you should refer to Section 3.4 in How to Use the NAG Library and its Documentation for details.

For environments where it might be inappropriate to halt program execution when an error is detected, the value

- 1 or 1

is recommended. If the output of error messages is undesirable, then the value

1

is recommended. Otherwise, the recommended value is

- 1

. When the value $- 1 or 1$ is used it is essential to test the value of ifail on exit.

On exit:

ifail = 0

unless the routine detects an error or a warning has been flagged (see Section 6).

6

Error Indicators and Warnings

If on entry

ifail = 0

- 1

, explanatory error messages are output on the current error message unit (as defined by x04aaf).

Errors or warnings detected by the routine:

$ifail = 1$: The supplied handle does not define a valid handle to the data structure for the NAG optimization modelling suite. It has not been initialized by e04raf or it has been corrupted.

$ifail = 2$: The problem cannot be modified in this phase any more, the solver has already been called.

$ifail = 3$: Variable bounds have already been defined.

$ifail = 4$: On entry, $nvar = 〈value〉$ , expected $value = 〈value〉$ .
Constraint: nvar must match the value given during initialization of handle.

$ifail = 10$: On entry, $j = 〈value〉$ , $bl (j) = 〈value〉$ , $bigbnd = 〈value〉$ .
Constraint: $bl (j) < bigbnd$ .

On entry, $j = 〈value〉$ , $bl (j) = 〈value〉$ and $bu (j) = 〈value〉$ .
Constraint: $bl (j) \leq bu (j)$ .

On entry, $j = 〈value〉$ , $bu (j) = 〈value〉$ , $bigbnd = 〈value〉$ .
Constraint: $bu (j) > - bigbnd$ .

$ifail = - 99$: An unexpected error has been triggered by this routine. Please contact NAG.
See Section 3.9 in How to Use the NAG Library and its Documentation for further information.

$ifail = - 399$: Your licence key may have expired or may not have been installed correctly.
See Section 3.8 in How to Use the NAG Library and its Documentation for further information.

$ifail = - 999$: Dynamic memory allocation failed.
See Section 3.7 in How to Use the NAG Library and its Documentation for further information.

7

Accuracy

Not applicable.

8

Parallelism and Performance

e04rhf is not threaded in any implementation.

9

Further Comments

9.1

Internal Changes

Internal changes have been made to this routine as follows:

At Mark 26.1: The limitation to specifying model fixed variables ( $bl (j) = bu (j)$ for some $j$ ) where such input returns $ifail = 10$ has been lifted. The only solver which cannot handle fixed variables (e04svf) will report an error on such a model directly.

For details of all known issues which have been reported for the NAG Library please refer to the Known Issues list.

10

Example

There is a vast number of problems which can be reformulated as SDP. This example follows Candes and Recht (2009) to show how a rank minimization problem can be approximated by SDP. In addition, it demonstrates how to work with the monitor mode of e04svf.

The problem can be stated as follows: Let's have

m

respondents answering

k

questions where they express their preferences as a number between

0

and

1

or the question can be left unanswered. The task is to fill in the missing entries, i.e., to guess the unexpressed preferences. This problem falls into the category of matrix completion. The idea is to choose the missing entries to minimize the rank of the matrix as it is commonly believed that only a few factors contribute to an individual's tastes or preferences.

Rank minimization is in general NP-hard but it can be approximated by a heuristic, minimizing the nuclear norm of the matrix. The nuclear norm of a matrix is the sum of its singular values. A rank deficient matrix must have (several) zero singular values. Given the fact that the singular values are always non-negative, a minimization of the nuclear norm has the same effect as

ℓ_{1}

norm in compress sensing, i.e., it encourages many singular values to be zero and thus it can be considered as a heuristic for the original rank minimization problem.

Let

\hat{Y}

denote the partially filled in

m \times k

matrix with the valid responses on

(i, j) \in Ω

positions. We are looking for

Y

of the same size so that the valid responses are unchanged and the nuclear norm (denoted here as

{‖\cdot‖}_{*}

) is minimal.

\begin{matrix} \underset{Y}{minimize} & {‖Y‖}_{*} \\ subject to & Y_{i j} = {\hat{Y}}_{i j} for all (i, j) \in Ω . \end{matrix}

This is equivalent to

\begin{matrix} \underset{W_{1}, W_{2}, Y}{minimize} & trace (W_{1}) + trace (W_{2}) \\ subject to & Y_{i j} = {\hat{Y}}_{i j} for all (i, j) \in Ω \\ (\begin{matrix} W_{1} & Y \\ Y^{T} & W_{2} \end{matrix}) ⪰ 0 \end{matrix}

which is the linear semidefinite problem solved in this example, see Candes and Recht (2009) and the references therein for details.

This example has

m = 15

respondents and

k = 6

answers. The obtained answers are

\hat{Y} = (\begin{matrix} * & * & * & * & * & 0.4 \\ 0.6 & 0.4 & 0.8 & * & * & * \\ * & * & 0.8 & * & 0.2 & * \\ 0.8 & 0.2 & * & * & * & * \\ * & 0.4 & * & 0.0 & * & 0.2 \\ 0.4 & * & * & 0.2 & * & 0.2 \\ * & 0.8 & 0.2 & 0.6 & * & * \\ * & * & 0.2 & * & * & * \\ * & 0.4 & * & 0.6 & 0.0 & * \\ * & * & 0.4 & * & * & * \\ * & * & 0.2 & 0.2 & 0.4 & 0.4 \\ * & * & * & * & 1.0 & 0.8 \\ 1.0 & * & 0.2 & * & * & 0.6 \\ * & * & * & * & * & 0.2 \\ 0.6 & * & 0.2 & 0.4 & * & * \end{matrix})

where

*

denotes missing entries (

- 1.0

is used instead in the data file). The obtained matrix has rank

4

and it is shown below printed to

1

-digit accuracy:

Y = (\begin{matrix} 0.5 & 0.3 & 0.2 & 0.2 & 0.4 & 0.4 \\ 0.6 & 0.4 & 0.8 & 0.2 & 0.3 & 0.4 \\ 0.4 & 0.3 & 0.8 & 0.0 & 0.2 & 0.2 \\ 0.8 & 0.2 & 0.3 & 0.4 & 0.3 & 0.4 \\ 0.0 & 0.4 & 0.2 & 0.0 & 0.2 & 0.2 \\ 0.4 & 0.1 & 0.2 & 0.2 & 0.1 & 0.2 \\ 0.6 & 0.8 & 0.2 & 0.6 & 0.2 & 0.4 \\ 0.1 & 0.1 & 0.2 & 0.0 & 0.0 & 0.1 \\ 0.6 & 0.4 & 0.1 & 0.6 & 0.0 & 0.3 \\ 0.2 & 0.1 & 0.4 & 0.0 & 0.1 & 0.1 \\ 0.5 & 0.3 & 0.2 & 0.2 & 0.4 & 0.4 \\ 0.7 & 0.4 & 0.3 & 0.0 & 1.0 & 0.8 \\ 1.0 & 0.3 & 0.2 & 0.5 & 0.5 & 0.6 \\ 0.2 & 0.1 & 0.1 & 0.1 & 0.2 & 0.2 \\ 0.6 & 0.3 & 0.2 & 0.4 & 0.2 & 0.3 \end{matrix}) .

The example also turns on monitor mode of e04svf, there is a time limit introduced for the solver which is being checked at the end of every outer iteration. If the time limit is reached, the routine is stopped by setting

inform = 0

within the monitor step.

See also Section 10 in e04raf for links to further examples in the suite.

NAG Library Routine Document

e04rhf (handle_set_simplebounds)

▸▿ Contents

1 Purpose

2 Specification

3 Description

4 References

5 Arguments

6 Error Indicators and Warnings

7 Accuracy

8 Parallelism and Performance

9 Further Comments

9.1 Internal Changes

10 Example

10.1 Program Text

10.2 Program Data

10.3 Program Results

1

Purpose

2

Specification

3

Description