naginterfaces.library.opt.miqp_mps_read¶
- naginterfaces.library.opt.miqp_mps_read(infile, maxn, maxm, maxnnz, maxncolh, maxnnzh, maxlintvar, pnames, mpslst=0, io_manager=None)[source]¶
miqp_mps_read
reads data for sparse linear programming, mixed integer linear programming, quadratic programming or mixed integer quadratic programming problems from an external file which is in standard or compatible MPS input format.For full information please refer to the NAG Library document for e04mx
https://support.nag.com/numeric/nl/nagdoc_30.3/flhtml/e04/e04mxf.html
- Parameters
- infileint
The ID of the MPSX data file to be read as returned by a call to the
FileObjManager
methodunit_from_fileobj()
.- maxnint
An upper limit for the number of variables in the problem.
If ,
miqp_mps_read
will start in query mode (see Query Mode).- maxmint
An upper limit for the number of general linear constraints (including the objective row) in the problem.
If ,
miqp_mps_read
will start in query mode (see Query Mode).- maxnnzint
An upper limit for the number of nonzeros (including the objective row) in the problem.
If ,
miqp_mps_read
will start in query mode (see Query Mode).- maxncolhint
An upper limit for the dimension of the matrix .
If ,
miqp_mps_read
will start in query mode (see Query Mode).- maxnnzhint
An upper limit for the number of nonzeros of the matrix .
If ,
miqp_mps_read
will start in query mode (see Query Mode).- maxlintvarint
If , an upper limit for the number of integer variables.
If ,
miqp_mps_read
will treat all integer variables in the file as continuous variables.- pnamesstr, length 8, array-like, shape
A set of names associated with the MPSX form of the problem.
Must either contain the name of the problem or be blank.
Must either be blank or contain the name of the objective row (in which case it overrides OBJNAME section and the default choice of the first objective free row).
Must either contain the name of the RHS set to be used or be blank (in which case the first RHS set is used).
Must either contain the name of the RANGE set to be used or be blank (in which case the first RANGE set (if any) is used).
Must either contain the name of the BOUNDS set to be used or be blank (in which case the first BOUNDS set (if any) is used).
- mpslstint, optional
If , summary messages are sent to the file object associated with the advisory I/O unit (see
FileObjManager
) asmiqp_mps_read
reads through the data file. This can be useful for debugging the file. If , then no summary is produced.- io_managerFileObjManager, optional
Manager for I/O in this routine.
- Returns
- nint
If
miqp_mps_read
was run in query mode (see Query Mode), or returned with = 2, an upper estimate of the number of variables of the problem. Otherwise, , the actual number of variables in the problem.- mint
If
miqp_mps_read
was run in query mode (see Query Mode), or returned with = 2, an upper estimate of the number of general linear constraints in the problem (including the objective row). Otherwise, , the actual number of general linear constraints of the problem.- nnzint
If
miqp_mps_read
was run in query mode (see Query Mode), or returned with = 2, an upper estimate of the number of nonzeros in the problem (including the objective row). Otherwise, the actual number of nonzeros in the problem (including the objective row).- ncolhint
If
miqp_mps_read
was run in query mode (see Query Mode), or returned with = 2, an upper estimate of the value of required byqpconvex1_sparse_solve()
andqpconvex2_sparse_solve()
. In this context is the number of leading nonzero columns of the Hessian matrix . Otherwise, the actual dimension of the matrix .- nnzhint
If
miqp_mps_read
was run in query mode (see Query Mode), or returned with = 2, an upper estimate of the number of nonzeros of the matrix . Otherwise, the actual number of nonzeros of the matrix .- lintvarint
If on entry , all integer variables are treated as continuous and .
If
miqp_mps_read
was run in query mode (see Query Mode), or returned with = 2, an upper estimate of the number of integer variables of the problem.Otherwise, the actual number of integer variables of the problem.
- iobjint
If , row of is a free row containing the nonzero coefficients of the vector .
If , the coefficients of are assumed to be zero.
If
miqp_mps_read
is run in query mode (see Query Mode) is not referenced.- afloat, ndarray, shape
The nonzero elements of , ordered by increasing column index.
If
miqp_mps_read
is run in query mode (see Query Mode), is not referenced.- irowaint, ndarray, shape
The row indices of the nonzero elements stored in .
If
miqp_mps_read
is run in query mode (see Query Mode), is not referenced.- iccolaint, ndarray, shape
A set of pointers to the beginning of each column of . More precisely, contains the index in of the start of the th column, for . Note that and .
If
miqp_mps_read
is run in query mode (see Query Mode), is not referenced.- blfloat, ndarray, shape
contains the vector (the lower bounds) for all the variables and constraints
- bufloat, ndarray, shape
contains the vector (the upper bounds) for all the variables and constraints
- pnamesstr, length 8, ndarray, shape
A set of names associated with the problem as defined in the MPSX data file as follows:
Contains the name of the problem (or blank if none).
Contains the name of the objective row (or blank if none).
Contains the name of the RHS set (or blank if none).
Contains the name of the RANGE set (or blank if none).
Contains the name of the BOUNDS set (or blank if none).
If
miqp_mps_read
is run in query mode (see Query Mode), is not referenced.- nnameint
, the total number of variables and constraints in the problem (including the objective row).
If
miqp_mps_read
was run in query mode (see Query Mode), or returned with = 2, is not set.- crnamestr, length 8, ndarray, shape
The MPS names of all the variables and constraints in the problem in the following order. The first elements contain the MPS names for the variables and the next elements contain the MPS names for the objective row and general linear constraints (if any). Note that the MPS name for the objective row is stored in .
If
miqp_mps_read
is run in query mode (see Query Mode), is not referenced.- hfloat, ndarray, shape
The nonzero elements of , arranged by increasing column index.
If
miqp_mps_read
is run in query mode (see Query Mode), is not referenced.- irowhint, ndarray, shape
The row indices of the elements stored in .
If
miqp_mps_read
is run in query mode (see Query Mode), is not referenced.- iccolhint, ndarray, shape
A set of pointers to the beginning of each column of . More precisely, contains the index in of the start of the th column, for . Note that and .
If
miqp_mps_read
is run in query mode (see Query Mode), is not referenced.- minmaxint
defines the direction of the optimization as read from the MPS file. By default the function assumes the objective function should be minimized and will return . If the function discovers in the OBJSENSE section that the objective function should be maximized it will return . If the function discovers that there is neither the linear objective term (the objective row) nor the Hessian matrix , the problem is considered as a feasible point problem and is returned.
If
miqp_mps_read
was run in query mode (see Query Mode), or returned with = 2, is not set.- intvarint, ndarray, shape
If on entry, contains pointers to the columns that are defined as integer variables. More precisely, , where is the index of a column that is defined as an integer variable, for .
If on entry, or
miqp_mps_read
was run in query mode (see Query Mode), or it returned with = 2, is not set.
- Raises
- NagValueError
- (errno )
Line : Incorrect ordering of indicator lines.
OBJNAME indicator line found after ROWS indicator line.
- (errno )
Line : Incorrect ordering of indicator lines.
COLUMNS indicator line found before ROWS indicator line.
- (errno )
Line : Incorrect ordering of indicator lines.
RHS indicator line found before COLUMNS indicator line.
- (errno )
Line : Incorrect ordering of indicator lines.
RANGES indicator line found before RHS indicator line.
- (errno )
Line : Incorrect ordering of indicator lines.
BOUNDS indicator line found before COLUMNS indicator line.
- (errno )
Line : Incorrect ordering of indicator lines.
QUADOBJ indicator line found before BOUNDS indicator line.
- (errno )
Line : Incorrect ordering of indicator lines.
QUADOBJ indicator line found before COLUMNS indicator line.
- (errno )
Line : Unknown indicator line .
- (errno )
Line : Indicator line ‘’ has been found more than once in the MPS file.
- (errno )
End of file found before ENDATA indicator line.
- (errno )
No indicator line found in file. It may be an empty file.
- (errno )
At least one mandatory section not found in MPS file.
- (errno )
Line : An illegal line was detected in section.
This is neither a comment nor a valid data line.
- (errno )
Line : Unknown inequality key in ROWS section.
Expected ‘
N
’, ‘G
’, ‘L
’ or ‘E
’.- (errno )
Line : Empty ROWS section.
Neither the objective row nor the constraints were defined.
- (errno )
The supplied name, in or in OBJNAME, of the objective row was not found among the free rows in the ROWS section.
- (errno )
The supplied name, in , of the BOUNDS set to be used was not found in the BOUNDS section.
- (errno )
The supplied name, in , of the RHS set to be used was not found in the RHS section.
- (errno )
The supplied name, in , of the RANGES set to be used was not found in the RANGES section.
- (errno )
Line : Illegal row name.
Row names must consist of printable characters only.
- (errno )
Line : Illegal column name.
Column names must consist of printable characters only.
- (errno )
Line : Row name has been defined more than once in the ROWS section.
- (errno )
Line : Column ‘’ has been defined more than once in the COLUMNS section. Column definitions must be continuous. (See COLUMNS Section).
- (errno )
Line : Found
'INTORG'
marker within'INTORG'
to'INTEND'
range.- (errno )
Line : Found
'INTEND'
marker without previous marker being'INTORG'
.- (errno )
Line : Found
'INTORG'
but not'INTEND'
before the end of the COLUMNS section.- (errno )
Line : Illegal marker type .
Should be either
'INTORG'
or'INTEND'
.- (errno )
Line : Unknown row name in section.
All row names must be specified in the ROWS section.
- (errno )
Line : Unknown column name in section.
All column names must be specified in the COLUMNS section.
- (errno )
Inconsistent bounds for row ‘’.
- (errno )
Inconsistent bounds for column ‘’.
- (errno )
Line : Unknown bound type in BOUNDS section.
- (errno )
More than one nonzero of has row name ‘’ and column name ‘’ in the COLUMNS section.
- (errno )
Field did not contain a number (see Notes).
- (errno )
On entry, .
Constraint: .
- Warns
- NagAlgorithmicWarning
- (errno )
Warning: MPS file not strictly fixed format, although the problem was read anyway. The data may have been read incorrectly. You should set and repeat the call to
miqp_mps_read
for more details.- (errno )
At least one of , , , or is too small. You must provide , , , , .
- (errno )
At least one of , , , , or is too small. You must provide , , , , , .
- Notes
miqp_mps_read
reads data for Linear Programming (LP) or Quadratic Programming (QP) problems (or their mixed integer variants) from an external file which is prepared in standard or compatible MPS (see IBM (1971)) input format. It then initializes (the number of variables), (the number of general linear constraints), the matrix , the vectors , , (stored in row of ) and the Hessian matrix for use withqpconvex1_sparse_solve()
andqpconvex2_sparse_solve()
. These functions are designed to solve problems of the formMPS input format
The input file of data may only contain two types of lines:
Indicator lines (specifying the type of data which is to follow).
Data lines (specifying the actual data).
A section is a combination of an indicator line and its corresponding data line(s). Any characters beyond column 80 are ignored. Indicator lines must not contain leading blank characters (in other words they must begin in column 1). The following displays the order in which the indicator lines must appear in the file:
NAME
user-supplied name
(optional)
OBJSENSE
(optional)
data line
OBJNAME
(optional)
data line
ROWS
data line(s)
COLUMNS
data line(s)
RHS
data line(s)
RANGES
(optional)
data line(s)
BOUNDS
(optional)
data line(s)
QUADOBJ
(optional)
data line(s)
ENDATA
A data line follows a fixed format, being made up of fields as defined below. The contents of the fields may have different significance depending upon the section of data in which they appear.
Field 1
Field 2
Field 3
Field 4
Field 5
Field 6
Columns
Contents
Code
Name
Name
Value
Name
Value
Each name and code must consist of ‘printable’ characters only; names and codes supplied must match the case used in the following descriptions. Values are read using a field width of . This allows values to be entered in several equivalent forms. For example, , , and all represent the same number. It is safest to include an explicit decimal point.
Lines with an asterisk () in column will be considered comment lines and will be ignored by the function.
Columns outside the six fields must be blank, except for columns 72–80, whose contents are ignored by the function. A non-blank character outside the predefined six fields and columns 72–80 is considered to be a major error ( = 16; see Exceptions), unless it is part of a comment.
NAME Section (optional)
The NAME section is the only section where the data must be on the same line as the indicator. The ‘user-supplied name’ must be in field but may be blank.
Field
Required
Description
No
Name of the problem
OBJSENSE Section (optional)
The data line in this section can be used to specify the sense of the objective function. If this section is present it must contain only one data line. If the section is missing or empty, minimization is assumed.
Field
Required
Description
No
Sense of the objective function
Field 2 may contain either
MIN
,MAX
,MINIMIZE
orMAXIMIZE
.OBJNAME Section (optional)
The data line in this section can be used to specify the name of a free row (see ROWS Section) that should be used as the objective function. If this section is present it must contain only one data line. If the section is missing or is empty, the first free row will be chosen instead. Alternatively, OBJNAME can be overridden by setting nonempty (see Parameters).
Field
Required
Description
No
Row name to be used as the objective function
Field 2 must contain a valid row name.
ROWS Section
The data lines in this section specify unique row (constraint) names and their inequality types (i.e., unconstrained, , or ).
Field
Required
Description
Yes
Inequality key
Yes
Row name
The inequality key specifies each row’s type. It must be
E
,G
,L
orN
and can be in either column or .Inequality Key
Description
N
Free row
G
Greater than or equal to
finite
L
Less than or equal to
finite
E
Equal to
finite
Row type
N
stands for ‘Not binding’. It can be used to define the objective row. The objective row is a free row that specifies the vector in the linear objective term . If there is more than one free row, the first free row is chosen, unless another free row name is specified by OBJNAME (see OBJNAME Section (optional)) or (see Parameters). Note that is assumed to be zero if either the chosen row does not appear in the COLUMNS section (i.e., has no nonzero elements) or there are no free rows defined in the ROWS section.COLUMNS Section
Data lines in this section specify the names to be assigned to the variables (columns) in the general linear constraint matrix , and define, in terms of column vectors, the actual values of the corresponding matrix elements.
Field
Required
Description
Yes
Column name
Yes
Row name
Yes
Value
No
Row name
No
Value
Each data line in the COLUMNS section defines the nonzero elements of or . Any elements of or that are undefined are assumed to be zero. Nonzero elements of must be grouped by column, that is to say that all of the nonzero elements in the jth column of must be specified before those in the th column, for . Rows may appear in any order within the column.
Integer Markers
For backward compatibility
miqp_mps_read
allows you to define the integer variables within the COLUMNS section using integer markers, although this is not recommended as markers can be treated differently by different MPS readers; you should instead define any integer variables in the BOUNDS section (see below). Each marker line must have the following format:Field
Required
Description
No
Marker ID
Yes
Marker tag
Yes
Marker type
The marker tag must be
'MARKER'
. The marker type must be'INTORG'
to start reading integer variables and'INTEND'
to finish reading integer variables. This implies that a row cannot be named'MARKER'
,'INTORG'
or'INTEND'
. Please note that both marker tag and marker type comprise of characters as a'
is the mandatory first and last character in the string. You may wish to have several integer marker sections within the COLUMNS section, in which case each marker section must begin with an'INTORG'
marker and end with an'INTEND'
marker and there should not be another marker between them.Field 2 is ignored by
miqp_mps_read
. When an integer variable is declared it will keep its default bounds unless they are changed in the BOUNDS section. This may vary between different MPS readers.RHS Section
This section specifies the right-hand side values (if any) of the general linear constraint matrix .
Field
Required
Description
Yes
RHS name
Yes
Row name
Yes
Value
No
Row name
No
Value
The MPS file may contain several RHS sets distinguished by RHS name. If an RHS name is defined in (see Parameters) then
miqp_mps_read
will read in only that RHS vector, otherwise the first RHS set will be used.Only the nonzero RHS elements need to be specified. Note that if an RHS is given to the objective function it will be ignored by
miqp_mps_read
. An RHS given to the objective function is dealt with differently by different MPS readers, therefore, it is safer to not define an RHS of the objective function in your MPS file. Note that this section may be empty, in which case the RHS vector is assumed to be zero.RANGES Section (optional)
Ranges are used to modify the interpretation of constraints defined in the ROWS section (see ROWS Section) to the form , where both and are finite. The range of the constraint is .
Field
Required
Description
Yes
Range name
Yes
Row name
Yes
Value
No
Row name
No
Value
The range of each constraint implies an upper and lower bound dependent on the inequality key of each constraint, on the RHS of the constraint (as defined in the RHS section), and on the range .
Inequality Key
Sign of
E
E
G
L
N
If a range name is defined in (see Parameters) then the function will read in only the range set of that name, otherwise the first set will be used.
BOUNDS Section (optional)
These lines specify limits on the values of the variables (the quantities and in ). If a variable is not specified in the bound set then it is automatically assumed to lie between and .
Field
Required
Description
Yes
Bound type identifier
Yes
Bound name
Yes
Column name
Yes/No
Value
Note: field 4 is required only if the bound type identifier is one of
UP
,LO
,FX
,UI
orLI
in which case it gives the value below. If the bound type identifier isFR
,MI
,PL
orBV
, field 4 is ignored and it is recommended to leave it blank.The table below describes the acceptable bound type identifiers and how each determines the variables’ bounds.
Bound Type Identifier
Integer Variable?
UP
unchanged
No
LO
unchanged
No
FX
No
FR
No
MI
unchanged
No
PL
unchanged
No
BV
Yes
UI
unchanged
Yes
LI
unchanged
Yes
If a bound name is defined in (see Parameters) then the function will read in only the bound set of that name, otherwise the first set will be used.
QUADOBJ Section (optional)
The QUADOBJ section defines nonzero elements of the upper or lower triangle of the Hessian matrix .
Field
Required
Description
Yes
Column name (HColumn Index)
Yes
Column name (HRow Index)
Yes
Value
No
Column name (HRow Index)
No
Value
Each data line in the QUADOBJ section defines one (or optionally two) nonzero elements of the matrix . Each element is given as a triplet of row index , column index and a value. The column names (as defined in the COLUMNS section) are used to link the names of the variables and the indices and . More precisely, the matrix on output will have a nonzero element
where index belongs to HColumn Index and index to one of the HRow Indices such that
and
.
It is only necessary to define either the upper or lower triangle of the matrix; either will suffice. Any elements that have been defined in the upper triangle of the matrix will be moved to the lower triangle of the matrix, then any repeated nonzeros will be summed.
Note: it is much more efficient for
qpconvex1_sparse_solve()
andqpconvex2_sparse_solve()
to have the matrix defined by the first column names. If the nonzeros of are defined by any columns that are not in the first of thenmiqp_mps_read
will rearrange the matrices and so that they are.Query Mode
miqp_mps_read
offers a ‘query mode’ to quickly give upper estimates on the sizes of user arrays. In this mode any expensive checks of the data and of the file format are skipped, providing a prompt count of the number of variables, constraints and matrix nonzeros. This might be useful in the common case where the size of the problem is not known in advance.You may activate query mode by setting any of the following: , , , or . If no major formatting error is detected in the data file, no exception or warning is raised is returned and the upper estimates are given as stated in Table [label omitted]. Alternatively, the function switches to query mode while the file is being read if it is discovered that the provided space is insufficient (that is, if , , , , or ). In this case = 2 is returned.
Argument Name
Upper Estimate for
- References
IBM, 1971, MPSX – Mathematical programming system, Program Number 5734 XM4, IBM Trade Corporation, New York