E04 Chapter Contents
E04 Chapter Introduction
NAG Library Manual

# NAG Library Routine DocumentE04RPF

Note:  before using this routine, please read the Users' Note for your implementation to check the interpretation of bold italicised terms and other implementation-dependent details.

## 1  Purpose

E04RPF is a part of the NAG optimization modelling suite and defines bilinear matrix terms either in a new matrix constraint or adds them to an existing linear matrix inequality.

## 2  Specification

 SUBROUTINE E04RPF ( HANDLE, NQ, QI, QJ, DIMQ, NNZQ, NNZQSUM, IROWQ, ICOLQ, Q, IDBLK, IFAIL)
 INTEGER NQ, QI(NQ), QJ(NQ), DIMQ, NNZQ(NQ), NNZQSUM, IROWQ(NNZQSUM), ICOLQ(NNZQSUM), IDBLK, IFAIL REAL (KIND=nag_wp) Q(NNZQSUM) TYPE (C_PTR) HANDLE

## 3  Description

After the initialization routine E04RAF has been called, E04RPF may be used to define bilinear matrix terms. It may be used in two ways, either to add to the problem formulation a new bilinear matrix inequality (BMI) which does not have linear terms:
 $∑ i,j=1 n xi xj Q ij ⪰0$ (1)
or to extend an existing linear matrix inequality constraint by bilinear terms:
 $∑ i,j=1 n xi xj Q ij k .$ (2)
Here ${Q}_{ij}^{k}$ are $d$ by $d$ (sparse) symmetric matrices and $k$, if present, is the number of the existing constraint. This routine will typically be used on semidefinite programming problems with bilinear matrix constraints (BMI-SDP)
 $minimize x∈ℝn 12 xTHx + cTx (a) subject to ∑ i,j=1 n xi xj Qijk + ∑ i=1 n xi Aik - A0k ⪰ 0 , k=1,…,mA (b) lB≤Bx≤uB (c) lx≤x≤ux . (d)$ (3)
The routine can be called multiple times to define an additional matrix inequality or to extend an existing one, but it cannot be called twice to extend the same matrix inequality. The argument IDBLK is used to distinguish whether a new matrix constraint should be added (${\mathbf{IDBLK}}=0$) or if an existing linear matrix inequality should be extended (${\mathbf{IDBLK}}>0$). In the latter case, IDBLK should be set to $k$, the number of the existing inequality. See E04RNF for details about formulation of linear matrix constraints and their numbering and a further description of IDBLK. For a generic description of the problem see E04RAF. In the further text, the index $k$ will be omitted.

### 3.1  Input data organization

It is expected that only some of the matrices ${Q}_{ij}$ will be nonzero therefore only their index pairs $i,j$ are listed in arrays QI and QJ. Note that a pair $i,j$ should not repeat, i.e., a matrix ${Q}_{ij}$ should not be defined more than once. No particular ordering of pairs $i,j$ is expected but other input arrays IROWQ, ICOLQ, Q and NNZQ need to respect the chosen order.
Note:  the dimension of ${Q}_{ij}$ must respect the size of the linear matrix inequality if they are supposed to expand it (case ${\mathbf{IDBLK}}>0$).
Matrices ${Q}_{ij}$ are symmetric and thus only their upper triangles are passed to the routine. They are stored in sparse coordinate storage format (see Section 2.1.1 in the F11 Chapter Introduction), i.e., every nonzero from the upper triangles is coded as a triplet of row index, column index and the numeric value. All these triplets from all ${Q}_{ij}$ matrices are passed to the routine in three arrays: IROWQ for row indices, ICOLQ for column indices and Q for the values. No particular order of nonzeros within one matrix is enforced but all nonzeros belonging to one ${Q}_{ij}$ matrix need to be stored next to each other. The first ${\mathbf{NNZQ}}\left(1\right)$ nonzeros belong to ${Q}_{{i}_{1}{j}_{1}}$ where ${i}_{1}={\mathbf{QI}}\left(1\right)$, ${j}_{1}={\mathbf{QJ}}\left(1\right)$, the following ${\mathbf{NNZQ}}\left(2\right)$ nonzeros to the next one given by QI, QJ and so on. The array NNZQ thus splits arrays IROWQ, ICOLQ and Q into sections so that each section defines one ${Q}_{ij}$ matrix. See Table 1 below. Routines E04RDF and E04RNF use the same data organization so further examples can be found there.
 IROWQ upper triangle upper triangle upper triangle ICOLQ nonzeros nonzeros $\cdots$ nonzeros Q $\underbrace{\text{from ​}{Q}_{{i}_{1}{j}_{1}}}$ $\underbrace{\text{from ​}{Q}_{{i}_{2}{j}_{2}}}$ $\underbrace{\text{from ​}{Q}_{{i}_{{\mathbf{NQ}}}{j}_{{\mathbf{NQ}}}}}$ ${\mathbf{NNZQ}}\left(1\right)$ ${\mathbf{NNZQ}}\left(2\right)$ ${\mathbf{NNZQ}}\left({\mathbf{NQ}}\right)$ ${i}_{1}={\mathbf{QI}}\left(1\right)$ ${i}_{2}={\mathbf{QI}}\left(2\right)$ ${i}_{{\mathbf{NQ}}}={\mathbf{QI}}\left({\mathbf{NQ}}\right)$ ${j}_{1}={\mathbf{QJ}}\left(1\right)$ ${j}_{2}={\mathbf{QJ}}\left(2\right)$ ${j}_{{\mathbf{NQ}}}={\mathbf{QJ}}\left({\mathbf{NQ}}\right)$
Table 1
Coordinate storage format of ${Q}_{ij}$ matrices in input arrays

## 4  References

Syrmos V L, Abdallah C T, Dorato P and Grigoriadis K (1997) Static output feedback – a survey Journal Automatica (Journal of IFAC) (Volume 33) 2 125–137

## 5  Arguments

1:     $\mathrm{HANDLE}$ – TYPE (C_PTR)Input
On entry: the handle to the problem. It needs to be initialized by E04RAF and must not be changed.
2:     $\mathrm{NQ}$ – INTEGERInput
On entry: the number of index pairs $i,j$ of the nonzero matrices ${Q}_{ij}$.
Constraint: ${\mathbf{NQ}}>0$.
3:     $\mathrm{QI}\left({\mathbf{NQ}}\right)$ – INTEGER arrayInput
4:     $\mathrm{QJ}\left({\mathbf{NQ}}\right)$ – INTEGER arrayInput
On entry: the index pairs $i,j$ of the nonzero matrices ${Q}_{ij}$ in any order.
Constraint: $1\le i,j\le n$ where $n$ is the number of decision variables in the problem set during the initialization of the handle by E04RAF. The pairs do not repeat.
5:     $\mathrm{DIMQ}$ – INTEGERInput
On entry: $d$, the dimension of matrices ${Q}_{ij}$.
Constraints:
• ${\mathbf{DIMQ}}>0$;
• if ${\mathbf{IDBLK}}>0$, DIMQ needs to be identical to the dimension of matrices of the constraint $k$.
6:     $\mathrm{NNZQ}\left({\mathbf{NQ}}\right)$ – INTEGER arrayInput
On entry: the numbers of nonzero elements in the upper triangles of ${Q}_{ij}$ matrices.
Constraint: ${\mathbf{NNZQ}}\left(i\right)>0$.
7:     $\mathrm{NNZQSUM}$ – INTEGERInput
On entry: the dimension of the arrays IROWQ, ICOLQ and Q, at least the total number of all nonzeros in all ${Q}_{ij}$ matrices.
Constraints:
• ${\mathbf{NNZQSUM}}>0$;
• ${\mathbf{NNZQSUM}}\ge \sum _{\mathit{k}=1}^{{\mathbf{NQ}}}{\mathbf{NNZQ}}\left(\mathit{k}\right)$.
8:     $\mathrm{IROWQ}\left({\mathbf{NNZQSUM}}\right)$ – INTEGER arrayInput
9:     $\mathrm{ICOLQ}\left({\mathbf{NNZQSUM}}\right)$ – INTEGER arrayInput
10:   $\mathrm{Q}\left({\mathbf{NNZQSUM}}\right)$ – REAL (KIND=nag_wp) arrayInput
On entry: the nonzero elements of the upper triangles of matrices ${Q}_{ij}$ stored in coordinate storage format. The first ${\mathbf{NNZQ}}\left(1\right)$ elements belong to the first ${Q}_{{i}_{1}{j}_{1}}$, the following ${\mathbf{NNZQ}}\left(2\right)$ to ${Q}_{{i}_{2}{j}_{2}}$, etc.
Constraint: $1\le {\mathbf{IROWQ}}\left(i\right)\le {\mathbf{DIMQ}}$, ${\mathbf{IROWQ}}\left(i\right)\le {\mathbf{ICOLQ}}\left(i\right)\le {\mathbf{DIMQ}}$.
11:   $\mathrm{IDBLK}$ – INTEGERInput/Output
On entry: if ${\mathbf{IDBLK}}=0$, a new matrix constraint is created; otherwise ${\mathbf{IDBLK}}=k>0$, the number of the existing linear matrix constraint to be expanded with the bilinear terms.
Constraint: ${\mathbf{IDBLK}}\ge 0$.
On exit: if ${\mathbf{IDBLK}}=0$ on entry, the number of the new matrix constraint is returned. By definition, it is the number of the matrix inequalities already defined plus one. Otherwise, ${\mathbf{IDBLK}}>0$ stays unchanged.
12:   $\mathrm{IFAIL}$ – INTEGERInput/Output
On entry: IFAIL must be set to $0$, $-1\text{​ or ​}1$. If you are unfamiliar with this argument you should refer to Section 3.4 in How to Use the NAG Library and its Documentation for details.
For environments where it might be inappropriate to halt program execution when an error is detected, the value $-1\text{​ or ​}1$ is recommended. If the output of error messages is undesirable, then the value $1$ is recommended. Otherwise, the recommended value is $-1$. When the value $-\mathbf{1}\text{​ or ​}1$ is used it is essential to test the value of IFAIL on exit.
On exit: ${\mathbf{IFAIL}}={\mathbf{0}}$ unless the routine detects an error or a warning has been flagged (see Section 6).

## 6  Error Indicators and Warnings

If on entry ${\mathbf{IFAIL}}=0$ or $-1$, explanatory error messages are output on the current error message unit (as defined by X04AAF).
Errors or warnings detected by the routine:
${\mathbf{IFAIL}}=1$
The supplied HANDLE does not define a valid handle to the data structure for the NAG optimization modelling suite. It has not been initialized by E04RAF or it has been corrupted.
${\mathbf{IFAIL}}=2$
The problem cannot be modified in this phase any more, the solver has already been called.
${\mathbf{IFAIL}}=3$
On entry, ${\mathbf{IDBLK}}=〈\mathit{\text{value}}〉$.
Bilinear terms of the matrix inequality block with the given IDBLK have already been defined.
${\mathbf{IFAIL}}=4$
On entry, ${\mathbf{IDBLK}}=〈\mathit{\text{value}}〉$.
The given IDBLK does not match with any existing matrix inequality block.
The maximum IDBLK is currently $〈\mathit{\text{value}}〉$.
On entry, ${\mathbf{IDBLK}}=〈\mathit{\text{value}}〉$.
The given IDBLK refers to a nonexistent matrix inequality block.
No matrix inequalities have been added yet.
${\mathbf{IFAIL}}=5$
On entry, ${\mathbf{DIMQ}}=〈\mathit{\text{value}}〉$, ${\mathbf{IDBLK}}=〈\mathit{\text{value}}〉$.
The correct dimension of the given IDBLK is $〈\mathit{\text{value}}〉$.
Constraint: DIMQ must match the dimension of the block supplied earlier.
${\mathbf{IFAIL}}=6$
On entry, ${\mathbf{DIMQ}}=〈\mathit{\text{value}}〉$.
Constraint: ${\mathbf{DIMQ}}>0$.
On entry, $i=〈\mathit{\text{value}}〉$ and ${\mathbf{NNZQ}}\left(i\right)=〈\mathit{\text{value}}〉$.
Constraint: ${\mathbf{NNZQ}}\left(i\right)>0$.
On entry, ${\mathbf{IDBLK}}=〈\mathit{\text{value}}〉$.
Constraint: ${\mathbf{IDBLK}}\ge 0$.
On entry, ${\mathbf{NNZQSUM}}=〈\mathit{\text{value}}〉$ and $\mathrm{sum}\left({\mathbf{NNZQ}}\right)=〈\mathit{\text{value}}〉$.
Constraint: ${\mathbf{NNZQSUM}}\ge \mathrm{sum}\left({\mathbf{NNZQ}}\right)$.
On entry, ${\mathbf{NQ}}=〈\mathit{\text{value}}〉$.
Constraint: ${\mathbf{NQ}}>0$.
${\mathbf{IFAIL}}=8$
On entry, an error occurred in matrix ${Q}_{ij}$ of index $k=〈\mathit{\text{value}}〉$, ${\mathbf{QI}}\left(k\right)=〈\mathit{\text{value}}〉$, ${\mathbf{QJ}}\left(k\right)=〈\mathit{\text{value}}〉$.
For $j=〈\mathit{\text{value}}〉$, ${\mathbf{ICOLQ}}\left(j\right)=〈\mathit{\text{value}}〉$ and ${\mathbf{DIMQ}}=〈\mathit{\text{value}}〉$.
Constraint: $1\le {\mathbf{ICOLQ}}\left(j\right)\le {\mathbf{DIMQ}}$.
On entry, an error occurred in matrix ${Q}_{ij}$ of index $k=〈\mathit{\text{value}}〉$, ${\mathbf{QI}}\left(k\right)=〈\mathit{\text{value}}〉$, ${\mathbf{QJ}}\left(k\right)=〈\mathit{\text{value}}〉$.
For $j=〈\mathit{\text{value}}〉$, ${\mathbf{IROWQ}}\left(j\right)=〈\mathit{\text{value}}〉$ and ${\mathbf{DIMQ}}=〈\mathit{\text{value}}〉$.
Constraint: $1\le {\mathbf{IROWQ}}\left(j\right)\le {\mathbf{DIMQ}}$.
On entry, an error occurred in matrix ${Q}_{ij}$ of index $k=〈\mathit{\text{value}}〉$, ${\mathbf{QI}}\left(k\right)=〈\mathit{\text{value}}〉$, ${\mathbf{QJ}}\left(k\right)=〈\mathit{\text{value}}〉$.
For $j=〈\mathit{\text{value}}〉$, ${\mathbf{IROWQ}}\left(j\right)=〈\mathit{\text{value}}〉$ and ${\mathbf{ICOLQ}}\left(j\right)=〈\mathit{\text{value}}〉$.
Constraint: ${\mathbf{IROWQ}}\left(\mathit{j}\right)\le {\mathbf{ICOLQ}}\left(\mathit{j}\right)$ (elements within the upper triangle).
On entry, an error occurred in matrix ${Q}_{ij}$ of index $k=〈\mathit{\text{value}}〉$, ${\mathbf{QI}}\left(k\right)=〈\mathit{\text{value}}〉$, ${\mathbf{QJ}}\left(k\right)=〈\mathit{\text{value}}〉$.
More than one element of ${Q}_{ij}$ has row index $〈\mathit{\text{value}}〉$ and column index $〈\mathit{\text{value}}〉$.
Constraint: each element of ${Q}_{ij}$ must have a unique row and column index.
${\mathbf{IFAIL}}=9$
On entry, index pair with ${\mathbf{QI}}=〈\mathit{\text{value}}〉$ and ${\mathbf{QJ}}=〈\mathit{\text{value}}〉$ repeats.
Constraint: each index pair QI, QJ must be unique.
On entry, $k=〈\mathit{\text{value}}〉$, ${\mathbf{QI}}\left(k\right)=〈\mathit{\text{value}}〉$ and $n=〈\mathit{\text{value}}〉$.
Constraint: $1\le {\mathbf{QI}}\left(k\right)\le n$.
On entry, $k=〈\mathit{\text{value}}〉$, ${\mathbf{QJ}}\left(k\right)=〈\mathit{\text{value}}〉$ and $n=〈\mathit{\text{value}}〉$.
Constraint: $1\le {\mathbf{QJ}}\left(k\right)\le n$.
${\mathbf{IFAIL}}=-99$
See Section 3.9 in How to Use the NAG Library and its Documentation for further information.
${\mathbf{IFAIL}}=-399$
Your licence key may have expired or may not have been installed correctly.
See Section 3.8 in How to Use the NAG Library and its Documentation for further information.
${\mathbf{IFAIL}}=-999$
Dynamic memory allocation failed.
See Section 3.7 in How to Use the NAG Library and its Documentation for further information.

Not applicable.

## 8  Parallelism and Performance

E04RPF is not threaded in any implementation.

None.

## 10  Example

This example demonstrates how semidefinite programming can be used in control theory. See also Section 10 in E04RAF for links to further examples in the suite.
The problem, from static output feedback (SOF) control Syrmos et al. (1997), solved here is the linear time-invariant (LTI) ‘test’ system
 $x.=Ax+Bu y=Cx$ (4)
subject to static output feedback
 $u=Ky .$ (5)
Here $A\in {ℝ}^{n×n}$, $B\in {ℝ}^{n×m}$ and $C\in {ℝ}^{p×n}$ are given matrices, $x\in {ℝ}^{n}$ is the vector of state variables, $u\in {ℝ}^{m}$ is the vector of control inputs, $y\in {ℝ}^{p}$ is the vector of system outputs, and $K\in {ℝ}^{m×p}$ is the unknown feedback gain matrix.
The problem is to find $K$ such that (4) is time-stable when subject to (5), i.e., all eigenvalues of the closed-loop system matrix $A+BKC$ belong to the left half-plane. From the Lyapunov stability theory, this holds if and only if there exists a symmetric positive definite matrix $P$ such that
 $A+BKCT P+ PA+BKC ≺0 .$
Hence, by introducing the new variable, the Lyapunov matrix $P$, we can formulate the SOF problem as a feasibility BMI-SDP problem in variables $K$ and $P$. As we cannot formulate the problem with sharp matrix inequalities, we can solve the following system instead (note that the objective function is added to bound matrix $P$):
 $minimize K,P traceP subject to A+BKCT P+PA+BKC ⪯ -I P⪰I.$ (6)
For $n=p=2$, $m=1$,
 $A= -1 2 -3 -4 , B= -1 -1 , C=I$
and the unknown matrices expressed as
 $P = x1 x2 x2 x3 , K = x4 x5 ,$
the problem (6) can be rewritten in the form (3) as follows:
 $minimize x∈ℝ5 x1+x3 subject to 2x1 ⁢ x4 + 2 x2 ⁢ x4 x1 ⁢ x5 + x2 ⁢ x4 + x2 ⁢ x5 + x3 ⁢ x4 sym. 2x2 ⁢ x5 + 2x3 ⁢ x5 + 2x1 + 6x2 -2x1 + 5x2 + 3x3 sym. -4x2 + 8x3 - I ⪰ 0 x1 x2 sym. x3 - I ⪰ 0 .$
This formulation has been stored in a generic BMI-SDP data file which is processed and solved by the example program.

### 10.1  Program Text

Program Text (e04rpfe.f90)

### 10.2  Program Data

Program Data (e04rpfe.d)

### 10.3  Program Results

Program Results (e04rpfe.r)