Title:
Process control using co-ordinate space
Document Type and Number:
United States Patent 7433743

Abstract:
In a control system for controlling a plant system or process (22), a model based problem is formulated and an explicit control solution is constructed off-line such that a parametric profile (24) is constructed using parametric optimisation techniques (26). As a result the system can operate in real-time with significantly reduced computational burden.

Inventors:
Pistikopoulos, Efstratios (London, GB)
Bozinis, Nikolaos A. (London, GB)
Dua, Vivek (London, GB)
Perking, John D. (Manchester, GB)
Sakizlis, Vassilis (London, GB)
      Plaque It!

Application Number:
10/479100
Publication Date:
10/07/2008
Filing Date:
05/27/2002
View Patent Images:
Images are available in PDF form when logged in. To view PDFs, Login  or  Create Account (Free!)
Assignee:
Imperial College Innovations, Ltd. (London, GB)
Primary Class:
Other Classes:
700/52, 700/86, 700/32, 702/189, 700/89, 700/29, 703/2
International Classes:
G05B13/02; G05B11/32; G05B19/42; G06F15/00; G06F7/60; G06F17/10; H03F1/26; H04B15/00
Field of Search:
703/6, 700/52, 700/67, 700/104, 703/22, 702/189, 700/49, 700/89, 700/28-34, 700/74, 702/179, 703/2, 700/47, 700/86, 703/9, 700/44, 700/73, 700/51, 706/21, 703/7
US Patent References:
4338672Off-line teach assist apparatus and on-line control apparatusJuly, 1982Perzley et al.700/249
5257206Statistical process control for air separation processOctober, 1993Hanson700/273
H001357Active sound cancellation system for time-varying signalsSeptember, 1994Ng et al.381/71.5
5347446Model predictive control apparatusSeptember, 1994Iino et al.
5347447Adaptive control system and method thereofSeptember, 1994Kiji et al.
5477449Hierarchical model predictive control system based on accurate manipulation variable predictionDecember, 1995Iino
5572420Method of optimal controller design for multivariable predictive control utilizing range controlNovember, 1996Lu700/33
5691895Mechanism and architecture for manufacturing control and optimizationNovember, 1997Kurtzberg et al.700/29
5704011Method and apparatus for providing multivariable nonlinear controlDecember, 1997Hansen et al.706/25
5751571Process and apparatus for determining optimum values for manipulated variables of a technical systemMay, 1998Tresp et al.
5796920Multiprocessor system and method for identification and adaptive control of dynamic systemsAugust, 1998Hyland706/20
5884037System for allocation of network resources using an autoregressive integrated moving average methodMarch, 1999Aras et al.709/226
6026334Control system for cross-directional profile sheet formationFebruary, 2000Kayihan et al.700/28
6056781Model predictive controllerMay, 2000Wassick
6064809Fast model predictive ellipsoid control processMay, 2000Braatz et al.
6064916Hybrid predictor, hybrid prediction method, and system for and method of controlling processes using the hybrid predictor and hybrid preedition methodMay, 2000Yoon
6085183Intelligent computerized control systemJuly, 2000Horn et al.
6207936Model-based predictive control of thermal processingMarch, 2001de Waard et al.
6243696Automated method for building a modelJune, 2001Keeler et al.706/21
6253113Controllers that determine optimal tuning parameters for use in process control systems and methods of operating the sameJune, 2001Lu700/28
6278899Method for on-line optimization of a plantAugust, 2001Piche et al.700/44
6445963Integrated advanced control blocks in process control systemsSeptember, 2002Blevins et al.700/44
6487459Method and apparatus for modeling dynamic and steady-state processes for prediction, control and optimizationNovember, 2002Martin et al.700/44
6529780Method for automatic operation of industrial plantsMarch, 2003Soergel et al.700/10
6564119Multivariate statistical model-based system for monitoring the operation of a continuous caster and detecting the onset of impending breakoutsMay, 2003Vaculik et al.700/146
6745087Method for control of a plantJune, 2004Shah700/29
6816810Process monitoring and control using self-validating sensorsNovember, 2004Henry et al.702/179
6826521System and methodology and adaptive, linear model predictive control based on rigorous, nonlinear process modelNovember, 2004Hess et al.703/12
6937966System and method for on-line adaptive prediction using dynamic management of multiple sub-modelsAugust, 2005Hellerstein et al.703/2
7039473System and method for adaptive control of uncertain nonlinear processesMay, 2006Corban700/20
7158566High-speed adaptive interconnect architecture with nonlinear error functionsJanuary, 2007Dowling375/229
20030046130System and method for real-time enterprise optimizationMarch, 2003Golightly et al.705/7
20050137721Use of core process models in model predictive controllerJune, 2005Attarwala700/30
20060074501Method and apparatus for training a system model with gain constraintsApril, 2006Hartman et al.700/29
Foreign References:
EP0712060May, 1996Method and apparatus for providing multivariable nonlinear control
EP0745916December, 1996Method and device for controlling a technical process
WO/1995/002213January, 1995PROCESS FOR DETERMINING THE OPTIMUM VALUES OF THE CORRECTING VARIABLES OF A TECHNICAL SYSTEM
WO/2000/041044July, 2000PROCESS FACILITY CONTROL SYSTEMS USING AN EFFICIENT PREDICTION FORM AND METHODS OF OPERATING THE SAME
WO/2000/041045July, 2000SYSTEMS FOR GENERATING AND USING A LOOKUP TABLE WITH PROCESS FACILITY CONTROL SYSTEMS AND MODELS OF THE SAME, AND METHODS OF OPERATING SUCH SYSTEMS
WO/2000/065417November, 2000ADVANCED SHIP AUTOPILOT SYSTEM
Other References:
Morari et al., “Model Predictive Control; past, present and future”, (1999) Comput. Chem. Engng. 23, pp. 667-682.
Communication from European Patent Office dated Sep. 29, 2006.
Bemporad et al., “The Explicit Solution of Model Predictive Control via Multiparametric Quadratic Programming”, in American Control Conference, Chicago, IL, Jun. 2000, pp. 872-876.
Bemporad et al., “Piecewise Linear Optimal Controllers for Hybrid Systems”, in American Control Conference, Chicago, IL, Jun. 2000, pp. 1190-1194.
Borrelli et al., “A Hybrid Approach to Traction Control”, in Hybrid Systems: Computation and Control, A Sangiovanni-Vincentelli and M.D. Di Benedetto, Eds. 2001, No. 2034 in Lecture Notes in Computer Science, pp. 162-174, Springer-Verlag. (published around Mar. 2001).
Bemporad et al., “Explicit Solution of LP-Based Receding Horizon Control”, in Proceedings of the 39th IEEE Conference on Decision and Control, Sydney, Australia, Dec. 2000, pp. 632-637.
Bemporad et al., Optimal Controllers for Hybrid Systems: Stability and Piecewise Linear Explicit Form, in Proceedings of the 39th IEEE Conference on Decision and Control, Sydney, Australia, Dec. 2000, pp. 1810-1815.
Bemporad et al., “Model Predictive Control: A Multi-Parametric Programming Approach”, in Proceedings of the European Symposium on Computer Aided Process Engineering-10, Florence, Italy, May 2000, pp. 301-306.
Bemporad et al., “Optimal Piecewise-Linear Control of Dry Clutch Engagement”, in IFAC Workshop Advances in Automotive Control, Karlstruhe, Germany, Mar. 2001, pp. 23-28.
Bemporad et al., Performance Analysis of Piecewise Linear Systems and Model Predictive Control, Sydney, Australia, Dec. 2000, pp. 4957-4962.
Pistikopoulos et al., “On-Line Optimization via Off-Line Parametric Optimization Tools”, Computers & Chemical Engineering, vol. 24, pp. 183-188, 2000.
Gal et al., Multiparametric Linear Programming. Management Science, 18: pp. 406-442, 1972.
Fiacco, “Introduction to Sensitivity and Stability Analysis in Nonlinear Programming”, Academic Press, London, U.K., 1983.
Morari et al., “Model Predictive Control Toolbox”, The Mathworks, Inc., 1994.
Primary Examiner:
Bullock, Crystal Barnes
Attorney, Agent or Firm:
Morgan & Finnegan LLP
Claims:
The invention claimed is:

1. A method of controlling operation of a system, the system having a control input variable and a parameter that can be measured or estimated, the method comprising: constructing, off-line, a system operation model based on said control input variable and measurable parameter; constructing, off-line, an optimised explicit control solution comprising a value of said control input variable as a function of said parameter using parametric optimisation, in which the control solution comprises a co-ordinate space of at least one control variable value region comprising a control variable substitution value or a control variable value as a function of a parameter value, the co-ordinate being the parameter; storing the control solution on a data storage device; and during operation of the system, measuring or estimating a parameter of the system, obtaining the control input variable based on the measured or estimated parameter from the stored control solution, and inputting the obtained control input variable to the system to control operation of the system according to the measured or estimated parameter of the system.

2. A method as claimed in claim 1 in which the system operation model is a model predictive control (MPC) model.

3. A method as claimed in claim 2 in which the explicit control solution is constructed in the continuous time domain.

4. A method as claimed in claim 3 in which the explicit control system comprises the solution of a multiparametric dynamic optimisation problem.

5. A method as claimed in claim 3 in which the control variable is obtained as a function of said parameter and time.

6. A method as claimed in claims 2 in which the MPC is formulated as a Quadratic Program.

7. A method as claimed in claim 1 in which the parameter comprises a measurable state.

8. A method as claimed in claim 1 in which the parameter comprises a system disturbance.

9. A method as claimed in claim 1 further comprising the step of analysing the control solution and constructing a revised system model based on said analysis.

10. A method as claimed in claim 1 in which the system operation model and/or the control solution includes a disturbance compensation term.

11. A method as claimed in claim 10 in which the control solution co-ordinate space further includes a disturbance as a co-ordinate.

12. A method as claimed in claim 10 in which the system operation model includes a worst-case disturbance compensation term.

13. A method as claimed in claim 12 in which the control solution co-ordinate space excludes a disturbance as a co-ordinate.

14. A method as claimed in claim 10 in which the control solution includes a disturbance estimate.

15. A method as claimed in claim 14 which the control solution is adjusted in an on-line control operation to correct the disturbance estimate.

16. A method as claimed in claim 1 in which the control solution is adjusted in an on-line control operation to correct a disturbance estimate.

17. A method as claimed in claim 1 in which the constructing are implemented by a computer program stored in a computer readable medium.

18. A computer readable medium storing a computer program for implementing a method as claimed in claim 1.

19. A method as claimed in claim 1 in which the control solution is stored in a data storage device comprising a computer readable medium.

20. A method of controlling operation of a system comprising: measuring or estimating, on-line, at a first time interval a parameter of the system; obtaining a control input variable based on the parameter from a pre-defined parametric optimised explicit control solution, the pre-defined parametric optimized explicit solution comprising a value of a control input variable of the system as a function of said parameter, in which the control solution comprises a co-ordinate space of at least one control variable value region comprising a control variable substitution value or a control variable as a function of a parameter value, the co-ordinate being the parameter value; and inputting the obtained control input variable to the system to control operation of the system according to the parameter of the system.

21. A method as claimed in claim 20 in which the measuring or estimating the on-line parameter and deriving the control variable are repeated at subsequent time intervals.

22. A method as claimed in claim 20 in which the control variable is further obtained based on a disturbance compensation term.

23. A method as claimed in claim 22 in which the control solution co-ordinate space further includes a disturbance as a co-ordinate.

24. A method as claimed in claim 22 in which the control solution includes a disturbance estimate.

25. A method of controlling operation of a system, the system having a control input variable and a parameter that can be measured or estimated, the method comprising: constructing, off-line, a system operation model based on said control input variable and measurable parameter; constructing, off-line, an optimised explicit control solution comprising a value of said control input variable as a function of said parameter using parametric optimisation; identifying a parameter of which the explicit solution is independent and eliminating measurements of said parameter; and storing the control solution in a hardware data storage device and in which the control solution comprises a coordinate space of at least one control input variable value region comprising a control input variable substitution value or a control input variable value as a function of the parameter, the co-ordinate being the parameter value, the method further comprising unifying control input variable value having the same solution, the stored control solution being employed to provide the system with the control input variable based on the parameter of the system to control operation of the system according to the parameter of the system.

Description:

FIELD OF THE INVENTION

The invention relates to improved process control, in particular improved model based process control.

BACKGROUND OF THE INVENTION

Modern automated processes such as manufacturing processes are implemented under strict and generally highly complex control regimes both to maximise efficiency and avoid error or failure. In their simplest form these regimes are typically based on a feedback system whereby a parameter of the process is monitored and fed to a controller as a control parameter for comparison with a target value, the state of the process being altered as a function of the control parameter to track the target value.

One known and widely adopted control regime is model predictive control (MPC) which is described in “Model Predictive Control; past, present and future.” Morari, M. and J. H. Lee (1999) Comput. Chem. Engng. 23, 667-682 which is incorporated herein by reference. The basic principle is illustrated in FIG. 1, adapted from Prett, D. M. and Garcia C. E. (1988) “Fundamental Process Control”, Butterworth Publishers, Boston. Using MPC, whilst the aim remains to track a target value, the controller at each control point—usually at discrete time intervals, not only monitors the existing state of the process, system or plant but estimates the state of the process at some point in the future, for example at the next time interval. References to control of a process in the following discussion can apply equally to plant or system control as appropriate.

Referring to FIG. 1, at a time t=k the current state is measured at point x k and its future states x k+1 to x k+p are estimated for corresponding future times t=k to t=k+p. As can be seen the aim is for the value x to track a target value x target . The control variable u t is similarly varied with time, its value for the next time increment being updated as the predicted state value is updated. As a result the system takes into account the effect that the current control variable will have on future states and accommodates that accordingly. The forward projection is carried out for a finite future period which is shifted forward incrementally at each measurement interval, termed a moving horizon policy.

This operation is carried out on-line and in real time, and is illustrated in FIG. 2. MPC operates by solving an optimization problem at each time interval based on measurements 10 from the process or plant 12 at that time. An optimiser 14 includes a process or plant model used to estimate the future behavior of the plant and an objective function to determine the optimal control strategy, ie variation of the control variable or corrective action 16 , to reach the desired target.

Mathematically, the process or plant model can be represented, in state-space, by the equations:
{ x ( t+ 1)= Ax ( t )+ Bu ( t )
{ y ( t )= Cx ( t ), (1)
y min ≦y ( t )≦ y max
u min ≦u ( t )≦ u max (2)
u represents the control variables or process inputs manipulated by the controller to control the process, x the process states, ie measured values representative of the current values of one or more process variables and y the process output measurements. For multi variable processes, x, y and u are of course vectors and A and B matrices. The output and control variables are bounded by the min and max values forming constraints on the process.

The equations represent mathematically how at a time t in a process the future state of the process at a discrete, subsequent time interval t+1 is predicted as a function of the measured state x at time t and the control variables applied at time t—this calculation is then iterated forward, still at time t, for the predicted state at time t+2 based on the calculation for time t+1 and so forth. At time t, in addition, the process output is a direct function of the instantaneous process state. The process output is calculated at equation (2) to ensure it does not exceed the ouput constraints.

It has been shown that the iteration up to a time t+N y can be posed in the form of the following problem to be optimised (for example, see Morari and Lee paper identified above):

min U J ( U , x ( t ) ) = x 1 + Ny Px t + Ny t t + k = 0 Ny - 1 ( x t + k t Qx t + k t + u t + k Ru t + k ) subject to y min y t + k t y max , k = 1 , , N c u min u t + k u max , k = 0 , 1 , , N c x t t = x ( t ) x t + k + 1 t = Ax t + k t + Bu t + k , k 0 y t + k t = Cx t + k t , k 0 u t + k = Kx t + k t , N u k N y ( 3 )
where U Δ {u t , . . . , u t+Nu−1 }, Q=Q′ custom character0, R=R′ custom character0, P custom character0, N y ≧N u , and K is some feedback gain. The problem (3) is solved repetitively at each time t for the current measurement x(t) and the vector of predicted state variables, x t+1|t , . . . , x t+k|t at time t+1, . . . , t+k respectively and corresponding control actions u t , . . . , u t+k−1 is obtained.

Equation (3) is the iterated expansion of equation (1). The first term on the right hand comprises a quadratic function of the predicted state variables at time t+N y , using the vector transpose x′ and constant matrix P. The second term is a summation of all the intermediate predicted state variables from time t to time t+N y −1 using the vector transpose x′ and constant matrix Q and, over the same range, of corresponding control variables u again in quadratic form with constant matrix R. In both cases each successive state value x t+k+1 is derived from the previous state value x 1+k using equation 1. Each value of u t+k is derived as a function of the predicted state value for that time and gain matrix K. The constraints for y and u are controlled up to a time N c . The function J is thus constructed.

The left hand side of equation (3) requires that an optimal solution is selected from the solution space by minimising the function J of the state x(t) and the vector U of control/input variables for all time intervals. The function J is minimised in control variable space, that is, the optimal value of U is found satisfying equation (3) including the various conditions in the “subject to” field such that J is minimum. The resulting values of u(t) and x(t) are then representable as shown in FIG. 1. The manner in which a real control situation can be represented as an MPC problem will be well known to the skilled person.

A significant problem arises in practical implementation of MPC as the processing power required for real time calculation is extremely high. Certainly if a large number of variables are required, complex control functions needed for complex processes or extremely short time intervals are desired, the burden can become cost, energy or even space inefficient. In addition, as the solution is created on-line and tailored only to instantaneous conditions, it provides no quantitative data on whether the model itself is appropriate.

Various attempts have been made to improve MPC implementation. For example in U.S. Pat. No. 6,056,781 to Wassick et al, in addition to a plant or process model, a disturbance model represents deviations from the plant model. In this version, if anything, the real time processing burden is enhanced. U.S. Pat. No. 5,347,446 to Iino et al describes a system taking into account constraints on the input or manipulated variables as well as constraints on controlled variables and change rates of the controlled variables. Again, the processing burden remains a significant concern.

U.S. Pat. No. 6,064,809 to Braatz et. al. addresses the problem of processing burden by approximating off-line the constraint set, that is; the limits or constraints on the input or manipulated variables as a mathematical construct off-line, in the form of an iteratively derived ellipsoid, effectively providing a simplified replacement for equation 3 above. However this simplified construct is then no more than an approximation which is scaled and then solved on-line in conventional MPC fashion. Accordingly Braatz et al. approached the problem by improving or simplifying the modeling process, but still requires significant on-line computational power.

SUMMARY OF THE INVENTION

According to the invention there is provided a method of deriving an explicit control solution for operation of a system, the system having a control variable and a measurable parameter, comprising the steps of constructing, off-line, a system operation model based on said control variable and measurable parameter, and constructing, off-line, an optimised explicit control solution for said control variable and measurable parameter using parametric optimisation. Because the solution is explicit and constructed off-line, on-line control of the system can be speeded up significantly using the solution. In addition the explicit solution can be reviewed off-line to provide insights into the control system/control model itself.

The explicit control solution is preferably stored on a data storage device such as a chip and the system operation model is preferably a model predictive control (MPC) model. The explicit control solution is preferably constructed in the continuous time domain allowing more accurate control. The MPC is preferably formulated as a Quadratic Program.

The control solution preferably comprises a co-ordinate space of at least one control variable value region comprising a control variable substitution value or a control variable value as a function of a measurable parameter value, the co-ordinate being the measurable parameter value. As a result a simple and manipulable parametric profile is provided. The measurable parameter may comprise a measurable state or a system disturbance. The method may further comprise the step of analysing the control solution and constructing a revised system model based on said analysis.

According to the invention there is further provided a method of controlling operation of a system comprising the steps of measuring, on-line, at a first time interval a parameter of the system, obtaining a control variable based on the measured parameter from a pre-defined parametric optimised explicit control solution and inputting the control variable to the system.

The steps of measuring the on-line state and deriving the control variable may be repeated at subsequent time intervals. The control solution preferably comprises a co-ordinate space of at least one control variable value region comprising a control variable substitution value or a control variable as a function of a measured state value, the co-ordinate being the measured state value.

According to the invention there is further provided a control system for controlling operation of a system having a control variable and a measurable state, the control system including a system state measurement element, a data storage element storing a predetermined parametric optimised explicit control solution profile, a processor arranged to obtain a control variable from said data storage element control solution based on a measured system state value and a controller arranged to input the obtained control variable to the system.

The method is preferably implemented in a computer program which can be stored in any appropriate computer readable medium. A data storage device is provided according to the invention storing a control solution derived by a method as herein described.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the invention will now be described by way of example with reference to the drawings, of which:

FIG. 1 shows a control strategy according to a model predictive control scheme;

FIG. 2 shows schematically an on-line optimisation strategy;

FIG. 3 shows an explicit control solution obtained by parametric optimisation;

FIG. 4 shows an explicit control solution for an alternative parametric optimisation operation;

FIG. 5 shows schematically an on-line optimisation strategy according to the present invention;

FIG. 6 shows the disturbance performance of various control strategies including those according to the present invention;

FIG. 7 shows the difference between actual and predicted disturbance in a controller according to the present invention;

FIG. 8 shows schematically a fluidised catalytic cracking unit modeled according to the present invention;

FIG. 9 shows an explicit control solution obtained for the unit of FIG. 8;

FIG. 10 a shows the time profile of the measurable states for the control strategy shown in FIG. 9;

FIG. 10 b shows the time profile of the measurable states for the control solution shown in FIG. 9;

FIG. 11 a shows the trajectory followed in state space for the control variables under the control solution of FIG. 9; and

FIG. 11 b shows the trajectory followed in state space for the control variables under the control solution of FIG. 9;

FIG. 12 shows schematically an evaporator unit modeled according to the present invention;

FIG. 13 shows a control solution according to the present invention without utilising disturbance rejection;

FIG. 14 shows the time profile of the measurable states for a control strategy according to the disturbance rejection model;

FIG. 15 shows the time profile of the measurable states for a control strategy according to the disturbance rejection model;

FIG. 16 a shows the trajectory followed in state space for the control variables according to the disturbance rejection model;

FIG. 16 b shows the trajectory followed in state space for the control variables according to the disturbance rejection model;

FIG. 17 a shows the trajectory followed for the control variables according to the disturbance rejection model;

FIG. 17 b shows the trajectory followed for the control variables according to the disturbance rejection model;

FIG. 18 shows the critical region partition for further embodiment;

FIG. 19 shows the output, control and state profile for the embodiment of FIG. 18;

FIG. 20 shows the critical region partition for further embodiment; and

FIG. 21 shows the output and control profile for the embodiment of FIG. 20.

DETAILED DESCRIPTION OF VARIOUS EXEMPLARY EMBODIMENTS

The present invention provides an alternative, improved real time solution to the problems of model-based control for example using model predictive control. In particular, by applying the technique generally known as “parametric optimisation” to the process model the invention allows control variables to be derived off-line for all operational parameters that will be encountered. The explicit analytical control solution thus constructed is embedded in a chip or other data store as a function of the operational parameters such that the process model does not have to be optimised at each time interval, hence reducing the processing burden significantly. Instead the control variables are immediately available as a function of the operational parameters and/or in look-up table form. Yet further the solution is viewable off-line and offers information on the problem to be solved.

Parametric Optimisation

The techniques of parametric or optimisation or parametric programming will be well known to the skilled person and the general principles are set out in Gal, T. (1995) “Postoptimal Analyses, Parametric Programming and Related Topics”, de Gruyter, New York and Dua, V. and E. N. Pistikopoulos (1999) “Algorithms for the Solution of Multiparametric Mixed-Integer Nonlinear Optimization Problems”, Ind. Eng. Chem. Res. 38, 3976-3987 which are incorporated herein by reference. In essence parametric optimisation is a mathematical technique by which a problem is first formulated as an optimisation problem, an objective function and optimisation variables are obtained as a function of parameters in the optimisation problem, and the region in the parameter space where the functions are valid are also obtained. In the most general form the parametric optimisation problem can be formulated as:
z (θ)=min z =( d T y+f ( x )) y, x
s.t. Ey+g ( x )≦ b+Fθ
θ min ≦θ≦θ max
x∈X custom character n
y∈Y={ 0, 1} m
θ∈Θ custom character s , (4)
where y is vector of 0-1 binary variables, x is a vector of continuous variables, f is a scalar, continuously differentiable function of x, g is a vector of continuously differentiable functions of x, b and d are constant vectors, E and F are constant matrices, θ is a vector of parameters, θ min and θ max are the vectors of lower and upper bounds on θ, and X and Θ are compact and convex polyhedral sets of dimensions n and s respectively.

This most general formulation requires minimisation of z, a function of optimization or control variables, x and y, to obtain them as a function of parameters which can be for example measurable states or system disturbances represented by vector θ. The generalised formulation covers cases where the control variables are continuous value vectors x, or binary value vectors y. The parameter values θ are bounded by minimum and maximum constraints. In the example discussed below the parameter values are measurable states.

Solutions are known for various special cases. For example where there is no control variable y (ie no binary variables), f(x) is quadratic and convex in x, where f(x) is defined to be convex if for any x 1 , x 2 ∈X and 0≦α≦1, f[(1−α)x 1 +αx 2 ]≦(1−α)f(x 1 )+αf(x 2 ), and g(x) is linear in x, the problem is reduced to one of a multiparametric Quadratic Program (mp-QP). The solution to this case is discussed in Dua et al. “An algorithm for the solution of multi-parametric quadratic programs” (1999) tech. Rep. D00.7, Centre for Process Systems engineering, Imperial College London, which is incorporated herein by reference. An example of the form of the solution to an mp-QP problem set out in Table 1 is now discussed.

TABLE 1
mp-QP Example: Mathematical Formulation
z ( θ ) = min x 1 , x 2 0.0098 x 1 2 + 0.0063 x 1 x 2 + 0.00995 x 2 2 s . t . x 1 0.417425 + 3.16515 θ 1 - 3.7546 θ 2 - x 1 3.582575 - 3.16515 θ 1 - 3.7546 θ 2 - 0.0609 x 1 0.413225 + 0.17355 θ 1 - 0.2717 θ 2 - 0.0064 x 1 0.467075 + 0.06585 θ 1 + 0.4714 θ 2 x 2 1.0902 + 1.8196 θ 1 - 3.2841 θ 2 - x 2 2.9098 - 1.8196 θ 1 + 3.2841 θ 2 0 θ 1 1 0 θ 2 1

As can be seen the function f(x) is a quadratic function of variables x 1 , x 2 . Each of x 1 and x 2 are further constrained dependent on state parameters θ 1 , θ 2 , which in turn are bounded. The function is minimised in control variable x 1 , x 2 space, ie the values of x 1 , x 2 are found for which f(x) is optimised.

The solution generated according to the Dua et. al. reference above takes the form of the plot in a coordinate space θ shown in FIG. 3. The axes are the state parameters θ 1 , θ 2 respectively and optimisation of the mp-QP problem demonstrates that there are only four possible control variable states across the bounded range of θ, represented by feasible regions #1 to #4 respectively. Accordingly, at any point in a process represented by the model in table 1, once state parameters have been measured, the region containing the coordinates (θ 1 , θ 2 ) is identified and the control variable values x 1 , x 2 are retrieved for that region. The control variables may be stored in the form of pure numbers or as simple optimised functions of θ 1 , θ 2 . In the specific example, where t 1 , t 2 represent θ 1 , θ 2 respectively, region definition as functions of θ 1 , θ 2 and the values or functions for x 1 , x 2 for each region are as follows:

    • Feasible region 1
  • x 1 =+0
  • x 2 =+0
  • −1*t 1 <=−0
  • +1*t 1 <=+1
  • −1*t 2 <=−0
  • +1*t 1 +1.18623*t 2 <=+1.13188
  • −1*t 1 +1.80485*t 2 <=+0.599143
    • Feasible region 2
  • x 1 =+3.16515*t 1 +3.7546*t 2 −3.58257
  • x 2 =+1.8196*t 1 −3.2841*t 2 +1.0902
  • +1*t 2 <=+1
  • −1.38941*t 1 −1*t 2 <=−1.19754
  • +1.34655*t 1 −1*t 2 <=+0.0209892
    • Feasible region 3
  • x 1 =−0.584871*t 1 +1.0556*t 2 −0.350421
  • x 2 =+1.8196*t 2 −3.2841*t 2 +1.0902
  • −1*t 1 <=−0
  • +1*t 2 <=+1
  • +1.38941*t 1 +1*t 2 <=+1.19754
  • +1*t 1 −1.80485*t 2 <=−0.599143
    • Feasible region 4
  • x 1 =+3.16515*t 1 +3.7546*t 2 −3.58257
  • x 2 =−1.00203*t 1 −1.18864*t 2 +1.13418
  • +1*t 1 <=+1
  • +1*t 2 <=+1
  • −1.34655*t 1 +1*t 2 <=−0.0209892
  • −1*t 1 −1.18623*t 2 <=−1.13188

It can be seen that for regions 1, x 1 and x 2 have fixed values, whereas for regions 2 to 4 x 1 and x 2 are expressed as functions of the coordinates (θ 1 , θ 2 )—it will be noted that x 1 and x 2 will thus vary within a given region dependent on their position in that region.

Another special case is where f(x) and g(x) are linear in x. The problem is then presented as a multiparametric Mixed Integer Linear Program (mp-MILP) for which algorithms have been developed as discussed in Acevedo J. and Pistikopoulos E. N. “A Multiparametric Programming Approach for Linear Process Engineering Problems under Uncertainty” (1997) Ind. Eng. Chem. Res. 36, 717-728 which is incorporated herein by reference.

An mp-MILP problem is set out in Table 2

TABLE 2
mp-MILP Example: Mathematical Formulation
z(θ) = min − 3x 1 − 2x 2 + 10y 1 + 5y 2
y, x
s.t. x 1 ≦ 10 + θ 1
x 2 ≦ 10 − θ 1
x 1 + x 2 ≦ 20
x 1 + 2x 2 ≦ 12 + θ 1 − θ 2
x 1 − 20y 1 ≦ 0
x 2 − 20y 2 ≦ 0
−x 1 + x 2 ≧ 4 − θ 2
y 1 + y 2 ≧ 1
x n ≧ 0, n = 1, 2
y 1 ε {0, 1}, 1 = 1, 2
2 ≦ θ s ≦ 5, s = 1, 2.

In this case f(x) and g(x) are linear functions of continuous variables x 1 , x 2 and of binary variables y 1 , y 2 . The solution generated according to the Acevedo and Pistikopoulos reference above takes the form of the plot of θ 1 , θ 2 shown in FIG. 4, in this case having five feasible regions with optimal solution as set out below:
    • Feasible region 1
  • x 1 =0
  • x 2 =0.5*t 1 −0.5*t 2 +6
  • Binary vector y=[0 1]
  • −1*t 1 <=−2
  • −1*t 2 <=−2
  • +3*t 1 −1*t 2 <=+8
  • +1*t 2 <=+5
    • Feasible region 2
  • x 1 =0.333333*t 1 +0.333333*t 2 +1.333333
  • x 2 =0.333333*t 1 −0.666666*t 2 +5.333333
  • Binary vector y=[1 1]
  • +1*t 1 <=+5
  • −1*t 2 <=−2
  • +2*t 1 −1*t 2 <=+7
  • −11*t 1 +1*t 2 <=−46
  • +1*t 2 <=+5
    • Feasible region 3
  • x 1 =0
  • x 2 =−1*t 1 +10
  • Binary vector y=[0 1]
  • −1*t 2 <−2
  • −3*t 1 +1*t 2 <=−8
  • +11*t 1 −1*t 2 <=+46
  • +1*t 2 <=+5
    • Feasible region 4
  • x 1 =−1*t 1 +1*t 2 +6
  • x 2 =−1*t 1 +10
  • Binary vector y=[1 1]
  • +1*t 1 <=+5
  • −1*t 2 <=−2
  • −2*t 1 +1*t 2 <=−7
  • +1*t 1 −1*t 2 <=+2.66667
    • Feasible region 5
  • x 1 =0
  • x 2 =−1*t 1 +10
  • Binary vector y=[0 1]
  • +1*t 1 <=+5
  • −1*t 2 <=−2
  • −1*t 1 +1*t 2 <=−2.66667
    where t 1 and t 2 correspond to θ 1 and θ 2 respectively.

It will further be recognised that the presentation of the solution in this simple, explicit form offers insights into the control process as a whole. Most significantly, it indicates the extent to which the state measurements are required for process control. For example in more complex processes having a large number of measured states it is entirely possible that the explicit solution will turn out to be independent of one or more of the measured states as a result of which the process control hardware can be designed or modified to eliminate the corresponding state measurement device and the software to eliminate the processing of related measured state data so rendering the process control scheme for efficient and economic operation at all levels.

The skilled person will be aware of other special cases for which the parametric optimization solution is known and further discussion of those is thus not required here.

Application of Parametric Optimisation Techniques

Using these techniques a model-based problem can be optimised according to the present invention using parametric optimisation providing control actions as a function of measurements from a plant to be controlled, by defining the control variables as the optimisation variables and the state of the plant as parameters. Then, during real time operation, as soon as the measurements from the plant are obtained, this function is evaluated to obtain the control actions using the on-line optimisation routine designated generally 20 in FIG. 5.

According to this approach a model-based problem to be optimised is formulated for the plant/system/process 22 in a known manner. An explicit control solution, parametric profile 24 , is constructed off-line using parametric optimisation techniques 26 . In the simplified scheme shown, the profile is represented as a two-dimensional plot of state variables as input and control variables as output, but it will be appreciated that the profile can be multi-dimensional and include function evaluation dependent on the state variable defined region as discussed above with reference to FIGS. 3 and 4. In on-line operation of the plant 22 , therefore, the state variables are entered to the profile as inputs 28 and the control actions 30 derived or looked up instantly and fed back to the plant 22 . As a result the processing burden is shifted to the front end and on-line processing is minimised.

Returning to the MPC problem of equation (3); the function J(U, x(t)) can be formulated as a Quadratic Programming (QP) problem by expanding the formula set out in equation (3) for x t+k+1 at time t as the summation:

x t + k t = A k x ( t ) + j = 0 k - 1 A j Bu t + k - 1 - j ( 5 )

This term is substituted into equation (3) to yield by simple algebraic manipulation the QP Problem:

J ( U , x ( t ) ) = min U 1 2 U HU + x ( t ) FU + 1 2 x ( t ) Yx ( t ) s . t . GU W + Ex ( t ) , ( 6 )
where U Δ [u′ t , . . . , u′ t+Nu−1 ]′∈ custom character s , s Δ mN u , is the vector of optimisation variables, H=H 1 custom character0, and H, F, Y, G, W, E are obtained from Q, R and (3) and (5).

The QP problem represented by equation (6) can be formulated as the mp-QP again using simple algebraic manipulation:

μ ( x ) = min z 1 2 z Hz s . t . Gz W + Sx ( t ) , ( 7 )
where z Δ U+H −1 F′x(t), z∈R s , represents the vector of optimisation variables, S Δ E+GH −1 F′ and x represents the vector of parameters.

It will be appreciated that the above derivation is performed based on predictions for discrete future intervals t, t+1 . . . t+k i.e. in the discrete time domain, but similar techniques can be applied to obtain the mp-QP problem in the continuous time domain, i.e. continuing to take measurements at discrete intervals t, but predicting from those measurements future continuous profiles of the state variable at a time t+k where the intermediate intervals t+1 . . . t+k−1 are infinitesimal.

In this case equation (6) is rewritten as:

ϕ ^ ( θ ) = min x , v 1 2 x ( t f ) T P 1 x ( t f ) + P 2 x ( t f ) ++ t o t f [ 1 2 x ( t ) T Q 1 x ( t ) + Q 2 x ( t ) + 1 2 v ( t ) T R 1 v ( t ) + R 2 v ( t ) ] t ( 8 )

  • s.t. {dot over (x)}(t)=Ax(t)+Bv(t)+Cθ(t)
  • initial condition (I. C.).: x(t o )=x o (θ, v)
  • B 1 ·v(t i )+A 1 ·x(t i )+C 1 ·θ(t i )+b≦0

y ( t ) = Dx ( t ) + Hv ( t ) + F θ ( t ) y min y ( t ) y max - t 0 t t f Path Constraints i = 0 , 1 , 2 , N f θ Θ s

where A, B, C, B 1 , A 1 , C 1 , H, D, F are time invariant matrices of dimensions n×n, n×m, n×s, q×m, q×n, q×s, r×m, r×n, r×s respectively and b is a vector of dimension n. Q 1 , P 1 , R 1 , P 2 , Q 2 , R 2 are symmetric matrices. x∈ custom character n is the vector of the state time dependent variables, v∈ custom character m is the vector of the optimisation variables, y∈ custom character z is the vector of algebraic variables including measurements and θ is the vector of the uncertain parameters. Note that the terms x(t f ) T P 1 x(t f ) and

t o t f [ 1 2 x ( t ) T Q 1 x ( t ) + 1 2 v ( t ) T R 1 v ( t ) ] t
represent the 2-norm of the state and control variables from the origin, whereas the terms ∥P 2 x(t f )∥ and

t o t f [ Q 2 x ( t ) ++ R 2 v ( t ) ] t
represent the 1- or ∞-norms of the state and control deviations from the set point. The time horizon t f of this problem is considered finite. The point constraints are imposed at N f discrete instants within the horizon. The optimisation variables, v, are called “control variables”. The initial conditions set out in the “subject to” field comprise the control problem to be solved.

Note that in (8), we have integrals and differential equations in the continuous model, whereas in (3) we had summation in the objective function and discretized model. Problem (8) is described in (i) Anderson, B. D. and J. B. Moore (1989) “Optimal Control: Linear Quadratic Methods”, Prentice Hall, Englewood Cliffs, N.J., (ii) Bryson, A. E. and Y. Ho (1975) “Applied Optimal Control”, Taylor and Francis, New York, and (iii) Kwakernak, H. and R. Sivan (1972) “Linear Optimal Control Systems”, Wiley Interscience, New York all of which are incorporated herein by reference.

The result of a parametric analysis on problem (8) is to express the optimal objective (φ) and the optimisation variables (v) as a function of the parameters (θ) for the complete space of the parameters variations. This can be achieved by transforming problem (8) to a form that can be solved with the current techniques of steady state parametric programming. Such a form in this case is the mp-QP formulation.

By adapting control vector parameterisation for solving the optimal control problem (e.g. “Off-line Computation of Optimum Controls for Plate Distillation Column” Pollard and Sargent, 1970 Automatica 6, 59-76, incorporated herein by reference), the optimisation problem can be considered only in the reduced space of v variables. This of course requires the explicit mapping of the x variables that appear in the constraints and the objective as a function of v,θ. This expression can be obtained by solving the linear ODE system in equation (8). The solution of this system is exact and in the case of time-invariant parameters and optimisation variables, is given by the analytical expression:

x ( t , v , θ ) = A ( t - to ) x o + At t o t - At ( Bv ( t ) + C θ ( t ) ) t ( 9 )

e At is the exponent of a matrix that is defined through eigenvalue or other decomposition analysis methods (“Matrix Computation”, Second Edition Colub and Van Loan 1990, The John Hopkins University Press).

The integral evaluation in equation (9) requires that the form of the profile of the uncertainty and control variables over time be specified. Control variables are usually represented as piecewise polynomial functions over time where the values of the coefficients in the polynomial are determined during the optimization (Vassiliadis, V. S., R. W. H. Sargent and C. C. Pantelides (1994) “Solution of a Class of Multistage Dynamic Optimization Problems. 1. Problems without Path Constraints.” Ind. Eng. Chem. Res. 33, 2111-2122 incorporated herein by reference). Note that if the order of the polynomial is assumed to be zero the control profiles correspond to a piecewise constant discretization. For the case of uncertainty, θ, it is described by using periodic harmonic oscillations, i.e. sinusoidal functions over time, of uncertain amplitude or mean value (Kookos, I. K and J. D. Perkins (2000) “An Algorithm for Simultaneous Process Design and Control”, Tech. Rep. A019, Centre for Process Systems Eng., Imperial College, London incorporated herein by reference). Note that more complex, forms of periodic functions can be reduced to a linear combination of sinusoidal functions by using Fourier analysis. By substituting (9) into (8) and hence eliminating the system of differential equations the problem is transformed as follows:

ϕ ( θ ) min v = 1 2 x ( t f , v , θ ) T P 1 x ( t f , v , θ ) + P 2 x ( t f , v , θ ) + t o t f [ 1 2 x ( t , v , θ ) T Q 1 x ( t , v , θ ) + Q 2 x ( t , v , θ ) + 1 2 v ( t ) T R 1 v ( t ) + R 2 v ( t ) ] t s . t . A 1 · x ( t j , v , θ ) + B 1 · v ( t i ) + C 1 θ ( t i ) + b 0 y ( t ) = Dx ( t , v , θ ) + Hv ( t ) + F θ ( t ) y min y ( t ) y max ( 10 )
By evaluating the matrix time integrals in equation (10), the objective function is expressed explicitly as a quadratic time invariant function of the parameters θ and the control variables v only. The same does not apply however, to the path constraints that are an explicit function of the control variables, the parameters and the time. The time dependence of such constraints renders problem (10) infinite dimensional. This difficulty is surpassed by applying the following methodology for converting the infinite dimensional path time-varying constraints to an equivalent finite number of point constraints:

  • 1. Consider a finite number of interior point constraints that have to be satisfied only at particular points within the horizon.
  • 2. Solve the optimization problem for this particular set of interior constraints.
  • 3. Now test whether the same constraints are satisfied for every time instant during the complete time horizon.
  • 4. If some of the constraints are violated at particular points t k , then augment these points into Step 1 and continue until the constraints are satisfied for the complete time horizon.

This methodology transforms the path constraints that have to be satisfied throughout the complete time-horizon to an equivalent series of point constraints that hold only at particular time points and therefore, are inherently finite.

Hence the time in the path constraints of (10) is substituted by an appropriate set of fixed time instants t k , k=1 . . . K. Consequently the constraints become a linear function of the control variables and parameters only. Thus the equivalent mathematical description of problem (10) is the following:

ϕ ^ = min v 1 2 ( L 1 + L 2 T v + L 3 T θ + v T L 4 v + θ T L 5 v + θ T L 6 θ ) s . t . G 1 v G 2 + G 3 θ ( 11 )
where L 1 is a scalar constant and L 2 , L 3 , L 4 , L 5 and L 6 are constant vectors and matrices of appropriate dimensions.

Problem (11) is now a multiparametric quadratic program (mp-QP) and its solution provides the control variables as a function of the state variables and uncertain parameters, similarly as in the discrete time case.

As a result, known parametric optimisation techniques for mp-QP problems can be applied to MPC problems in the discrete or continuous time domain to obtain the full solution set for z and hence u as an affine function of x of the form:
u=p T x+q (12)
where p is a constant vector and q is a scalar constant, for the complete feasible space of x (ie. the full available range of control variables) using appropriate algorithms and techniques such as those set out in the Dua et. al. reference identified above and as will be well-known to the skilled person. This is all performed off-line, such that on-line the only control calculations are those of evaluating or solving the functions derived for the control variables.

A limitation of the system described above is that it does not take into account model inaccuracies and constant disturbances except to the extent that the disturbances can be modeled as additional parameters. Accordingly inaccurate forecasting of the process behavior can lead to infeasabilities such as off-specification production, excessive waste disposal or even hazardous plant operation. Below there are discussed two general methodologies for compensating for disturbances.

In real processes there are usually disturbances due to sensor malfunctioning, degrading performance of the process or system due to catalyst fouling, noise, human error or mistake, cost or model inaccuracies, amongst other possible factors. These disturbances cannot always be measured and accordingly it is desirable to take such disturbances into account in deriving the optimal control law.

Rewriting equation (3) above, an appropriate formulation for deriving an explicit model-based control law for a process system is as follows:

φ ( x t 0 ) = min v 1 s N x t N T Px t N + k = 0 N - 1 [ y t k T Qy t k + v t k T Rv t k ] s . t . x t k + 1 = A 1 x t k + A 2 v t k y t k = B 1 x t k + B 2 v t k x t 0 = x * 0 g ( y k t , x k t , v k t ) = C o y t k + C 1 x t k + C 2 v t k + C 4 k = 0 , 1 , 2 N ( 13 )
where x∈X custom character n are the states, y∈ custom character m , are the outputs and v∈ custom character q are the controls. The outputs are the variables that we aim to control, i.e. to drive to their set-point y o , (which might be temperatures, concentrations) whereas the states are the variables that fully characterize the current process conditions (which might be enthalpies, internal energies, volume). v N denotes the sequence of the control vector over the receding horizon. Note that in (13) the outputs participate in the objective function instead of the states. Since the outputs are linear function of the states, with proper rearrangement on the weighting matrix Q this formulation (13) is equivalent to equation (3) above.

By considering the current states x t as parameters, problem (13) is recast as a multiparametric quadratic program (mp-QP) of the form given in (7). The solution of that problem corresponds to an explicit control law for the system that expresses the optimum control action in terms of the current states. The mathematical form of this parametric controller, similar to that given in (12), is as follows:
v ct|0 ( x *)= a c x*+b c ;
CR c 1 x*+CR c 2 ≦0
for c=1, . . . , N c (14)
where N c is the number of regions in the state space. Matrices a c , CR 1 c and vectors b c , CR 2 c are determined from the solution of the parametric programming problem and the index c designates that each region admits a different control law. Vector v ct|0 is the first element of the control sequence, similar expressions are derived for the rest of the control elements.

The model-based parametric controller described in the previous paragraph does not account for the impact of persistent slowly varying unmeasured disturbances and uncertainties of the type discussed above that either enter the system as inputs or derive from modelling errors and time varying process characteristics. These disturbances result in an offset, i.e. a permanent deviation, of the output variables from their target values and additionally may cause constraint violations. As discussed below, according to the invention two possible solution techniques are introduced: Proportional Integral (PI) control, and origin re-adjustment. The suitable model readjustment according to disturbance estimates, enables the recursive on-line adaptation of the model based controller to the current conditions.

FIG. 6 illustrates the situation where a step disturbance enters and propagates in a plant controlled by the controller discussed above. In the illustration shown in FIG. 6 “conventional parco” refers to a model-based controller according to the discussion above whereas “PI-parco” refers to parametric PI. It can be seen from the resultant profile shown in FIG. 7 of the controlled output that it is driven closer to the set point but there is an off-set between the set point y set , in this case y set=0 and the output y:
Δ y=y−y set (15)

The reason for the off-set is that the model has not predicted the presence of the disturbance.

Following the fist approach according to the invention, to eliminate the off-set an integral state is incorporated in the model-based optimisation framework. This provides off-line derived parametric proportional integral controller (“Parametric PI”). As discussed in more detail below, in particular an integral state is added into the dynamic system, and is also added in the objective function with a particular waiting penalty. The updated problem is solved again to obtain the model-based parametric control law discussed above.

In conventional feedback control schemes, Seborg et al., (1989) “Process Dynamics & Control”, Wiley & Sons, integral action is incorporated for attenuating any permanent deviation of the output variables from their set-points due to the presence of disturbances. This gives rise to the so-called proportional integral controller (PI-controller). Here, the incorporation of the integral action for the same purpose is achieved by introducing an integral state that is equal to the anticipated deviations of the output from its reference point, usually the origin. This state is augmented as an additional quadratic penalty in the objective function (Kwakernaak and Sivan, 1972) “Linear Optimal Control Systems”, John Wiley & Sons Ltd. This technique has also been adopted by the Generic Model Control framework (Lee and Sullivan, 1988 “Generic Model Control (GMC)” Comput. Chem. Eng. 12(6), 573-580), but in that control scheme no state constraints or other model characteristics are considered and on-line optimization is required for deriving the control actions. Equation (13) after the incorporation of the integral state is modified as follows:

φ ( x t 0 ) = min v k t N x t N T Px t N + xq t N T P 1 xq t N + k = 0 N - 1 [ y t N T Qy t k + v t N T Rv t k + xq t k T Q 1 xq t k ] s1 . x t k + 1 = A 1 x t k + A 2 v t k y t k = B 1 x t k + B 2 v t k xq t k + 1 = xq t k + y t k x t 0 = x * xq t 0 = xq * 0 g ( y k t , x k t , v k t ) = C o y t k + C 1 x t k + C 2 v t k + C 4 k = 0 , 1 , 2 N xq t k m ( 16 )
where xq is the integral state; Q 1 , P 1 are the quadratic costs corresponding to that state. Note that the terms in bold take into account integral action and are the additional terms when comparing to (13).

Equation (16) and the associated conditions effectively introduce the additional state xq as an additional term in the objective function and as an additional condition dependent on the preceding integral state value and the respective output.

By eliminating the equalities associated with the dynamic system and considering the current pure and integral states as parameters a multiparametric quadratic program similar to equation (7) is formulated. The solution of this mp-QP corresponds to the following piecewise affine control law:
v ct|0 ( x *)= a c x*+b c +d c xq*;
CR c 1 x*+CR c 2 +CR c 1 xq* ≦0
for c=1, . . . N c (17
which is similar to that given in equation (12).

The piecewise affine multivariable controller represented by equation (4) contains a proportional part a c x t (t*) with respect to the states, an integral part d c xq t in terms of the outputs and a bias b c , hence it is a parametric proportional integral controller (Parametric PI). This control law is asymptotically stable, thus it guarantees no steady state offset from the target point on condition that (i) the dimension of the controls is larger or equal to the output dimension q≧m, which is the prevailing case in control problems (ii) the open-loop transfer matrix defined from the equation: H(s)=B 1 )(sI−A 1 ) −I A 2 +B 2 posses no zeros at the origin and (iii) the quadratic cost matrix Q 1 that penalizes the integral error is positive-definite.

Similarly, derivative action can be accommodated in the parametric control law. An algebraic variable is introduced in the formulation that is equal to the difference between the current and the preceding output variable. This variable is penalized in the objective function as follows:

φ ( x t 0 ) = min v k t N jx t N T Px t N + xq t N T P 1 xq t N + k = 0 N - 1 [ y t k T Qy t k + v t k T Rv t k + xq t k T Q 1 xq t k + y d t k T Q z y d t k ] s . t . x t k + 1 = A 1 x t k + A 2 v t k k = 0 , 1 , 2 , N y t k = B 1 x t k + B 2 v t k k = 0 , 1 , 2 , N xq t k + 1 = xq t k + y t k