[go: up one dir, main page]
Next Article in Journal / Special Issue
Fractional Differential Texture Descriptors Based on the Machado Entropy for Image Splicing Detection
Previous Article in Journal
Energetic and Exergetic Analysis of an Ejector-Expansion Refrigeration Cycle Using the Working Fluid R32
Previous Article in Special Issue
Generalized Boundary Conditions for the Time-Fractional Advection Diffusion Equation
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Entropy
Volume 17
Issue 7
10.3390/e17074762
entropy-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

H∞ Control for Markov Jump Systems with Nonlinear Noise Intensity Function and Uncertain Transition Rates

by
Xiaonian Wang
and
Yafeng Guo
*
Department of Control Science and Engineering, Tongji University, Shanghai 201804, China
*
Author to whom correspondence should be addressed.
Entropy 2015, 17(7), 4762-4774; https://doi.org/10.3390/e17074762
Submission received: 30 April 2015 / Revised: 19 June 2015 / Accepted: 1 July 2015 / Published: 6 July 2015
(This article belongs to the Special Issue Complex and Fractional Dynamics)
Browse Figures

<p>State response of the open-loop system with 1000 random samplings.</p> ">
<p>State response of the closed-loop system with 1000 random samplings.</p> ">
<p>Functional cost <span class="html-italic">J</span>(<span class="html-italic">T<sub>f</sub></span>) with 1000 random samplings.</p> ">
Versions Notes

Abstract

:
The problem of robust ℋ∞ control is investigated for Markov jump systems with nonlinear noise intensity function and uncertain transition rates. A robust ℋ∞ performance criterion is developed for the given systems for the first time. Based on the developed performance criterion, the desired ℋ∞ state-feedback controller is also designed, which guarantees the robust ℋ∞ performance of the closed-loop system. All the conditions are in terms of linear matrix inequalities (LMIs), and hence they can be readily solved by any LMI solver. Finally, a numerical example is provided to demonstrate the effectiveness of the proposed methods.

1. Introduction

Many dynamical systems are subject to random abrupt changes, which may be caused by random failures and repairs of the components, changes in the interconnections of subsystems, sudden environment changes, etc. Most of the traditional dynamical systems are usually powerless to face these random abrupt changes. However, Markov jump systems (MJSs), a special class of stochastic hybrid systems, are suitable mathematical model to describe such systems. As a result, MJSs have been widely applied in many fields, such as unmanned air vehicles [1], solar power stations [2], communication systems [3], power systems [4], economics [5], and so on.
MJSs have been widely investigated and many useful results have obtained, such as the controllability and observability [6], controller design [6–9] and filtering [10,11]. For more extensive introductions, the interested reader is referred to an important monograph about MJSs [12]. It is noticed that in almost all reported results, only linear MJSs are considered. It is well known that the nonlinearity is an inevitable feature of almost all real-world systems. The existence of nonlinearity may lead to undesirable behavior of the systems. Therefore, MJSs with nonlinearity also attract researcher’s attention; see [13–15] and references therein.
For MJSs, the transition rates are crucial to determine the behavior of the systems. Thus, the main investigation on MJSs is to assume that the information on transition rates is completely known. However, in practice, only estimated values of transition rates are available, and estimation errors, i.e., the uncertainties of the transition rates, may lead to instability or at least degraded performance of a system. Therefore, no matter in the theory or in practice, it is necessary to further consider more general jump systems with uncertain transition rates. There have been some reports regarding control of this type of system in the literature. For example, in [16], the stability and control problems are considered for linear MJSs with uncertain transition rates by using restrictive Young inequality. By using general Young inequality, in [17] less conservative results than that of [16] are proposed. Due to the use of Young inequality, the proposed controller design methods in both [16] and [17] need to solve a set of nonlinear matrix inequalities (NLMIs). Unfortunately, such NLMIs cannot still be completely solved up to now [18]. Moreover, in the existing literatures, only linear MJSs with uncertain transition rates were studied. To the author’s best knowledge, the problem of ℋ∞ control for MJSs with nonlinear noise intensity function and uncertain transition rates has not been fully investigated. It still remains important and challenging.
This paper is concerned with the robust ℋ∞ control for MJSs with nonlinear noise intensity function and uncertain transition rates. First, the robust ℋ∞ performance criterion is derived. Then, ℋ∞ controller design method is presented based on the proposed performance criterion. Instead of using the traditional Young inequality, we adopt an improved bounding technique for the uncertain terms. As a benefit, the obtained controller design method only needs to solve a set of pure linear matrix inequalities (LMIs) rather than NLMIs, which can be readily solved by any LMI solver. Finally, a numerical example is given to show the effectiveness of the proposed methods.
Notations: The notations in this paper are quite standard. Throughout this paper, ℝn and ℝn×m denote respectively the n-dimensional Euclidean space and the set of all n × m real matrices. The superscript T denotes transpose. The notation X ≥ Y (respectively, X > Y) where X and Y symmetric matrices, means that X − Y is positive semidefinite (respectively, positive definite). I denotes the identity matrix of appropriate dimension. L2[0, ∞) is the space of square integrable functions. ( Ω , ℱ , { ℱ t } t ≥ 0 , P ) is a complete probability space with a filtration {ℱt}t≥0 satisfying the conditions that it is right continuous and ℱ0 contains all P−null sets. ℰ{⋅} stands for the mathematical expectation. trace{A} denotes the trace of a matrix A. We use ∗ as an ellipsis for the terms that are introduced by symmetry. diag{·,⋯,·} stands for a block-diagonal matrix. Matrices, if their dimensions are not explicitly stated, are assumed to be compatible for algebraic operations.

2. Problem Description

Consider the following MJS with nonlinear noise intensity function and uncertain transition rates.
d x t = [ A ( r t ) x t + B ( r t ) u t + B v ( r t ) v t ] d t + f ( x t , r t ) d w t ,
z t = C ( r t ) x t + D ( r t ) u t + D v ( r t ) v t ,
where x t ∈ ℝ n x is the state u t ∈ ℝ n u is the control input v t ∈ ℝ n v is the disturbance input which belongs to L2[0, ∞], z t ∈ ℝ n z is the controlled output, f : ℝ n x × S → ℝ n x × n w is the nonlinear noise intensity function, and w t ∈ ℝ n w is an nw-dimention Brownian motion satisfying ℇ{dwt} = 0, ℇ{dwt(dwt)T} = Idt. The mode jump process {rt} is a continuous-time, discrete-state Markov process taking values in a finite set S = { 1 , 2 , … s } and has mode transition probabilities:
Pr { r t + Δ = j | r t = i } = { π ^ i j Δ + o ( Δ ) , if i ≠ j , 1 + π ^ i j Δ + o ( Δ ) , if i = j ,
where Δ > 0, limΔ→0{o(Δ)/Δ}=0, π ^ i j ≥ 0 for i ≠ j, is the transition rate from mode i at time t to mode j at time t + Δ, and π ^ i i = − ∑ j = 1 , j ≠ i s π ^ i j for each mode i. In addition, we assume that the Markov process {rt} is independent of the Brownian motion {wt}.
In this paper, the noise intensity function f(·,·) and the transition rate matrix Π ^ = { π ^ i j } , ∀ i , j ∈ S cannot be exactly obtained. It is only known that f(·,·) satisfies the following growth condition:
trace ( f T ( x t , r t ) f ( x t , r t ) ) ≤ ‖ F i x t ‖ 2 , f ( 0 , r t ) ≡ 0 , ∀ r t = i ∈ S .
where Fi, ∀ i ∈ S is a known constant matrix.
As for Π ^, only its admissible uncertainty domain is known:
D π = { Π ^ = Π + Δ Π : | Δ π i j | ≤ ε i j , ε i j ≥ 0 , for all i , j ∈ S , j ≠ i } ,
where Π = ( π i j ) , ∀ i , j ∈ S is a known constant matrix, while ∆Π = (∆πij) denotes the uncertainty of the mode transition rate matrix. For all i , j ∈ S , j ≠ i , π i j ( ≥ 0 ) denote the estimate of π ^ i j and Δ π i j = π ^ i j − π i j is the estimate error, which can take any value in [−εij, εij]; for all i ∈ S, one has π i j = − ∑ j = 1 , j ≠ i s π i j and Δ π i j = − ∑ j = 1 , j ≠ i s Δ π i j.
In this paper, we only consider a mode-dependent linear state-feedback control law
u t = K ( r t ) x t ,
where K i = K ( r t = i ) ∈ ℝ n x × n u, i ∈ S, are the controller gain matrices to be designed. Substituting the state-feedback controller (6) into system (1) one yields the corresponding closed-loop system
d x t = [ A ¯ ( r t ) x t + B v ( r t ) v t ] d t + f ( x t , r t ) d w t , z t = C ¯ ( r t ) x t + D v ( r t ) v t ,
where
A ¯ ( r t ) = A ( r t ) + B ( r t ) K ( r t ) , C ¯ ( r t ) = C ( r t ) + D ( r t ) K ( r t ) .
Certainly, the resulting closed-loop system (7) is also a MJS with nonlinear noise intensity function and uncertain transition rates. Now, for a more precise description of the main objective in this paper, we introduce the following definitions for the underlying system.
Definition 1. [19] The system (7) is said to be robustly stochastically stable if with vt = 0
lim t → ∞ ε { ‖ x t ‖ 2 } = 0
holds for any initial conditions and over all the admissible noise intensity functions and transition rates satisfying (4)–(5).
Definition 2. [19] Given a scalar γ > 0, the system (7) is said to be robustly stochastically stable with disturbance attenuation level γ if it is robustly stochastically stable, and under zero initial conditions, ‖ z t ‖ ε 2 2 ≤ γ 2 ‖ v t ‖ 2 2 is satisfied for all nonzero vt ∈ L2[0, ∞) and over all the admissible noise intensity functions and transition rates satisfying (4)–(5), where
‖ z t ‖ ε 2 2 = ε { ∫ 0 ∞ ‖ z t ‖ 2 d t } .
Now, we are in a position to propose the object of the paper. The purpose is to design a linear state-feedback controller (6), such that the resulted closed-loop system (7) is robustly stochastically stable with a given disturbance attenuation level γ over all the admissible noise intensity functions and transition rates.
The following lemma will be used in the sequel.
Lemma 1. (Schur Complement [20]) Given constant matrices Ω1, Ω2 and Ω3, with Ω 1 = Ω 1 T and 0 < Ω 2 = Ω 2 T then Ω 3 T Ω 2 − 1 Ω 3 − Ω 1 < 0if and only if
[ − Ω 1 Ω 3 T * − Ω 2 ] < 0 o r [ − Ω 2 Ω 3 * − Ω 1 ] < 0.
For the sake of simplicity, in the rest of the paper a matrix A(rt = i) will be denoted by Ai.

3. Robust Stochastic ℋ∞ Performance Analysis

In this section, the ℋ∞ performance analysis problem of system (7) is considered. The following theorem gives a robust stochastic ℋ∞ performance criterion for system (7).
Theorem 1. Consider the MJS (1) with nonlinear noise intensity function and uncertain transition rates. Given the controller gains Ki, i ∈ S, the closed-loop system (7) is robustly stochastically stable with disturbance attenuation level γ if there exist matrices Pi > 0, Mij ≥ 0, i, j ∈ S, j ≠ i, and scalars αi, i ∈ S such that for ∀ i ∈ S the following LMIs are feasible.
[ Θ i P i B v i C ¯ i T * − γ 2 I D v i T * * − I ] < 0 ,
P i − α i I ≤ 0 ,
P j − P i − M i j ≤ 0 , ∀ j ∈ S , j ≠ i ,
where
Θ i = A ¯ i T P i + P i A ¯ i + α i F i T F i + ∑ j = 1 , j ≠ i s { π ¯ i j ( P j − P i ) + 2 ε i j M i j } , π ¯ i j = π i j − ε i j .
Proof. Construct a stochastic Lyapunov function candidates as
V ( x t , r t , t ) = x t T P ( r t ) x t ,
where Pi i ∈ S are symmetric positive definite matrices with appropriate dimensions to be determined.
Let ℒ be the weak infinitesimal generator of the random process {xt, rt}. Then, for each rt = i, i ∈ S, it can be shown that
ℒ V ( x t , i , t ) = x t T ( ∑ j = 1 s π ^ i j P j ) x t + 2 x t T P i [ A ¯ i x t + B v i v t ] + trace [ f T ( x t , i ) P i f ( x t , i ) ] .
From (4) and (9), we have
trace [ f T ( x ( t ) , i ) P i f ( x ( t ) , i ) ] ≤ α i x T ( t ) F i T F i x ( t ) .
In addition, noticing π ^ i i = − ∑ j = 1 , j ≠ i s π ^ i j , π ^ i j = π i j + Δ π i j and π ¯ i j = π i j − ε i j, we have
∑ j = 1 s π ^ i j P j = ∑ j = 1 , j ≠ i s π ^ i j P j − ∑ j = 1 , j ≠ i s π ^ i j P j = ∑ j = 1 , j ≠ i s π ^ i j ( P j − P i ) = ∑ j = 1 , j ≠ i s [ ( π i j − ε i j ) + ( ε i j + Δ π i j ) ] ( P j − P i ) = ∑ j = 1 , j ≠ i s { π ¯ i j ( P j − P i ) + ( ε i j + Δ π i j ) ( P j − P i ) } .
Noticing Mij ≥ 0, ∆πij ∈ [−εij, εij], ∀i, j ∈ S, j ≠ i, and (10), we have
( ε i j + Δ π i j ) ( P j − P i ) ≤ ( ε i j + Δ π i j ) M i j ≤ 2 ε i j M i j , ∀ i , j ∈ S , j ≠ i .
Applying (15) to (14), we have
∑ j = 1 s π ^ i j P j ≤ ∑ j = 1 , j ≠ i s { π ¯ i j ( P j − P i ) + 2 ε i j M i j } .
Then, from (12), (13) and (16), we obtain
ℒ V ( x t , i , t ) + z t T z t − γ 2 v t T v t ≤ x t T ( ∑ j = 1 , j ≠ i s { π ¯ i j ( P j − P i ) + 2 ε i j M i j } ) x t + 2 x t T P i [ A ¯ i x t + B v i v t ] + x t T ( α i F i T F i ) x t + z t T z t − γ 2 v t T v t = ξ t T Ψ i ξ t ,
where
ξ t T = [ x t T v t T ] ,
Ψ i = [ Θ i P i B v i * − γ 2 I ] + [ C ¯ i T D v i T ] [ C ¯ i D v i ] .
From (17), we know that ℒ V ( x t , i , t ) + z t T z t − γ 2 v t T v t ≤ 0 if Ψi < 0. By the Schur complement, one can see that (8) guarantees Ψi < 0. Thus, ℒ V ( x t , i , t ) + z t T z t − γ 2 v t T v t ≤ 0 holds. Integrating both sides with respect to t over the time period [0, ∞), we have
∫ 0 ∞ ℒ V ( x t , i , t ) d t + ∫ 0 ∞ [ z t T z t − γ 2 v t T v t ] d t ≤ 0.
In addition, by Itô’s formula, we can derive
ε ∫ 0 ∞ ℒ V ( x t , i , t ) d t = ε V ( x ∞ , r ∞ , ∞ ) − ε V ( x 0 , r 0 , 0 ) .
Therefore, taking the mathematical expectation on both sides of (18), we have
ε V ( x ∞ , r ∞ , ∞ ) − ε V ( x 0 , r 0 , 0 ) + ε ∫ 0 ∞ z t T z t d t − γ 2 ∫ 0 ∞ v t T v t d t ≤ 0.
Under zero initial conditions, we have ℇV (x0, r0, 0) = 0 and ℇV (x∞, r∞, ∞) ≥ 0, thus (20) guarantees ‖ z t ‖ ε 2 2 ≤ γ 2 ‖ v t ‖ 2 2.
The second task is to show robustly stochastically stability of the closed system when vt = 0. By following similar procedures as previously, we obtain
ℒ V ( x t , i , t ) ≤ x T ( t ) Θ i x ( t ) .
One can see that (8) guarantees Θi < 0. Thus ℒV (x(t), t, i) < 0 holds for every xt ≠ 0. Therefore, by Definition 2 and [21], the closed-loop system (7) is robustly stochastically stable with vt = 0. This completes the proof. □
Remark 1. It is well known that the uncertainty domain (5) can be formulated into a fix polytope ([8,22]), and then one can test the robust stochastic ℋ∞ performance by solving large arrays of simultaneous LMIs corresponding to the vertices of the uncertainty polytope. However, as the number of modes increases, the number of LMIs increases exponentially. Thus it leads to a combinatoric complexity explosion ([23,24]). Therefore, the element-wise description (i.e.,(5)) for the uncertain transition rates has attracted researcher’s attention since the number of resulted LMIs increases only in function of power along with the increase of the number of modes. When using the element-wise description, a key problem is how to bound the uncertain term ∑ j = 1 s π ^ i j P j. The literature [25] considered the robust stabilization problem with the element-wise description for the uncertain transition rates. The proposed controller design method in [25] only involves LMIs, but they are usually conservative. The main reason for this is that when bounding the uncertain term ∑ j = 1 s π ^ i j P j all transition rates are enlarged as their upper bounds so that the relationship among them is not taken into account. By utilizing the relationship among the transition rates, literature [16,17] obtained less conservative results than that of [25]. However, in the stability analysis of [16,17], the traditional Young inequality is used to bound the uncertain term ∑ j = 1 s π ^ i j P j Such bounding technique produces the quadratic form of Pj − Pi (for example, in [17] the quadratic terms ( P j − P i ) T i j − 1 ( P j − P i ) arise), which results that the obtained controller design method involves a set of NLMIs. Unfortunately, such NLMIs cannot be completely solved yet up to now [18]. Based on the bounding technique of [17], a LMI method for controller design is proposed in [26], but it is at the expense of the increase of conservatism (i.e., the method in [26] has a higher conservatism than that of [17]). From (14)–(16), one can see that our adopting bounding technique avoids the production of quadratic form of Pj − Pi. It is easy to prove that the bounding technique does not increase conservatism comparing with those of [16] and [17]. Moreover, as shown in next section, the obtained controller design method only involves a set of pure LMIs rather than NLMIs, which can be readily solved by any LMI solver. Therefore, the merit of the adopted bounding technique is that the obtained controller design method is not only LMI method but also not at the expense of the increase of conservatism comparing with the results in [16,17] and [26].

4. Robust Stochastic ℋ∞ Controller Design

In this section, the ℋ∞ controller design problem of system (1) is considered. The following theorem is proposed to design the robust stochastic ℋ∞ controller with the form (6) for system (1).
Theorem 2. Consider the MJS (1) with nonlinear noise intensity function and uncertain transition rates. The closed -loop system (7) is robustly stochastically stable with disturbance attenuation level γ if there exist matrices Qi > 0, Nij ≥ 0, Yi, i, j ∈ S, j ≠ i, and scalars βi, i ∈ S such that for ∀ i ∈ S, the following LMIs are feasible.
[ Φ i B v i Q i C i T + Y i T D i T Q i F i T Ξ i * − γ 2 I D v i T 0 0 * * − I 0 0 * * * − β i I 0 * * * * − Λ i ] < 0 ,
[ − β i I β i I * − Q i ] ≤ 0 ,
[ − Q i − N i j Q i * − Q j ] ≤ 0 , ∀ j ∈ S , j ≠ i ,
where
Φ i = ( A i Q i + B i Y i ) T + ( A i Q i + B i Y i ) + ∑ j = 1 , j ≠ i s { 2 ε i j N i j − π i j Q i } , Ξ i = [ π ¯ i 1 Q i ⋯ π ¯ i ( i − 1 ) Q i π ¯ i ( i + 1 ) Q i ⋯ π ¯ i s Q i ] , Λ i = diag { Q 1 , ⋯ , Q i − 1 , Q i + 1 , ⋯ Q s } .
Moreover, an admissible controller gain is given by
K i = Y i Q i − 1 .
Proof. First of all, by Theorem 1, we know that system (7) with nonlinear noise intensity function and uncertain transition rates is robustly stochastically stable with disturbance attenuation level γ if inequalities (8)–(10) holds. By using the Schur complement and noticing (8)–(10) are equivalent to the following (26)–(28), respectively.
[ Φ i P i B v i C i T + K i T D i T F i T Ξ i * − γ 2 I D v i T 0 0 * * − I 0 0 * * * − α i − 1 0 * * * * − Λ ¯ i ] < 0 ,
[ − α i I I * − P i − 1 ] ≤ 0 ,
[ − P i − M i j I * − P j − 1 ] ≤ 0 , ∀ j ∈ S , j ≠ i ,
where
Φ ¯ i = ( A i + B i K i ) T P i + P i ( A i + B i K i ) + ∑ j = 1 , j ≠ i s { 2 ε i j M i j − π i j P i } , Ξ ¯ i = [ π ¯ i 1 I ⋯ π ¯ i ( i − 1 ) I π ¯ i ( i + 1 ) I ⋯ π ¯ i s I ] , Λ ¯ i = diag { P 1 − 1 , ⋯ , P i − 1 − 1 , P i + 1 − 1 , ⋯ P s − 1 } .
Setting Q i = P i − 1, performing a congruence transformation to the inequality in (26) by diag{Qi, I,⋯, I} and applying the change of variable Nij = Qi Mij Qi, Yi = KiQi, and β i = α i − 1, one can obtain the inequality in (22). Performing a congruence transformation to the inequality in (27) by diag{βiI, I}, one can obtain the inequality in (23). Performing a congruence transformation to the inequality in (28) by diag{Qi, I}, one can obtain the inequality in (24). In addition, due to Yi = KiQi, the desired controller gain is given by K i = Y i Q i − 1. This completes the proof. □
Remark 2. In view of Theorem 2, the ℋ∞ control problem for MJSs with nonlinear noise intensity function and uncertain transition rates can be solved in terms of the feasibility of LMIs in (22)–(24). Note that the inequalities in (22)–(24) are not only linear with respect to variables Qi, Nij, Yi and βi but also linear with respect to the scalar γ2. Then, the robust ℋ∞ controller with minimum guaranteed cost can be readily found by solving the following convex optimization problem:
COP : min ( Q i , N i j , Y i , β i ) ϕ s u b j e c t t o ( 22 ) – ( 24 ) w i t h ϕ = γ 2 .
Then, the minimum guaranteed cost is given by γ* = (min ϕ)1/2.

5. Numerical Example

In this section, an example is provided to illustrate the effectiveness of the developed theory in this paper.
Consider the MJS (1) with two modes, whose data are:
A 1 = [ 0.15 − 0.08 2 − 0.04 ] , B 1 [ 5.5 0.45 ] , B v 1 [ 0.21 1.13 ] , C 1 = [ − 0.35 0.19 ] , D 1 = − 0.56 , D v 1 = 0.25 , A 2 = [ − 0.25 − 0.13 0.5 0.22 ] , B 2 [ 4.22 − 0.21 ] , B v 2 [ 1.15 0.42 ] , C 2 = [ 0.44 0.28 ] , D 2 = − 0.76 , D v 2 = 0.58.
The nonlinear noise intensity function satisfies:
trace ( f T ( x t , i ) f ( x t , i ) ) ≤ ‖ F i x t ‖ 2 , where F 1 = diag { 0.1 , 0.1 } and F 2 = diag { 0.2 , 0.2 } .
The uncertain transition rates satisfy:
Π = [ − 0.5 0.5 0.3 − 0.3 ] , | Δ π i j | ≤ 0.8 π i j , for all i , j ∈ S , j ≠ i ,
The robust stochastic ℋ∞ controller is designed such that the resulting closed-loop system is robustly stochastically stable with disturbance attenuation level γ over all the admissible nonlinear noise intensity functions and uncertain transition rates. By solving COP, the obtain minimum disturbance attenuation level is γ* = 0.5801 with the corresponding controller gain matrices
K 1 = [ − 1.3470 − 1.3780 ] , K 2 = [ − 0.6703 − 0.6596 ] .
In the following simulation study, we choose f(xt, 1) = 0.1 sin ‖xt‖ xt and f(xt, 2) = −0.2 cos ‖xt‖ xt, which obviously satisfy (29). In each simulation run, the transition rates are randomly varying but satisfy (30). To make the simulation more persuasive, simulation results with 1000 random samplings are shown in this example.
Figure 1 is the state response curves with initial condition x0 = [−1 1]T when ut = 0 and vt = 0. It is shown that the open-loop system is not stable since its state trajectories are not convergent along with the increase of time.
However, under the same conditions, applying the controllers in (31), the trajectory simulation of state response for the closed-loop system are shown in Figure 2. It is shown that the closed-loop system is stable.
Now we further check whether the closed-loop system achieves the desired disturbance attenuation level. We made simulations under the disturbance input vt = cos(t)e−0.1t. Figure 3 shows the trajectories of functional cost J ( T f ) = ∫ 0 T f { z t T z t − γ 0 2 v t T v t } d t under zero-initial-state condition, where γ0 = 0.5801. One can see from Figure 3 that J(Tf) always becomes negative along with the increase of Tf in all the 1000 simulations. Therefore, the closed-loop systems achieves the desired disturbance attenuation level.

6. Conclusion

In this paper, the ℋ∞ control problem is investigated for MJSs with nonlinear noise intensity function and uncertain transition rates. Attention is focused on the design of a controller such that the closed-loop system is robustly stochastically stable and guarantees a desired robust ℋ∞ performance over all the admissible noise intensity functions and transition rates. The developed method for controller design is in terms of linear matrix inequalities, which can be readily solved by any LMI solver. The effectiveness of the method is illustrated by a numerical example.

Acknowledgments

This work is supported by National Natural Science Foundation of China (61104115), Research Fund for the Doctoral Program of Higher Education of China (20110072120018), and the Fundamental Research Funds for the Central Universities.

Author Contributions

Both authors have contributed to the study and preparation of the article. Both authors have read and approved the final manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Stoica, A.; Yaesh, I. Jump-Markovian based control of wing deployment for an uncrewed air vehicle. J. Guid. Control Dyn. 2002, 25, 407–411. [Google Scholar]
  2. Sworder, D.D.; Rogers, R.O. An LQG solution to a control problem with solar thermal receiver. IEEE Trans. Autom. Control 1983, 28, 971–978. [Google Scholar]
  3. Ploplys, N.J.; Kawka, P.A.; Alleyne, A.G. Closed-loop control over wireless networks. IEEE Control Syst. Mag. 2004, 24, 58–71. [Google Scholar]
  4. Ugrinovskii, V.A.; Pota, H.R. Decentralized control of power systems via robust control of uncertain Markov jump parameter systems. Int. J. Control 2005, 78, 662–677. [Google Scholar]
  5. Svensson, L.E.O.; Williams, N. Optimal monetary policy under uncertainty: A Markov jump-linear-quadratic approach. Fed. Reserve St. Louis Rev. 2008, 90, 275–293. [Google Scholar]
  6. Ji, Y.; Chizeck, H.J. Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control. IEEE Trans. Autom. Control 1990, 35, 777–788. [Google Scholar]
  7. Feng, X.; Loparo, K.A.; Ji, Y.; Chizeck, H.J. Stochastic stability properties of jump linear systems. IEEE Trans. Autom. Control 1992, 37, 38–53. [Google Scholar]
  8. Costa, O.L.V. do Val, J.B.R.; Geromel, J.C. Continuous-time state-feedback H2-control of Markovian jump linear system via convex analysis. Automatica 1999, 35, 259–268. [Google Scholar]
  9. Do Val, J.B.R. Geromel, J.C.; Goncalves, A.P.C. The ℋ2-control for jump linear systems: Cluster observations of the Markov state. Automatica 2002, 38, 343–349. [Google Scholar]
  10. De Farias, D.P.; Geromel, J.C. do Val, J.B.R.; Costa, O.L.V. Output feedback control of Markov jump linear systems in continuous-time. IEEE Trans. Autom. Control 2000, 45, 944–949. [Google Scholar]
  11. Costa, O.L.V.; Guerra, S. Robust linear filtering for discrete-time hybrid Markov linear systems. Int. J. Control 2002, 75, 712–727. [Google Scholar]
  12. Costa, O.L.V.; Fragoso, M.D.; Todorov, M.G. Continuous-Time Markov Jump Linear Systems; Asmussen, S., Gani, J., Jagers, P., Kurtz, T.G., Eds.; Springer: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
  13. Yue, D.; Han, Q.-L. Delay-dependent exponential stability of stochastic systems with time-varying delay, nonlinearity, and Markovian switching. IEEE Trans. Autom. Control 2005, 50, 217–222. [Google Scholar]
  14. Senthilkumar, T.; Balasubramaniam, P. Delay-dependent robust stabilization and ℋ∞ control for nonlinear stochastic systems with Markovian jump parameters and interval time-varying delays. J. Optim. Theory Appl. 2011, 151, 100–120. [Google Scholar]
  15. Zhang, Y. Stability of discrete-time delay Markovian jump systems with stochastic non-linearity and impulses. IET Control Theory A 2013, 7, 2178–2187. [Google Scholar]
  16. Xiong, J.; Lam, J.; Gao, H.; Ho, D.W.C. On robust stabilization of Markovian jump systems with uncertain switching probabilities. Automatica 2005, 41, 897–903. [Google Scholar]
  17. Xiong, J.; Lam, J. Robust ℋ2 control of Markovian jump systems with uncertain switching probabilities. Int. J. Syst. Sci. 2009, 40, 255–265. [Google Scholar]
  18. Shu, Z.; Lam, J. Static output-feedback stabilization of discrete-time Markovian jump linear systems: A system augmentation approach. Automatica 2010, 46, 687–694. [Google Scholar]
  19. Xu, S.; Chen, T. Robust ℋ∞ control for uncertain stochastic systems with state delay. IEEE Trans. Autom. Control 2002, 47, 2089–2094. [Google Scholar]
  20. Boyd, S.; El Ghaoui, L.; Feron, E.; Balakrishnan, V. Linear Matrix Inequalities in System and Control Theory; SIAM: Pennsylvania, PA, USA, 1994. [Google Scholar]
  21. Mao, X. Robustness of exponential stability of stochastic differential delay equation. IEEE Trans. Autom. Control 1996, 41, 442–447. [Google Scholar]
  22. El Ghaoui, L.; Rami, M.A. Robust state-feedback stabilization of jump linear systems via LMIs. Int. J. Robust Nonlinear Control 1996, 6, 1015–1022. [Google Scholar]
  23. Ugrinovskii, V.A. Randomized algorithms for robust stability and guaranteed cost control of stochastic jump parameters systems with uncertain switching policies. J. Optim. Theory Appl. 2005, 124, 227–245. [Google Scholar]
  24. Barmish, B.R.; Shcherbakov, P.S. On avoiding vertexization of robustness problems: the approximate feasibility concept. IEEE Trans. Autom. Control 2002, 47, 819–824. [Google Scholar]
  25. Boukas, E. K.; Shi., P.; Benjelloun, K. On stabilization of uncertain linear systems with jump parameters. Int. J. Control 1999, 72, 842–850. [Google Scholar]
  26. Wang, G.; Zhang, Q. Robust ℋ∞ control of Markovian jump systems with uncertain switching probabilities. Asian J. Control 2012, 14, 1407–1410. [Google Scholar]
Entropy 17 04762f1 1024
Figure 1. State response of the open-loop system with 1000 random samplings.
Figure 1. State response of the open-loop system with 1000 random samplings.
Entropy 17 04762f1
Entropy 17 04762f2 1024
Figure 2. State response of the closed-loop system with 1000 random samplings.
Figure 2. State response of the closed-loop system with 1000 random samplings.
Entropy 17 04762f2
Entropy 17 04762f3 1024
Figure 3. Functional cost J(Tf) with 1000 random samplings.
Figure 3. Functional cost J(Tf) with 1000 random samplings.
Entropy 17 04762f3

Share and Cite

MDPI and ACS Style

Wang, X.; Guo, Y. H∞ Control for Markov Jump Systems with Nonlinear Noise Intensity Function and Uncertain Transition Rates. Entropy 2015, 17, 4762-4774. https://doi.org/10.3390/e17074762

AMA Style

Wang X, Guo Y. H∞ Control for Markov Jump Systems with Nonlinear Noise Intensity Function and Uncertain Transition Rates. Entropy. 2015; 17(7):4762-4774. https://doi.org/10.3390/e17074762

Chicago/Turabian Style

Wang, Xiaonian, and Yafeng Guo. 2015. "H∞ Control for Markov Jump Systems with Nonlinear Noise Intensity Function and Uncertain Transition Rates" Entropy 17, no. 7: 4762-4774. https://doi.org/10.3390/e17074762

APA Style

Wang, X., & Guo, Y. (2015). H∞ Control for Markov Jump Systems with Nonlinear Noise Intensity Function and Uncertain Transition Rates. Entropy, 17(7), 4762-4774. https://doi.org/10.3390/e17074762

Article Metrics

Back to TopTop