Assumptions: (1) Response variables are fully observed, with (yi,yi)|(xi,xi)(i=1,2,...,n) independent mutual conditions. The conditional density function is then p((yi,yi)|(xi,xi))=a((yi,yi)|(σ,σ)2)exp{12(σ,σ)2di(yi,yi);(μi,μt)}(i=1,2,...,n);

(2) The vector (xi,xi), which is composed of k explanatory variables, is a discrete random vector whose distribution density function is p((xi,xi)|(γ,γ)),(γ,γ)=((γ1,γ1),(γ2,γ2),...,(γr,γr)). Some of the explanatory variable values are missing in the partially observed data points, and this loss is random; (xi,xi)(i = 1, 2, . . ., n) are independent of each other.

Set (θ,θ)=((β,β)T,(γ,γ)T),Then,((xi,xi)(yi,yi)) is the joint probability density p((xi,xi),(yi,yi))=p((xi,xi)|(yi,yi))|(γ,γ). The joint α-log likelihood function of ((xi,xi),(yi,yi)) is

if we define L(yi,yi)|(xi,xi)(α)(β,β)=L(α)(p(yi,yi)|(xi,xi)), then L(xi,xi)(α)(γ,γ)=L(α)(p((xi,xi)|(γ,γ))) is the edge α-log likelihood function of (xi,xi). Thus, the combined α-log likelihood function of (y,y)=((y1,y1)),(y2,y2),...,(y2,y2)Tand(x,x)=((x1,x1),(x2,x2),...,(xn,xn))T can be expressed as

Set the complete data Unexpected text node: ' x 'xobs,i) is the observed data of (xi,xi),(xmis,i,xmis,i) is the missing data of (xi,xi),p((xmis,i,xmis,i)|(xobs,i,xobs,i),(yi,yi),(θ,θ)) is the conditional distribution density function of the missing explanatory variable (xmis,i,xmis,i) under the condition of (θ,θ), and the observed data (xobs,i,xobs,i) are given.

Thus, the dynamic fuzzy MLE algorithm (dynamic fuzzy α − EM algorithm) is shown in Algorithm 1.3.

Algorithm 1.3 DF α − EM algorithm

Dynamic fuzzy α -E step:

where (θ,θ)(m) denotes the iteration value of (θ,θ) obtained by the m th dynamic fuzzy α-EM iteration, E represents the expectation with respect to the distribution p((xmis,i,xmis,i))|(xobs),xobj,i),(yi,yi),(θ,θ)(m)),(xmis,i,xmis,i) represents the sum of all possible values of the missing explanatory variable (xmis,j,xmis,j), and the conditional distribution density function for the missing explanatory variable (xmis,j,xmis,j) under the condition of (θ,θ)m and the observed data (xobs,j)xobs,i) are given. The Bayesian formula can be directly applied to get:

Dynamic fuzzy α-E step:

and set the sum of the two terms on the right of (1.22) as Q1(α)((β,β)|(θ,θ)(m)),Q2(α)(γ,γ)|(θ,θ)(m)), respectively. Because Q1(a)((β,β)|(θ,θ)(m)),Q2(a)((γ,γ)|(θ,θ)(m)) are non-negative, the (m + 1)th dynamic ambiguity α-EM iteration can be transformed to:

The method of solving (γ,γ)(m+1) is related to the distribution of the explanatory variables. The iterative formula for solving is [32]:

the definition of each variable is described in [32].

The above two steps are repeated until convergence.

1.3.2.2Convergence of algorithms

We will describe the convergence behaviour of the convergence of is similar.

Theorem 1.6

Theorem 1.7 is monotonically increasing [28].

Theorem 1.8 Let be continuous in and differentiable in its interior [29]. For any if the set is dense and is inside holds for all and m. Then, we have the following conclusions:

(1)The limit point of the sequence is the fixed point of

(2) converges monotonically to

Proof: Define the iterative operator:

Under the conditions of the theorem, the operator Λ(α) is closed.

inside guarantees that and are differentiable for any such that the global convergence conditions in [30] and [31] are satisfied:

(1)Sequence is generated by

(2)The fixed point set of the iterative operator Λ(α) is contained in a dense set

(3) is continuous. Thus, for there is

Therefore, by the global convergence theorem in [30] and [31], the proof is complete.

1.3.2.3Examples

Table 1.1 provides complete data for 32 patients with haematological malignancy, from Ibrahim (1900). Assume that the 3rd, 8th, 19th, 27th, and 32nd data points are not fully observed, see Tab. 1.2, which is taken from [32]. In the table, t represents the patient’s duration (weeks); indicates that a biological characteristic test for leukocytes is positive, indicates that the test was negative; z = 0 indicates that there are less than 11,000 white blood cells in the blood to be tested, z = 1 represents 11,000 ≤ WBC ≤ 40,000, and z = 2 represents WBC > 40,000.

Variable z has three states. Therefore, two dummy dynamic fuzzy variables are introduced. When

Assuming that follows the parameter and the logarithmic gamma distribution of the mean then

Suppose the joint probability distribution of denotes the function of the j th result of is the probability corresponding to the j th result of Setting the probability density of the complete data based on n= 32 observation points of can be expressed as

Tab. 1.1: Blood cancer patient data.

Tab. 1.2: Partially incomplete data.

The probability density of the incomplete data is

The α – log likelihood ratio of the complete data is

Our basic task is to estimate the parameter Table 1.3 gives only the maximum likelihood estimate and the estimated standard error, which is the same as the EM algorithm in [32]. However, the convergence speed is different. The influence of different α on the convergence rate indicator can be ascertained from Tab. 1.4. When α = − 1, we have the EM algorithm. Obviously, obtaining the appropriate of the parameter will greatly improve the convergence rate of the algorithm, overcoming the shortcoming of the EM algorithm [29]; of course, which value of α gives the fastest convergence speed requires further exploration.

Note: In Tab. 1.4, the CPU time ratio is the ratio of the CPU consumed by the algorithm to the time taken to execute the algorithm; the CPU time rate is the number of time cycles of the algorithm that the CPU executes per unit of time and the number of time periods of the CPU itself.

Tab. 1.3: Numerical test results.

Tab. 1.4: Effect of α on the convergence rate index.

1.4Process control model of DFMLS [8]

Studying the visualization and process control of machine learning is a fundamental problem. This section attempts to examine this issue from the perspective of process control to study the problem of learning. The results are summarized below.

1.4.1Process control model of DFMLS

For a DFMLS composed of m rules Rl(l = 1, 2, . . ., m), the global model of the system is

As each dynamic fuzzy subsystem is linearly descriptive, when we choose the global dynamic fuzzy control law, we first use linear system theory to stabilize the subsystem and obtain the local dynamic fuzzy control law that satisfies the subsystem design requirements. The global dynamic fuzzy control law is a weighted combination of subsystem control laws.

The dynamic fuzzy control rules are as follows:

and the global control is

Thus, the global model of the DFML process control system (hereinafter referred to as dynamic fuzzy control system) is

For ease of analysis, note that

1.4.2Stability analysis

The most important characteristic of the control system is its stability, because an unstable system is unable to complete the expected control tasks. This section presents a stability analysis of the dynamic fuzzy control system.

Theorem 1.9 For the dynamic fuzzy control system shown in (1.26), if there exists a common dynamic fuzzy positive definite matrix such that [33]

is valid, then the dynamic fuzzy control system (1.26) is globally asymptotically stable.

In general, even if all the subsystems are stable, there is a possibility that the public dynamic fuzzy positive definite matrix (P,P) does not exist, so that (1.28) holds, especially when dynamic fuzzy control rules are more difficult to apply or are invalid [34]. To avoid the difficulty of finding (P,P), we propose a simple and effective method to judge the stability of closed-loop dynamic fuzzy control systems based on the interval matrix and robust control theory.

(C,C) changes with the state value (X,X)(k) at each time, but any element (cij,cij)in(C,C) is the weighted sum of the corresponding elements of the subsystem. Thus, we know that the elements of (C,C) are in the determined closed interval given by (C,C)max=maxl(cijl,cijl),(C,C)min=minl(cijl,cijl).Then(C,C)[(C,C)min,(C,C)max],Write(C0,C0)=((C,C)max+(C,C)min)/2,(H,H)=((C,C)max(C,C)min)/2(H,H)=((hij,hij)).

Using the properties of interval matrices, (C,C) can be equivalently expressed as follows:

where

Here, (ei,ei) is the unit dynamic fuzzy column vector whose i th element is (1,1), and the remaining elements are (0,0);(M,M)ϵ(R,R)n×n2,(N,N)ϵ(R,R)hn2×n,(Σ,Σ)ϵ(R,R)n2×n2 is the dynamic fuzzy diagonal matrix, and the value of (Σ,Σ) changes with the rule weight value at each time, but (Σ,Σ)T(k)(Σ,Σ)(k)(I,I). Then, the global model of the closed-loop dynamic fuzzy control system can be expressed as

Definition 1.10 For an uncertain dynamic fuzzy autonomous system [35],

|(εij,εij)(k)|(1,1),(i,j)=1,2,...,n;(M,M)=[(h11,h11)(e1,e1)...(h1N,h1n)(e1,e1)...(hN1,hn1)(en,en)(hnn,hnn)(eN,eN)](N,N)=[(h11,h11)(e1,e1)...(h1N,h1n)(en,en)...(hn1,hN1)(e1,e1)...(hnn,hnn)(eN,eN)]T.

if there exists an n-order dynamic fuzzy positive definite matrix (P,P) and a dynamic fuzzy constant (α,α)>(0,0) such that, for any permissible uncertainty Δ(A,A),

(X,X)(t)=((A0,A0)+Δ(A,A))(X,X)(t),

holds for any solution (X,X)(t) and t, then the system is said to be quadratic stable. In the above expression, (A0,A0)=((A,A)max+(A,A)min)/2(A,A)max= maxl((aijl,aijl))(A,A)min=minl((aijl,aijl)).

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.15.228.246