Articles
Relative controllability of multiagent systems with pairwise different delays in states*
Relative controllability of multiagent systems with pairwise different delays in states*
Nonlinear Analysis: Modelling and Control, vol. 27, núm. 2, pp. 289-307, 2022
Vilniaus Universitetas
Recepción: 09 Octubre 2020
Revisado: 06 Abril 2021
Publicación: 06 Enero 2022
Abstract: In this manuscript, relative controllability of leader–follower multiagent systems with pairwise different delays in states and fixed interaction topology is considered. The interaction topology of the group of agents is modeled by a directed graph. The agents with unidirectional information flows are selected as leaders, and the others are followers. Dynamics of each follower obeys a generic time-invariant delay differential equation, and the delays of agents, which satisfy a specified condition, are different one another because of the degeneration or burn-in of sensors. With a neighbor-based protocol steering, the dynamics of followers become a compact form with multiple delays. Solution of the multidelayed system without pairwise matrices permutation is obtained by improving the method in the references, and relative controllability is established via Gramian criterion. Further rank criterion of a single delay system is dealt with. Simulation illustrates the theoretical deduction
Keywords: multiagent systems, relative controllability, multiple time delays, solution.
1 Introduccion
The cluster behaviors of multiagent systems are hot topics because of the wide applications of them, such as unmanned air vehicles, satellite formation, underwater robot, etc. Cooperative control of distributed multiagent systems is concerning with the control and operate capabilities with limited processing abilities, locally sensed information, and limited intercomponent communications achieving a collective goal [29]. Consensus of multiagent systems, which relies on a neighbor-based protocol to achieve a common interesting objective [9, 14, 31, 38, 40], is a typical instance of cooperative control. The factors like time delays [8,28, 36, 37] and switching topology [6,25], widely existing in the application of formation control [3,39], flocking [1], and others, are considered while dealing with the consensus of multiagent systems.
An inevitable problem of multiagent systems is the controllability, which determines whether we can control and operate the multiagent systems by assigning suitable leaders in the group of agents. Tanner [33] derives the controllability criterion of multiagent systems with a leader and reveals the relation between the communication topology and the controllability. Liu and Chu [16] present the controllability of multiagent systems with switching topology and point out the relationship between the controllability and connectivity. Ji and Wang [12] generalize the control problems into the system with time delays in state and switching topology. Tian et al. [34] deal with the controllability of multiagent systems with periodically switching topologies and switching leaders who reveal that the switching-leader controllability is equivalent to multiple-leaders controllability. Other literature is paying attention to the reflection of graph-theoretic notions on the properties of multiagent systems (see [27] etc.).
Structural controllability firstly defined and researched by Lin [15] is introduced into the multiagent systems by Liu [20] who proves that the multiagent systems with switching topology is structurally controllable if and only if the union graph of interaction topology is connected. More literatures around the controllability of multiagent systems it is suggested referring to [10, 11, 17–19, 21, 32, 35].
Time delay is ubiquitous in intelligent network, digital communication, unmanned aerial vehicle, etc. (see more in [5, 8, 12, 19]). Comparing with the classical controllability, it is more appropriate to consider the relative controllability for time-delay systems because the latter can exactly describe the influence of the delay on the controllability (see more in [13]). We call the leader–follower multiagent systems relatively controllable if, for an arbitrary initial function on the delayed interval, there exist piecewise continuous control functions, which adjust the leaders’ trajectories such that the states of the followers can be steered to any terminal ones in a finite time.
For relative controllabilitu, there is abundant literature (see in [2, 13, 26]). Khusainov [13] presents a solution of the delayed system by constructing the delayed exponential matrix and establishes the rank criterion of relative controllability. Pospíšil [26] investigates the relative controllability of linear delayed neutral differential system by using the Legendre polynomials.
Relative controllability of multiagent systems with two delays in state is considered in [30] in which Gramian and rank criteria are established, respectively. With reference to [30], this paper considers the relative controllability of multiagent systems with pair- wise different delays in states and fixed communication topology. Some agents with unidirectional information flows are selected as leaders, which act as external steering inputs. With a neighbor-based protocol steering, the multiagent systems are transformed into a system with multiple delays. Further, the solution of this system without pair- wise matrices permutation is obtained by improving the method in [22, 24]. Based on this, Gramian and rank criteria are established, respectively. An example is dealt with to illustrate the theorem deduction. The contribution of this paper lies in establishing a framework of judging the controllability of multiagent systems with multiple delays.
One of the difficulties lies in constructing the solution of the multidelayed system without matrices pairwise permutations.
This paper is organized as follows. In Section 2, we present some basic knowledge of graph theory. In Section 3, we formulate the problems and explore the solution of multiagent systems. Controllability is tackled in Section 4, and simulation is shown in Section 5, respectively.
2 Preliminaries
Denote by
a weighted digraph of nodes, the set of nodes with
, the set of the directed edges with
, and a weighted adjacency matrix. A directed edge
is an ordered pair of nodes
with
called parent and child nodes, respectively. In a digraph
means that node vj can obtain information from but might not inversely. The elements of the adjacency matrix
are defined by
or zero otherwise. The set of neigbords of node . The Laplanician matrix
is definded by

More properties of the Laplacian matrix can be found in [7].
In what follows, we denote by N and L the positive integers, Θ, I, and θ the corresponding dimensional zero matrix, unit matrix, and zero vector, respectively, and
the n-dimensional Euclidean space.
3 Formulation
In some application the dynamics of agents may exhibit different time delays because the degeneration or burn-in of sensors. With reference to [30], in what follows, we will continuous to consider the relative controllability of a group of agents with pairwise different delays in states and directly fixed interaction topology.
Suppose that the multiagent systems are consisting of
agents, and interaction topology of the systems is modeled by a weighted digraph
, each node of the graph representing an agent and the set of nodes represented by
. Further, suppose that
, information flows of which are unidirectional, are selected as leaders. The rest labeled by
are followers. Dynamics of the followers obey the following generic time-invariant delay differential equations:

where xi Rn, Ai, Bi, and Ci are the parameter matrices of appropriate dimensions, ui
where
is the steering input,
, and τj is corresponding delay of vj, which satisfies
. Whereas dynamics of the leaders are assumed in any form as long as they are controllable. Interactions among agents are realized through the following relative protocol:

where and are the gain matrices of appropriate dimensions, is the neighbour of
is the coupled weight of followers and their neighbors,
, is the output of leaders, which acts as exogenous control input of followers,
is the coupled weight of leader and follower, and
is equal to one if the leader
has information flow towards the follower directly or zero else,
. Under (2), (1) becomes

were 

and

and
is a block matrix with the ith block of main diagonal being
or zero else.
Remark 1. System (3) contains multiple delays and does not enjoy the matrices pairwise permutable. It is a hot topic around the well-posedness and controllability of the delay differential equations (see in [13, 22, 23]). Khusainov et al. [13] present the explicit solution of the linear delay system by constructing a delayed matrix exponential function and establish a criterion for the relative controllability of the system with pure delay. Mahmudov [22] presents a delayed perturbation of Mittag-Leffler-type matrix function and solves the linear nonhomogeneous fractional delay system. Medved’ et al. [23] generate the results of Khusainov and Shuklin and establish a multidelayed exponential function to solve the multidelayed system with pairwise matrices permutation. With reference to [30], we will construct the solution of (3) without matrices pairwise permutations by improving the methods in [22,23].
3.1 Solution
With reference to [22,23], firstly, we introduce the following matrix sequence:

where
Further, introduce the following matrix function:

where is a positive integer, and
is the gamma function defined by

If
, we have

With reference to [23], for
, construct the following function:

where
is equal to (5). For
, we have the following lemma hold.
Lemma 1.
is a solution of the following matrix equation:

with

Proof. With reference to [22,30],
is the respective solution of

which satisfies 
Suppose that
is a solution of

with
. Based on (6), we know that for
,
.
, we have

Thus, it holds that

Further for
, we have

Thus, it holds for 
For
, take the derivative of
and arrange it to get

where


and


From 
From 



Further, making a change of variable
, we have


Thus, we have

which implies the assumption is held and the proof is completed.
Lemma 2. The homogeneous problem

has a solution of the form

where

Proof. From Lemma 1 it is obtained that (9) solves (7). Next, we verify that (9) satisfies (8). For
. Thus,
. From
we further arrive at 
and 
. Thus

Besides, from
. Again, from
. For 

Thus, we obtain that

The proof is completed.
Lemma 3. System (3) with
, has a solution of the following form:

Proof. Suppose (3) with
, has a solution of the form

Taking the derivative of (10) with respect to t and following from Lemma 1 to yield

For 
. Further, we obtain

Comparing it with (3), we obtain
. This completes the proof.
Lemma 4. System (3) with initial data (8) has a solution of the form

Proof. It follows from Lemmas 2–3 that solution of (3) with initial data (8) is (11). This completes the proof.
4 Controllability
In this section, relative controllability of multiagent systems will be considered. Firstly, we present the definition of it.
Definition 1. System (3) is called relatively controllable if, for any initial vector function
, and final state , there exists a terminal time
and a measurable function
such that system (3) has a solution
, which satisfies
.
4.1 Gramian criterion
Given some
, construct the following matrix:

Denote

For the controllability of (3), we have the following theorem hold.
Theorem 1. System (3) is relatively controllable if and only if there exists a
such that (12) is nonsingular.
Proof. Sufficiency. Suppose that (12) is nonsingular for some
. For any terminal state and any initial function
, construct the following control input:

From Lemmas 2–4 the solution of (3) always has the form of (11), which automatically satisfies the initial condition, thus we have

which implies that system (3) is relatively controllable.
Necessity. Suppose that system (3) is relatively controllable, but (12) is singular. There exists a nonzero vector
such that
. Thus, we have that

Further, we arrive at

System (3) being relatively controllable, we know that for an arbitrary initial function
, and the given terminal states
and θ, there exist measurable control functions such that

Thus, we obtain

Further, it yields

which implies that
. This contradicts with the assumption that
is a nonzero vector. Thus, (12) is nonsingular. The proof is completed.
4.2 Rank criterion
Next, we consider the rank criterion of relative controllability for the system with single delay.
For
, system (3) degenerates into

where
is the sum of
. With reference to [22], solution of (14) with initial data (8) is degenerated into the form

where
is defined by (5) with the matrix sequence (4) replaced by

In what follows, we will use
to replace
for the simplicity of notation.
Lemma 5. The derivative of
up to any kth order can be represented as

Proof. It is trivial for
. Suppose that (16) holds for any integer . Then for
, we have


which implies that (16) holds for any positive integer k, and the proof is completed.
Next, we present the result of the rank criterion for system (14) without matrices pairwise permutation.
Theorem 2. If
, then system (14) is relatively controllable for some
, where

Proof. Assume that
, whereas system (14) is uncontrollable. Then from Theorem 1 we know there exists a nonzero vector
such that

Taking the derivative of
in (18) up to any order and from Lemma 5 we have

Taking
in (19), we have

Continuous take
and suppose that

holds, where
, we have


From the definition of the matrix sequence in (15) we know that
is nothing but a combination of
and
in a stack with positions, where matrices
are inserted into positions, and
matrices
are inserted into
positions, total ways of which are
. Thus, for
, we regard it as a combination of
and
in a stack with
positions: we separate the stack into two parts with the former part being positions, and the latter one being positions. The first way is that all the matrices
are inserted into the latter positions, and the
matrices
are inserted into the remained
positions. The second way is that
matrices
are inserted into the latter positions, the remained one
is inserted into the former positions, and the
matrices
are inserted into the
positions. Following this process until the matrices
are all inserted into the former positions, we obtain that

by using the stepwise principle of combination, where
. Thus, we further arrive at


From the assumption we obtain that
, which implies that (21) holds.
Rearrange (20) and (21) to yield

which implies that

for any finite integer
because the solution of (22) is a solution of (23). This implies that
is row linearly dependent, thus we have
, which contradicts with the assumption. Thus, for the relative controllability of system (14), we need 
Remark 2. If
, then (17) is degenerated into

Further, if
, then (17) is degenerated into

if
, then (17) is degenerated into

5 Simulation
In this section an example of leader–follower multiagent systems will be considered to verify the theorem deduction. To simplify the problem, we assume that the system consists of 4 agents, and we show the interaction topology in Fig. 1, where the one labeled by 0 is assigned as leader, and the others are followers. The dynamics of the followers obey the following delay differential equations:

where
. Taking values as 
, we know that the delays of each agent satisfy the condition in (1). Thus, for an initial vector function
and protocol (2), system (24) always has a solution in the form of (11). Denote that 
. From Theorem 1 we know if (12) is nonsingular, system (24) is relative controllable. For , the control input function is

where is defined by (13). For
, the control input is

For
, the control input is


Other parameters are taken values as:

. We have that (12) is nonsingular, thus system (24) is relative controllable. Results of simulation are presented in Figs. 2–4.
From Figs. 2–4 we know that all the trajectories of the followers achieve the given terminal state in a finite time under the steering of leader, which verifies the theory deduction.




6 Conclusion
This paper considers the relative controllability of multiagent systems with pairwise dif- ferent delays in states. Based on a neighbor-based interaction protocol, the multiagent systems are transformed into a multidelayed system, and solution of it is obtained by improving the methods in [22, 23] without the pairwise matrices permutation. Following from the solution, Gramian criterion of relative controllability is established, and rank criterion is also yielded for the single-delayed system without pairwise matrices permu- tation. This work guarantees that we can further explore the iterative learning control of the delayed multiagent systems (see more in [4]).
References
1 H. Atrianfar, M. Haeri, Adaptive flocking control of nonlinear multi-agent systems with directed switching topologies and saturation constraints, J. Franklin Inst., 350(6):1545–1561, 2013, https://doi.org/10.1016/j.jfranklin.2013.03.002.
2 K. Balachandran, Y. Zhou, J. Kokila, Relative controllability of fractional dynamical systems with distributed delays in control, Comput. Math. Appl., 64:3201–3209, 2012, https:// doi.org/10.1016/j.camwa.2011.11.061.
3 T. Balch, R. Arkin, Behavior-based formation control for multirobot teams, IEEE Trans. Robotic Autom., 14(6):926–939, 1998, https://doi.org/10.1109/70.736776.
4 X. Cao, M. Fecˇkan, D. Shen, J. Wang, Iterative learning control for multi-agent systems with impulsive consensus tracking, Nonlinear Anal. Model. Control, 26(1):130–150, 2021, https://doi.org/10.15388/namc.2021.26.20981.
5 Y. Cao, R. Samidurai, R. Sriraman, Stability and stabilization analysis of nonlinear time-delay systems with randomly occurring controller gain fluctuation, Math. Comput. Simul., 171:36– 51, 2020, https://doi.org/10.1016/j.matcom.2019.03.002.
6 L. Cheng, Y. Wang, W. Ren, On convergence rate of leader-following consensus of linear multi- agent systems with communication noises, IEEE Trans. Autom. Control, 61(11):3586–3592, 2016, https://doi.org/10.1109/TAC.2016.2522647.
7 C. Godsil, G. Royle, Algebraic Graph Theory, Springer, New York, 2013.
8 J. Hu, Y. Hong, Leader-following coordination of multi-agent systems with coupling time delays, Physica A, 374(2):853–863, 2007, https://doi.org/10.1016/j.physa. 2006.08.015.
9 W. Hu, L. Liu, G. Feng, Consensus of linear multi-agent systems by distributed event-triggered strategy, IEEE Trans. Cybern., 46(1):148–157, 2017, https://doi.org/10.1109/ TCYB.2015.2398892.
10 Z. Ji, H. Lin, T. Lee, A graph theory based characterization of controllability for multi-agent systems with fixed topology, in 47th IEEE Conference on Decision and Control, December 9–11, 2008, Cancun, Mexico, IEEE, Piscataway, NJ, 2008, pp. 5262–5267, https://doi. org/10.1109/CDC.2008.4738636.
11 Z. Ji, Z. Wang, H. Lin, Interconnection topologies for multi-agent coordination under leader– follower framework, Automatica, 45(12):2857–2863, 2009, https://doi.org/10. 1016/j.automatica.2009.09.002.
12 Z. Ji, Z. Wang, H. Lin, Controllability of multi-agent systems with time-delay in state and switching topology, Int. J. Control, 91(5):1023–1033, 2010, https://doi.org/10. 1080/00207170903171330.
13 D. Khusainov, G. Shuklin, Relative controllability in systems with pure delay, Int. Appl. Mech., 41(2):210–221, 2005, https://doi.org/10.1007/s10778-005-0079-3.
14 Z. Li, Z. Duan, G. Chen, Consensus of multi-agent systems and synchronization of complex networks: A unified viewpoint, IEEE Trans. Circuits Syst. I, Regul. Pap., 57(1):213–224, 2010, https://doi.org/10.1109/TCSI.2009.2023937.
15 C. Lin, Structural controllability, IEEE Trans. Autom. Control, 19(3):201–208, 1974, https://doi.org/10.1109/TAC.1974.1100557.
16 B. Liu, T. Chu, L. Wang, Controllability of a leader–follower dynamic network with switching topology, IEEE Trans. Autom. Control, 53(4):1009–1013, 2008, https://doi.org/10. 1109/TAC.2008.919548.
17 B. Liu, T. Chu, L. Wang, Controllability of switching networks of multi-agent systems, Int.J. Robust Nonlinear Control, 22(6):630–644, 2012, https://doi.org/10.1002/rnc. 1713.
18 B. Liu, Y. Ping, L. Wu, Controllability of discrete-time multi-agent systems based on absolute protocol with time-delays, Neurocomputing, 409:316–328, 2020, https://doi.org/10. 1016/j.neucom.2020.05.046.
19 B. Liu, H. Su, R. Li, Switching controllability of discrete-time multi-agent systems with multiple leaders and time-delays, Appl. Math. Comput., 228(1):571–588, 2014, https://doi.org/10.1016/j.amc.2013.12.020.
20 X. Liu, H. Lin, B. Chen, Graph-theoretic characterizations of structural controllability for multi-agent system with switching topology, Int. J. Control, 86(2):7012–7017, 2012, https://doi.org/10.1080/00207179.2012.723136.
21 Y. Liu, J. Slotine, A. Barabasi, Controllability of complex networks, Nature, 473(7346):167– 173, 2011, https://doi.org/10.1038/nature10011.
22 N. Mahmudov, Delayed perturbation of Mittag-Leffler functions and their applications to fractional linear delay differential equations, Math. Method. Appl. Sci., 42(16):5489–5497, 2019, https://doi.org/10.1002/mma.5446.
23 M. Medved’, M. Pospíšil, Sufficient conditions for the asymptotic stability of nonlinear multidelay differential equations with linear parts defined by pairwise permutable matrices, Nonlinear Anal., Theory Methods Appl., 75(7):3348–3363, 2012, https://doi.org/10. 1016/j.na.2011.12.031.
24 M. Medved’, M. Pospíšil, Representation of solutions of systems of linear differential equations with multiple delays and linear parts given by nonpermutable matrices, J. Math. Sci., 228:276– 289, 2018, https://doi.org/10.1007/s10958-017-3620-0.
25 W. Ni, D. Cheng, Leader-following consensus of multi-agent systems under fixed and switching topologies, Syst. Control Lett., 59(3-4):209–217, 2010, https://doi.org/ 10.1016/j.sysconle.2010.01.006.
26 M. Pospíšil, Relative controllability of neutral differential equations with a delay, SIAM J. Control Optim., 55(2):835–855, 2017, https://doi.org/10.1137/15M1024287.
27 A. Rahmani, M. Ji, M. Mesbahi, Controllability of multi-agent systems from a graph-theoretic perspective, SIAM J. Control Optim., 48(1):162–186, 2009, https://doi.org/10. 1137/060674909.
28 R. Saber, R. Murray, Consensus problems in networks of agents with switching topology and time-delays, IEEE Trans. Autom. Control, 49(9):1520–1533, 2004, https://doi.org/ 10.1109/TAC.2004.834113.
29 J. Shamma, Cooperative Control of Distributed Multi-Agent Systems, John Wiley & Sons, Chichester, 2007.
30 Y. Si, J. Wang, Relative controllability of multi-agent systems with two time delays, Eur. J. Control, submitted.
31 H. Su, Y. Ye, Q. Yuan, Semi-global output consensus for discrete-time switching networked systems subject to input saturation and external disturbances, IEEE Trans. Cybern., 49(11): 3934–3945, 2019, https://doi.org/10.1109/TCYB.2018.2859436.
32 C. Sun, G. Hu, L. Xie, Controllability of multi-agent networks with antagonistic interactions, IEEE Trans. Autom. Control, 62(10):5457–5462, 2017, https://doi.org/10.1109/ TAC.2017.2697202.
33 H. Tanner, On the controllability of nearest neighbor interconnections, in H. Tanner (Ed.), 2004 43rd IEEE Conference on Decision and Control (CDC), Nassau, Bahamas 14–17 December, 2004, Vol. 5, IEEE, Piscataway, NJ, 2004, pp. 2467–2472, https://doi.org/10. 15242/2009.07.09.
34 L. Tian, B. Zhao, L. Wang, Controllability of multi-agent systems with periodically switching topologies and switching leaders, Int. J. Control, 91(5):1023–1033, 2018, https://doi. org/10.1080/00207179.2017.1303850.
35 Y. Wang, J. Xiang, Y. Li, Controllability of dynamic-edge multi-agent systems, IEEE Trans. Control Netw., .(3):857–867, 2018, https://doi.org/10.1109/TCNS.2017. 2648513.
36 X. Wu, T. Yang, J. Cao, W. Zhang, Distributed consensus of stochastic delayed multi- agent systems under asynchronous switching, IEEE Trans. Cybern., 46(8):1817–1827, 2017, https://doi.org/10.1109/TCYB.2015.2453346.
37 F. Xiao, L. Wang, Consensus protocols for discrete-time multi-agent systems with time- varying delays, Automatica, 44(10):2577–2582, 2008, https://doi.org/10.1016/ j.automatica.2008.02.017.
38 C. Yang, L. Zhang, C. Li, M. Chen, Observer-based consensus tracking of nonlinear agents in hybrid varying directed topology, IEEE Trans. Cybern., 47(8):2212–2222, 2017, https://doi.org/10.1109/TCYB.2016.2573138.
39 W. Yu, G. Chen, M. Cao, Distributed leader–follower flocking control for multi-agent dynamical systems with time-varying velocities, Syst. Control Lett., 59(9):543–552, 2010, https://doi.org/10.1016/j.sysconle.2010.06.014.
40 W. Yu, G. Chen, M. Cao, Some necessary and sufficient conditions for second-order consensus in multi-agent dynamical systems, Automatica, 46(6):1089–1095, 2010, https://doi. org/10.1016/j.automatica.2010.03.006.