---
abstract: 'This paper [[provides a framework to evaluate]{}]{} the performance of single and double integrator networks over arbitrary directed graphs. Adopting vehicular network terminology, we consider quadratic performance metrics defined by the of position and velocity based response [[functions given]{}]{} [[impulsive inputs to]{}]{} each vehicle. We [[exploit the spectral properties of weighted graph Laplacians and output performance matrices to derive]{}]{} a novel method of computing the closed-form solutions for this general class of [[performance]{}]{} metrics, [[which include $\mathcal{H}_2$-norm based quantities as special cases.]{}]{} We then explore the effect of the interplay between network properties (such as edge directionality and connectivity) and the control strategy on the overall network performance. More precisely, for systems whose interconnection is described by graphs with [[normal]{}]{} Laplacian $L$, we characterize the role of directionality by comparing [[their]{}]{} performance with [[that of]{}]{} their undirected counterparts, represented by the Hermitian part of $L$. We show that, for single-integrator networks, directed and undirected graphs perform identically. However, for double-integrator networks, graph directionality -expressed by [[the eigenvalues of $L$]{}]{} with nonzero imaginary part- can significantly degrade performance. Interestingly, in many cases, well-designed feedback can also exploit directionality to mitigate degradation or even improve the performance to exceed that of the undirected case. [[Finally we focus on a system coherence metric -aggregate deviation from the state average-]{}]{} to investigate the relationship between performance and degree of connectivity, leading to somewhat surprising findings. For [[example,]{}]{} increasing the number of neighbors on a neighbor directed graph does not necessarily improve performance. [[Similarly,]{}]{} we demonstrate equivalence in performance between all-to-one and all-to-all communication graphs.'
author:
- 'H. Giray Oral, Enrique Mallada and Dennice F. Gayme [^1]'
bibliography:
- 'IEEEabrv.bib'
- 'GirayBib.bib'
title: 'Performance of Single and Double-Integrator Networks over Directed Graphs'
---

[Shell : ]{}

$\mathcal{L}_2$, $\mathcal{H}_2$ norm, directed graph, performance.

Introduction
============

for reaching consensus -achieving a synchronized steady state- [[have been]{}]{} widely studied for networked dynamical systems, [[see e.g.]{}]{} [@RenAtkins2005; @YuChen2010; @ZhuTian2009]. A related and equally important question is how the system performs in its effort to restore and/or maintain synchrony in the face of disturbances. This synchronization performance can be interpreted as a measure of efficiency or robustness, and has been evaluated, for example, in terms of the lack of coherence or the degree of disorder in first order (single-integrator) [@SiamiMotee2016; @YoungLeonard2010; @BamiehJovanovic2012; @DezfulianMotee2018; @SarkarDahleh2018; @MaElia2015; @LinJovanovic2012_2] and second order (double-integrator) [@BamiehJovanovic2012; @GrunbergGayme2018; @teglingbamieh2019; @PatesRantzer2017; @HaoBarooah2013; @LinJovanovic2012; @OralMalladaGayme2017] consensus networks. Robustness metrics in power systems (e.g. transient real power losses or phase/frequency incoherency) have been assessed in transmission and inverter-based networks [@BamiehGayme2013; @TeglingBamiehGayme2015; @TeglingGayme2015; @m2016cdc; @jpm2017cdc; @wjzmdd2018tac; @wdj2016; @sppmd2016; @oralgaymeecc2019]. Controllers that have been proposed to improve these types of performance include dynamic feedback [@m2016cdc; @jpm2017cdc; @wjzmdd2018tac; @teglingbamieh2019] and optimization based approaches [@wdj2016; @sppmd2016]. A widely utilized approach to quantify performance in systems subjected to distributed disturbances is to select a system output such that the desired metric is defined through the input-output $\mathcal{H}_2$ norm of the system. Certain $\mathcal{H}_2$ based performance metrics for systems whose underlying graphs are undirected can be obtained in closed form, e.g. [@BamiehJovanovic2012; @GrunbergGayme2018; @TeglingBamiehGayme2015; @sppmd2016; @jpm2017cdc]. [[Related]{}]{} performance metrics have also been evaluated in terms of the effective resistance of undirected graphs [@GrunbergGayme2018; @TylooJacquod2019; @pattersonYiZhang2019], which allows for efficient computational approaches [@EllensKooij2011]. The notion of effective resistance has been extended to directed graphs [@YoungLeonard2016; @YoungLeonard2016_2], however its application to performance analysis remains an open question. Much of the existing literature on [[evaluating the performance in systems with]{}]{} directed interconnection topologies considers restrictive scenarios on the graph topology (e.g. spatially invariant [@oralgaymeacc2019] and nearest-neighbor type interactions [@LinJovanovic2012]; or systems with normal Laplacian matrices [@YoungLeonard2010; @DezfulianMotee2018; @OralMalladaGayme2017]) with closed-form solutions obtained [[only]{}]{} for specific metrics (full state [@SiamiMotee2017], degrees of disorder [@BamiehJovanovic2012], etc.). [[Closed-form expressions for more]{}]{} general quadratic performance metrics of double-integrator networks over undirected graphs formulated in terms of the $\mathcal{L}_2$ norm of the system output have [[also]{}]{} been obtained [@PaganiniMallada2017; @PaganiniMallada2019; @ColettaJacquod2019]. [[An extension to directed graphs with diagonalizable Laplacian matrices was provided for $\mathcal{H}_2$ based metrics [@jmg2018], however a precise understanding of the role that the underlying network architecture plays is still lacking.]{}]{} [[Although the results described above represent progress into a wide range of special cases,]{}]{} a unified treatment of general performance metrics over *arbitrary* directed graphs has yet to be developed. This paper aims to lay the foundations for such a framework via the following contributions:

1.  We provide a novel unifying approach to compute a general class of quadratic performance metrics for single and double integrator systems defined over directed graphs that have at least one globally reachable node.

2.  We use the closed-form solutions resulting from this approach to demonstrate that overall network performance is determined by an interaction between network topological characteristics (e.g. edge directionality and connectivity) and the control strategy. In particular, we show that

    1.  The effect of edge directionality on performance can be characterized by the respective spectral structures of [[Laplacian]{}]{} and output [[matrices]{}]{}, which needs to be accounted for in judicious feedback design.

    2.  While performance is sensitive to the degree of connectivity in directed graphs, [[the]{}]{} relationship is not monotonic.

We develop the framework outlined above by formulating the performance metrics through the $\mathcal{L}_2$ norm of the system response due to distributed impulse disturbances. Adopting the terminology from vehicular networks, the metrics are defined in terms of either the position or the velocity states of agents. Our novel method of computing these metrics in closed-form stems from exploiting the spectral properties of weighted graph Laplacians and output performance matrices. These newly derived closed-form expressions pave the way for our analytical findings. By focusing on the subclass of directed graphs emitting diagonalizable Laplacians, we first show that the closed-form solutions for the performance metrics simplify for this family of graphs, allowing for the investigation of the interplay between the network topology and control strategy. Using systems with normal Laplacian matrices as an example, we present a comparative analysis between directed graphs and their undirected counterparts represented by the Hermitian part of the graph Laplacian. In this setting, we show that directed graphs and their undirected counterparts provide identical performance for single integrator networks. In the case of double-integrator networks, we demonstrate that the presence of observable Laplacian eigenvalues with nonzero imaginary part (i.e. [[the]{}]{} observability of modes associated with directed paths) can significantly degrade both position and velocity based performance compared to the undirected topology. Nevertheless, this degradation can be eliminated for velocity-based metrics using absolute position feedback. On the other hand, for the case of position-based metrics a proper combination of relative position and velocity feedback can, not only [[mitigate]{}]{} this degradation, but also lead to improved performance over [[systems with]{}]{} the undirected topology.

We [[then]{}]{} investigate the role of the degree of connectivity in system performance. We first focus on the class of systems that we term $\omega$-nearest neighbor networks, which have a cyclic and directed communication structure with each agent admitting uniformly weighted uni-directional state measurements from $\omega$ consecutive neighbors. For the special case of the metric quantifying the aggregate state deviation from the average, we show that performance does not monotonically improve by increasing $\omega$. [[ nearest neighbors with which each agent communicates through uni-directional links.]{}]{} We also show an equivalence between uniformly weighted, directed (imploding star) and all-to-all networks and show, for the same performance metric. an equivalence between them. The remainder of the paper is organized as follows. In Section \[sysModel\], the system models and the performance metrics are introduced. In Section \[BlockDiag\], we block-diagonalize the closed-loop dynamics and discuss the stability of the input-output system, facilitating the analysis in the following sections. In Section \[ArbitraryL\], the closed-form solution for the general class of output $\mathcal{L}_2$ norm based performance metrics is provided for both single and double-integrator networks over arbitrary directed graphs that have at least one globally reachable node. In Section \[diagL\], we show that the performance computation simplifies for the case of the diagonalizable weighted graph Laplacian matrices. In Section \[NormalL\], the role of communication directionality is studied through systems with normal graph Laplacians. In Section \[CentDistFeed\], and $\omega$-nearest neighbor networks are analyzed. Section \[conclusion\] concludes the paper.

System Models and Performance Metrics {#sysModel}
=====================================

Single and Double-Integrator Networks
-------------------------------------

Consider $n$ dynamical systems that communicate over a weighted digraph $\mathcal{G} = \{\mathcal{N}, \mathcal{E}, \mathcal{W}\}$ that have at least one globally reachable node. Here, $\mathcal{N} = \{1,...,n\}$ is the set of nodes and $\mathcal{E} = \{(i,j) \mid i,j \in \mathcal{N}, \, i \neq j\} $ is the set of edges with weights $\mathcal{W} = \{ b_{ij} > 0 \mid (i,j) \in \mathcal{E} \}$. In the following $b_{ij} = 0$ if and only if $(i,j) \notin \mathcal{E}$.

We consider two types of nodal dynamics. Single integrator systems of the form $$\label{firstorder} \nonumber
\dot{x}_i = -\sum_{j=1}^{n}b_{ij}(x_i - x_j) + w_i,$$ at each $i \in \mathcal{N}$, where $w_i$ denotes the disturbance to the $i^{th}$ agent. This results in the well-known consensus network $$\label{firstmatrix}
\bold{\dot{x}} = -L \bold{x} + \bold{w},$$ where $L$ denotes the weighted graph Laplacian matrix given by $[L]_{ii} = \sum_{j=1}^{n}b_{ij}$, and $[L]_{ij} = -b_{ij}$ if $i \neq j$, $\forall i, j \in \mathcal{N}$. The second type of system is governed by double-integrator dynamics of the form $$\label{secondorder} \nonumber
\ddot{x}_i + k_d \dot{x}_i + k_p x_i = -u_i + w_i,$$ where $u_i =  \gamma_p \sum_{j=1}^{n}b_{ij}(x_i - x_j) + \gamma_d \sum_{j=1}^{n}b_{ij}(\dot{x}_i - \dot{x}_j)$ $\forall i \in \mathcal{N}$. Here, $k_p, k_d, \gamma_p, \gamma_d \geq 0$, and $w_i$ denotes the disturbance to the $i^{th}$ system. Defining $\bold{v} := \bold{\dot{x}}$, the double-integrator dynamics can be expressed in matrix form as $$\label{secondmatrix}
\begin{bmatrix}
\bold{\dot{x}} \\ \bold{\dot{v}}
\end{bmatrix} = 
\begin{bmatrix}
0 & I \\ 
-k_p I - \gamma_p L & -k_d I - \gamma_d L
\end{bmatrix}
\begin{bmatrix}
\bold{x} \\ \bold{v}
\end{bmatrix} + 
\begin{bmatrix}
0 \\ I
\end{bmatrix} \bold{w}.$$ A necessary condition for to reach consensus without disturbance ($\bold{w} = 0$) is that at least one of $(k_p,\gamma_p)$ and at least one of $(k_d,\gamma_d)$ are non-zero [@OralMalladaGayme2017 Lemma 3]. [[To ensure that this condition is met, we impose the following assumption throughout the paper.]{}]{}

\[assum\_gain\] System has feedback in both state variables (position and velocity), i.e. at least one of $(k_p,\gamma_p)$ and at least one of $(k_d,\gamma_d)$ are non-zero.

Performance Metrics
-------------------

Performance metrics that are quadratic in the state variables are widely used in control synthesis problems, especially paired with $\mathcal{H}_2$ or $\mathcal{H}_\infty$ criteria. In this work we focus on the analysis of such metrics through a more general output norm based approach in order to gain insight into how directed communication affects performance.

For $C \in \mathbb{R}^{q \times n}$, the performance output $$\label{posOutput}
\bold{y} = C \bold {x}$$ will be used to quantify the performance of the single-integrator network and the double-integrator network for metrics related to the position state $\bold{x}$. For the double-integrator network , the performance output $$\label{velOutput}
\bold{y} = C \bold {v},$$ which quantifies performance metrics related to the velocity state $\bold{v}$, will also be considered. We are interested in performance metrics of the form $$\label{perf_x}
P = \lVert \bold{y} \rVert_{\mathcal{L}_2}^2 = \int_{0}^{\infty} \bold{y}(t)^* \bold{y}(t) dt$$ for an impulse input $$\label{distDelta}
\bold{w}(t) = \bold{w}_0 \delta (t)$$ with an arbitrary direction vector $\bold{w}_0 \in \mathbb{R}^{n}$. Similar metrics appear in [@PaganiniMallada2017] for networks over undirected graphs. Denoting the impulse response function from $\bold{w}(t)$ to $\bold{y}(t)$ by $T (t)$, the performance output can be written as $$\label{posOut2}
\bold{y} (t) =
\int_{0}^{t} T (t-\tau) \bold{w}(\tau) d \tau.$$ Substitution of and into gives $$\label{perf_x_2}
P = \int_{0}^{\infty} \bold{w}_0^* T (t)^* T (t) \bold{w}_0 dt.$$ Therefore, is finite if and only if $T (t)$ is input-output (IO) stable. We will later discuss conditions that guarantee the IO stability of $T (t)$.

We now show that As stated next, for a special case of the impulse input , the performance metric can be computed using the $\mathcal{H}_2$ norm of $T(t)$. Although this connection is standard in the literature [@BamiehGayme2013], for completeness we provide a short proof below. This relationship, which is standard in the literature [@BamiehGayme2013], will be used in the upcoming sections. This relationship will be used in the upcoming sections.

\[Prop\_H2L2\] Consider a general MIMO system $G(t)$ from $\bold{w}$ to $\bold{y}$ . Assume a random impulse input with $E \left[\bold{w}_0 \bold{w}_0^* \right] = I$ and zero initial condition. Then $
\lVert G \rVert_{\mathcal{H}_2}^2
=
E
\left[  
\lVert \bold{y} \rVert_{\mathcal{L}_2}^2
\right].
$

[[ Assuming zero initial condition,]{}]{} the output is given by $
\bold{y}(t) = C e^{At} B \bold{w}_0.
$ Then $$\begin{aligned}
E 
\left[  
\lVert \bold{y}(t) \rVert_{\mathcal{L}_2}^2
\right] \
&= \ E
\left[ 
\mathrm{tr} \!
\int_0^{\infty} \! \!
C e^{At} B \bold{w}_0
\bold{w}_0^* B^* e^{A^* t} C^*
dt
\right]
\\
\ &= \ 
\mathrm{tr} \!
\int_0^{\infty} \! \!
C e^{At} B B^* e^{A^* t} C^*
dt 
\ = \ \lVert G \rVert_{\mathcal{H}_2}^2.
\ 
\! \! \! \! \!
\mbox{\qedhere}
$$

Block-diagonalization of the Closed-loop Dynamics {#BlockDiag}
=================================================

![Block diagram of the closed-loop system $T (s)$ from the disturbance input $\bold{w} (s)$ to the performance output $\bold{y} (s)$ and the closed-loop system $H_{\bold{x}\bold{w}}(s)$ from $\bold{w} (s)$ to the position state $\bold{x} (s)$. The performance output $\bold{y} (s)$ is given by if $r(s) = 1$ and by if $r(s) = s$. []{data-label="block1"}](block1_f){width="2.5in"}

In this section, we express the dynamics given in and in the frequency domain using an approach based on [@PaganiniMallada2017]. The framework, denoted in Figure \[block1\], describes identical systems $g(s)$ receiving feedback that depends on an arbitrary transfer function $f(s)$ and the weighted graph Laplacian $L$ emitted by the network interconnection. Assuming that $\bold{x}(0) = \bold{v}(0) = 0$ (we consider perturbations to the equilibrium), the closed-loop system from the input $\bold{w}$ to the position state $\bold{x}$ is given by

$$\label{laplace1}
\left[ (g(s)^{-1} I + f(s) L \right] \bold{x}(s) = \bold{w}(s),$$

which leads to $$\begin{aligned}
 \label{laplace2}
\bold{x}(s) = \left[ (I + g(s) f(s) L \right]^{-1} g(s) \bold{w}(s) 
=: H_{\bold{x}\bold{w}}(s) \bold{w}(s), 
$$ where $H_{\bold{x}\bold{w}}(s)$ denotes the transfer function from the input $\bold{w}$ to the position state $\bold{x}$. $L$ can be decomposed as $L = R J R^{-1}$, where $R \in \mathbb{C}^{n \times n}$ is invertible and $J \in \mathbb{C}^{n \times n}$ is in Jordan Canonical Form (JCF). This decomposition transforms into $$\label{laplace3}
\bold{x}(s) = R \left[ (I + g(s) f(s) J \right]^{-1} g(s) R^{-1} \bold{w}(s), \nonumber$$ as shown by the block diagram in Figure \[block2\]. Defining $\bold{\tilde{x}} := R^{-1} \bold{x}$ and $\bold{\tilde{w}} := R^{-1} \bold{w}$, the transfer function from $\bold{\tilde{w}}$ to $\bold{\tilde{x}}$ is $$\label{T_tilde_pos}
H_{\bold{\tilde{x}} \bold{\tilde{w}}} (s) = \left[ (I + g(s) f(s) J \right]^{-1} g(s),$$ where the following relationship holds $$\label{TxwTrans}
H_{\bold{x} \bold{w}} = R H_{\bold{\tilde{x}} \bold{\tilde{w}}} R^{-1}.$$

![Application of a change of basis given by the Jordan decomposition $L = R J R^{-1}$ to the closed-loop system $H_{\bold{x}\bold{w}}(s)$. The feedback loop gives the closed-loop system $H_{\bold{\tilde{x}}\bold{\tilde{w}}}(s)$.[]{data-label="block2"}](block2_f){width="3.3in"}

$J$ is composed of Jordan blocks $J_k$ associated with the eigenvalues $\lambda_k \in \mathbb{C}$ of $L$ for $k = 1, \dots, m$: $$\label{jordanL}
\iffalse
J =
\begin{bmatrix} 
J_1 & & \\
& \ddots & \\
& & J_m
\end{bmatrix},
\fi
J = \operatorname{blockdiag}{\left( J_k \right)_{1 \leq k \leq m}},
$$ where $J_k \in \mathbb{C}^{n_k \times n_k}$ and $\sum_{k=1}^{m} n_k = n$. Since $L$ is a Laplacian matrix, $L \bold{1} = \bold{0}$ with $\bold{1}$ denoting the vector of all ones therefore $J_1 = \lambda_1 = 0$. Also $\operatorname{Re}\left[ \lambda_k \right] > 0$ for $k = 2, \dots, m$ due to the fact that $\mathcal{G}$ has a globally reachable node [@bullo2016lectures Theorem 7.4]. So can be written as $$\label{block_diag}
\iffalse
H_{\bold{\tilde{x}} \bold{\tilde{w}}} (s) = 
\begin{bmatrix}
H_{\bold{\tilde{x}}_1 \bold{\tilde{w}}_1} (s) & & \\
& \ddots & \\
& & H_{\bold{\tilde{x}}_m \bold{\tilde{w}}_m} (s)
\end{bmatrix},
\fi
H_{\bold{\tilde{x}} \bold{\tilde{w}}} (s) = \operatorname{blockdiag}{\left( H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k} (s) \right)_{1 \leq k \leq m}}, 
$$ where $$\label{T_tilde_i}
H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}(s) = \left[ (I + g(s) f(s) J_k \right]^{-1} g(s).$$ Here, the vectors $\bold{\tilde{x}}_k = [ \tilde{x}_{d_k + 1}, \dots, \tilde{x}_{d_k+n_k}]^\intercal$ and $\bold{\tilde{w}}_k ~=~ [ \tilde{w}_{d_k +1}, \dots, \tilde{w}_{d_k+n_k} ]^\intercal$ respectively denote the position state and the input to the associated subsystem, with $d_1 = 0$ and $d_k = \sum_{i=1}^{k-1} n_i$ for $k=2,\dots,m$. An equivalent representation of the transfer function in is given by the block diagram in Figure \[fig3\].

![Block diagram of each subsystem $H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}$ for $k=1,\dots,m$.[]{data-label="fig3"}](block3_f){width="1.9in"}

The following lemma describes the form of the transfer function in which will be used to compute the performance metric in what follows.

\[lemma1\] $H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}(s)$ in is an upper triangular Toeplitz matrix given by $$\nonumber
H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}(s) = \frac{1}{ f(s) }
\begin{bmatrix}
h_k(s) & \dots & (-1)^{n_k - 1} h_k(s)^{n_k} \\
& \ddots & \vdots \\
& & h_k(s)
\end{bmatrix},$$ where $
h_k(s) = \frac{g(s) f(s)}{1 + \lambda_k g(s) f(s) }
$.

Using and the definition of $J_k$ $$\nonumber
H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}(s) =
\begin{bmatrix}
\frac{1+ \lambda_k g(s) f(s) } {g(s)} & f(s) & & \\
& \ddots & \ddots & \\
& &  \ddots & f(s) \\
& & &  \frac{1+ \lambda_k g(s) f(s)}{g(s)}
\end{bmatrix}^{-1},$$ where factoring out $g(s) f(s)$ gives $$\label{T_tilde_prf}
H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}(s) = \frac{1}{f(s)}
\begin{bmatrix}
h_k(s)^{-1} & 1 & & \\
& \ddots & \ddots & \\
& &  \ddots & 1 \\
& & &  h_k(s)^{-1}
\end{bmatrix}^{-1}.$$ Using the inverse of the JCF in yields the result.

The form of the closed-loop transfer function in Lemma \[lemma1\] holds for arbitrary open-loop and feedback transfer functions $g(s)$ and $f(s)$, and therefore applies to a general class of networked dynamical systems.

We next apply Lemma \[lemma1\] to the special cases of the single and double-integrator networks.

\[cor1\] Consider the single-integrator network . Then, $H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}(s)$ in is an upper triangular Toeplitz matrix $$\nonumber
H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}(s) =
\begin{bmatrix}
h_k(s) & \dots & (-1)^{n_k - 1} h_k(s)^{n_k} \\
& \ddots & \vdots \\
& & h_k(s)
\end{bmatrix},$$ where $
h_k(s) = \frac{1}{s + \lambda_k}
$.

Taking the Laplace transform of leads to $g(s) = \frac{1}{s}$ and $f(s) = 1$. Evaluating the result of Lemma \[lemma1\] at these values gives the desired result.

\[cor2\] Consider the double-integrator network . Then, $H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}(s)$ in is an upper triangular Toeplitz matrix $$\nonumber
H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}(s) = \frac{1}{\gamma_p + s \gamma_d}
\begin{bmatrix}
h_k(s) & \dots & (-1)^{n_k - 1} h_k(s)^{n_k} \\
& \ddots & \vdots \\
& & h_k(s)
\end{bmatrix},$$ where $
h_k(s) = \frac{\gamma_p + s \gamma_d}{s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k}
$.

Taking the Laplace transform of leads to $g(s) ~=~  \frac{1}{s^2 + k_d s + k_p}$ and $f(s) ~=~ \gamma_p + s \gamma_d$. Evaluating the result of Lemma \[lemma1\] at these values gives the desired result.

The transfer function from the input $\bold{w}$ to the velocity state $\bold{v}$ is given by $H_{\bold{v}\bold{w}}(s)
:=  s H_{\bold{x}\bold{w}}(s)
$ since Therefore, the closed-loop transfer function $T (s)$ from the input $\bold{w}$ to the output $\bold{y}$ can be written as $$\label{H_func}
T (s) = C r(s) H_{\bold{x}\bold{w}}(s),$$ using the notation in Figure \[block1\] and specifying $r(s)$ such that

[T (s) =]{} C H\_(s), & $r(s) = 1$ \[H\_cases\_1\]\
C H\_(s), & $r(s) = s$ \[H\_cases\_2\].

The cases and correspond to the outputs and , respectively. We next provide necessary and sufficient conditions for the input-output stability of and , which ensure the finiteness of the performance metric .

Input-Output Stability
----------------------

In this subsection we state necessary and sufficient conditions for the input-output stability of and . The following assumption will be imposed throughout the paper to eliminate the unstable consensus mode of the Laplacian from the performance output.

\[assum1\] The output matrix $C$ satisfies $C \bold{1}= \bold{0}$.

First, we apply the change of basis in to the closed-loop system . Since $L \bold{1} = \bold{0}$, we can apply the partitioning $$\label{RandQ}
R = \begin{bmatrix} \alpha \bold{1} & \tilde{R} \end{bmatrix} \
\text{and} \
R^{-1} = \begin{bmatrix} \bold{q}_1 & \tilde{Q}^*\end{bmatrix}^*,$$ where $\alpha \in \mathbb{C}$, $\bold{q}_1^* \in \mathbb{C}^{1\times n} $ is the left eigenvector of $\lambda_1=0$, $\tilde{R} \in \mathbb{C}^{n \times n-1}$ and $\tilde{Q} \in \mathbb{C}^{n-1 \times n}$. Substituting , and into we obtain $$\begin{aligned}
 \nonumber
T (s) &= C
\left( \alpha r(s) H_{\bold{\tilde{x}}_1 \bold{\tilde{w}}_1} (s) \bold{1} \bold{q}_1^* +  
\tilde{R} \, \tilde{H} (s) \tilde{Q} \right) \\
&= C \tilde{R} \, \tilde{H}(s) \tilde{Q} \label{H_x_hat},\end{aligned}$$ where $$\label{T_tilde}
\! 
\tilde{H}(s) 
\! = \! \!
\left[ \! \begin{smallmatrix} 
\tilde{H}_2 (s) & & \\
& \ddots & \\
& & \tilde{H}_m (s) \!
\end{smallmatrix} \right]
\! \! \!:= \!
r(s) \! \!
\left[ \begin{smallmatrix} 
H_{\bold{\tilde{x}}_2 \bold{\tilde{w}}_2} (s) & & \\
& \ddots & \\
& & H_{\bold{\tilde{x}}_m \bold{\tilde{w}}_m} (s)
\end{smallmatrix} \right] \! \!, \! \! \! \! \! \! \! \!$$ $$\label{T_tilde}
\! 
\tilde{H}(s) 
\! = \!
\operatorname{blockdiag}{ ( \tilde{H}_k (s) ) } 
\! := \!
r(s)
\operatorname{blockdiag}{ \left(
H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k} (s) \right) }, \! \! \! \! \! \! \! \!$$ for $k = 2, \dots, m$ and we have used Assumption \[assum1\] and the fact that $H_{\bold{\tilde{x}}_1 \bold{\tilde{w}}_1} (s)$ is a scalar. We can partition $\tilde{R}$ in as $$\label{Rtilde_part}
\tilde{R} = \begin{bmatrix} \tilde{R}_2 & \dots & \tilde{R}_m \end{bmatrix},$$ which is in a form that conforms to . Then the columns of $\tilde{R}_k ~\in~ \mathbb{C}^{n \times n_k}$ are the right generalized eigenvectors associated with the Jordan block $J_k$ in for $k = 2, \dots, m$. This partitioning leads to the following useful definition.

\[obsv\_indices\] The set of observable indices $\mathcal{N}_{obsv}$ is given by $$\label{obsv_ind_eqn}
\mathcal{N}_{obsv} =
\left\{
k \in \{ 2, \dots, m \}
\mid
C \tilde{R}_k \neq 0 
\right\}.$$ $$\mathcal{N}_{obsv} =
\left\{
k \in \{ 2, \dots, n \}
\mid
C \bold{r}_k \neq 0 
\right\},$$ recalling that $\bold{r}_k$ denote the right generalized eigenvectors of $L$ as defined in .

We now state the stability conditions. We begin with the system $T$ in for the single-integrator network .

\[prop4\] Consider the single-integrator network . The system $T$ in is input-output stable if and only if Assumption \[assum1\] holds [@bullo2016lectures Theorem 7.4].

As we show next for the double-integrator network , stability of the observable modes is necessary and sufficient for the input-output stability of the system $T$ given by or . For simplicity, we assume $L$ to be diagonalizable; the result can be extended by relaxing this assumption.

\[prop3\] Consider the double-integrator network and suppose that $L$ is diagonalizable and assumptions \[assum\_gain\] and \[assum1\] hold. The system $T$ given by or is input-output stable if and only if $$\label{char_eq_s}
s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k = 0$$ has solutions that satisfy $\operatorname{Re}(s) < 0$ for all $k \in \mathcal{N}_{obsv}$.

Using the block diagram in Figure \[fig3\] and the fact that $J_k = \lambda_k$ leads to the following realization for $H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}$ $$\begin{aligned}
\begin{bmatrix}
\bold{\dot{\tilde{x}}}_k \\ \bold{\dot{\tilde{v}}}_k
\end{bmatrix} &= 
\underbrace{
\begin{bmatrix}
0 & 1 \\ 
-k_p - \gamma_p \lambda_k & -k_d - \gamma_d \lambda_k
\end{bmatrix}}_{\Lambda_k}
\begin{bmatrix}
\bold{\tilde{x}}_k \\ \bold{\tilde{v}}_k
\end{bmatrix}
+ 
\begin{bmatrix}
0 \\ 1
\end{bmatrix}
 \bold{\tilde{w}}_k \nonumber \\
\bold{\tilde{y}}_k &=
\begin{bmatrix}
1 & 0 
\end{bmatrix} 
\begin{bmatrix}
\bold{\tilde{x}}_k \\ \bold{\tilde{v}}_k
\end{bmatrix} =
 \bold{\tilde{x}}_k.
 \label{Hk_real}\end{aligned}$$ Since $L$ is diagonalizable, the partitioning of $\tilde{R}$ in becomes $\tilde{R} = \begin{bmatrix}
\bold{r}_2 & \dots & \bold{r}_n
\end{bmatrix}$. Using the block-diagonal form of $\tilde{H}(s)$ in and the conformal partitioning $\tilde{Q} ~=~ \begin{bmatrix} \bold{q}_2 & \dots & \bold{q}_n \end{bmatrix}^*$, can be expressed in time-domain as $$T(t) \ = \ 
C \sum_{k=2}^{n} \bold{r}_k \tilde{H}_k (t) \bold{q}_k^* \
= C \! \sum_{k \in \mathcal{N}_{obsv}} \! \! \! \! \bold{r}_k \tilde{H}_k (t) \bold{q}_k^*.$$ For , we can use and the realization for $H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k}$ in to re-write the equation above as $$\begin{aligned}
T(t) \ =&
\sum_{k \in \mathcal{N}_{obsv}} \! \! \! \! \begin{bmatrix}
C \bold{r}_k  & 0
\end{bmatrix}
e^{\Lambda_k t} 
\begin{bmatrix}
0 \\
\bold{q}_k^*
\end{bmatrix},\end{aligned}$$ which has a realization $$\label{T_real_pos}
T(t) =
\left(
\begin{array}{c|c}
\left[
\begin{smallmatrix}
\ddots & & \\
& \Lambda_k & \\
& & \ddots
\end{smallmatrix} \right]
& 
\left[ \begin{smallmatrix}
\vdots \\
\left[
\begin{smallmatrix}
0 \\ \bold{q}_k^*
\end{smallmatrix}
\right]
\\ \vdots
\end{smallmatrix} \right]
\\ \hline
\left[
\begin{smallmatrix}
\dots & 
\left[
\begin{smallmatrix}
C \bold{r}_k  & 0
\end{smallmatrix}
\right]
& \dots
\end{smallmatrix} \right]
& 0
\end{array}
\right), 
\quad k \in \mathcal{N}_{obsv}.$$ The associated observability matrix is given by $$\label{pos_obsv}
\mathcal{O} = 
\left[
\begin{array}{c}
\left[
\begin{smallmatrix}
\dots & 
\left[
\begin{smallmatrix}
C \bold{r}_k  & 0
\end{smallmatrix}
\right]
& \dots
\end{smallmatrix} \right]
\\
\left[
\begin{smallmatrix}
\dots & 
\left[
\begin{smallmatrix}
C \bold{r}_k  & 0
\end{smallmatrix}
\right] \Lambda_k
& \dots
\end{smallmatrix} \right]
\\
\vdots
\\
\left[
\begin{smallmatrix}
\dots & 
\left[
\begin{smallmatrix}
C \bold{r}_k  & 0
\end{smallmatrix}
\right] \Lambda_k^{2 |\mathcal{N}_{obsv}|-1}
& \dots
\end{smallmatrix} \right]
\end{array} 
\right],$$ where $k \in \mathcal{N}_{obsv}$ and $|\mathcal{N}_{obsv}|$ denotes the cardinality of $\mathcal{N}_{obsv}$. Due to the form of $\Lambda_k$ in , we can see that . Then the first two block-rows of imply that $\mathcal{O}$ is full rank if the vectors $C \bold{r}_k$ are linearly independent for $k \in \mathcal{N}_{obsv}$. For a proof by contradiction, assume that $C \bold{r}_k$ are linearly dependent, i.e. $\sum_{k \in \mathcal{N}_{obsv}}\alpha_k C \bold{r}_k = 0$ where $\alpha_k$ is non-zero for some $k$. This implies that $\sum_{k \in \mathcal{N}_{obsv}}\alpha_k \bold{r}_k \in \ker \{C\}$, which can be expressed as a linear combination of the vectors that span $\ker \{C\}$. Then $$\sum_{k \in \mathcal{N}_{obsv}}\alpha_k \bold{r}_k = -
\! \!
\sum_{k \in \{ 1, \dots, n  \} \setminus \mathcal{N}_{obsv}}
\! \!
\alpha_k \bold{r}_k
\Rightarrow
\sum_{k=1}^{n} \alpha_k \bold{r}_k = 0,$$ which would contradict the fact that $R$ is invertible. Therefore, $\mathcal{O}$ in is full rank, so the realization in is observable. By a similar argument we can prove the controllability, hence the minimality of . Therefore, the poles of $T(s)$ in are given precisely by the eigenvalues of the system matrix in , which are determined by . Then $T(s)$ is input-output stable if and only if its poles are on the open left half-plane.

We now repeat the argument for which is given by $$\begin{aligned}
T(t) \ =&
\sum_{k \in \mathcal{N}_{obsv}} \! \! \! \! \begin{bmatrix}
0 & C \bold{r}_k
\end{bmatrix}
e^{\Lambda_k t} 
\begin{bmatrix}
0 \\
\bold{q}_k^*
\end{bmatrix}\end{aligned}$$ in time-domain with a realization $$\label{T_real_vel}
T(t) =
\left(
\begin{array}{c|c}
\left[
\begin{smallmatrix}
\ddots & & \\
& \Lambda_k & \\
& & \ddots
\end{smallmatrix} \right]
& 
\left[ \begin{smallmatrix}
\vdots \\
\left[
\begin{smallmatrix}
0 \\ \bold{q}_k^*
\end{smallmatrix}
\right]
\\ \vdots
\end{smallmatrix} \right]
\\ \hline
\left[
\begin{smallmatrix}
\dots & 
\left[
\begin{smallmatrix}
0 & C \bold{r}_k
\end{smallmatrix}
\right]
& \dots
\end{smallmatrix} \right]
& 0
\end{array}
\right), 
\quad k \in \mathcal{N}_{obsv}.$$ The associated observability matrix is given by $$\label{vel_obsv}
\mathcal{O} = 
\left[
\begin{array}{c}
\left[
\begin{smallmatrix}
\dots & 
\left[
\begin{smallmatrix}
0 & C \bold{r}_k
\end{smallmatrix}
\right]
& \dots
\end{smallmatrix} \right]
\\
\left[
\begin{smallmatrix}
\dots & 
\left[
\begin{smallmatrix}
0 & C \bold{r}_k
\end{smallmatrix}
\right] \Lambda_k
& \dots
\end{smallmatrix} \right]
\\
\vdots
\\
\left[
\begin{smallmatrix}
\dots & 
\left[
\begin{smallmatrix}
0 & C \bold{r}_k
\end{smallmatrix}
\right] \Lambda_k^{2 |\mathcal{N}_{obsv}|-1}
& \dots
\end{smallmatrix} \right]
\end{array} 
\right],$$ where $k \in \mathcal{N}_{obsv}$. Since $$\begin{bmatrix}
0 & C \bold{r}_k
\end{bmatrix}
\Lambda_k =
C \bold{r}_k
\begin{bmatrix}
-k_p - \gamma_p \lambda_k & -k_d - \gamma_d \lambda_k
\end{bmatrix},$$ and assumption \[assum\_gain\] holds, is full rank and is observable, hence minimal. Therefore, the poles of $T(s)$ in are given precisely by the eigenvalues of the system matrix in , which are determined by . Then $T(s)$ is input-output stable if and only if its poles are on the open left half-plane. [[See]{}]{} [@OralMalladaGayme2019_arxiv] for a proof.

\[rem1\] Assumption \[assum1\] can be relaxed for specific values of $k_p$ and $k_d$ for which the consensus modes become Hurwitz. If $k_p \neq 0$ and $k_d \neq 0$, the assumption can be relaxed for both and since $
H_{\bold{\tilde{x}}_1 \bold{\tilde{w}}_1} (s) = \frac{h_1 (s)}{f(s)} = g(s) = \frac{1}{s^2 + k_d s + k_p}
$ and $
H_{\bold{\tilde{v}}_1 \bold{\tilde{w}}_1} (s) = s H_{\bold{\tilde{x}}_1 \bold{\tilde{w}}_1}(s) = \frac{s}{s^2 + k_d s + k_p}
$ have stable poles by the Routh-Hurwitz criterion.

Similarly, one can relax the assumption for but [[not]{}]{} for if $k_p = 0$ and $k_d \neq 0$ since has a pole at $s=0$ but has a stable pole. However for the sake of simplicity, we only consider performance metrics such that Assumption \[assum1\] is satisfied for both and .

[[ The stability condition in Proposition \[prop3\] can be restated as follows.]{}]{}

\[prop\_stab\_rh\] Consider the double-integrator network and suppose that $L$ is diagonalizable and assumptions \[assum\_gain\] and \[assum1\] hold. The system $T$ given by or is input-output stable if and only if $$\label{stab_rh}
\alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 > 0 \ \text{and} \ \phi_k > 0, \ \ 
k \in \mathcal{N}_{obsv},
$$ where $\alpha_k = k_p + \gamma_p \operatorname{Re}[\lambda_k]$, $\phi_k = k_d + \gamma_d \operatorname{Re}[\lambda_k]$, $\beta_k = \gamma_p \operatorname{Im}[\lambda_k]$ and $\xi_k = \gamma_d\operatorname{Im}[\lambda_k]$.

The result follows from applying [@LiHuang2010 Lemma 4] to Proposition \[prop3\].

Performance over Arbitrary Digraphs {#ArbitraryL}
===================================

In this section, [[we use the block-diagonalization procedure outlined in Section \[BlockDiag\] to derive closed-form expressions]{}]{} for the performance of the single and double-integrator networks and over arbitrary directed graphs [[that have at least one]{}]{} globally reachable node. Throughout the discussion we use both time and frequency domain representations, which simplifies the analysis.

First, we simplify using the block-diagonal form of and show that performance can be quantified as a linear combination of scalar integrals. These integrals can be interpreted as $\mathcal{L}_2$ scalar products of the elements of the closed-loop impulse response function matrix blocks $H_{\bold{\tilde{x}}_k \bold{\tilde{w}}_k} (t)$ and $H_{\bold{\tilde{v}}_k \bold{\tilde{w}}_k} (t)$.

Combining and , the performance metric in can be written as $$\label{perf_generic}
P = \int_{0}^{\infty} \bold{w}_0^* \tilde{Q}^* \tilde{H} (t)^* \tilde{N} \tilde{H} (t) \tilde{Q} \bold{w}_0 dt,$$ where $\tilde{N} = \tilde{R}^* C^* C \tilde{R}$ and $\tilde{H}$ is defined as in with $$\label{TF_block}
\tilde{H}_k (s) = 
\begin{bmatrix}
\tilde{h}_{11}^{(k)}(s) & \dots & \tilde{h}_{1,n_k}^{(k)}(s) \\
& \ddots & \vdots \\
& & \tilde{h}_{n_k,n_k}^{(k)}(s)
\end{bmatrix}$$ for $k=2,\dots,m$. The upper triangular form of is given in Lemma \[lemma1\]. Since $$\label{matrix_M}
M := C^* C$$ is a symmetric matrix, it is unitarily diagonalizable, i.e. $$\! M = \Theta W \Theta^*, \ \
\iffalse
W = \left[ \begin{smallmatrix} 
\mu_1 & & \\ 
& \ddots & \\
& & \mu_n
\end{smallmatrix} \right] \in \mathbb{R}^{n \times n}, \ \
\fi
W = \operatorname{diag}{ (\mu_i)_{1 \leq i \leq n} }
\in \mathbb{R}^{n \times n} \! , \ \ 
\text{and} \ \
\Theta \Theta^* = I,$$ therefore $\tilde{N} = \tilde{R}^* \Theta W \Theta^* \tilde{R}$. Using Assumption \[assum1\] and assuming without loss of generality that $\mu_1 = 0$ is associated with the eigenvector $\boldsymbol{\theta}_1 = \frac{1}{\sqrt{n}}\bold{1}$, we can state $\tilde{N}$ element-wise as $$\label{nu_eta_kappa}
(\tilde{N})_{\eta-1, \kappa-1} = \sum_{l=2}^{n} 
\langle \boldsymbol{\theta}_l, \bold{r}_{\eta}  \rangle 
\langle \bold{r}_{\kappa}, \boldsymbol{\theta}_l  \rangle
\mu_l
=: \nu_{\eta, \kappa}$$ for $\eta, \kappa = 2, \dots, n$, where $\langle \boldsymbol{\theta}_l, \bold{r}_{\eta}  \rangle = \bold{r}_{\eta}^*\boldsymbol{\theta}_l$, $\bold{r}_{\kappa}$ and $\boldsymbol{\theta}_l$ denote respectively the columns $\kappa$ and $l$ of $\tilde{R}$ and $\Theta$.

Using this notation, can be written in terms of the scalar products between the elements of $\tilde{H}_k (t)$, which are given by the element-wise inverse Laplace transforms of .

\[lemma2\] The performance metric $P$ in is given by $$\label{perf_generic_sol1}
P = \operatorname{tr}{(\Sigma_Q \Psi )},$$ where $$\label{Sigma}
\Sigma_Q = \tilde{Q} \Sigma_0 \tilde{Q}^*, \, \Sigma_0 = \bold{w}_0 \bold{w}_0^*,$$ and the matrix $\Psi$ is partitioned as $
\iffalse
\Psi = 
\begin{bmatrix}
\Psi_{22} & \dots & \Psi_{2m} \\
\vdots & \ddots & \vdots \\
 \Psi_{m2} & \dots & \Psi_{mm}
\end{bmatrix}.
\fi
\Psi = \left[ \Psi_{kl} \right]_{2 \leq k,l \leq  m}. 
$ Furthermore, the entry $(q, b)$ of the matrix $\Psi_{kl}$ for $k, l ~=~ 2,\dots, m$ is given by $$\label{psi_ik}
\left[ \Psi_{kl} \right]_{q b} = \sum_{p=1}^{q} \sum_{a=1}^{b} \nu_{d_k+p, d_l+a} 
\left \langle \tilde{h}_{a b}^{(l)}(t), \tilde{h}_{p q}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2},$$ where $$\label{L2_scalar}
\left \langle \tilde{h}_{a b}^{(l)}(t), \tilde{h}_{p q}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2} = 
\int_0^{\infty} \overline{ \tilde{h}_{p q}^{(k)} (t) } \tilde{h}_{a b}^{(l)}(t) dt.$$ Here the indices $q = 1,\dots,n_k$ and $b = 1,\dots,n_l$ are determined by the Jordan block sizes $n_k$ and $n_l$. Terms of the form in appear in the summand of and their indices take values larger than the sum of the previous Jordan block sizes, namely $d_k = \sum_{i=1}^{k-1} n_i$ and $d_l = \sum_{i=1}^{l-1} n_i$.

\[rem2\] For the special case in which $L$ is diagonalizable each Jordan block is a scalar, i.e. $n_k = 1$, and leads to $$\nonumber
\Psi_{kl} = \nu_{kl} 
\left \langle \tilde{h}^{(l)}(t), \tilde{h}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2}.$$ Here we dropped the subscripts of $\tilde{h}_{p q}^{(k)}$ for simplicity. The case with diagonalizable $L$ was studied in [@PaganiniMallada2017; @PaganiniMallada2019] and Lemma \[lemma2\] provides a generalization to the case of arbitrary Jordan block size $n_k$ for $k=2, \dots, m$.

Taking the trace of both sides of and using the permutation property of the trace, we have $
P = \operatorname{tr}\left( \tilde{Q} \bold{w}_0 \bold{w}_0^* \tilde{Q}^*\Psi \right),
$ where $\Psi (t) = \int_{0}^{\infty} \tilde{H}(t)^* \tilde{N} \tilde{H} (t) dt$. Partitioning $\tilde{N}$ conformally so that its $(k,l)$ block is given by $\tilde{N}_{kl}$, one can write $$\label{psi_kl_full}
\Psi_{kl} = \int_{0}^{\infty}
\tilde{H}_k (t) ^ *
\tilde{N}_{kl}
\tilde{H}_l (t)  dt,$$ for $k,l = 2,\dots,m$. Direct multiplication of the matrices in the integral argument and interchanging the order of integration with the summation gives the desired result.

\[rem\_perf\_real\] Since $\tilde{N} = \tilde{N} ^ *$, i.e. $\tilde{N}_{kl} = \tilde{N}_{lk} ^ *$, leads to $\Psi_{kl} = \Psi_{lk} ^ *$, therefore $\Psi$ is Hermitian. The fact that $\Sigma_{Q}$ in is also Hermitian leads to $
\operatorname{tr}{(\Sigma_Q \Psi )} =  \operatorname{tr}{\left[ (\Sigma_Q \Psi)^* \right]}
= \overline{\operatorname{tr}{(\Sigma_Q \Psi )}},
$ which verifies that $P$ in is real as expected.

As Lemma \[lemma2\] indicates, can be expressed in closed-form if the integral in can be evaluated. In what follows, we derive time-domain realizations for the transfer functions $\tilde{h}_{p q}^{(k)}(s)$ in , which enables the evaluation of this integral. This leads to [[our first major contribution, which we state next for single and double-integrator networks and .]{}]{}

Performance of Single-Integrator Networks
-----------------------------------------

We now present the main result of this section for the single-integrator network . The following result provides a closed-form solution for the performance metric $P$ in .

\[thm1\] Consider the single-integrator network . The performance metric $P$ in for the system $T$ given by is $
P = \operatorname{tr}{(\Sigma_Q \Psi)}.
$ The elements of $\Psi$ are defined in and the scalar product in is given by $$\label{L2_scalar_sol_consensus}
\left \langle \tilde{h}_{a b}^{(l)}(t), \tilde{h}_{p q}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2} = 
\frac{{(-1)}^{b - a + q - p} \Phi }
{ {\left( \overline{\lambda_k} + \lambda_l \right)}^{b - a + q - p + 1} },$$ where $\Phi = 
\frac{(b - a + q - p)!}{(b - a)! (q - p)!} $.

Using the result of Corollary \[cor1\] and the notation in $$\nonumber
 \tilde{h}_{p q}^{(k)}(s) = 
 {(-1)}^{q-p}
 \frac{1}
 { {\left( s + \lambda_k \right)}^{q-p+1}}.$$ Here, $\frac{1}
 { {\left( s + \lambda_k \right)}^{q-p+1}}$ has the following realization $\left( \mathcal{A}_{k,\delta}, \mathcal{B}_{k,\delta}, \mathcal{C}_{k,\delta} \right)$ in JCF $$\label{Jordan_realization_3}
\mathcal{A}_{k,\delta} =
\mathcal{J} (-\lambda_k, \delta),$$ $$\nonumber
\mathcal{B}_{k,\delta} = \bigg[ \underbrace{\begin{matrix} 0 & \dots & 1 \end{matrix}}_{1 \times \delta} \bigg]^\intercal, 
\mathcal{C}_{k,\delta} = \bigg[ \underbrace{\begin{matrix} 1 & \dots & 0 \end{matrix}}_{1 \times \delta} \bigg],$$ where $\mathcal{J} (-\lambda_k, \delta)$ denotes the size-$\delta$ Jordan block with the eigenvalue $-\lambda_k$ and $\delta = q - p + 1$. Then, $\tilde{h}_{p q}^{(k)}(t)$ is given by $$\label{h_impResp_sing}
\tilde{h}_{p q}^{(k)}(t) = 
 {(-1)}^{q - p}
C_{k,\delta} e^{A_{k,\delta} t} B_{k,\delta}.$$ where $$\label{jordan_exp}
e^{A_{k,\delta} t } = 
e^{\mathcal{J} (-\lambda_k, \delta) t} 
=
e^{ - \lambda_k t}
\begin{bmatrix}
1 & t & \dots & \frac{t^{(\delta - 1)}}{(\delta - 1)!} \\
& \ddots & \ddots & \vdots \\
& & & t \\
& & & 1
\end{bmatrix}.$$ Combining and leads to $$\nonumber
\tilde{h}_{p q}^{(k)}(t) = 
{(-1)}^{q - p}
e^{ -\lambda_k t}
 \frac{t^{q - p}}{(q - p)!}.$$ The proof is completed by evaluating the integral in using the fact that [[ $\int_{0}^{\infty} t^n e^{\lambda t} dt = {(-1)}^{n+1}\frac{n!}{\lambda^{n+1}}$ for $\lambda \in \mathbb{C}$, $\operatorname{Re}[\lambda] ~<~ 0$. ]{}]{} $\int_{0}^{\infty} t^n e^{-\lambda t} dt = 
\frac{n!}{\lambda^{n+1}}$ for $\lambda \in \mathbb{C}$, $\operatorname{Re}[\lambda] > 0$.

The denominator of the right-hand side of is given by a power of the sum of the graph Laplacian eigenvalues that are associated with possibly distinct Jordan blocks $k$ and $l$. The power of this term depends on the Jordan block sizes $n_k$ and $n_l$ through the indices $q$ and $b$ and it increases as the Jordan block size increases. This indicates that performance is affected not only by the network size, but also [[by]{}]{} the graph Laplacian spectrum and the size of the individual Jordan blocks.

We next present the [[analogous result]{}]{} for the double-integrator network .

Performance of Double-Integrator Networks {#PerfArbDouble}
-----------------------------------------

We now provide the closed-form solution for the performance metric $P$ in for the double-integrator network . A similar approach to the one in Theorem \[thm1\] [[is taken]{}]{} but the computation of the impulse response functions $\tilde{h}_{p q}^{(k)}(t)$ is more involved. [[We compute these functions through Lemmas \[lemma3\] and \[lemma4\] in the Appendix. Then by evaluating the integral in , the result of this subsection is stated as follows.]{}]{}

Before presenting the closed-form solutions for the performance metric $P$ in , we first provide two lemmas that are concerned with deriving a time-domain realization for a transfer function that is a common factor for all $\tilde{h}_{p q}^{(k)}(s)$ in . These realizations will be used to compute the scalar products for the double-integrator network .

\[lemma3\] Consider the transfer function $$\label{phi_TF}
\Omega_{k,\delta}(s) = \frac
{ r(s) {\left( \gamma_p + s \gamma_d \right)}^{\delta-1}}
{{\left[ s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k \right] }^\delta}$$ for some $\delta \in \mathbb{Z}_{+}$. Suppose that $s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k = 0$ has distinct roots $\rho_1^{(k)}$ and $\rho_2^{(k)}$, i.e. $\rho_1^{(k)} \neq \rho_2^{(k)}$. Then, $\Omega_{k,\delta}(s)$ has the realization $\left( \mathcal{A}_{k,\delta}, \mathcal{B}_{k,\delta}, \mathcal{C}_{k,\delta} \right)$ in Jordan canonical form given by $$\label{Jordan_realization}
\mathcal{A}_{k,\delta} =
\begin{bmatrix}
\mathcal{J} (\rho_1^{(k)}, \delta) & \\
& \mathcal{J} (\rho_2^{(k)}, \delta)
\end{bmatrix},$$ $\mathcal{B}_{k,\delta} = \bigg[ \underbrace{\begin{matrix} 0 & \dots & 1 \end{matrix}}_{1 \times \delta} \underbrace{\begin{matrix} 0 & \dots & 1 \end{matrix}}_{1 \times \delta} \bigg]^\intercal$, $\mathcal{C}_{k,\delta} = \begin{bmatrix} c_{1}^{(k)} & \dots & c_{2\delta}^{(k)} \end{bmatrix}$, where $\mathcal{J} (\rho_1^{(k)}, \delta)$ denotes the size-$\delta$ Jordan block with the eigenvalue $\rho_1^{(k)}$.

If $r (s) = 1$, the elements of $\mathcal{C}_{k,\delta}$ are given by $$\begin{aligned}
c_{l}^{(k)} &= \sum_{\zeta=0}^{l-1} \tau(\zeta,l) {\gamma_d}^{\zeta} \frac{{(\gamma_p + \rho_1^{(k)} \gamma_d)}^{\delta-\zeta-1}}{{(\rho_1^{(k)} - \rho_2^{(k)})}^{\delta+l-\zeta-1}}, \nonumber \\
c_{l+\delta}^{(k)} &= \sum_{\zeta=0}^{l-1} \tau(\zeta,l) {\gamma_d}^{\zeta} \frac{{(\gamma_p + \rho_2^{(k)} \gamma_d)}^{\delta-\zeta-1}}{{(\rho_2^{(k)} - \rho_1^{(k)})}^{\delta+l-\zeta-1}}, \nonumber\end{aligned}$$ if $r (s) = s$, the elements of $\mathcal{C}_{k,\delta}$ are given by $$\begin{aligned}
c_{l}^{(k)} &= 
\sum_{\zeta=0}^{l-1} \tau(\zeta,l) {\gamma_d}^{\zeta-1} 
\left( 
\frac{ \zeta \gamma_p + \delta \rho_1^{(k)} \gamma_d } {\delta - \zeta}
\right)
\frac{{(\gamma_p + \rho_1^{(k)} \gamma_d)}^{\delta-\zeta-1}}{{(\rho_1^{(k)} - \rho_2^{(k)})}^{\delta+l-\zeta-1}},
\nonumber \\
c_{l+\delta}^{(k)} &= 
\sum_{\zeta=0}^{l-1} \tau(\zeta,l) {\gamma_d}^{\zeta-1} 
\left( 
\frac{ \zeta \gamma_p + \delta \rho_2^{(k)} \gamma_d } {\delta - \zeta}
\right)
\frac{{(\gamma_p + \rho_2^{(k)} \gamma_d)}^{\delta-\zeta-1}}{{(\rho_2^{(k)} - \rho_1^{(k)})}^{\delta+l-\zeta-1}},
\nonumber\end{aligned}$$ for $l=1,\dots,\delta$, where $\tau(\zeta,l) = {(-1)}^{l-\zeta-1} \binom{l-1}{\zeta}
\binom{\delta+l-\zeta-2}{l-1}
$.

Using the fact that the denominator of $\Omega_{k,\delta}(s)$ has distinct roots $$\nonumber
\Omega_{k,\delta}(s) =  
\frac{\Gamma (s)}{{(s - \rho_1^{(k)})}^{\delta} {(s - \rho_2^{(k)})}^{\delta}},$$ where $\Gamma (s) = r(s) {\left( \gamma_p + s \gamma_d \right)}^{\delta-1}$. Applying partial fractions, we have $$\label{par_frac}
\Omega_{k,\delta}(s) = \sum_{l=1}^{\delta} 
\frac{c_{l}^{(k)}}{{(s - \rho_1^{(k)})}^{\delta-l+1}} +
\frac{c_{l+\delta}^{(k)}}{{(s - \rho_2^{(k)})}^{\delta-l+1}},$$ which can be represented by the Jordan canonical realization . Here the coefficients $c_{l}^{(k)}$ and $c_{l+\delta}^{(k)}$ are given by $$\begin{aligned}
c_{l}^{(k)} &= \frac{1}{(l-1)!}
\lim_{s \to  \rho_1^{(k)}} \frac{d^{l-1}}{ds^{l-1}} \left[ {(s - \rho_1^{(k)})}^{\delta} \Omega_{k,\delta}(s) \right], \label{c_l} \\
c_{l+\delta}^{(k)} &= \frac{1}{(l-1)!}
\lim_{s \to  \rho_2^{(k)}} \frac{d^{l-1}}{ds^{l-1}} \left[ {(s - \rho_2^{(k)})}^{\delta} \Omega_{k,\delta}(s) \right]. \label{c_l_beta}\end{aligned}$$ The general Leibniz rule for the derivative of product yields $$\begin{aligned}
\! \! \! \! \! \!
c_{l}^{(k)} \! &= \! \! \lim_{s \to  \rho_1^{(k)}} \!
\sum_{\zeta = 0}^{l-1} 
\frac{ \binom{l-1}{\zeta} } {(l-1)!}
\frac{d^{\zeta} \Gamma (s) }{ds^{\zeta}} 
\frac{d^{l-1-\zeta}}{ds^{l-1-\zeta}} \! \!
\left[ {(s - \rho_2^{(k)})}^{-\delta} \right] \! \!, \! \!
\label{c_l_2} \\
\! \! \! \!
c_{l+\delta}^{(k)} \! &= \! \! \lim_{s \to  \rho_2^{(k)}} \!
\sum_{\zeta = 0}^{l-1} 
\frac{ \binom{l-1}{\zeta} } {(l-1)!}
\frac{d^{\zeta}}{ds^{\zeta}} \Gamma (s)
\frac{d^{l-1-\zeta}}{ds^{l-1-\zeta}} \left[ {(s - \rho_1^{(k)})}^{-\delta} \right] \! \!, \!
\label{c_l_beta_2}\end{aligned}$$ For the cases of $r(s) = 1$ or $ r(s) = s $, a direct calculation shows that $$\!
\frac{d^{\zeta}}{ds^{\zeta}} \left[ {(\gamma_p + s \gamma_d)}^{\delta-1} \right] 
\! \! = \!
{\gamma_d}^{\zeta} \frac{(\delta-1)!}{(\delta-\zeta-1)!} 
{(\gamma_p + s \gamma_d)}^{\delta-\zeta-1} \! , \! \! \! \!
\label{deriv1}$$ $$\begin{aligned}
\! \! \! \! \! \! \! \! \! \!
\frac{d^{\zeta}}{ds^{\zeta}} \left[ {s(\gamma_p + s \gamma_d)}^{\delta-1} \right] 
\! \! &= \!
s {\gamma_d}^{\zeta} \frac{(\delta-1)!}{(\delta-\zeta-1)!} 
{(\gamma_p + s \gamma_d)}^{\delta-\zeta-1} \nonumber \\
&+ {\gamma_d}^{\zeta - 1} \zeta \frac{(\delta-1)!}{(\delta-\zeta)!} 
{(\gamma_p + s \gamma_d)}^{\delta-\zeta} \! , \! \!
\label{deriv2}\end{aligned}$$ $$\frac{d^{l-1-\zeta}}{ds^{l-1-\zeta}} \left[ {(s - \rho_2^{(k)})}^{-\delta} \right] =
{(-1)}^{l-1-\zeta} \frac{(\delta+l-\zeta-2)!}{(\delta-1)!} 
{(s - \rho_2^{(k)})}^{-\delta-l+\zeta+1}. \label{deriv3}$$ Substituting and , into and taking the limit gives the desired result. A similar argument is also valid for .

The following lemma addresses the case where the roots are repeated.

\[lemma4\] Consider the transfer function $$\nonumber
\Omega_{k,\delta}(s) = \frac
{r(s) {\left( \gamma_p + s \gamma_d \right)}^{\delta-1}}
{{\left[ s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k \right] }^\delta}$$ for some $\delta \in \mathbb{Z}_{+}$. Suppose that $s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k = 0$ has repeated roots $\rho_1^{(k)}$ and $\rho_2^{(k)}$, i.e. $\rho_1^{(k)} = \rho_2^{(k)} = \rho^{(k)}$. Then, $\Omega_{k,\delta}(s)$ has the realization $\left( \mathcal{A}_{k,\delta}, \mathcal{B}_{k,\delta}, \mathcal{C}_{k,\delta} \right)$ in Jordan canonical form given by $$\label{Jordan_realization_2}
\mathcal{A}_{k,\delta} =
\mathcal{J} (\rho^{(k)}, 2\delta),$$ $$\nonumber
\mathcal{B}_{k,\delta} = \bigg[ \underbrace{\begin{matrix} 0 & \dots & 1 \end{matrix}}_{1 \times 2\delta} \bigg]^\intercal, 
\mathcal{C}_{k,\delta} = \begin{bmatrix} c_{1}^{(k)} & \dots & c_{2\delta}^{(k)} \end{bmatrix}.$$ If $r(s) = 1$, the elements of $\mathcal{C}_{k,\delta}$ are given by $$\nonumber
c_{l}^{(k)} = 
\begin{cases} 
{\gamma_d}^{l-1} 
\binom{\delta-1}{l-1}
{(\gamma_p + \rho^{(k)} \gamma_d)}^{\delta-l}, & 1 \leq l \leq \delta \\
\hfil 0 , & \delta+1 \leq l \leq 2\delta
\end{cases},$$ if $ r(s) = s $, the elements of $\mathcal{C}_{k,\delta}$ are given by $$\nonumber
c_{l}^{(k)} \! = \! 
\begin{cases} 
\!
\left[ \frac{ (l-1)\gamma_p + \delta \rho^{(k)} \gamma_d } {\delta - l + 1} \right] \!
{\gamma_d}^{l-2}
\binom{\delta-1}{l-1}
{(\gamma_p + \rho^{(k)} \gamma_d)}^{\delta-l}, & 1 \leq l \leq \delta \\
\hfil {\gamma_d}^{\delta - 1}, & l = \delta+1 \\
\hfil 0, & \delta+2 \leq l \leq 2\delta
\end{cases}.$$

Using the fact that $\Omega_{k,\delta}(s)$ has repeated roots $$\nonumber
\Omega_{k,\delta}(s) =  
\frac{r(s) {\left( \gamma_p + s \gamma_d \right)}^{\delta-1}} 
{{(s - \rho^{(k)})}^{2\delta}}.$$ Applying partial fractions, we have $$\nonumber
\Omega_{k,\delta}(s) = \sum_{l=1}^{2\delta} 
\frac{c_{l}^{(k)}}{{(s - \rho^{(k)})}^{2\delta-l+1}},$$ which can be represented by the Jordan canonical realization . Here the coefficients $c_{l}^{(k)}$ are given by $$c_{l}^{(k)} = 
\frac{1}{(l-1)!}
\lim_{s \to  \rho^{(k)}} \frac{d^{l-1}}{ds^{l-1}} 
\left[
r(s) {\left( \gamma_p + s \gamma_d \right)}^{\delta-1} 
\right], \label{c_l_2_rep} 
$$ For the cases of $r(s) = 1$ or $r(s) = s$, using respectively and and taking the limit in gives the desired result.

Lemmas and provide a means to conveniently calculate the impulse response functions $\tilde{h}_{p q}^{(k)}(t)$, which are the time-domain representations of the transfer functions in . By evaluating the integral in , the main result of this section for the double-integrator network is stated as follows.

\[thm2\] Consider the double-integrator network . Let $\rho_1^{(k)}$ and $\rho_2^{(k)}$ denote the roots of $$\label{char_eq_s2}
s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k = 0.$$ The performance metric $P$ in for the system $T$ given by or is $
P = \operatorname{tr}{(\Sigma_Q \Psi)}
$, where $\Psi$ is given element-wise by and the scalar product in is as follows: If $\rho_1^{(k)} \neq \rho_2^{(k)}$ and $\rho_1^{(l)} \neq \rho_2^{(l)}$ $$\begin{aligned}
  \label{L2_scalar_sol_1}
&\left \langle \tilde{h}_{a b}^{(l)}(t), \tilde{h}_{p q}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2} = 
\sum_{\zeta=1}^{\sigma} \sum_{r=1}^{\upsilon}
\frac{ \Phi_{\zeta r} (\sigma, \upsilon) \overline{c_{\zeta}^{(k)}} c_{r}^{(l)} }
{ {\left( \overline{\rho_1^{(k)}} + \rho_1^{(l)} \right)}^{\sigma + \upsilon - \zeta - r + 1} } \nonumber \\
&+ 
\frac{ \Phi_{\zeta r} (\sigma, \upsilon) \overline{c_{\zeta}^{(k)}} c_{r+\upsilon}^{(l)} }
{ {\left( \overline{\rho_1^{(k)}} + \rho_2^{(l)} \right)}^{\sigma + \upsilon - \zeta - r + 1} } \nonumber
\ + \ 
\frac{ \Phi_{\zeta r} (\sigma, \upsilon) \overline{c_{\zeta+\sigma}^{(k)}} c_{r}^{(l)} }
{ {\left( \overline{\rho_2^{(k)}} + \rho_1^{(l)} \right)}^{\sigma + \upsilon - \zeta - r + 1} } \nonumber \\
&+ 
\frac{ \Phi_{\zeta r} (\sigma, \upsilon) \overline{c_{\zeta+\sigma}^{(k)}} c_{r+\upsilon}^{(l)} }
{ {\left( \overline{\rho_2^{(k)}} + \rho_2^{(l)} \right)}^{\sigma + \upsilon - \zeta - r + 1} },\end{aligned}$$ If $\rho_1^{(k)} \neq \rho_2^{(k)}$ and $\rho_1^{(l)} = \rho_2^{(l)} = \rho^{(l)}$ $$\begin{aligned}
  \label{L2_scalar_sol_2}
\! \! \! \!
\left \langle \tilde{h}_{a b}^{(l)}(t), \tilde{h}_{p q}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2} &= 
\sum_{\zeta=1}^{\sigma} \sum_{r=1}^{2\upsilon}
\frac{{(-1)}^{\upsilon} \Phi_{\zeta r} (\sigma, 2\upsilon) \overline{c_{\zeta}^{(k)}} c_{r}^{(l)} }
{ {\left( \overline{\rho_1^{(k)}} + \rho^{(l)} \right)}^{\sigma + 2\upsilon - \zeta - r + 1} } \nonumber \\
&+ 
\frac{{(-1)}^{\upsilon} \Phi_{\zeta r} (\sigma, 2\upsilon) \overline{c_{\zeta+\sigma}^{(k)}} c_{r}^{(l)} }
{ {\left( \overline{\rho_2^{(k)}} + \rho^{(l)} \right)}^{\sigma + 2\upsilon - \zeta - r + 1} },\end{aligned}$$ If $\rho_1^{(k)} = \rho_2^{(k)} = \rho^{(k)}$ and $\rho_1^{(l)} = \rho_2^{(l)} = \rho^{(l)}$ $$\label{L2_scalar_sol_3}
\! \!
\left \langle \tilde{h}_{a b}^{(l)}(t), \tilde{h}_{p q}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2} \! = \!
\sum_{\zeta=1}^{2\sigma} \sum_{r=1}^{2\upsilon}
\frac{{(-1)}^{\sigma + \upsilon} \Phi_{\zeta r} (2\sigma, 2\upsilon) \overline{c_{\zeta}^{(k)}} c_{r}^{(l)} }
{ {\left( \overline{\rho^{(k)}} + \rho^{(l)} \right)}^{2\sigma + 2\upsilon - \zeta - r + 1} } \! ,$$ where $\sigma = q - p + 1$, $\upsilon = b - a + 1$ and $\Phi_{\zeta r} (\sigma, \upsilon) ~=~ 
{(-1)}^{ 1 - \zeta - r}
\frac{(\sigma+\upsilon - \zeta - r)!}{(\sigma - \zeta)! (\upsilon - r)!} $.

The coefficients $c_{\zeta}^{(k)}$ are given in the Appendix by Lemma \[lemma3\] if $\rho_1^{(k)} \neq \rho_2^{(k)}$ and by Lemma \[lemma4\] if $\rho_1^{(k)} = \rho_2^{(k)}$.

For double-integrator networks, the scalar products in - depend on both the control gains and the eigenvalues of $L$, via the roots of and the coefficients $c_{\zeta}^{(k)}$. In contrast, for single-integrator networks, eigenvalues of $L$ appear explicitly in the analogous expression in .

Using the result of Corollary \[cor2\], the notation in and , $\tilde{h}_{p q}^{(k)}(t)$ is given by $$\label{h_impResp}
\tilde{h}_{p q}^{(k)}(t) = {(-1)}^{\sigma -1} \Omega_{k, \sigma} (t).$$ If $\rho_1^{(k)} \neq \rho_2^{(k)}$, the realization in can be used to calculate $$\nonumber
\Omega_{k, \sigma} (t) = C_{k,\sigma} e^{A_{k,\sigma} t} B_{k,\sigma}, \\$$ where $e^{A_{k,\sigma} t} = 
\iffalse
\begin{bmatrix}
e^{\mathcal{J} (\rho_1^{(k)}, \, \sigma)t}  & \\
& e^{\mathcal{J} (\rho_2^{(k)}, \, \sigma)t}
\end{bmatrix}
\fi
\operatorname{blockdiag}{ \left(
e^{\mathcal{J} (\rho_i^{(k)}, \, \sigma)t} \right) }_{i=1,2}
$ and $ e^{\mathcal{J} (\rho_i^{(k)}, \, \sigma) t} $ can be expanded as in . $$\nonumber
 e^{\mathcal{J} (\rho_i^{(k)}, \, \sigma) t} = 
e^{ \rho_i^{(k)} t}
\begin{bmatrix}
1 & t & \dots & \frac{t^{(\sigma - 1)}}{(\sigma - 1)!} \\
& \ddots & \ddots & \vdots \\
& & & t \\
& & & 1
\end{bmatrix}.$$ Then, using and the definitions of $C_{k,\sigma}$ and $B_{k,\sigma}$ in $$\nonumber
\tilde{h}_{p q}^{(k)}(t) = 
{(-1)}^{\sigma -1}
\sum_{\zeta=1}^{\sigma} 
\left( c_{\zeta}^{(k)} e^{ \rho_1^{(k)} t} + c_{\zeta + \sigma}^{(k)} e^{ \rho_2^{(k)} t}  \right)
 \frac{t^{\sigma - \zeta}}{(\sigma - \zeta)!}.$$ If $\rho_1^{(k)} = \rho_2^{(k)} = \rho^{(k)}$, a similar argument combined with leads to $$\nonumber
\tilde{h}_{p q}^{(k)}(t) = 
{(-1)}^{\sigma -1}
\sum_{\zeta=1}^{2\sigma} 
c_{\zeta}^{(k)} e^{ \rho^{(k)} t}
 \frac{t^{2\sigma - \zeta}}{(2\sigma - \zeta)!}.$$ The proof is completed by evaluating the integral in using the fact that $\int_{0}^{\infty} t^n e^{\lambda t} dt = {(-1)}^{n+1}\frac{n!}{\lambda^{n+1}}$ for $\lambda \in \mathbb{C}$, $\operatorname{Re}[\lambda] ~<~ 0$.

Theorems \[thm1\] and \[thm2\] provide closed-form solutions for the performance metric which consist of terms that: (a) are geometric, i.e. terms that depend on the input direction, the eigenvalues and the eigenvectors of $M$ in and the eigenvectors of $L$ as in and ; and (b) terms that depend on the closed-loop dynamics of the system, as in . Overall, performance is given by a linear combination of the entries of the matrix $\Psi$ in , weighted by the entries of the matrix $\Sigma_Q$ in . Therefore, in the most general case, it is not straightforward to deduce the individual effect of properties such as network size, graph topology and the spectrum of the output matrix for an arbitrary system.

In the next section, we study special cases to provide insight on the effect of edge directionality on performance.

Digraphs with Diagonalizable Laplacian Matrices {#diagL}
===============================================

[[ We now consider the class of graphs that emit diagonalizable Laplacian matrices; and its subclass of normal Laplacian matrices. The closed-form solutions derived here will be used in sections \[NormalL\] and \[CentDistFeed\] to [[provide further insights on]{}]{} the results of the last section. As a special case of the diagonalizable Laplacians, we will further investigate the case of normal Laplacian matrices. Namely, we will show that performance is determined by the interplay between edge directionality and control strategy (judicious selection of control gains). For disturbance inputs that are uniform across the network, the closed-form computations will reveal how performance is simultaneously determined by edge directionality (the role of complex eigenvalues of the Laplacian) and control strategy (judicious selection of control gains). ]{}]{}

Single-Integrator Networks
--------------------------

The following theorem provides the main result of this section for the single-integrator network .

\[[[Single-Integrator, Diagonalizable Laplacian]{}]{}\] \[thm3\] Consider the single-integrator network and suppose that $L$ is diagonalizable. Then, the metric $P$ in for the system $T$ given by is $
P = \operatorname{tr}{(\Sigma_Q \Psi)}
$, where $\bold{j}^2 = -1$ and $$\label{psi_ik_diagable}
\Psi_{kl} =
\nu_{kl} 
\frac{\operatorname{Re}[\lambda_k]+\operatorname{Re}[\lambda_l] + \bold{j} (\operatorname{Im}[\lambda_k]-\operatorname{Im}[\lambda_l])}
{(\operatorname{Re}[\lambda_k]+\operatorname{Re}[\lambda_l])^2 +(\operatorname{Im}[\lambda_k]-\operatorname{Im}[\lambda_l])^2}.
$$

The fact that $L$ is diagonalizable leads to $m=n$, i.e. all Jordan blocks are scalars. Then using from Lemma \[lemma2\], we have $
\Psi_{kl}  = 
\nu_{kl} 
\left \langle \tilde{h}_{11}^{(l)}(t), \tilde{h}_{11}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2}
$. Also, from Theorem \[thm1\] gives $
\left \langle \tilde{h}_{11}^{(l)}(t), \tilde{h}_{11}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2} = 
\frac{1} {\overline{\lambda_k} + \lambda_l }. 
$ Combining these facts and re-arranging terms yields the result.

Note that the diagonal terms $\Psi_{kk}$ are real and the cross-terms $\Psi_{kl}$ for $k \neq l$ are possibly imaginary in . However, $P$ is guaranteed to be real due to Remark \[rem\_perf\_real\].

### Normal Laplacian Matrices {#normal-laplacian-matrices .unnumbered}

We next focus on systems over digraphs that emit normal weighted Laplacian matrices. First recall Definition \[obsv\_indices\], which introduced the set of observable indices $\mathcal{N}_{obsv}$ in . If $L$ is normal therefore diagonalizable, we can re-state this set as $$\mathcal{N}_{obsv} =
\left\{
k \in \{ 2, \dots, n \}
\mid
C \bold{r}_k \neq 0 
\right\},$$ recalling that $\bold{r}_k$ denote the right eigenvectors of $L$ as defined in . We now present two lemmas that will be useful in proving the upcoming results. We now present a lemma that will be useful in proving the upcoming results.

\[prop\_obsv\] For $k \in \{ 2, \dots, n \}$, the eigenvalue-eigenvector pair $(\mu_k, \boldsymbol{\theta}_k)$ of $M$ in satisfies $\mu_k = 0$ if and only if $C \boldsymbol{\theta}_k = 0$.

Assume for any $k \in \{ 2, \dots, n \}$ that $\mu_k = 0$. Then $0 = M \boldsymbol{\theta}_k = C^T C \boldsymbol{\theta}_k$. This implies that the vector $C \boldsymbol{\theta}_k$ is in the left nullspace of $C$, therefore is orthogonal to the column space of $C$. But $C \boldsymbol{\theta}_k$ also has to be in the column space of $C$ therefore $C \boldsymbol{\theta}_k = 0$.

Conversely, if $C \boldsymbol{\theta}_k = 0$ for any $k \in \{ 2, \dots, n \}$, then $0 ~=~ M \boldsymbol{\theta}_k = \mu_k \boldsymbol{\theta}_k$ which gives $\mu_k = 0$ since $\boldsymbol{\theta}_k \neq 0$. See [@OralMalladaGayme2019_arxiv] for a proof.

\[prop\_obsv\_modes\] Suppose that $L$ is normal. For $k \in \{ 2, \dots, n \}$, $\nu_{kk}$ in satisfies

1.  $\nu_{kk} = 0$ if and only if $k \notin \mathcal{N}_{obsv}$.

2.  $\nu_{kk} > 0$ if and only if $k \in \mathcal{N}_{obsv}$.

Normality of $L$ means that it is unitarily diagonalizable, therefore $R^{-1} = {R}^*$. We also recall that $M$ in is symmetric, therefore unitarily diagonalizable. Therefore $\bold{r}_1 = \boldsymbol{\theta}_1 = 
\frac{1}{\sqrt{n}} \boldsymbol{1}
$ and it holds that $\bold{r}_k, \boldsymbol{\theta}_l \in \operatorname{span}\{ \boldsymbol{1} \} ^ {\bot} \subset \mathbb{C}^n$ for $k, l \in~ \{ 2,\dots,n \}$. So, we have $\bold{r}_k = \sum_{i=2}^{n} \chi_{i}^{k} \boldsymbol{\theta}_i$ with constants $\chi_{i}^{k} \in~ \mathbb{C}$ for $k \in \{ 2,\dots,n \}$. Given any $k \in \{ 2, \dots, n \}$, it follows from and Lemma \[prop\_obsv\] that $\nu_{kk} = 0$ if and only if $\left \langle\boldsymbol{\theta}_l, \bold{r}_k \right \rangle = 0$ for all $l \in~ \{ 2, \dots, n \}$ such that $C \boldsymbol{\theta}_l \neq 0$. Combining the preceding arguments leads to $$\nu_{kk} = 0 \ \Leftrightarrow \
\left( \sum_{i=2}^{n} \overline{\chi_{i}^{k}} \boldsymbol{\theta}_i^* \right)
\boldsymbol{\theta}_l = 0,
\ l \in \{ 2, \dots, n \}, \
C \boldsymbol{\theta}_l \neq 0,$$ which is equivalent to having $\chi_{l}^{k} = 0$ for such $l$, due to the orthonormality of $\boldsymbol{\theta}_l$. In other words, $
\nu_{kk} = 0 \ \Leftrightarrow \
\bold{r}_k \! \! ~=~ \! \! \! \!
\sum\limits_{\substack{C \boldsymbol{\theta}_i = 0, \ i \in \{ 2, \dots, n \} }} 
\! \!
\chi_{i}^{k} \boldsymbol{\theta}_i
\ \Leftrightarrow \
C \bold{r}_k = 0,
$ which proves the first result. Since $M$ in is postive semi-definite, $\nu_{kk}$ for $k \in \{ 2, \dots, n \}$ is given by a summation in with each summand being non-negative. So, $\nu_{kk} \geq 0$ and the first result implies the second result. [[See]{}]{} [@OralMalladaGayme2019_arxiv] for a proof.

[[ Theorem \[thm3\] leads to the following result for normal Laplacian matrices. ]{}]{}

\[[[Single-Integrator, Normal Laplacian]{}]{}\] \[cor4\] Consider the single-integrator network . Suppose that $L$ is normal and the input $\bold{w}_0$ [[has unit covariance, i.e. $E\left[\Sigma_0\right] = I $]{}]{}. Then, the expectation of the metric $P$ in for the system $T$ given by is $$\label{perf_single_normal}
E\left[P\right] = 
\lVert T \rVert_{\mathcal{H}_2}^2
=
\sum_{k \in \mathcal{N}_{obsv}} \nu_{kk}
\frac{1}
{2\operatorname{Re}[\lambda_k]}.$$

Orthonormality of $\bold{r}_j$ for $j = 1, \dots, n$ yields $E\left[\Sigma_Q\right] ~=~ I$ and leads to $E\left[P\right] = \sum_{k=2}^{n} \Psi_{kk}$ due to Theorem \[thm3\]. We note that this simplifies to by using , Proposition \[Prop\_H2L2\] and Lemma \[prop\_obsv\_modes\].

Although Corollary \[cor4\] is a special case of Theorem \[thm3\], and consequently Theorem \[thm1\], it generalizes [[[@YoungLeonard2010 Proposition 1]]{}]{} to performance metrics with arbitrary output matrices.

Double-Integrator Networks
--------------------------

Next we present the main result of this section for the double-integrator network .

\[[[Double-Integrator, Diagonalizable Laplacian]{}]{}\] \[thm4\] Consider the double-integrator network . Suppose that $L$ is diagonalizable. The performance metric $P$ in is $
P = \operatorname{tr}{(\Sigma_Q \Psi)}
$, where $$\label{second_pos_closedform}
\Psi_{kk} =
\nu_{kk} 
\frac{\phi_k}
{2 ( \alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 ) }$$ for the position-based output, i.e. system $T$ given by and $$\label{second_vel_closedform}
\Psi_{kk} = 
\nu_{kk} 
\frac{ \xi_k \beta_k + \phi_k \alpha_k }
{2 ( \alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 ) }$$ for the velocity-based output, i.e. system $T$ given by ; where $\alpha_k = k_p + \gamma_p \operatorname{Re}[\lambda_k]$, $\phi_k = k_d + \gamma_d \operatorname{Re}[\lambda_k]$, $\beta_k ~=~ \gamma_p \operatorname{Im}[\lambda_k]$ and $\xi_k = \gamma_d\operatorname{Im}[\lambda_k]$.

Here, the cross-terms $\Psi_{kl}$ for $k \neq l$ are not given explicitly for brevity. A Gramian computation as in [@PaganiniMallada2017; @PaganiniMallada2019] would give $\Psi_{kl}$ in closed-form for $k \neq l$, which is not tractable due to the number of terms involved. To gain some insight from the computation, we focus on the diagonal terms which are the only required ones when $\Sigma_Q$ in is diagonal.

The fact that $L$ is diagonalizable leads to $m=n$, i.e. all Jordan blocks are scalars. Then, using from Lemma \[lemma2\] we have $
\Psi_{kl}  = 
\nu_{kl} 
\left \langle \tilde{h}_{11}^{(l)}(t), \tilde{h}_{11}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2}.
$ First consider the position-based performance metric, i.e. the system $T$ given by . Due to from the proof of Theorem \[thm2\] and , $
\tilde{h}_{11}^{(k)}(s) = 
\frac{1}
{s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k}
$, which has the realization $\left( \mathcal{A}_{k}, \mathcal{B}_{k}, \mathcal{C}_{k} \right)$ in controllable canonical form given by $\mathcal{A}_{k} =
\left[
\begin{smallmatrix}
0 & 1 \\
-k_p - \gamma_p  \lambda_k & -k_d - \gamma_d  \lambda_k
\end{smallmatrix}
\right]$, $\mathcal{B}_{k} = \begin{bmatrix} 0 & 1 \end{bmatrix}^\intercal$ and $\mathcal{C}_{k} = \begin{bmatrix} 1 & 0 \end{bmatrix}$. If $k=l$, performing a standard computation, $\left \langle \tilde{h}_{11}^{(k)}(t), \tilde{h}_{11}^{(k)}(t) \right \rangle_{\mathcal{L}_2} = 
\mathcal{B}_{k}^\intercal \mathcal{X}_k \mathcal{B}_{k}$, where $\mathcal{X}_k$ satisfies the Lyapunov equation $
\mathcal{A}_{k}^*\mathcal{X}_k + \mathcal{X}_k \mathcal{A}_{k} = -\mathcal{C}_k^*\mathcal{C}_k
$. Then we get $$\nonumber
\left \langle \tilde{h}_{11}^{(k)}(t), \tilde{h}_{11}^{(k)}(t) \right \rangle_{\mathcal{L}_2} = 
\frac{\phi_k}
{2 ( \alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 ) }.$$ Considering the velocity-based performance metric, i.e. the system $T$ given by and using and we have $
\tilde{h}_{11}^{(k)}(s) = 
\frac{s}
{s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k}
$, so that $\mathcal{A}_{k}$ and $\mathcal{B}_{k}$ are the same but $\mathcal{C}_{k} = \begin{bmatrix} 0 & 1 \end{bmatrix}$. If $k=l$, solving the Lyapunov equation leads to $$\left \langle \tilde{h}_{11}^{(k)}(t), \tilde{h}_{11}^{(k)}(t) \right \rangle_{\mathcal{L}_2} = 
\frac{\xi_k \beta_k + \phi_k \alpha_k}
{2 ( \alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 )}.
\quad
\mbox{\qedhere}
\! \! \! \! \!
\! \! \! \! \!
\! \!
$$

If we further assume real eigenvalues, we obtain a result similar to the one in [@PaganiniMallada2017; @PaganiniMallada2019] for diagonalizable Laplacians.

\[[[Double-Integrator, Diagonalizable Laplacian with Real Eigenvalues]{}]{}\] \[cor3\] Consider the double-integrator network . Suppose that $L$ is diagonalizable and has real eigenvalues. Then $$\label{cor3_psi_pos}
\Psi_{kl} =
\nu_{kl} 
\frac{2k_d + \gamma_d (\lambda_k + \lambda_l)}
{\Psi_{kl}^{denom}},$$ for the position-based output, i.e. system $T$ given by and $$\label{cor3_psi_vel}
\Psi_{kl} = 
\nu_{kl} 
\frac
{
(k_p+\gamma_p \lambda_l)(k_d+\gamma_d \lambda_k) +
(k_p+\gamma_p \lambda_k)(k_d+\gamma_d \lambda_l)
}
{\Psi_{kl}^{denom}}$$ for the velocity-based output, i.e. system $T$ given by , where $$\begin{aligned}
\Psi_{kl}^{denom} \, \, &= \, \,
(k_d+\gamma_d \lambda_k)(k_d+\gamma_d \lambda_l)
(2k_p + \gamma_p (\lambda_k + \lambda_l)) \, \, + \\
\gamma_p^2(\lambda_k - \lambda_l)^2 + 
& (k_p+\gamma_p \lambda_k)(k_d+\gamma_d \lambda_l)^2 +
(k_p+\gamma_p \lambda_l)(k_d+\gamma_d \lambda_k)^2.\end{aligned}$$

By the argument used in the proof of Theorem \[thm4\] we have $
\Psi_{kl}  = 
\nu_{kl} 
\left \langle \tilde{h}_{11}^{(l)}(t), \tilde{h}_{11}^{(k)}(t) 
\right \rangle_{\mathcal{L}_2}
$ and $\left \langle \tilde{h}_{11}^{(l)}(t), \tilde{h}_{11}^{(k)}(t) \right \rangle_{\mathcal{L}_2} = 
\mathcal{B}_{k}^\intercal \mathcal{X}_{kl} \mathcal{B}_{l}$, where $\mathcal{X}_{kl}$ satisfies the Sylvester equation $
\mathcal{A}_{k}^*\mathcal{X}_{kl} + \mathcal{X}_{kl} \mathcal{A}_{l} = -\mathcal{C}_k^*\mathcal{C}_l
$ [@PaganiniMallada2017; @PaganiniMallada2019]. Considering and individually and solving for $\mathcal{X}_{kl}$ in each case leads to respectively and .

The real and imaginary parts of the Laplacian eigenvalues, and the control gains appear explicitly in the solutions for the performance metrics in Theorem \[thm4\] and Corollary \[cor3\]. However, these solutions are still given by a weighted linear combination of $\Psi_{kl}$, therefore analyzing the dependence of the performance metrics on network topological characteristics as well as control strategy will require further simplifying assumptions. For this reason, [[we now focus on normal Laplacians.]{}]{}

### [[Normal Laplacian Matrices]{}]{} {#normal-laplacian-matrices-1 .unnumbered}

[[As in the case of single-integrator network , this class of graphs provides an insightful example for the upcoming sections.]{}]{}

\[[[Double-Integrator, Normal Laplacian]{}]{}\] \[cor5\] Consider the double-integrator network . Suppose that $L$ is normal and the input $\bold{w}_0$ [[has unit covariance, i.e. $E[\Sigma_0] = I $]{}]{}. Then, the expectation of the performance metric $P$ in is $$\label{perf_x_sol_normal}
E\left[P\right] =
\lVert T \rVert_{\mathcal{H}_2}^2
= \! \!
\sum_{k \in \mathcal{N}_{obsv}}
\!
 \nu_{kk} 
\frac{\phi_k}
{2 ( \alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 ) },
\!$$ for the position-based output, i.e. system $T$ given by and $$\label{perf_v_sol_normal}
E\left[P\right] = 
\lVert T \rVert_{\mathcal{H}_2}^2
= \! \!
\sum_{k \in \mathcal{N}_{obsv}} 
\!
\nu_{kk} 
\frac{ \xi_k \beta_k + \phi_k \alpha_k }
{2 ( \alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 ) },
\!$$ for the velocity-based output, i.e. system $T$ given by ; where $\alpha_k = k_p + \gamma_p \operatorname{Re}[\lambda_k]$, $\phi_k = k_d + \gamma_d \operatorname{Re}[\lambda_k]$, $\beta_k ~=~ \gamma_p \operatorname{Im}[\lambda_k]$ and $\xi_k = \gamma_d\operatorname{Im}[\lambda_k]$.

By and and the same argument used in the proof of Corollary \[cor4\], we reach the desired result.

Note that per Lemma \[prop\_obsv\_modes\] all $\nu_{kk}$ in and are positive. In addition, stability guarantees that the [[numerators and the denominators]{}]{} in and are positive due to Proposition \[prop\_stab\_rh\]. Therefore the performance metrics are guaranteed to be positive quantities as expected. [[This result generalizes the result given in [@OralMalladaGayme2017 Corollary 2] to position and velocity based performance metrics with arbitrary output matrices.]{}]{} [[In the next section, we study the effect of communication directionality on performance through the example of normal Laplacian matrices.]{}]{}

[[The Role of Communication Directionality]{}]{} {#NormalL}
================================================

In this section, we focus on a special class of graphs that emit normal weighted Laplacian matrices [[and use the respective results from Section \[diagL\] to investigate the effect of directed feedback]{}]{}. This class of graphs can for example arise in spatially invariant systems [@BamiehJovanovic2012; @teglingbamieh2019]. Given any normal weighted Laplacian matrix $L$, we [[extract its Hermitian part as]{}]{} $$\label{herm_part_L}
L^{\prime} := \frac{L + L^*}{2}.$$ [[ Since $L$ is weight-balanced [@YoungLeonard2010 Lemma 4], gives the Laplacian matrix of an undirected graph $\mathcal{G}^{\prime} = \{\mathcal{N}, \mathcal{E}^{\prime}, \mathcal{W}^{\prime}\}$, where $\mathcal{E}^{\prime} = \mathcal{E} \cup \{(j,i) \mid (i,j) \in \mathcal{E} \} $ and $\mathcal{W}^{\prime} = \{\frac{b_{ij} + b_{ji}}{2} \mid b_{ij} \in \mathcal{W} \}$. Put another way, $\mathcal{G}^{\prime}$ is the *undirected counterpart* of $\mathcal{G}$ resulting from creating reverse edges in $\mathcal{G}$ and re-defining edge weights such that both graphs have the same nodal out-degree.]{}]{} If in addition $L$ is non-symmetric, i.e. the corresponding graph $\mathcal{G}$ is directed, the relationship given by *symmetrizes* then leads to a symmetric Laplacian $L^{\prime}$ (whose corresponding graph $\mathcal{G}^{\prime}$ has only undirected paths). [[Normality of $L$ and imply that the spectrum of $L^\prime$,]{}]{} $$\label{L_prime_spec}
\operatorname{spec}(L^\prime) = \{ \operatorname{Re}[\lambda_i] | \lambda_i \in \operatorname{spec}(L), i=1,\dots, n \}.$$ [[ In addition, since $L$ is normal, it has eigenvalues with non-zero imaginary parts if and only if its graph $\mathcal{G}$ is directed. For disturbance inputs that are uniform and uncorrelated across the network, we observe that both the position and velocity based performance metrics and depend on both the real and imaginary parts of the Laplacian eigenvalues. Therefore, comparison of directed graphs $\mathcal{G}$ and their undirected counterparts $\mathcal{G}^{\prime}$ can reveal the interplay between the imaginary parts, i.e. edge directionality and control strategy (judicious selection of control gains) that determines overall performance.]{}]{} For disturbance inputs that are uniform across the network, how performance is simultaneously determined by edge directionality (the role of complex eigenvalues of the Laplacian) and control strategy (judicious selection of control gains).

Position based Performance
--------------------------

### Single-Integrator Networks

The following [[theorem]{}]{} provides a comparison of the single-integrator systems with respective Laplacians $L$ and $L^{\prime}$ [[in terms of]{}]{} the performance metric given in .

\[[[Equal Performance with Directed Networks and Undirected Counterparts]{}]{}\] \[cor\_single\_normal\] Consider the single-integrator network and the performance metric $P$ in . Let $T$ and $T^\prime$ be two systems given by with weighted Laplacian matrices $L$ and $L^\prime$. Suppose $L$ is normal and $L^{\prime}$ is given by . Then $\lVert T \rVert_{\mathcal{H}_2}^2 ~=~ \lVert T^\prime \rVert_{\mathcal{H}_2}^2$.

The result follows from and .

As Theorem \[cor\_single\_normal\] indicates, directed and [[associated undirected]{}]{} single-integrator systems perform identically for any output matrix $C$ satisfying Assumption \[assum1\]. This implies that the same level of performance can be achieved either using [[directed]{}]{} paths in the commmunication graph or using the corresponding [[undirected]{}]{} graph per . [[The directed system might be preferable in certain cases due to reduced communication requirements (e.g. uni-directional vs. bi-directional paths).]{}]{} Theorem \[cor\_single\_normal\] also provides a generalization of previous results obtained for this class of directed and [[undirected]{}]{} single-integrator systems. For example, performance of directed systems can be bounded by functions of the spectrums of output performance matrices and associated [[undirected]{}]{} system Laplacians (see e.g. [@SiamiMotee2017 Theorem 5]). Here, we provide exact solutions in Corollary \[cor4\] by additionally accounting for the eigenvectors of these matrices, which lead to the equivalence between directed and [[associated undirected]{}]{} systems as shown by Theorem \[cor\_single\_normal\].

### Double-Integrator Networks

We now provide a comparison of the double-integrator systems with respective Laplacians $L$ and $L^{\prime}$ for the performance metric given in .

\[rem4\] The performance metric in simplifies to an expression that does not explicitly depend on $\operatorname{Im}[\lambda_k]$ if $\beta_k \xi_k \phi_k - \beta_k^2 = 0$ for $k \in \mathcal{N}_{obsv}$. This holds if $\operatorname{Im}[\lambda_k] = 0$ for $k \in \mathcal{N}_{obsv}$ or $L$ is symmetric or $\gamma_p = 0$. If $\beta_k \xi_k \phi_k - \beta_k^2 = 0$ for $k \in \mathcal{N}_{obsv}$, reduces to $$\label{P_normal_x_noImag}
\lVert T \rVert_{\mathcal{H}_2}^2
\! = \! \! \! \!
\sum_{k \in \mathcal{N}_{obsv}} 
\! \!
\nu_{kk} \frac{1}{2(k_p + \gamma_p\operatorname{Re}[\lambda_k]) (k_d + \gamma_d\operatorname{Re}[\lambda_k])},
\! \!$$ [[when the]{}]{} stability condition from Proposition \[prop\_stab\_rh\] holds.

Depending on the values of $k_p, k_d, \gamma_p$ and $\gamma_d$ in , the denominator in can be quadratic in $\operatorname{Re}[\lambda_k]$, which could indicate a smaller $\mathcal{H}_2$ norm for sufficiently large $\operatorname{Re}[\lambda_k]$, hence better performance compared to the performance of the first order system given by . The following Lemma shows the effect of the imaginary parts of the weighted Laplacian eigenvalues on the position based performance of the double-integrator network .

\[thm\_imag\] Consider the double-integrator network and the performance metric $P$ in . Let $T$ and $T^\prime$ be two systems given by with weighted Laplacian matrices $L$ and $L^\prime$. Suppose $L$ is normal and $L^{\prime}$ is given by . Then the following hold:

1.  $\lVert T \rVert_{\mathcal{H}_2}^2 = \lVert T^\prime \rVert_{\mathcal{H}_2}^2$ if $\operatorname{Im}[\lambda_k] = 0 \, \, \forall k \in \mathcal{N}_{obsv}$. \[thm\_Im\_1\]

2.  \[thm\_Im\_2\] $\lVert T \rVert_{\mathcal{H}_2}^2 \leq \lVert T^\prime \rVert_{\mathcal{H}_2}^2$ if $$\label{cor3_cond1}
    \!
    \gamma_d (k_d + \gamma_d \operatorname{Re}[\lambda_k]) - \gamma_p \geq 0, 
    \ \
    \forall k \in \mathcal{N}_{obsv}.
    $$ Furthermore, $\lVert T \rVert_{\mathcal{H}_2}^2 < \lVert T^\prime \rVert_{\mathcal{H}_2}^2$ if in addition at least one of the inequalities in strictly holds for some $k \in \mathcal{N}_{obsv}$ such that $\operatorname{Im}[\lambda_k] \neq 0$ and relative position feedback is present, i.e. $\gamma_p \neq 0$.

    Similarly, $\lVert T \rVert_{\mathcal{H}_2}^2 \geq \lVert T^\prime \rVert_{\mathcal{H}_2}^2$ if $$\label{cor3_cond2}
    \!
    \gamma_d (k_d + \gamma_d \operatorname{Re}[\lambda_k]) - \gamma_p \leq 0, 
    \ \ 
    \forall k \in \mathcal{N}_{obsv}.
    $$ Furthermore $\lVert T \rVert_{\mathcal{H}_2}^2 ~>~ \lVert T^\prime \rVert_{\mathcal{H}_2}^2$ if in addition at least one of the inequalities in strictly holds for some $k \in \mathcal{N}_{obsv}$ such that $\operatorname{Im}[\lambda_k] \neq 0$ and relative position feedback is present, i.e. $\gamma_p \neq 0$.

Invoking Remark \[rem4\] and using , both $\lVert T \rVert_{\mathcal{H}_2}^2$ and $\lVert T^\prime \rVert_{\mathcal{H}_2}^2$ are given by which leads to Item *\[thm\_Im\_1\])*. Condition implies that $\beta_k \xi_k \phi_k - \beta_k^2 \geq 0$ for $k \in \mathcal{N}_{obsv}$ therefore $$\label{cor3_ineq}
\frac{\phi_k}{2 ( \alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 ) } \leq \frac{1}{2\alpha_k \phi_k }, \ \ 
k \in \mathcal{N}_{obsv}.
\!$$ Since $\nu_{kk} > 0$ for $k \in \mathcal{N}_{obsv}$ due to Lemma \[prop\_obsv\_modes\], multiplication of both sides of by $\nu_{kk}$ and summation of the inequalities gives $\lVert T \rVert_{\mathcal{H}_2}^2 \leq \lVert T^\prime \rVert_{\mathcal{H}_2}^2$. If in addition to at least one of these inequalities strictly holds for some $k \in \mathcal{N}_{obsv}$ such that $\operatorname{Im}[\lambda_k] \neq 0$ and $\gamma_p \neq 0$, then $\lVert T \rVert_{\mathcal{H}_2}^2 < \lVert T^\prime \rVert_{\mathcal{H}_2}^2$. The reverse inequalities follow from using a similar argument.

Note that the results in Lemma \[thm\_imag\] hold for any output matrix $C$ satisfying Assumption \[assum1\]. It is necessary that at least one observable eigenvalue does not lie on the real line for the performance of the directed and [[undirected]{}]{} systems to differ, and the gains need to be tuned based on [[these]{}]{} eigenvalues to improve performance. We next use this result to characterize the position-based performance of directed and [[undirected]{}]{} double-integrator systems in terms of relative feedback.

\[thm\_gp\] Consider the double-integrator network and the performance metric $P$ in . Let $T$ and $T^\prime$ be two systems given by with weighted Laplacian matrices $L$ and $L^\prime$. Suppose that $L$ is normal and $L^{\prime}$ is given by . Then the following hold:

1.  If relative position feedback is absent, i.e. $\gamma_p = 0$, then $\lVert T \rVert_{\mathcal{H}_2}^2 = \lVert T^\prime \rVert_{\mathcal{H}_2}^2$. \[thm\_gp\_1\]

2.  If relative position feedback is present and relative velocity feedback is absent, i.e. $\gamma_p \neq 0$ and $\gamma_d = 0$, and $\operatorname{Im}[\lambda_k] \neq 0$ for some $k \in \mathcal{N}_{obsv}$, then $\lVert T \rVert_{\mathcal{H}_2}^2 ~>~ \lVert T^\prime \rVert_{\mathcal{H}_2}^2$. \[thm\_gp\_2\]

3.  If both relative position and velocity feedback are present, i.e. $\gamma_p \neq 0$ and $\gamma_d \neq 0$, and $\operatorname{Im}[\lambda_k] \neq 0$ for some $k \in \mathcal{N}_{obsv}$, then there exists $\underline{\gamma}_p$ and $\overline{\gamma}_p$ that satisfy $$\min\limits_{\substack{k \in \mathcal{N}_{obsv}, \\ \operatorname{Im}[\lambda_k] \neq 0}}
    \! \!
    \operatorname{Re}[\lambda_k]
    \, \,
    \leq
    \, \,
    \frac{\underline{\gamma}_p}{\gamma_d^2} - \frac{k_d}{\gamma_d}
    \, \,
    \leq
    \, \,
    \frac{\overline{\gamma}_p}{\gamma_d^2} - \frac{k_d}{\gamma_d}
    \, \,
    \leq
    \, \,
    \max\limits_{\substack{k \in \mathcal{N}_{obsv}, \\ \operatorname{Im}[\lambda_k] \neq 0}}
    \! \!
    \operatorname{Re}[\lambda_k],$$ such that $\lVert T \rVert_{\mathcal{H}_2}^2 < \lVert T^\prime \rVert_{\mathcal{H}_2}^2$ if $\gamma_p < \underline{\gamma}_p$ and $\lVert T \rVert_{\mathcal{H}_2}^2 > \lVert T^\prime \rVert_{\mathcal{H}_2}^2$ if $\gamma_p > \overline{\gamma}_p$. \[thm\_gp\_3\]

    Invoking Remark \[rem4\] and using leads to Item *\[thm\_gp\_1\])*. Item *\[thm\_gp\_2\])* follows from Lemma \[thm\_imag\] by setting $\gamma_p \neq 0$ and $\gamma_d = 0$ in . To prove Item *\[thm\_gp\_3\])* we observe from Lemma \[thm\_imag\] that $$\begin{gathered}
    \gamma_p >
    \max\limits_{\substack{k \in \mathcal{N}_{obsv}, \\ \operatorname{Im}[\lambda_k] \neq 0}}
    \gamma_d (k_d + \gamma_d \operatorname{Re}[\lambda_k])
    =: \gamma_{u}
    \Rightarrow
    \lVert T \rVert_{\mathcal{H}_2}^2 > \lVert T^\prime \rVert_{\mathcal{H}_2}^2,
    \\
    \gamma_p <
    \min\limits_{\substack{k \in \mathcal{N}_{obsv}, \\ \operatorname{Im}[\lambda_k] \neq 0}}
    \gamma_d (k_d + \gamma_d \operatorname{Re}[\lambda_k])
    =: \gamma_{l}
    \Rightarrow
    \lVert T \rVert_{\mathcal{H}_2}^2 < \lVert T^\prime \rVert_{\mathcal{H}_2}^2.\end{gathered}$$ So $
    \lVert T \rVert_{\mathcal{H}_2}^2 = \lVert T^\prime \rVert_{\mathcal{H}_2}^2
    $ if $\gamma_p = \underline{\gamma}_p$ and $
    \lVert T \rVert_{\mathcal{H}_2}^2 < \lVert T^\prime \rVert_{\mathcal{H}_2}^2
    $ if $\gamma_p < \underline{\gamma}_p$ for some $\underline{\gamma}_p \in [\gamma_l, \gamma_u]$, since $
    \lVert T \rVert_{\mathcal{H}_2}^2$ and $\lVert T^\prime \rVert_{\mathcal{H}_2}^2
    $ are continuous in $\gamma_p$. Similarly, $
    \lVert T \rVert_{\mathcal{H}_2}^2 = \lVert T^\prime \rVert_{\mathcal{H}_2}^2
    $ if $\gamma_p = \overline{\gamma}_p$ and $
    \lVert T \rVert_{\mathcal{H}_2}^2 > \lVert T^\prime \rVert_{\mathcal{H}_2}^2
    $ if $\gamma_p > \overline{\gamma}_p$ for some $\overline{\gamma}_p \in [\gamma_l, \gamma_u]$. Finally we note that $\underline{\gamma}_p \leq \overline{\gamma}_p$, because otherwise $\gamma_p = \underline{\gamma}_p 
    > \overline{\gamma}_p
    $ would imply that $
    \lVert T \rVert_{\mathcal{H}_2}^2 = \lVert T^\prime \rVert_{\mathcal{H}_2}^2
    $ and $
    \lVert T \rVert_{\mathcal{H}_2}^2 > \lVert T^\prime \rVert_{\mathcal{H}_2}^2
    $ must simultaneously hold, which is a contradiction.

Directed communication degrades performance for metrics that capture some of the modes resulting from the directed [[paths]{}]{} (i.e. $\operatorname{Im}[\lambda_k] \neq 0$ for some $k \in \mathcal{N}_{obsv}$) if relative position feedback is used without relative velocity feedback. For such metrics, this issue can be addressed in several ways depending on the available feedback. For example, omitting relative position feedback (which requires absolute position feedback due to Assumption \[assum\_gain\]) can mitigate this degradation. In this case, the directionality of relative velocity feedback does not affect performance since directed and [[undirected]{}]{} systems perform identically.

It is when both types of relative feedback are used that tuning their respective gains properly can, not only mitigate the performance degradation, but also lead to the directed system outperforming its [[undirected]{}]{} counterpart. Therefore, it is critical to have relative velocity feedback in addition to relative position feedback. Namely, the directed system performs better than its [[undirected]{}]{} counterpart for sufficiently small relative position gain (the converse is true for sufficiently large relative position gain). This sufficient magnitude is determined by the velocity gains as well as the magnitude of the real parts of the observable eigenvalues that have non-zero imaginary parts. As a consequence, a judicious control strategy depends on the topological characteristics of the network.

Velocity based Performance
--------------------------

[[This subsection]{}]{} provides a comparison of the double integrator systems with respective Laplacians $L$ and $L^{\prime}$ [[in terms of]{}]{} the performance metric given in .

\[rem5\] The performance metric in simplifies to an expression that does not explicitly depend on $\operatorname{Im}[\lambda_k]$ if $\beta_k = 0$  for $k \in \mathcal{N}_{obsv}$. This holds if $\operatorname{Im}[\lambda_k] = 0$ for $k \in \mathcal{N}_{obsv}$ or $L$ is symmetric or $\gamma_p = 0$. If $\beta_k = 0$ for $k \in \mathcal{N}_{obsv}$,   reduces to $$\label{P_normal_v_noImag}
\lVert T \rVert_{\mathcal{H}_2}^2
=
\sum_{k \in \mathcal{N}_{obsv}} \nu_{kk} \frac{1}{2 (k_d + \gamma_d \operatorname{Re}[\lambda_k])},$$ [[when the]{}]{} stability condition from Proposition \[prop\_stab\_rh\] holds.

In contrast to the position based performance metric in , the velocity based performance in depends only on absolute or relative velocity feedback and its denominator is affine in $\operatorname{Re}[\lambda_k]$. So, absolute or relative position feedback does not affect velocity based performance if $\mathcal{G}$ is undirected.

The following theorem demonstrates that if the velocity based performance of the system given by $\eqref{H_cases_2}$ is considered and its directed graph emits a normal weighted Laplacian, its $\mathcal{H}_2$ norm is lower bounded by the $\mathcal{H}_2$ norm of the corresponding [[undirected]{}]{} system whose interconnection is defined by . This [[result]{}]{} highlights the inability of standard feedback schemes to mitigate velocity-based performance degradation.

\[Characterization of Velocity based Performance\] \[thm\_vel\] Consider the double-integrator network and the performance metric $P$ in . Let $T$ and $T^\prime$ be two systems given by with weighted Laplacian matrices $L$ and $L^\prime$. Suppose that $L$ is normal and $L^{\prime}$ is given by . Then the following hold:

1.  \[thm\_vel\_1\] $\lVert T \rVert_{\mathcal{H}_2}^2 
    \geq 
    \lVert T^\prime \rVert_{\mathcal{H}_2}^2$.

2.  \[thm\_vel\_3\] $\lVert T \rVert_{\mathcal{H}_2}^2 > \lVert T^\prime \rVert_{\mathcal{H}_2}^2$ if and only if $\operatorname{Im}[\lambda_k] \neq 0$ for some $k \in \mathcal{N}_{obsv}$ and relative position feedback is present, i.e. $\gamma_p ~\neq~ 0$.

3.  \[thm\_vel\_2\] $\lVert T \rVert_{\mathcal{H}_2}^2 \!= \lVert T^\prime \rVert_{\mathcal{H}_2}^2$ if and only if $\operatorname{Im}[\lambda_k] = 0 \, \, \forall k \in \mathcal{N}_{obsv}$ or relative position feedback is absent, i.e. $\gamma_p = 0$.

Since $-\beta_k^2 = - \gamma_p^2 \operatorname{Im}[\lambda_k]^2 \leq 0$, it holds that $$\label{cor12_ineq}
\alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 \leq \alpha_k \phi_k^2 + \beta_k \xi_k \phi_k, \ \ 
k \in \mathcal{N}_{obsv}.$$ Stability condition from Proposition \[prop\_stab\_rh\] states that $$\label{stab_vel_perf_thm}
\alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 > 0 \ \text{and} \ \phi_k > 0, \ \ 
k \in \mathcal{N}_{obsv}.$$ Therefore, can be re-arranged as $$\label{vel_perf_ineq}
\frac{ \xi_k \beta_k + \phi_k \alpha_k }
{ \alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2  }
\geq \frac{1}{\phi_k},
\ \
k \in \mathcal{N}_{obsv}.$$ Since $\nu_{kk} > 0$ for $k \in \mathcal{N}_{obsv}$ as shown in Lemma \[prop\_obsv\_modes\], $$\label{cor12_ineq_2}
\nu_{kk}
\frac{ \xi_k \beta_k + \phi_k \alpha_k }
{2( \alpha_k \phi_k^2 + \beta_k \xi_k \phi_k - \beta_k^2 ) }
\geq 
\nu_{kk}
\frac{1}{2 \phi_k},
\ \
k \in \mathcal{N}_{obsv}.$$ Summation of the inequalities given in and using and leads to [[Item *\[thm\_vel\_1\])*]{}]{}. To prove the necessity part of [[Item *\[thm\_vel\_3\])*]{}]{}, we observe that $-\beta_k^2 = - \gamma_p^2 \operatorname{Im}[\lambda_k]^2 < 0$ for some $k \in \mathcal{N}_{obsv}$ therefore strictly holds for such $k$. Then by a similar argument to the one used above, strictly holds for such $k$ as well, which leads to $\lVert T \rVert_{\mathcal{H}_2}^2 > \lVert T^\prime \rVert_{\mathcal{H}_2}^2$. [[To prove sufficiency]{}]{} suppose that $\lVert T \rVert_{\mathcal{H}_2}^2 > \lVert T^\prime \rVert_{\mathcal{H}_2}^2$. Using and , this implies that strictly holds for some $k \in \mathcal{N}_{obsv}$ (otherwise $\lVert T \rVert_{\mathcal{H}_2}^2 = \lVert T^\prime \rVert_{\mathcal{H}_2}^2$). Since $\nu_{kk} > 0$ for $k \in \mathcal{N}_{obsv}$, strictly holds for some $k \in \mathcal{N}_{obsv}$ as well. Using and re-arranging terms leads to $\beta_k^2 = \gamma_p^2 \operatorname{Im}[\lambda_k]^2 > 0$ for some $k \in \mathcal{N}_{obsv}$ implying that $\operatorname{Im}[\lambda_k] \neq 0$ for some $k \in \mathcal{N}_{obsv}$ and $\gamma_p \neq 0$. Finally we note that [[items *\[thm\_vel\_1\])* and *\[thm\_vel\_3\])* imply Item *\[thm\_vel\_2\])*.]{}]{}

Unlike position based performance, there does not exist a choice of control gains for the directed system that can result in better velocity based performance compared to its [[undirected]{}]{} counterpart for any output matrix $C$ satisfying Assumption \[assum1\]. Furthermore, when relative position feedback is used, the directed system performs strictly worse compared to its [[undirected]{}]{} counterpart for metrics capturing the effect of the directed interconnection. They perform identically without relative position feedback or if metrics do not capture the edge directionality. When the overall system performance is considered in terms of both position and velocity based metrics, a trade-off emerges. For systems with observable directed paths, it is possible to have equal performance to that of their [[undirected]{}]{} counterparts in the case of both position and velocity based metrics by omitting relative position feedback. But this is true only if absolute position feedback is used, as it is required for stability (Assumption \[assum\_gain\]). Therefore, unless absolute position measurements are available, the directed system requires well-tuned gains to prevent degradation of the position-based performance (or to possibly improve it) while it will always have worse velocity-based performance compared to the [[undirected]{}]{} system. For directed systems with absolute position feedback, improving position-based performance comes at the expense of the velocity-based performance.

For the particular metric defined as the variance of the full-state, the $\mathcal{H}_2$ norm of a linear system can be upper bounded by the $\mathcal{H}_2$ norm of a system whose dynamics emit the Hermitian part of the original state matrix [@SiamiMotee2017 Theorem 2]. In the case of double-integrator networks, this comparison does not [[explicitly]{}]{} account for [[the Laplacian eigenvalues, i.e.]{}]{} communication directionality. In contrast, we have studied communication directionality for general quadratic metrics by comparing directed graphs and their [[undirected]{}]{} counterparts represented by the Hermitian part of the Laplacian . Our results characterize performance as an aggregate outcome of judicious control strategy and network topology.

Example: Position and Velocity based Performance with Uni-directional vs. Bi-directional Feedback
-------------------------------------------------------------------------------------------------

We now consider a cyclic digraph in which each node has uniform out-degree $d$ and the uniformly weighted edges that start at each node reach $\omega$ succeeding nodes. This results in ‘look-ahead’ type state measurements through $\omega$ communication hops. The respective weighted Laplacian is given by $$\label{cycle_L}
\iffalse
\small
\! \!
L^{cyc}(d,\omega) \! = \!
d \! \!
\begin{bmatrix*}[r]
1 & -\frac{1}{\omega} & \dots & -\frac{1}{\omega} & 0 & \dots & 0 \\
0 & 1 & -\frac{1}{\omega} & \dots & -\frac{1}{\omega} & \ddots & \vdots \\
\vdots & \ddots & \ddots & \ddots & \ddots & \ddots & 0 \\
0 & \ddots & 0 & 1 &  -\frac{1}{\omega} & \ddots & -\frac{1}{\omega} \\
-\frac{1}{\omega} & \ddots & \ddots & \ddots & \ddots & \ddots & \vdots \\
\vdots & \ddots & \ddots & \ddots & 0 & \ddots & -\frac{1}{\omega}\\
-\frac{1}{\omega} & \dots & -\frac{1}{\omega} & 0 & \dots & 0 & 1 
\end{bmatrix*} \! \!, \! \! \! \! \!
\normalsize
\fi
\! \,
L^{cyc}(d,\omega) \! = \! 
d \! \times \! \operatorname{circ}{ \left( 
\begin{bmatrix}
1 & -\frac{1}{\omega} & \dots & -\frac{1}{\omega} & 0 & \dots & 0 
\end{bmatrix}
\right) } \!, \! \! \! \! \!$$ where $d \in \mathbb{R}^{+}$, $\omega \in \mathbb{Z}^{+}$, $\omega \leq n-1$ and $\operatorname{circ}(\cdot)$ denotes the circulant matrix generated by permuting the row vector in the argument. The Jordan decomposition of $L = L^{cyc}$ gives [@HornJohnson] $$\label{jordan_cycle}
J_k = \lambda_k = 
d \left( 1 - \frac{1}{\omega} \sum_{i=1}^{\omega}
e^{-\bold{j} \frac{2 \pi}{n} i (k-1)} \right),$$ for $k = 1, \dots, n$. Choosing $\alpha = \frac{1}{\sqrt{n}}$ in , the columns of $\tilde{R}$ are given by $$\begin{aligned}
\bold{r}_{l} &= \frac{1}{\sqrt{n}}
\begin{bmatrix} 
1 & e^{\bold{j} \frac{2 \pi}{n} (l-1)} & \dots & e^{\bold{j} \frac{2 \pi}{n} (l-1) (n-1)}
\end{bmatrix} ^*, \label{r_cycle} 
$$ for $l=2,\dots,n$. For the special case of uni-directional feedback, we set $d=1$ and $\omega =1$ in therefore $$L = L^{cyc}(1,1).$$ $$L = L^{cyc}(1,1) \quad
\text{and} \quad
L^\prime = 
\frac
{L^{cyc}(1,1) + L^{cyc}(1,1)^*}
{2},$$ where we have used to also define the corresponding bi-directional feedback. $$L^\prime = 
\frac
{L^{cyc}(1,1) + L^{cyc}(1,1)^*}
{2}.$$ We consider the respective systems $T$ and $T^\prime$ with an arbitrary output matrix $C \in \mathbb{R}^{n \times n}$ that satisfies Assumption \[assum1\], for $n=50$.

For the double-integrator network given by $\eqref{H_cases_1}$ (position based performance), Figure \[fig\_section6\]a shows that, as suggested by [[Item *\[thm\_gp\_2\])*]{}]{} of Theorem \[thm\_gp\], using relative position feedback without relative velocity feedback ($\gamma_p \neq 0$ and $\gamma_d = 0$) leads to worse performance with directed interconnection. It is when both relative position and velocity measurements are used ($\gamma_p \neq 0$ and $\gamma_d \neq 0$) that the directed cycles can be utilized for better performance by tuning the gains. Per [[Item *\[thm\_gp\_3\])*]{}]{} of Theorem \[thm\_gp\], sufficiently small $\gamma_p$ (i.e. sufficiently large velocity gains $k_d$ and $\gamma_d$) improves the performance of the directed interconnection relative to its [[undirected]{}]{} counterpart; but the performance degrades for sufficiently large $\gamma_p$, as shown in Figure \[fig\_section6\]b. Directed cycles require less communication thus can be preferable, provided the gains are carefully selected. For the double-integrator network given by $\eqref{H_cases_2}$ (velocity based performance), Figure \[fig\_section6\]c shows that relative position feedback degrades performance if the cycles are directed. But the performance becomes comparable to that of the [[undirected]{}]{} system for sufficiently small $\gamma_p$, equaling it at $\gamma_p = 0$. This [[supports]{}]{} the findings of Theorem \[thm\_vel\].

All-to-One vs. $\omega$-Nearest Neighbor Networks {#CentDistFeed}
=================================================

In this section, we compare two different relative feedback schemes. The first one is called an network, which designates a ‘leader’ node that receives no relative feedback, [[where]{}]{} the remaining nodes [[have access to]{}]{} uniformly weighted uni-directional state measurements relative to the leader only. The second one is referred to as an $\omega$-nearest neighbor network, which is based on uniformly weighted uni-directional state measurements of each node relative to $\omega$ succeeding nodes. [[ We consider performance metrics that have circulant output matrices $C$, which arise in many applications such as quantifying lack of coherence in a system in terms of global or local disorder [@BamiehJovanovic2012; @teglingbamieh2019; @oralgaymeacc2019].]{}]{} We also consider a special case of such performance metrics which is a global measure of disorder and quantifies the aggregate state deviation from the average through $$\label{C_dav}
C = I - \frac{1}{n} \bold{1} \bold{1}^\intercal
= L^{cyc} \left( \frac{n-1}{n},n-1 \right).$$ This metric will be denoted by $P_{dav}$.

Imploding Star Graph: All-to-One Networks
-----------------------------------------

networks can be modeled [[as]{}]{} the imploding star graph whose edge weights are normalized such that the out-degree of each node is $\frac{n}{n-1}$. The [[corresponding]{}]{} weighted Laplacian is given by $$\label{L_star}
L = 
\iffalse
\frac{n}{n-1}
\begin{bmatrix}
1 & 0 & \dots & 0 & -1 \\
0 & 1 & \ddots & \vdots & -1 \\
\vdots & \ddots & \ddots & 0 & \vdots \\
0 & \dots & 0 & 1 &-1 \\
0 & \dots & \dots & 0 & 0
\end{bmatrix},
\fi
\frac{n}{n-1}
\begin{bmatrix}
I_{n-1} & -\bold{1} \\
\bold{0}^{\intercal} & 0
\end{bmatrix}, 
$$ [[with total out-degree $n$.]{}]{} The Jordan decomposition gives $$\label{jordan_star}
J = 
\frac{n}{n-1}
\begin{bmatrix}
0 & \bold{0}^{\intercal} \\
\bold{0} & I_{n-1}
\end{bmatrix}.$$ Choosing $\alpha = 1$ in , the matrices $\tilde{R}$ and $\tilde{Q}$ are given by $$\tilde{R} =
\begin{bmatrix}
I_{n-1} \\ 
\bold{0}^{\intercal}
\end{bmatrix} 
\
\text{and}
\
\tilde{Q} =
\begin{bmatrix}
I_{n-1} & -\bold{1}
\end{bmatrix}.
\label{r_q_star}$$

### Single-Integrator Networks

The next theorem provides the solution for for the single-integrator network [[using Theorem \[thm3\] and the decomposition given by and .]{}]{}

\[cor7\] Consider the single-integrator network . Suppose that $\mathcal{G}$ is an imploding star graph with the weighted Laplacian , $C$ is circulant and the disturbance [[has unit covariance, i.e. $ E [ \Sigma_0 ] = I$]{}]{}. Then the expectation of the performance metric for the system $T$ given by is $$\begin{aligned}
\label{perf_star}
\!
E\left[P\right] \! = 
\lVert T \rVert_{\mathcal{H}_2}^2
= \,
 \frac{n-1}{n^2} 
\sum_{i=2}^{n} \, & \mu_i
\Bigg( \! n-1 \, \, +
\\ 
\nonumber
+ &
\! \! \! \! \! \!
\sum_{ \substack{ l > k, \\ k,l \in \{ 2, \dots, n \} } }
\! \! \! \! \! \! \! \!
\cos \left( \! \frac{2 \pi}{n} (i-1) (l-k) \! \right) \!
\! \Bigg) \!. 
\! \! \!\end{aligned}$$ $$\label{perf_star}
\footnotesize
\!
E\left[P\right] \! = 
\lVert T \rVert_{\mathcal{H}_2}^2
= \,
 \frac{n-1}{n^2} 
\sum_{i=2}^{n} \, \mu_i
\Bigg( \! n-1 \, \, +
\! \! \! \! \! \!
\sum_{ \substack{ l > k, \\ k,l \in \{ 2, \dots, n \} } }
\! \! \! \! \! \! \! \!
\cos \left( \! \frac{2 \pi}{n} (i-1) (l-k) \! \right) \!
\! \Bigg) \!. 
\! \! \!$$

Using the fact that $E\left[\Sigma_0 \right]= I$, we have $E\left[P\right] = \operatorname{tr}(\tilde{Q} \tilde{Q}^* \Psi)$. leads to $\tilde{Q} \tilde{Q}^* = I_{n-1} + \bold{1} \bold{1}^\intercal$ which gives $$\label{P_psi_star}
E\left[
P\right] = \sum_{k=2}^{n} \Psi_{kk} + \sum_{k=2}^{n} \sum_{l=2}^{n} \Psi_{kl}.$$ The matrix $M$ in has the eigenvectors $$\label{C_circ_evec}
\boldsymbol{\theta}_{l} = \frac{1}{\sqrt{n}}
\begin{bmatrix} 
1 & e^{\bold{j} \frac{2 \pi}{n} (l-1)} & \dots & e^{\bold{j} \frac{2 \pi}{n} (l-1) (n-1)}
\end{bmatrix} ^*$$ for $l=2,\dots,n$. Using and the columns of $\tilde{R}$ given in , the scalar products in are obtained as $$\label{scalar_star_r_theta}
\left \langle \boldsymbol{\theta}_{i}, \bold{r}_{k} \right \rangle
=
\frac{1}{\sqrt{n}}  e^{-\bold{j} \frac{2 \pi}{n} (i-1) (k-2)}, \quad
k = 2,\dots,n.$$ By and the fact that $\lambda_i = \frac{n}{n-1}$ for $i=2,\dots,n$ we have $ \Psi_{kl} = \frac{n-1}{2n} \nu_{kl}$, therefore using and results in $$\label{perf_exp_star}
\small
E\left[P\right] 
= 
\frac{n-1}{2n^2} \!
\left(
\sum_{k=2}^{n} \sum_{i=2}^{n} \mu_i
+ \sum_{k=2}^{n} \sum_{l=2}^{n}  \sum_{i=2}^{n} 
e^{\bold{j} \frac{2 \pi}{n} (i-1) (l-k)} \mu_i
\right) \! \!. 
\! \!$$ Rearranging the terms in and using Proposition \[Prop\_H2L2\] gives the result.

[[ We now consider a special case of circulant output matrices $C$, which leads to a global measure of disorder that quantifies the aggregate state deviation from the average through $$\label{C_dav}
C = I - \frac{1}{n} \bold{1} \bold{1}^\intercal
= L^{cyc} \left( \frac{n-1}{n},n-1 \right).$$ This metric will be denoted by $P_{dav}$.]{}]{}

### Relationship to Previous Results {#relationship-to-previous-results .unnumbered}

[[ For $P_{dav}$, the following proposition shows that the result in [@YoungLeonard2010] can be reproduced as a special case of Theorem \[cor7\].]{}]{}

\[prop\_star\] Consider the single-integrator network [[and the output matrix , i.e. the performance metric $P_{dav}$]{}]{}. Suppose that $\mathcal{G}$ is an imploding star graph with the weighted Laplacian , and the disturbance [[has unit covariance, i.e. $ E [\Sigma_0] = I$]{}]{}. Then the expectation of the performance metric for the system $T$ given by is $$\label{P_star_dav}
E\left[
P_{dav}
\right] =
\lVert T \rVert_{\mathcal{H}_2}^2
=
 \frac{(n-1)^2}{2n}.$$

The fact that $\mu_i = 1 \ \forall i$ and gives $$E\left[
P_{dav}
\right] = \frac{n-1}{2n^2} 
\bigg(
2 (n-1)^2
+ \sum_{k \neq l}  \sum_{i=2}^{n} 
e^{\bold{j} \frac{2 \pi}{n} (i-1) (l-k)}
\bigg).$$ Since $\sum_{i=1}^{n} e^{ \bold{j} \frac{2 \pi}{n} (i-1) (l-k)} \! = \! 0$ for $l - k  \! = \! \pm 1, \dots, \pm (n-2)$, $$E\left[
P_{dav}
\right] = \frac{n-1}{2n^2} 
\bigg(
2 (n-1)^2
- \underbrace{\sum_{k \neq l} e^{\bold{j} \frac{2 \pi}{n} 0 (l-k)}}_{ = (n-1)(n-2)}
\bigg). 
\quad 
\mbox{\qedhere}
\! \! \! \! \! \! \! 
\! \! \! \! \! \! 
$$ $
E\left[
P_{dav}
\right] = \frac{n-1}{2n^2} 
\bigg(
2 (n-1)^2
- \underbrace{\sum_{k \neq l} e^{\bold{j} \frac{2 \pi}{n} 0 (l-k)}}_{ = (n-1)(n-2)}
\bigg)
= \frac{n-1}{2n^2} 
\bigg(
2 (n-1)^2
- (n-1)(n-2)
\bigg)
$

### Double-Integrator Networks

Using Corollary \[cor3\] [[from Section \[diagL\]]{}]{}, the following theorem [[characterizes performance metric for all-to-one networks with double-integrator dynamics ]{}]{}.

\[cor8\] Consider the double-integrator network . Suppose that $\mathcal{G}$ is an imploding star graph with the weighted Laplacian , the output matrix $C$ is circulant and the disturbance [[has unit covariance, i.e. $ E [\Sigma_0] = I$]{}]{}. Then the expectation of the performance metric is $$\label{P_star_secpos}
E\left[P\right]
=
\lVert T \rVert_{\mathcal{H}_2}^2
 = 
P_{0}
\frac{1}{ 2 (k_p + \gamma_p \frac{n}{n-1})(k_d + \gamma_d \frac{n}{n-1}) }$$ for the system $T$ given by and $$\label{P_star_secvel}
E\left[P\right]
=
\lVert T \rVert_{\mathcal{H}_2}^2 = 
P_{0}
\frac{1}{ 2(k_d + \gamma_d \frac{n}{n-1} ) }$$ for the system $T$ given by , where $$P_{0} = \frac{1}{n}
\left(
\sum_{k=2}^{n} \sum_{i=2}^{n} \mu_i
+ \sum_{k=2}^{n} \sum_{l=2}^{n}  \sum_{i=2}^{n} 
e^{\bold{j} \frac{2 \pi}{n} (i-1) (l-k)} \mu_i
\right).
$$

Furthermore, if [[the output matrix is given by ,]{}]{} then $$\label{P_star_secpos_dav}
E\left[P_{dav} \right]
=
\lVert T \rVert_{\mathcal{H}_2}^2
= 
\frac{n-1}{ 2 (k_p + \gamma_p \frac{n}{n-1})(k_d + \gamma_d \frac{n}{n-1}) }$$ for the system $T$ given by and $$\label{P_star_secvel_dav}
E\left[P_{dav} \right]
=
\lVert T \rVert_{\mathcal{H}_2}^2  
= 
\frac{n-1}{ 2 (k_d + \gamma_d \frac{n}{n-1} ) }$$ for the system $T$ given by .

Substitution of $\lambda_k = \frac{n}{n-1}$ for $k = 2, \dots, n$ into and gives $
\Psi_{kl} = \nu_{kl}
\frac{1}{ 2 (k_p + \gamma_p \frac{n}{n-1})(k_d + \gamma_d \frac{n}{n-1}) }
$ for the system $T$ given by and $
\Psi_{kl} = \nu_{kl}
\frac{1}{ 2 (k_d + \gamma_d \frac{n}{n-1}) }
$ for the system $T$ given by . By the argument given in the proof of Theorem \[cor7\], using the expressions above and leads to and . The argument given in the proof of Proposition \[prop\_star\] combined with and yields and .

When $P_{dav}$ is considered, Proposition \[prop\_star\] and Theorem \[cor8\] show that the performance metric grows unboundedly with the network size. Next we study $\omega$-nearest neighbor networks.

Cyclic Digraphs: $\omega$-Nearest Neighbor Networks
---------------------------------------------------

The cyclic digraph defined by the weighted Laplacian can be used to model $\omega$-nearest neighbor networks. In order to normalize the edge weights of the digraphs with different number of communication hops we choose the out-degree of each node as $d = 1$ [[in ]{}]{}, which leads to $$\label{dist_feed}
L = L^{cyc} \left( 1, \omega \right)$$ so that the total out-degree in the graph is $n$. Since we consider circulant output matrices $C$, the eigenvectors of $M$ in are given by . Combining this with , the scalar products in are obtained as $$\label{th_r_orth}
\left \langle \boldsymbol{\theta}_{l}, \bold{r}_{k} \right \rangle
=
\begin{cases}
1 & k = l \\
0 & k \neq l
\end{cases},
\ k = 2, \dots, n,$$ therefore leads to $$\label{nu_mu}
\nu_{kk} = \mu_k.$$ This means that the dependence of , and on the output matrix $C$ is only through the eigenvalues $\mu_k$ of $M$.

Then performance is given by for the single-integrator system, and by or for the double-integrator system, where due to the eigenvalues of $L$ satisfy $$\label{lambda_cyc}
\lambda_k = 
1 - \frac{1}{\omega} \sum_{i=1}^{\omega}
e^{-\bold{j} \frac{2 \pi}{n} i (k-1)},
\ k=1,\dots,n.$$ Next we present two examples to demonstrate the effect of the number of communication hops $\omega$ on the performance of $\omega$-nearest neighbor networks and to investigate the relationship between all-to-one and all-to-all communication [[structures]{}]{}.

[[Example: Number of Communication Hops]{}]{}
---------------------------------------------

In the following we investigate how performance changes with respect to $\omega$. We first show that performance does not necessarily improve by increasing $\omega$, i.e. through communication with a larger [[number of nearest neighbors.]{}]{}

For convenience suppose that $n$ is odd. Consider the case where $\omega = \frac{n-1}{2}$ such that $L=L^{cyc} (1,\frac{n-1}{2})$. Using the definition given by $$\label{L_dist_comp}
L^{\prime} = \frac{ L^{cyc} (1,\frac{n-1}{2}) + L^{cyc} (1,\frac{n-1}{2})^* } {2}
= L^{cyc} (1,n-1),$$ i.e. $L^{\prime}$ is the weighted Laplacian associated with the complete graph with uniform edge weights $\frac{1}{n-1}$. Then the associated systems $T$ and $T^\prime$ have the following properties for any performance metric satisfying Assumption \[assum1\]:

-   $\lVert T \rVert_{\mathcal{H}_2}^2 = \lVert T^{\prime} \rVert_{\mathcal{H}_2}^2$ for the single-integrator network defined by $\eqref{H_cases_1}$ due to Theorem \[cor\_single\_normal\],

-   It is possible due to Theorem \[thm\_gp\] that $\lVert T \rVert_{\mathcal{H}_2}^2 <  \lVert T^{\prime} \rVert_{\mathcal{H}_2}^2$, $\lVert T \rVert_{\mathcal{H}_2}^2 = \lVert T^{\prime} \rVert_{\mathcal{H}_2}^2$ or $\lVert T \rVert_{\mathcal{H}_2}^2 > \lVert T^{\prime} \rVert_{\mathcal{H}_2}^2$ for the position based performance of the double-integrator network defined by system ,

-   It can only hold that $\lVert T \rVert_{\mathcal{H}_2}^2 = \lVert T^{\prime} \rVert_{\mathcal{H}_2}^2$ or $\lVert T \rVert_{\mathcal{H}_2}^2 > \lVert T^{\prime} \rVert_{\mathcal{H}_2}^2$ for the velocity based performance of the double-integrator network defined by system due to Theorem \[thm\_vel\].

As this example suggests, using half the number of communication hops as compared to the complete graph, i.e. the case in which $\omega$ is maximal, provides identical performance for the single integrator network . It is possible to achieve better performance [[using half the number of hops compared to the complete graph]{}]{} in the case of the position based metrics of the double integrator network ; but this is not the case for the velocity based metrics.

The dependence of $E\left[P_{dav}\right]$ on $\omega$ is illustrated in figures for a case in which $n=51$ and the disturbance [[has unit covariance, i.e. $E[\Sigma_0] = I$]{}]{}. For the single integrator network we observe in Figure \[hops\_comp\_star\]a that $\lVert T \rVert_{\mathcal{H}_2}^2 = \lVert T^{\prime} \rVert_{\mathcal{H}_2}^2$. This is also true for the position and velocity based performance of the double-integrator network if relative position feedback is absent ($k_p=k_d=\gamma_d=1$ and $\gamma_p = 0$) as shown in figures \[hops\_comp\_star\]c (due to Item \[thm\_gp\_1\] in Theorem \[thm\_gp\]) and \[hops\_comp\_star\]e (due to Item \[thm\_vel\_2\] in Theorem \[thm\_vel\]). Conversely, using relative position feedback ($k_p=k_d=\gamma_p=\gamma_d = 1$) leads to $\lVert T \rVert_{\mathcal{H}_2}^2 < \lVert T^{\prime} \rVert_{\mathcal{H}_2}^2$ as shown in Figure \[hops\_comp\_star\]b (due to Item \[thm\_gp\_3\] in Theorem \[thm\_gp\]) for the position based performance and to $\lVert T \rVert_{\mathcal{H}_2}^2 > \lVert T^{\prime} \rVert_{\mathcal{H}_2}^2$ as shown in Figure \[hops\_comp\_star\]d (due to Item \[thm\_vel\_3\] in Theorem \[thm\_vel\]) for the velocity based performance. For all cases, increasing $\omega$ up to $\omega = 25$ monotonically improves performance. Compared to $\omega = 25$, choosing $25 < \omega < 50$ degrades performance, excluding the velocity based performance with relative position feedback ($\gamma_p \neq 0$, Figure \[hops\_comp\_star\]d) which improves monotonically as $\omega$ is increased. Therefore at least for $n=51$ and the cases in figures \[hops\_comp\_star\]a-\[hops\_comp\_star\]c and \[hops\_comp\_star\]e, $\omega = \frac{n-1}{2}$ provides the optimal performance.

The next example provides a comparison between and all-to-all networks.

[[Example: versus Networks]{}]{}
--------------------------------

For the special case of $P_{dav}$ which is determined by , holds and we have $\mu_k =1$ for $k=2,\dots,n$. If networks are considered, i.e. $L$ is given by , reduces to $\lambda_k = \frac{n}{n-1}$ for $k=2,\dots,n$. Then $P_{dav}$ is given by

-   for the single-integrator network given by ,

-   for the double-integrator network given by ,

-   for the double-integrator network given by ,

where we respectively used , and . Therefore, $\omega$-nearest neighbor networks with $\omega = n-1$ (all-to-all) and networks perform *identically* if $P_{dav}$ is considered, which is illustrated in figures \[hops\_comp\_star\]f - \[hops\_comp\_star\]j for up to $n=49$. In conclusion, given that the total out-degree is normalized to be $n$ for each graph, the same $P_{dav}$ is achieved by using $n-1$ directed edges that follow a common leader [[as that of]{}]{} using $n(n-1)$ directed edges such that each node follows every other node. The latter feedback scheme can be interpreted as every node being a common leader in the sense of the former feedback scheme. In other words, the network can be interpreted as the superposition of $n$ networks with edge weights scaled by $\frac{1}{n}$. Thus the same level of deviation from the average state (position or velocity) is achieved by following a single common leader instead of using all-to-all communication, provided the edge weights are sufficiently large. As $n$ grows, the number of edges grow linearly and each edge weight $\frac{n}{n-1}$ remains bounded in networks. In contrast, the number of edges grow quadratically and each edge weight $\frac{1}{n-1}$ decays to zero in networks. We note for double-integrator networks given by that compared to both and communication, it is possible to achieve better position-based $P_{dav}$ with $\omega = \frac{n-1}{2}$ nearest neighbor interactions (odd $n$), if both relative position and velocity feedback are employed and the relative position feedback gain $\gamma_p$ is sufficiently small (e.g. Figure \[hops\_comp\_star\]b).

Conclusions {#conclusion}
===========

We studied the performance of single and double integrator networks over arbitrary digraphs that have at least one globally reachable node. Using a unifying framework, closed-form solutions are provided for a general class of output $\mathcal{L}_2$ norm based [[quadratic]{}]{} performance metrics. The special case of normal weighted Laplacian matrices reveals the importance of judicious control design for mitigating any performance degradation in directed networks, and possibly improving upon their [[undirected]{}]{} counterparts. In addition, we have demonstrated that performance is sensitive to the degree of connectivity (e.g. range of communication in $\omega$-nearest neighbor networks), but it does not depend on it monotonically. This non-monotonicity can also be deduced from the equivalence between and networks. That is, the same level of state deviation from the average is achieved using either [[network architecture]{}]{}.

Lemmas from Subsection \[PerfArbDouble\]
----------------------------------------

\[lemma3\] Consider the transfer function $$\label{phi_TF}
\Omega_{k,\delta}(s) = \frac
{ r(s) {\left( \gamma_p + s \gamma_d \right)}^{\delta-1}}
{{\left[ s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k \right] }^\delta}$$ for some $\delta \in \mathbb{Z}_{+}$. Suppose that $s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k = 0$ has distinct roots $\rho_1^{(k)}$ and $\rho_2^{(k)}$, i.e. $\rho_1^{(k)} \neq \rho_2^{(k)}$. Then, $\Omega_{k,\delta}(s)$ has a realization $\left( \mathcal{A}_{k,\delta}, \mathcal{B}_{k,\delta}, \mathcal{C}_{k,\delta} \right)$ in Jordan canonical form given by $$\label{Jordan_realization}
\mathcal{A}_{k,\delta} =
\iffalse
\begin{bmatrix}
\mathcal{J} (\rho_1^{(k)}, \delta) & \\
& \mathcal{J} (\rho_2^{(k)}, \delta)
\end{bmatrix},
\fi
\operatorname{blockdiag}{ \left(
\mathcal{J} (\rho_i^{(k)}, \delta)
\right)_{i=1,2} }, 
$$ $\mathcal{B}_{k,\delta} = \bigg[ \underbrace{\begin{matrix} 0 & \dots & 1 \end{matrix}}_{1 \times \delta} \underbrace{\begin{matrix} 0 & \dots & 1 \end{matrix}}_{1 \times \delta} \bigg]^\intercal$, $\mathcal{C}_{k,\delta} = \begin{bmatrix} c_{1}^{(k)} & \dots & c_{2\delta}^{(k)} \end{bmatrix}$, where $\mathcal{J} (\rho_1^{(k)}, \delta)$ denotes the size-$\delta$ Jordan block with the eigenvalue $\rho_1^{(k)}$.

If $r (s) = 1$, i.e. we consider system $T$ given by , the elements of $\mathcal{C}_{k,\delta}$ are given by $$\begin{aligned}
c_{l}^{(k)} &= \sum_{\zeta=0}^{l-1} \tau(\zeta,l) {\gamma_d}^{\zeta} \frac{{(\gamma_p + \rho_1^{(k)} \gamma_d)}^{\delta-\zeta-1}}{{(\rho_1^{(k)} - \rho_2^{(k)})}^{\delta+l-\zeta-1}}, \nonumber \\
c_{l+\delta}^{(k)} &= \sum_{\zeta=0}^{l-1} \tau(\zeta,l) {\gamma_d}^{\zeta} \frac{{(\gamma_p + \rho_2^{(k)} \gamma_d)}^{\delta-\zeta-1}}{{(\rho_2^{(k)} - \rho_1^{(k)})}^{\delta+l-\zeta-1}}, \nonumber\end{aligned}$$ if $r (s) = s$, i.e. we consider system $T$ given by , the elements of $\mathcal{C}_{k,\delta}$ are given by $$\begin{aligned}
c_{l}^{(k)} &= 
\sum_{\zeta=0}^{l-1} \tau(\zeta,l) {\gamma_d}^{\zeta-1} 
\left( 
\frac{ \zeta \gamma_p + \delta \rho_1^{(k)} \gamma_d } {\delta - \zeta}
\right)
\frac{{(\gamma_p + \rho_1^{(k)} \gamma_d)}^{\delta-\zeta-1}}{{(\rho_1^{(k)} - \rho_2^{(k)})}^{\delta+l-\zeta-1}},
\nonumber \\
c_{l+\delta}^{(k)} &= 
\sum_{\zeta=0}^{l-1} \tau(\zeta,l) {\gamma_d}^{\zeta-1} 
\left( 
\frac{ \zeta \gamma_p + \delta \rho_2^{(k)} \gamma_d } {\delta - \zeta}
\right)
\frac{{(\gamma_p + \rho_2^{(k)} \gamma_d)}^{\delta-\zeta-1}}{{(\rho_2^{(k)} - \rho_1^{(k)})}^{\delta+l-\zeta-1}},
\nonumber\end{aligned}$$ for $l=1,\dots,\delta$, where $\tau(\zeta,l) = {(-1)}^{l-\zeta-1} \binom{l-1}{\zeta}
\binom{\delta+l-\zeta-2}{l-1}
$.

Using the fact that the denominator of $\Omega_{k,\delta}(s)$ has distinct roots $$\nonumber
\Omega_{k,\delta}(s) =  
\frac{\Gamma (s)}{{(s - \rho_1^{(k)})}^{\delta} {(s - \rho_2^{(k)})}^{\delta}},$$ where $\Gamma (s) = r(s) {\left( \gamma_p + s \gamma_d \right)}^{\delta-1}$. Applying partial fractions, we have $$\label{par_frac}
\Omega_{k,\delta}(s) = \sum_{l=1}^{\delta} 
\frac{c_{l}^{(k)}}{{(s - \rho_1^{(k)})}^{\delta-l+1}} +
\frac{c_{l+\delta}^{(k)}}{{(s - \rho_2^{(k)})}^{\delta-l+1}},$$ which can be represented by the Jordan canonical realization . Here the coefficients $c_{l}^{(k)}$ and $c_{l+\delta}^{(k)}$ are given by $$\begin{aligned}
c_{l}^{(k)} &= \frac{1}{(l-1)!}
\lim_{s \to  \rho_1^{(k)}} \frac{d^{l-1}}{ds^{l-1}} \left[ {(s - \rho_1^{(k)})}^{\delta} \Omega_{k,\delta}(s) \right], \label{c_l} \\
c_{l+\delta}^{(k)} &= \frac{1}{(l-1)!}
\lim_{s \to  \rho_2^{(k)}} \frac{d^{l-1}}{ds^{l-1}} \left[ {(s - \rho_2^{(k)})}^{\delta} \Omega_{k,\delta}(s) \right]. \label{c_l_beta}\end{aligned}$$ The general Leibniz rule for the derivative of product yields $$\begin{aligned}
\! \! \! \! \! \!
c_{l}^{(k)} \! &= \! \! \lim_{s \to  \rho_1^{(k)}} \!
\sum_{\zeta = 0}^{l-1} 
\frac{ \binom{l-1}{\zeta} } {(l-1)!}
\frac{d^{\zeta} \Gamma (s) }{ds^{\zeta}} 
\frac{d^{l-1-\zeta}}{ds^{l-1-\zeta}} \! \!
\left[ {(s - \rho_2^{(k)})}^{-\delta} \right] \! \!, \! \!
\label{c_l_2} \\
\! \! \! \!
c_{l+\delta}^{(k)} \! &= \! \! \lim_{s \to  \rho_2^{(k)}} \!
\sum_{\zeta = 0}^{l-1} 
\frac{ \binom{l-1}{\zeta} } {(l-1)!}
\frac{d^{\zeta}}{ds^{\zeta}} \Gamma (s)
\frac{d^{l-1-\zeta}}{ds^{l-1-\zeta}} \left[ {(s - \rho_1^{(k)})}^{-\delta} \right] \! \!, \!
\label{c_l_beta_2}\end{aligned}$$ For the cases of $r(s) = 1$ or $ r(s) = s $, a direct calculation shows that $$\!
\frac{d^{\zeta}}{ds^{\zeta}} \left[ {(\gamma_p + s \gamma_d)}^{\delta-1} \right] 
\! \! = \!
{\gamma_d}^{\zeta} \frac{(\delta-1)!}{(\delta-\zeta-1)!} 
{(\gamma_p + s \gamma_d)}^{\delta-\zeta-1} \! , \! \! \! \!
\label{deriv1}$$ $$\begin{aligned}
\! \! \! \! \! \! \! \! \! \!
\frac{d^{\zeta}}{ds^{\zeta}} \left[ {s(\gamma_p + s \gamma_d)}^{\delta-1} \right] 
\! \! &= \!
s {\gamma_d}^{\zeta} \frac{(\delta-1)!}{(\delta-\zeta-1)!} 
{(\gamma_p + s \gamma_d)}^{\delta-\zeta-1} \nonumber \\
&+ {\gamma_d}^{\zeta - 1} \zeta \frac{(\delta-1)!}{(\delta-\zeta)!} 
{(\gamma_p + s \gamma_d)}^{\delta-\zeta} \! , \! \!
\label{deriv2}\end{aligned}$$ $$\frac{d^{l-1-\zeta}}{ds^{l-1-\zeta}} \left[ {(s - \rho_2^{(k)})}^{-\delta} \right] =
{(-1)}^{l-1-\zeta} \frac{(\delta+l-\zeta-2)!}{(\delta-1)!} 
{(s - \rho_2^{(k)})}^{-\delta-l+\zeta+1}. \label{deriv3}$$ Substituting , and into and taking the limit gives the desired result. A similar procedure can be followed to evaluate the expression in .

\[lemma4\] Consider the transfer function $\Omega_{k,\delta}(s)$ in $$\nonumber
\Omega_{k,\delta}(s) = \frac
{r(s) {\left( \gamma_p + s \gamma_d \right)}^{\delta-1}}
{{\left[ s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k \right] }^\delta}$$ for some $\delta \in \mathbb{Z}_{+}$. Suppose that $s^2 + (k_d + \gamma_d \lambda_k) s + k_p + \gamma_p  \lambda_k = 0$ has repeated roots $\rho_1^{(k)}$ and $\rho_2^{(k)}$, i.e. $\rho_1^{(k)} = \rho_2^{(k)} = \rho^{(k)}$. Then, $\Omega_{k,\delta}(s)$ has a realization $\left( \mathcal{A}_{k,\delta}, \mathcal{B}_{k,\delta}, \mathcal{C}_{k,\delta} \right)$ in Jordan canonical form given by $$\label{Jordan_realization_2}
\mathcal{A}_{k,\delta} =
\mathcal{J} (\rho^{(k)}, 2\delta),$$ $$\nonumber
\mathcal{B}_{k,\delta} = \bigg[ \underbrace{\begin{matrix} 0 & \dots & 1 \end{matrix}}_{1 \times 2\delta} \bigg]^\intercal, 
\mathcal{C}_{k,\delta} = \begin{bmatrix} c_{1}^{(k)} & \dots & c_{2\delta}^{(k)} \end{bmatrix}.$$ If $r(s) = 1$, i.e. we consider system $T$ given by , the elements of $\mathcal{C}_{k,\delta}$ are given by $$\nonumber
c_{l}^{(k)} = 
\begin{cases} 
{\gamma_d}^{l-1} 
\binom{\delta-1}{l-1}
{(\gamma_p + \rho^{(k)} \gamma_d)}^{\delta-l}, & 1 \leq l \leq \delta \\
\hfil 0 , & \delta+1 \leq l \leq 2\delta
\end{cases},$$ if $ r(s) = s $, i.e. we consider system $T$ given by , the elements of $\mathcal{C}_{k,\delta}$ are given by $$\nonumber
c_{l}^{(k)} \! = \! 
\begin{cases} 
\!
\left[ \frac{ (l-1)\gamma_p + \delta \rho^{(k)} \gamma_d } {\delta - l + 1} \right] \!
{\gamma_d}^{l-2}
\binom{\delta-1}{l-1}
{(\gamma_p + \rho^{(k)} \gamma_d)}^{\delta-l}, & 1 \leq l \leq \delta \\
\hfil {\gamma_d}^{\delta - 1}, & l = \delta+1 \\
\hfil 0, & \delta+2 \leq l \leq 2\delta
\end{cases}.$$

Using the fact that $\Omega_{k,\delta}(s)$ has repeated roots leads to $$\nonumber
\Omega_{k,\delta}(s) =  
\frac{r(s) {\left( \gamma_p + s \gamma_d \right)}^{\delta-1}} 
{{(s - \rho^{(k)})}^{2\delta}}.$$ Applying partial fractions, we have $$\nonumber
\Omega_{k,\delta}(s) = \sum_{l=1}^{2\delta} 
\frac{c_{l}^{(k)}}{{(s - \rho^{(k)})}^{2\delta-l+1}},$$ which can be represented by the Jordan canonical realization . Here the coefficients $c_{l}^{(k)}$ are given by $$c_{l}^{(k)} = 
\frac{1}{(l-1)!}
\lim_{s \to  \rho^{(k)}} \frac{d^{l-1}}{ds^{l-1}} 
\left[
r(s) {\left( \gamma_p + s \gamma_d \right)}^{\delta-1} 
\right]. \label{c_l_2_rep} 
$$ For the cases of $r(s) = 1$ or $r(s) = s$, using respectively and and taking the limit in gives the desired result. See [@OralMalladaGayme2019_arxiv] for a proof.

[^1]: H. G. Oral and D. F. Gayme are with the Dept. of Mechanical Engineering, E. Mallada is with the Dept. of Electrical and Computer Engineering at The Johns Hopkins University, Baltimore, MD, USA, 21218, [`giray@jhu.edu, dennice@jhu.edu, mallada@jhu.edu`]{}. Partial support by the NSF (ECCS 1230788, CNS 1544771, EPCN 1711188) and ARO W911NF-17-1-0092 is gratefully acknowledged.
