Abstract
The multilayer network framework has served to describe and uncover a number of novel and unforeseen physical behaviors and regimes in interacting complex systems. However, the majority of existing studies are built on undirected multilayer networks while most complex systems in nature exhibit directed interactions. Here, we propose a framework to analyze diffusive dynamics on multilayer networks consisting of at least one directed layer. We rigorously demonstrate that directionality in multilayer networks can fundamentally change the behavior of diffusive dynamics: from monotonic (in undirected systems) to non-monotonic diffusion with respect to the interlayer coupling strength. Moreover, for certain multilayer network configurations, the directionality can induce a unique superdiffusion regime for intermediate values of the interlayer coupling, wherein the diffusion is even faster than that corresponding to the theoretical limit for undirected systems, i.e. the diffusion in the integrated network obtained from the aggregation of each layer. We theoretically and numerically show that the existence of superdiffusion is fully determined by the directionality of each layer and the topological overlap between layers. We further provide a formulation of multilayer networks displaying superdiffusion. Our results highlight the significance of incorporating the interacting directionality in multilevel networked systems and provide a framework to analyze dynamical processes on interconnected complex systems with directionality.
Export citation and abstract BibTeX RIS
1. Introduction
Multilayer networks provide a proper mathematical representation of complex systems with different types of interactions, e.g. social interactions among individuals across different social platforms such as Facebook and Twitter, and enable the understanding of dynamics acting on or evolving within those systems [1, 2]. A number of dynamical processes are studied on the framework of multilayer networks: for example, innovation/information diffusion [3], the control of formation and task allocation of swarms [4–6], synchronization of oscillators [7], the understanding of functional brain connectivity [8], and many others. More specifically, recent studies based on a multilayer network representation have revealed unforeseen dynamical regimes and behaviors, such as new spreading regimes when more than one diseases in spreading in a given population [9–12], and enhanced stability of synchronized states [13]. Moreover, conversely from building up a multilayer structure, gradually dismantling a multilayer network triggers an abrupt transition [14], suggesting a non-additive effect of a multilayer structure from the integration of its layers. In terms of diffusion dynamics, multilayer network studies revealed that for any multilayer configuration, the diffusive behavior of the overall system (multilayer network) could be tuned to be faster than that of the slowest layer for significant values of interlayer diffusivity (in comparison to intralayer diffusivity). More surprisingly, but only for certain multilayer network configurations, the overall system can exhibit a superdiffusive behavior for large values of interlayer diffusivity, where the diffusive dynamics on the multilayer network is faster than in any of the individual layers, when those are considered in independently [15–17].
Most of the studies made in the field of multilayer networks adopt undirected structures, i.e. the interactions represented by both interlayer and intralayer links are assumed to be undirected. However, most real world systems are inherently directed. Examples are the World Wide Web, in which hyperlinks run in one direction from one Webpage to another; food webs, in which energy flows from prey to predator; phone call networks; metabolic networks; citation networks; social networks of followers and followee; gene regulation networks, to name a few. Additionally, some dynamical processes are governed by physical laws and inherently evolve in a directional manner despite of the underlying undirected connectivity topology, like current/information flow from high voltage to low voltage, virus transmissions from infected to susceptible individuals. Moreover, multi-leveled unidirectional interactions are commonly found in interacting systems. For example, a gene regulation network aims to properly characterize both protein-DNA and protein-protein directed interactions between genes and proteins [18]. Therein, multilayer networks with directionality provide a realistic representation for such systems consisting of multilevel and directed interactions.
Multilayer networks where at least one of the layers is directed give rise to new theoretical challenges in analyzing their dynamical behaviors. As diffusion dynamics on undirected multilayer networks is fully characterized by the spectrum of network matrices, like supra-Laplacian [15], network directionality leads to nonsymmetrical graph matrices, which mostly features complex and non-orthogonal spectrum. Consequently, spectrum related analysis on undirected multilayer networks might be proven as invalid or inaccurate. Few recent studies on directed multilayer networks reveal new and unexpected physical behaviors [16, 19], as well as increased sensitivity to structural changes [20].
The contribution of this paper is to provide a theoretical framework for diffusive dynamics on multilayer networks with directed layers. We show that although certain undirected multilayer networks can result in enhanced diffusive (faster than the slowest layer) or superdiffusive (faster than any of the layers) regimes for large values of the interlayer coupling, the diffusive rate of the overall system never exceeds the diffusion on the equivalent aggregated system (the direct sum of each layer). We also show that certain directed multilayer networks can also show enhanced diffusive and superdiffusive regimes for large values of interlayer coupling. Remarkably, directed multilayer networks, differently from their undirected counterparts, can exhibit a unique superdiffusive behavior for intermediate values of coupling, where diffusion dynamics are even faster than the corresponding aggregated system. This unique superdiffusion regime only emerges when certain structural conditions are satisfied. We analytically and numerically uncover conditions driving the unique superdiffusion in directed multilayer networks. In addition, we propose a model to configure directed multilayer networks that achieves the unique superdiffusion with tunable magnitude.
The paper is organized as follows. Diffusive dynamics on multilayer networks with direction is described in the Model section 2. The section 3 of Results presents the conditions for diffusion regimes below the diffusivity in the corresponding aggregated system in section 3.1 and for the superdiffusion regime above the diffusivity in the aggregated system in section 3.2, followed by a model for the construction of a multilayer network with superdiffusion in section 3.3. Section 4 concludes the work.
2. Model
Multilayer networks consist of nodes interacting both within the same layer and across different layers via intralinks and interlinks which encodes multiple types of interactions. In this study, we focus on a particular type of multilayer networks called multiplex networks, characterized by layers consisting of the same set of nodes, but possibly different connectivity (layer topology); and layers interacting with each other only via counterpart node. The topological structure of the multiplex is described by the so-called supra-adjacency matrix , which is a block diagonal matrix. Each block is an N × N matrix, where N is the number of nodes per layer. Each diagonal block corresponds to the adjacency matrix of a layer (intra-layer connectivity, and therefore an entry aij = 1 in such a block corresponds to an interlayer link), while the off-diagonal blocks, given the definition of a multiplex network, are just N × N identity matrices, representing the inter-layer links between replica nodes across layers. Note that a directed multiplex, is a multiplex where at least one of the diagonal blocks is not symmetric.
Let Q be the corresponding Laplacian matrix, defined as Q = D − A where and denoting the out-going degree of a node i. We consider without loss of generality a multiplex network consisting of two directed layers and interconnected via links of weight p ⩾ 0, the corresponding Laplacian matrix Q can be written in a block form as
where Qi = Di − Ai , i = 1, 2, denotes the Laplacian matrix for the directed graph in each layer and pI encodes the weighted interconnections across layers. The above defined Laplacian matrix for multilayer networks with directed layers is non-symmetrical, which might lead to complex rather than real spectrum. As the Laplacian satisfies a zero row sum, i.e. Qu = 0 with u denoting the all one vector, value 0 is an eigenvalue with right eigenvector u and left eigenvector denoted as y. For a nonsymmetric matrix, left and right eigenvectors are in general not the same.
To analyze the effect of network directionality on dynamical processes, we consider the standard diffusive dynamics on multilayer networks with directed layers and determine the convergence rate to a fixed point solution. Let xi (t) denotes the state of a node i at time t. Changes of the state xi (t) with respect to time is governed by . The diffusive dynamics on a multilayer network can be written in a matrix form as
where ()T denotes transposition, and x(t) is the vector encoding the state of all nodes at time t. The solution of the above governing equation follows x(t)T = x(0)Te−Qt . The fixed point x*T at which is calculated employing the conservation law x(0)T u = x(∞)T u, where all one vector u is the right eigenvector corresponding to eigenvalue 0 of the Laplacian matrix Q. Let y denote the left eigenvector of Q corresponding to eigenvalue 0. Combining the conservation law x(0)T u = x*T u and yT Q = 0 yields the solution of fixed point
We show in appendix
2.1. General analysis for diffusive behavior
To analyze the convergence behavior of diffusive dynamics on multiplex networks with directed layers, we study the spectrum of the governing Laplacian matrix and compare with the integrated system. The characteristic polynomial for the Laplacian matrix Q in equation (1) can be calculated by, applying the Schur complement theorem on the block Laplacian matrix,
where . The eigen-pair of eigenvalue 2p and eigenvector holds for directed multilayer networks, which is previously found in undirected multilayered networks [12, 21]. The joint effect of the Laplacian matrices Q1 and Q2 for each layer, encoded in the matrix ΔQ, determines the deviation of the convergence rate of the whole system from that of the integrated multilayer.
Depending on relations between the diffusive rate of the system as a whole and that of the integrated system, we refer two complementary regimes, superdiffusive and non-superdiffusive, as follows: (i) if Re λ2(Q) of the overall system is greater than λ2((Q1 + Q2)/2) of the integrated system, we refer to as superdiffusive, (ii) otherwise as non-superdiffusive.
We mention that the superdiffusive regime defined in this work slightly differs from the definition in literature [15, 16], where superdiffusion implies a faster diffusion on the overall system than the diffusion on the fastest layer. Here, we mainly focus on diffusive behavior comparing the overall system and the correspondent integrated system, given the later serves as the asymptotic diffusion as intercoupling strength goes to infinity and, most importantly, serves as a theoretical upper limit for diffusion on undirected multiplex networks [as shown in the following equation (8)].
Under the special case of Q1 = Q2, solving equation (4) yields and therefore only the non-superdiffusive regime is exhibited. General cases of Q1 ≠ Q2 result in possibilities of both non-superdiffusive and superdiffusive regimes. Figure 1 exemplifies three typologies including (a) coupled directed and undirected layers, (b) coupled directed layers with the opposite direction, and (c) coupled directed layers with the same direction. Figure 1(a) and (c) show only non-superdiffusive regimes and figure 1(b) exhibits superdiffusion. Figures 2(a) and (c) show the non-superdiffusive and superdiffusive behavior on real-world multiplex networks, respectively.
Download figure:
Standard image High-resolution imageGiven the rich dynamical behavior of diffusion in directed multiplex, it is of paramount importance to identify the key structural properties underpinning each of the observed regimes. In this study, we mainly focus on identifying the underlying conditions driving the non-superdiffusive and superdiffusive regimes employing the principal submatrix approach and the Cauchy interlacing theorem [22] (or the Poincare separation theorem). In addition, we employ the eigenvalue property of a normal matrix, which satisfies XXT = XT X. For a normal matrix, the real parts of eigenvalues are the eigenvalues of the Hermitian part Re X = (X + XT)/2 of the matrix X.
The Laplacian matrix is similar to the following matrix in a transformed basis
which can be simplified as
The integrated Laplacian appears as a principal submatrix of the transformed Laplacian of the whole system. In addition, eigenvalues of the matrix are the same with eigenvalues of Q due to the similarity relation between Q and . Applying the Cauchy interlacing theorem on the transformed matrix and the integrated system as a principal submatrix, undirected multilayer networks always satisfy the following interlacing relation
Hence, there never occurs a superdiffusion in undirected multilayer networks, regardless of the strength of intercoupling. Equation (8) serves as a theoretical limit and implies that although multilayer structure of undirected layers enhances the less diffusive layer, the diffusive rate is upper bounded by the integrated system.
3. Results
3.1. Conditions for the non-superdiffusive regime
For multilayer networks with directed layers, the conditions for non-superdiffusive and superdiffusive regimes are translated into conditions when the Cauchy interlacing theorem between a non-symmetric matrix and its principle submatrix is satisfied. Starting from the special case of coupled identical layers, it follows
which implies a non-superdiffusive regime for directed multilayer networks with identical directed layers for . When the transformed Laplacian and all the principal matrices including the integrated matrix (Q2 + Q1)/2 are normal, the interlacing is also satisfied. Because for a principally normal matrix, all eigenvalues of matrices Q and (Q2 + Q1)/2 lie on the same complex line with an angle θ in the complex plane [23, 24]. For a principally normal matrix, the partial order of generalized interlacing on a complex plain is obtained:
As the real part of eigenvalue reads and θ is the same for all eigenvalues, it implies an interlacing between real parts of eigenvalues and accordingly a non-superdiffusive regime for multilayer networks with principally normal Laplacian matrices.
When the requirement of normality of all principal submatrices is relaxed to the normality of a single principal submatrix, generalized interlacing of lexicographic order can be applied to and (Q2 + Q1)/2. For a normal Laplacian matrix and a normal principal submatrix , we have that
where ⩽θ represents the lexicographic order [25] characterized by the positive cone H := {a + bi: a > 0 or a = 0 and b > 0}. Equation (11) means that lies in a positive cone, which implies . Therefore, directed multilayer networks with normal Laplacian matrix and normal principal submatrix exhibit only the non-superdiffusive regime.
3.2. Conditions for the superdiffusive regime
Diffusion on undirected multilayer never exceeds the diffusion of integrated part. However, certain multilayer networks with directed layers break the constraint and exhibit a unique superdiffusion. In this subsection, we analyze conditions for the occurrence of such superdiffusion. For the generalized interlacing theorem to hold, it requires both the whole system and the integrated system to be normal or simultaneously close to normal. When the condition is relaxed such that the integrated system is normal or close to normal, while the whole system deviates from normality, it might occur with superdiffusion. We provide analytical evidences by firstly relating the real part of eigenvalues and eigenvalues of the Hermitian part of the original matrix, which follows
where denotes the Hermitian part of matrix . Because and for a normal subgraph, we have that . The equality, , is achieved if the integrated system is normal.
Secondly, we analyze the superdiffusion condition by relating eigenvalues of the Hermitian part of the integrated system and Hermitian part of the whole system. On one hand, observing that the Hermitian part of the integrated system coincides with the principal submatrix of the Hermitian part of the whole system, we have that due to the Cauchy interlacing theorem for Hermitian matrices. On the other hand, due to Ky Fan majorization [26] theorem . Therefore, if the difference is bounded, it leads to .
A superdiffusion is thus established
if (i) the integrated system is or close to normal and (ii) the structure difference of coupled layers Re Q2 − Re Q1 is negligibly small.
The equality of is reached for a multilayer network consisting of a directed graph coupled with its reversed graph, . In this case, it follows Re Q2 = Re Q1 and there exists a superdiffusion of .
It was reported that the superdiffusion occurs when a fully connected network coupled with a network with a certain level of directionality, quantified by a metric called network directionality index [16]. Here, we prove in appendix
Download figure:
Standard image High-resolution imageThough the results are demonstrated for two-layer multiplex networks, numerical results on multiplex networks with a larger number of layers show analogous superdiffusive and non-superdiffusive behaviors, also depending on the nonnormality and NDI conditions of the structure of each layer. However, in those cases it is far more challenging to provide a complete mathematical proof due to the difficulty in isolating the Laplacian of each layer from the block Laplacian.
3.3. Formulation of multilayer networks with superdiffusion
To interpret the normality conditions for superdiffusion, we propose a model to construct multiplayer networks exhibiting superdiffusion with a tunable level of magnitude. When the coupled layers have identical Hermitian part of Laplacian, the minimization of the normality level of the integrated structure is translated into
with proof in appendix
We decompose the construction model into two parts: (i) constructing a graph G2 from the replication of graph G1 but after reversing the direction of directed links; (ii) preserving the out-degree of each node in graph G1 such that graph Laplacian Q2 has the same diagonal elements as Q1. To ensure the second smallest real part of the Laplacian eigenvalue to be nonzero, we assume a single requirement of graph G1 to be a strongly connected directed graph. To this end, we propose to reverse links in a cycle fashion, i.e. simultaneously reversing the direction of all links involved in a cycle. In addition, the number of links reversed in a cycle fashion is closely associated with the magnitude of superdiffusion. For two directed graphs G1 and G2, we define a variable q as direction overlap, the fraction of links having the same direction and calculated by or in a matrix form as
The denominator normalizes the direction overlap, in which q = 0 corresponds to and q = 1 corresponds to Q1 = Q2. The magnitude of superdiffusion can thus be tuned by reversing different fraction of links, parameterized by 1 − p.
Figure 4 shows diffusive behaviors on constructed multiplex networks consisting of (a) a circulant directed graph and the duplicate digraph with 1 − q reversed links and (b) a real-world genetic and protein interactions network of the Epstein–Barr virus [29, 30] and the duplicate digraph with 1 − q reversed links. The coupled digraph and its duplicate without link reversing (q = 1) displays a non-superdiffusive behavior. For 0 ⩽ q < 1, the constructed multiplex built upon both synthetic and real-world directed graph shows superdiffusion regimes. In addition, a higher fraction of reversed links (a smaller q) results in a higher magnitude of superdiffusion.
Download figure:
Standard image High-resolution image4. Conclusions
In this paper, we study the diffusive dynamics on multiplex networks consisting of at least one directed layers. Though multilayer structure of undirected layers enhances diffusion, it is restricted to a theoretical limit by the aggregation of each layer. We show that ubiquitous property of directionality in each layer could break this limit and achieve a unique superdiffusion regime, wherein diffusion is even faster than the corresponding aggregated system. We analytically and numerically uncover that the unique superdiffusion is driven by the directionality and the underlying structure of layers rather than how strongly layers are coupled. In particular, diffusive behaviors are associated with the non-normality level of the integrated and the overall system: when both the integrated and the overall system are normal, it is assured that the multiplex exhibits only a non-superdiffusive regime; when the integrated system is normal or close to normal while the whole system is deviated from normal, it exhibits the unique superdiffusive regime. Additionally, we provide a model to construct multiplex networks, achieving superdiffusion with a tunable level of magnitude. We show that directionality induces a unique superdiffusion, a regime not existed in the counterpart of undirected multilayer, and suggest the key role of network directionality in analyzing diffusive dynamics on real-world systems which oftentimes are structurally directed and multilayered.
Acknowledgments
XW acknowledges the project 62003156 supported by NSFC and project ‛PCL Future Greater-Bay Area Network Facilities for Large-scale Experiments and Applications (LZC0019)'. AT acknowledges partial support from NSF Grants EAR-181190 and the UK Research and Innovation Global Challenges Research Fund Living Deltas Hub Grant NES0089261. YM acknowledges partial support from the Government of Aragón, Spain through a grant to the group FENOL (E36-20R), by MINECO and FEDER funds (Grant FIS2017-87519-P) and by Intesa Sanpaolo Innovation Center. The funders had no role in study design, data collection and analysis, or preparation of the manuscript.
Data availability statement
All data that support the findings of this study are included within the article (and any supplementary files).
Appendix A.: Convergence to the fixed point
The convergence to the fixed point is characterized by . The rate of convergence is regulated by . The norm ∥Δx(t)T∥ of the difference vector is bounded by
If one mainly concerns with the convergence behavior for the decrease of ∥Δx(t)∥, the following holds for a bounded operator Q in a Hilbert space
where λmin is the minimum eigenvalue of the Laplacian Q. For a connected directed graph, λmin equals to zero which means a guaranteed convergence to the steady state x* calculated by equation (3).
Appendix B.: Proof that network directionality index is normalized
In the appendix, we prove that the metric quantifying the level of directionality is normalized to 1. Rewrite the definition [16] of NDI as
or equivalently,
where Δdij = |di→j − dj→i |.
Theorem 1. For a directed cycle network consisting of N nodes and N directed links in a clockwise or counterclockwise direction, the NDI can be simplified as
where is the average path asymmetry and is the average path length starting from an arbitrary node i and arriving at each of the remaining N − 1 nodes.
Proof. For a directed circulant graph of N nodes and N directed links in a clockwise direction, the shortest directed path from node i to node j and back to i forms a closed cycle of length N, regardless of choices of pairs of nodes (i ≠ j). Thus, we have that
Applying the symmetry of Δdij = Δdji into the numerator of (B.2), we have that
For a directed cycle consisting of N nodes and N directed links in a clockwise direction, the sum is the same for each node i and we arrive at
Substituting (B.4) and (B.6) into the definition of NDI establishes theorem 1.(figure B1) □
Download figure:
Standard image High-resolution imageTheorem 2. Given a directed cycle consisting of N nodes and N directed links in a clockwise direction, adding a single or multiple directed links between any pair of nodes i and j generates shortcuts either in forward (i → j) or backward (j → i) direction between that pair of nodes and thus forms k (k ⩾ 1) sub-cycles with each consisting of ck (ck ⩽ N) nodes and ck links. The NDI' after adding directed links is smaller than or equal to the NDI of the original directed cycle.
Proof. Adding a directed link connecting node j to i forms a sub-cycle k consisting of ck nodes and ck directed links in a clockwise direction, as shown in figure B2. For a pair of nodes i and j in the sub-cycle k, the difference of path asymmetry Δdij before and after adding directed links reads
and the difference of di→j + dj→i before and after link addition reads
Summing up all the node pairs starting from node i to the remaining N − 1 nodes yields
where m is a column vector of length N with element if node j belongs to a sub-cycle of ck nodes and ck directed links in a clockwise direction, which can be further simplified as
It has been shown [16] that a directed cycle of N nodes has NDI < 1. Subtracting the same number both in the numerator and denominator of (B.2) does not increase the NDI of the original cycle consisting of N nodes. □
Since a directed cycle of N nodes has NDI ⩽ 1 (theorem 1) and adding directed links does not increase the NDI (theorem 2), we prove that NDI ⩽ 1.
Download figure:
Standard image High-resolution imageAppendix C.: Proof of equation (14)
Given the equality of the Hermitian part of the coupled directed layers, we show that the close to normal condition of the integrated system is translated to the minimization of equation (14) in the main text. The definition of normality of the integrated system reads , which can be rewritten as
Left multiplying Q1 of the equality of Re Q1 = Re Q2 yields
Additionally, right multiplying Q1 yields
Subtracting equation (C.3) from equation (C.2) results in
Analogously, left and right multiplying Q2 establishes
Substituting the equations (C.4)–(C.5) into the definition of normality leads to
from which we have that is a skew symmetric matrix and the real part of all eigenvalues are 0. Minimizing the normality level of the integrated system can be quantified and analyzed by the minimization of equation (14).