Connectivity-Driven Brain Parcellation via Consensus Clustering

Connectivity-Driven Brain Parcellation via Consensus Clustering

Anvar Kurmukov The Institute for Information Transmission ProblemsNational Research University Higher School of Economics    Ayagoz Mussabayeva The Institute for Information Transmission Problems    Yulia Denisova The Institute for Information Transmission Problems    Daniel Moyer University of Southern California    Boris Gutman Illinois Institute of Technology The Institute for Information Transmission Problems

We present two related methods for deriving connectivity-based brain atlases from individual connectomes. The proposed methods exploit a previously proposed dense connectivity representation, termed continuous connectivity, by first performing graph-based hierarchical clustering of individual brains, and subsequently aggregating the individual parcellations into a consensus parcellation. The search for consensus minimizes the sum of cluster membership distances, effectively estimating a pseudo-Karcher mean of individual parcellations. We assess the quality of our parcellations using (1) Kullback-Liebler and Jensen-Shannon divergence with respect to the dense connectome representation, (2) inter-hemispheric symmetry, and (3) performance of the simplified connectome in a biological sex classification task. We find that the parcellation based-atlas computed using a greedy search at a hierarchical depth 3 outperforms all other parcellation-based atlases as well as the standard Dessikan-Killiany anatomical atlas in all three assessments.

1 Introduction

The ability to quantify how the human brain is interconnected in vivo has opened the door to a number of possible analyses. In nearly all of these, brain parcellation plays a crucial role. Variations in parcellation significantly impact connectome reproducibility, derived graph-theoretical measures, and the relevance of connectome measures with respect to biological questions of interest [16]. A natural approach is then to use individual densely sampled connectomes to drive the parcellation directly, leading to a more compact, connectivity-aware set of brain regions and resulting graph, as done in e.g. [10]. A comprehensive review of parcellation methods and their effects on the derived connectome quality is given in [17]. Because individual connectivity data is at once very informative and highly redundant, there is a great flexibility in how parcels can be derived from dense, highly resolute graphs. It is possible for example to derive (1) a unified population-based atlas, (2) individual-level parcellations with cross-subject label mapping, or (3) individual parcellations with no inter-subject label correspondence. While the first approach is appealing for its simplicity and ease of interpretation, the second and third may enable the researcher to reveal some individual aspect of the connectome that is lost in the aggregate atlas.

In this work, we attempt to bridge these three approaches by first constructing maximally flexible hierarchical parcellations, and then finding a unifying set of labels and parcels to maximize individual agreement. We use the a continuous representation of a brain connectivity [8] as our initial dense connectome representation. Continuous connectivity is a parcellation-free representation of tractography-based, or “structural” connectomes that is based on the Poisson point process. Once individual parcellations are computed, we obtain a group-wise parcellation using partition ensemble algorithm. We access quality of the resulting parcellations in three ways. (1) We use the continuous connectome framework to compare parcellation-approximate and exact edge distribution functions. (2) We compare perfomance of the resulting graphs on a gender classification task. (3) We also show that without any explicit knowledge of brain geometry and based solely on graph connectivity we obtain comparatively symmetric parcellations.

2 Methods

2.1 Continuous Connectome

The continuous connectome model (ConCon) treats each tract as an observation of an inhomogeneous symmetric Poisson point process with the intensity function given by


where denote union of two disjoint toplogically spherical brain hemispheres, representing cortical white matter boundaries. In practice, ConCon uses cortical mesh vertices as nodes of connectivity graph. From such a representation, a “discrete” connectivity graph could be computed from any particular cortical parcellation . We follow definitions from [8] and call a parcellation of if such that , and is the number of parcels (ROIs). Edges between regions and can then be computed by integration of the intensity function:


Due to properties of the Poisson Process, is the expectation of the number of observed tracts between and . In the context of connectomics, this is the expected edge strength.

2.2 Graph Clustering

Once we obtain all individual continuous connectomes, we partition each independently into a set of disjoint communities. For graph clustering we use the Louvain modularity algorithm [1], as it has shown good results in multiple neuroimaging studies [9], [12], [5], [7]. This algorithm consist of two steps. The first step combines locally connected nodes into communities, while the second step builds new meta graph. The nodes of the meta-graph are communities from the previous step, and the edges are defined as the sum of all inter-community connections of the new nodes. The algorithm in [1] cycles over these steps iteratively, converging when further node clustering leads to no increase in modularity.

Figure 1: Adjacency matrix of a sample continuous connectome. Rows and columns are reordered according to partition of the third hierarchical level. Boxes of different color represents clusters of different hierarchical levels. clusters are obtained first, next we reapply clustering on each detected cluster and obtain . This is repeated once more to obtain

We follow the hierarchical brain concept [7], repeating the clustering procedure iteratively. After the initial parcellation, we further cluster each individual parcel as an independent graph. In this work, we repeat the process three times. For each (’th) continuous connectome this procedure yields a three-level hierarchically embedded partition: , (see Figure 1).

2.3 Consensus clustering

In order to obtain a unified parcellation for all subjects, we use consensus clustering. The concept was developed for aggregating multiple partitions of the same data into a single partition. We define the average partition over all individual partitions as:


where is used to denoted desirable average partition, is a number of averaged partitions, is a distance measure between two partitions and we want to minimize average distance from to all given partitions . All partitions are represented by a vector of length , where is a number of clustered objects (vertices of a graph in our case). It contains values from up to , where is a number of clusters (parcels). This task is generally NP complete [14], but there are many approximate algorithms. We use two approaches: Cluster-based Similarity Partitioning Algorithm (cspa) [11] and greedy algorithm from [2].

CSPA defines a similarity between data points based on co-occurrence in a same cluster across different partitions, and then partitions a graph induced by this similarity. Specifically, given multiple partitions of a data points . One can define similarity between points as follow:


Here is Kroneker delta. Thus is just number of partitions in which points and were in the same cluster. Next we build a graph, with nodes correspond to data points and edge between node and is equal to . We the partition this graph into communities using some clustering algorithm and the resulting partition is our clustering consensus partition.

Another way to find such average clustering is to optimize loss function given by Equation 3.

The authors of [2] propose a greedy approach (Hard Ensemble - HE). Given multiple partitions it combines them iteratively, first it finds average of , next average of and and so on. As a measure of distance the authors take the average square distance between membership functions:


Exclusively for this definition we use another way to encode object’s memberships: is a matrix of size (number of objects times number of clusters)


In Equation 5 and are rows of memberships matrices and respectively. They correspond to membership vector of the object. Since we are looking for disjoint clusters, only a single element of such row vector is equal to . This representation is defined up to any column permutation of matrix , thus the optimization procedure is done subject to all possible column permutations.

2.4 Comparison metrics

Once we find individual partitions and combine them into an average partition, we want to access their quality. We use two different approaches.

First, we compare representation strength of different parcellations by measuring distance between original and its piece-wise approximation given by:


where and . Natural way to compare two statistical distributions is to measure distance between their probability density functions, we will use Kullback-Leibler divergence [4]. For two probability distributions with densities and the KL divergence is:


It takes values close to 0 if two distributions are equal almost everywhere. Similar but symmetrized version of KL divergence is Jensen-Shannon divergence [6]. Again for two probability distributions with densities and it is given by:


where .

Second, we compare performance of different parcellations on a gender classification task. We use Logistic Regression model with (small) regularization on a vectors of edge weights (the upper triangle of adjacency matrix excluding diagonal). Classification perfomance is measured in terms of ROC AUC score, which is typical for binary classification tasks.

Finally, in order to quantify goodness of consensus clustering and access hemisphere symmetry we use Adjusted Mutual Information [15]. It measures similarity between two partitions, with value 1 corresponds to identical partitions and values close to zero for partitions that are very different.

Using AMI we access ensemble goodness (how good clustering ensemble algorithm combines multiple partitions) using modified 3:


We compute parcellation symmetry by comparing hemisphere parcels (labels):


3 Experiments

3.1 Data description

We use construct continuous connetocmes of 400 subjects from the Human Connectome Project S900 release [13] following [8]. We use an icosahedral spehrical sampling, at a resolution of mesh vertices per hemisphere. We used Dipy’s implementation of constrained spherical deconvolution (CSD) to perform probabilistic tractography. Prior to clustering, we exclude all mesh vertices that were labeled by FreeSurfer as corpus callosum or cerebellum.

3.2 Experimental pipeline

Our experiments are summarized as follows:

  1. For each subject we reconstruct its Continuous Connectome.

  2. For each Continuous Connectome we iteratively run Louvain clustering algorithm, as described above. Subgraphs of having less then 1 percent of original graph vertices were not divided.

  3. Next we aggregate individual subject partitions and obtain consensus clustering. Aggregation was done over 400 HCP subjects. Further, after finding the optimal parcellation, we obtain two parcellations based on two disjoint sets of 200 HCP subjects in order to compute reproducibility.

  4. We aggregate partitions of the same level (I-II-III) using CSPA and HE.

  5. We compare obtained partitions between themselves and with FreeSurfer’s Desikan-Killiani parcellation using Kullback-Leibler and Jensen-Shannon divergence. We compute goodness of an ensemble and parcellation symmetry using AMI.

  6. We compare performance of simplified connectomes on a binary classification task using Logistic Regression with penalty. Classification results are measured in terms of ROC AUC score, with averaging over cross-validation folds.

cspa cspa cspa HE HE HE DKT
Gender Classification
Hemisphere symmetry
Ensemble goodness
Number of ROIs 5 7 8 7 30 83 68
Table 1: All results are rounded to 2 significant digits. Where it possible results are reported with standard deviation. Best result in each row is colored. KL, JS divergences, lower is better; binary Gender Classification was measured in terms of ROC AUC score, higher - better; Ensemble goodness and Hemisphere symmetry were measured using AMI, Ensemble goodness is an average AMI between consensus partition and all individual partitions, higher - better.
Figure 2: Left column: Desikan-Killiany parcellation. Right column: HE parcellation. Lateral and Medial views, left hemisphere.

3.3 Results

Table 1 represent all comparison results. First we can see that CSPA algorithm failed to find good clustering ensemble which result in poor classification performance and high KL and JS divergences. Greedy algorithm performed on on the other hand outperforms standard Desikan atlas accross all comparison metrics (except number of parcels, 68 versus 83). Surprisingly, greedy ensemble of second level partition () performs comparatively with Desikan , despite having twice as lower number of parcels (30 versus 68).

Another interesting property that we get automatically is parcellation symmetry. Our clustering algorithm known nothing about brain topology (all information was contained in graph connectivity), still reconstruct parcellations which are highly symmetrical. For standard Desikan atlas hemisphere symmetry is , and for our best parcellation this value even higher (), and still remains quite high for second level partition ().

Finally we check if our best ensemble parcellation, which combines individual partitions is stable. We split subjects into groups of subjects and independently combine their partitions. We compare resulting parcellations: and between themselves and with original (which is an ensemble of all subjects) again using Adjusted Mutual Information. Both and shows AMI value greater than ( and respectively) when compare with , they also highly similar between themselves.

4 Conclusion

We have presented an approach for generating unified connectivity-based human brain atlases bases on consensus clustering. The method is based on finding a pseudo average over the set of individual partitions. Our approach outperforms standard a anatomical parcellation on several important metrics, including agreement with dense connectomes, improved relevance to biological data, and even improved symmetry. Because our approach is entirely data driven an requires no agreement between individual parcellation labels, it combines both the flexibility of individual parcellations and the interpretability of simple unified atlases.


  • [1] Blondel, Vincent D., et al. ”Fast unfolding of communities in large networks.” Journal of statistical mechanics: theory and experiment 2008.10 (2008): P10008.
  • [2] Dimitriadou, Evgenia, Andreas Weingessel, and Kurt Hornik. ”A combination scheme for fuzzy clustering.” International Journal of Pattern Recognition and Artificial Intelligence 16.07 (2002): 901-912.
  • [3] Hubert, Lawrence, and Phipps Arabie. ”Comparing partitions.” Journal of classification 2.1 (1985): 193-218.
  • [4] Kullback, Solomon, and Richard A. Leibler. ”On information and sufficiency.” The annals of mathematical statistics 22.1 (1951): 79-86.
  • [5] Kurmukov, Anvar, et al. ”Classifying Phenotypes Based on the Community Structure of Human Brain Networks.” Graphs in Biomedical Image Analysis, Computational Anatomy and Imaging Genetics. Springer, Cham, 2017. 3-11.
  • [6] Lin, J. (1991) Divergence measures based on Shannon entropy. IEEE Transactions on Information Theory, 37, 14, 145 – 151.
  • [7] Meunier, David, Renaud Lambiotte, and Edward T. Bullmore. ”Modular and hierarchically modular organization of brain networks.” Frontiers in neuroscience 4 (2010): 200.
  • [8] Moyer, Daniel, et al. ”Continuous representations of brain connectivity using spatial point processes.” Medical image analysis 41 (2017): 32-39.
  • [9] Nicolini, Carlo, Cécile Bordier, and Angelo Bifone. ”Community detection in weighted brain connectivity networks beyond the resolution limit.” Neuroimage 146 (2017): 28-39.
  • [10] Parisot, Sarah, et al. ”GraMPa: Graph-based multi-modal parcellation of the cortex using fusion moves.” International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, 2016.
  • [11] Strehl, Alexander, and Joydeep Ghosh. ”Cluster ensembles—a knowledge reuse framework for combining multiple partitions.” Journal of machine learning research 3.Dec (2002): 583-617.
  • [12] Taylor, Peter N., Yujiang Wang, and Marcus Kaiser. ”Within brain area tractography suggests local modularity using high resolution connectomics.” Scientific reports 7 (2017): 39859.
  • [13] Van Essen, David C., et al. ”The WU-Minn human connectome project: an overview.” Neuroimage 80 (2013): 62-79.
  • [14] Vega-Pons, Sandro, and José Ruiz-Shulcloper. ”A survey of clustering ensemble algorithms.” International Journal of Pattern Recognition and Artificial Intelligence 25.03 (2011): 337-372.
  • [15] Vinh, Nguyen Xuan, Julien Epps, and James Bailey. ”Information theoretic measures for clusterings comparison: Variants, properties, normalization and correction for chance.” Journal of Machine Learning Research 11.Oct (2010): 2837-2854.
  • [16] Petrov, D., Ivanov, A., and Faskowitz, J., Gutman, B., Moyer, D., Villalon, J., Jahanshad, N., Thompson, P., ”Evaluating 35 Methods to Generate Structural Connectomes Using Pairwise Classification”, ArXiv e-prints, eprint = 1706.06031, June (2017)
  • [17] Salim Arslan, Sofia Ira Ktena, Antonios Makropoulos, Emma C. Robinson, Daniel Rueckert, Sarah Parisot, Human brain mapping: A systematic comparison of parcellation methods for the human cerebral cortex, NeuroImage, (170) 5-30, (2018)
Comments 0
Request Comment
You are adding the first comment!
How to quickly get a good reply:
  • Give credit where it’s due by listing out the positive aspects of a paper before getting into which changes should be made.
  • Be specific in your critique, and provide supporting evidence with appropriate references to substantiate general statements.
  • Your comment should inspire ideas to flow and help the author improves the paper.

The better we are at sharing our knowledge with each other, the faster we move forward.
The feedback must be of minimum 40 characters and the title a minimum of 5 characters
Add comment
Loading ...
This is a comment super asjknd jkasnjk adsnkj
The feedback must be of minumum 40 characters
The feedback must be of minumum 40 characters

You are asking your first question!
How to quickly get a good answer:
  • Keep your question short and to the point
  • Check for grammar or spelling errors.
  • Phrase it like a question
Test description