Sparse Quadratic Approximation for Graph Learning
- Dimosthenis Pasadakis ,
- Matthias Bollhöfer ,
- Olaf Schenk
Abstract
Learning graphs represented by M-matrices via an l1-regularized Gaussian
maximum-likelihood method is a popular approach, but also one that poses
computational challenges for large scale datasets. Recently proposed
methods cast this problem as a constrained optimization variant of
precision matrix estimation. In this paper, we build on a
state-of-the-art sparse precision matrix estimation method and introduce
two algorithms that learn M-matrices, that can be subsequently used for
the estimation of graph Laplacian matrices. In the first one, we propose
an unconstrained method that follows a post processing approach in order
to learn an M-matrix, and in the second one, we implement a constrained
approach based on sequential quadratic programming. We also demonstrate
the effectiveness, accuracy, and performance of both algorithms. Our
numerical examples and comparative results with modern open-source
packages reveal that the proposed methods can accelerate the learning of
graphs by up to 3 orders of magnitude, while accurately retrieving the
latent graphical structure of the data. Furthermore, we conduct large
scale case studies for the clustering of COVID-19 daily cases and the
classification of image datasets to highlight the applicability in
real-world scenarios.01 Sep 2023Published in IEEE Transactions on Pattern Analysis and Machine Intelligence volume 45 issue 9 on pages 11256-11269. 10.1109/TPAMI.2023.3263969