Positive definite matrices and the S-divergence

Sra, Suvrit

doi:10.1090/proc/12953

Positive definite matrices and the S-divergence
HTML articles powered by AMS MathViewer

by Suvrit Sra PDF

Proc. Amer. Math. Soc. 144 (2016), 2787-2797 Request permission

Abstract:

Hermitian positive definite (hpd) matrices form a self-dual convex cone whose interior is a Riemannian manifold of nonpositive curvature. The manifold view comes with a natural distance function but the conic view does not. Thus, drawing motivation from convex optimization we introduce the S-divergence, a distance-like function on the cone of hpd matrices. We study basic properties of the S-divergence and explore its connections to the Riemannian distance. In particular, we show that (i) its square-root is a distance, and (ii) it exhibits numerous nonpositive-curvature-like properties.

References

T. Ando, Concavity of certain maps on positive definite matrices and applications to Hadamard products, Linear Algebra Appl. 26 (1979), 203–241. MR 535686, DOI 10.1016/0024-3795(79)90179-4
Arindam Banerjee, Srujana Merugu, Inderjit Dhillon, and Joydeep Ghosh, Clustering with Bregman divergences, Proceedings of the Fourth SIAM International Conference on Data Mining, SIAM, Philadelphia, PA, 2004, pp. 234–245. MR 2388444
Christian Berg, Jens Peter Reus Christensen, and Paul Ressel, Harmonic analysis on semigroups, Graduate Texts in Mathematics, vol. 100, Springer-Verlag, New York, 1984. Theory of positive definite and related functions. MR 747302, DOI 10.1007/978-1-4612-1128-0
K. V. Bhagwat and R. Subramanian, Inequalities between means of positive operators, Math. Proc. Cambridge Philos. Soc. 83 (1978), no. 3, 393–401. MR 467372, DOI 10.1017/S0305004100054670
Rajendra Bhatia, Matrix analysis, Graduate Texts in Mathematics, vol. 169, Springer-Verlag, New York, 1997. MR 1477662, DOI 10.1007/978-1-4612-0653-8
Rajendra Bhatia, Positive definite matrices, Princeton Series in Applied Mathematics, Princeton University Press, Princeton, NJ, 2007. MR 2284176
Rajendra Bhatia and John Holbrook, Riemannian geometry and matrix geometric means, Linear Algebra Appl. 413 (2006), no. 2-3, 594–618. MR 2198952, DOI 10.1016/j.laa.2005.08.025
A. Bhattacharyya, On a measure of divergence between two statistical populations defined by their probability distributions, Bull. Calcutta Math. Soc. 35 (1943), 99–109. MR 10358
Philippe Bougerol, Kalman filtering with random coefficients and contractions, SIAM J. Control Optim. 31 (1993), no. 4, 942–959. MR 1227540, DOI 10.1137/0331041
Stephen Boyd and Lieven Vandenberghe, Convex optimization, Cambridge University Press, Cambridge, 2004. MR 2061575, DOI 10.1017/CBO9780511804441
Martin R. Bridson and André Haefliger, Metric spaces of non-positive curvature, Grundlehren der mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], vol. 319, Springer-Verlag, Berlin, 1999. MR 1744486, DOI 10.1007/978-3-662-12494-9
Zeineb Chebbi and Maher Moakher, Means of Hermitian positive-definite matrices based on the log-determinant $\alpha$-divergence function, Linear Algebra Appl. 436 (2012), no. 7, 1872–1889. MR 2889964, DOI 10.1016/j.laa.2011.12.003
Pengwen Chen, Yunmei Chen, and Murali Rao, Metrics defined by Bregman divergences, Commun. Math. Sci. 6 (2008), no. 4, 915–926. MR 2511699, DOI 10.4310/CMS.2008.v6.n4.a6
A. Cherian, S. Sra, A. Banerjee, and N. Papanikolopoulos, Efficient Similarity Search for Covariance Matrices via the Jensen-Bregman LogDet Divergence, Int. Conf. Computer Vision (ICCV), Nov. 2011, pp. 2399–2406.
Thomas M. Cover and Joy A. Thomas, Elements of information theory, Wiley Series in Telecommunications, John Wiley & Sons, Inc., New York, 1991. A Wiley-Interscience Publication. MR 1122806, DOI 10.1002/0471200611
Miroslav Fiedler, Bounds for the determinant of the sum of hermitian matrices, Proc. Amer. Math. Soc. 30 (1971), 27–31. MR 286814, DOI 10.1090/S0002-9939-1971-0286814-1
S. G. Gindikin, Invariant generalized functions in homogeneous domains, Funkcional. Anal. i Priložen. 9 (1975), no. 1, 56–58 (Russian). MR 0377423
Fumio Kubo and Tsuyoshi Ando, Means of positive linear operators, Math. Ann. 246 (1979/80), no. 3, 205–224. MR 563399, DOI 10.1007/BF01371042
Hosoo Lee and Yongdo Lim, Invariant metrics, contractions and nonlinear matrix equations, Nonlinearity 21 (2008), no. 4, 857–878. MR 2399829, DOI 10.1088/0951-7715/21/4/011
Bas Lemmens and Roger Nussbaum, Nonlinear Perron-Frobenius theory, Cambridge Tracts in Mathematics, vol. 189, Cambridge University Press, Cambridge, 2012. MR 2953648, DOI 10.1017/CBO9781139026079
Yurii Nesterov and Arkadii Nemirovskii, Interior-point polynomial algorithms in convex programming, SIAM Studies in Applied Mathematics, vol. 13, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 1994. MR 1258086, DOI 10.1137/1.9781611970791
S. Sra, Positive definite matrices and the S-Divergence, arXiv:1110.1773 (2011).
S. Sra, A new metric on the manifold of kernel matrices with application to matrix geometric means, Adv. Neural Inf. Proc. Syst., December 2012.