Streamlined Variational Inference for Linear Mixed Models with Crossed Random Effects
Di Credico, Gioia
Wand, Matt P.
We derive streamlined mean ﬁeld variational Bayes algorithms for ﬁtting linear mixed models with crossed random effects. In the most general situation, where the dimensions of the crossed groups are arbitrarily large, streamlining is hindered by lack of sparseness in the underlying least squares system. Because of this fact we also consider a hierarchy of relaxations of the mean ﬁeld product restriction. The least stringent product restriction delivers a high degree of inferential accuracy. However, this accuracy must be mitigated against its higher storage and computing demands. Faster sparse storage and computing alternatives are also provided, but come with the price of diminished inferential accu-racy. This article provides full algorithmic details of three variational inference strategies, presents detailed empirical results on their pros and cons and, thus, guides the users on their choice of variational inference approach depending on the problem size and computing resources.
DEAMS Research Paper Series, 2020, 2
EUT Edizioni Università di Trieste
Marianne Menictas, Gioia Di Credico, Matt P. Wand, "Streamlined Variational Inference for Linear Mixed Models with Crossed Random Effects", Trieste, EUT Edizioni Università di Trieste, 2020
Attribution-NonCommercial-NoDerivatives 4.0 Internazionale