Abstract

In this paper, we consider a linear mixed effect model (LMM) assuming that the random effect and error terms follow an unrestricted skew-normal generalized-hyperbolic (SUNGH) distribution. The SUNGH is a broad class of flexible distributions that includes various other well-known asymmetric and symmetric families and provides a high degree of flexibility for the modeling of complex multivariate data with different directions and degrees of asymmetry, kurtosis and heavy tails. The choice of the best fitting distribution can proceed quite naturally through parameter estimation or by placing constraints on specific parameters and assessing using model choice criteria. We estimate parameters of the LMM using a Bayesian approach and examine the performance of the proposed methodology on simulated and real data from a clinical trial on treatment options for schizophrenia (Lapierre et al. Acta Psychiatric Scandinavica 82:72-76, 1990; Ho and Lin Biom J 52(4):449-469, 2010).