Contents
Marchenko–Pastur distribution
In the mathematical theory of random matrices, the Marchenko–Pastur distribution, or Marchenko–Pastur law, describes the asymptotic behavior of singular values of large rectangular random matrices. The theorem is named after soviet mathematicians Volodymyr Marchenko and Leonid Pastur who proved this result in 1967. If X denotes a m\times n random matrix whose entries are independent identically distributed random variables with mean 0 and variance, let and let be the eigenvalues of Y_n (viewed as random variables). Finally, consider the random measure counting the number of eigenvalues in the subset A included in \mathbb{R}. Theorem. Assume that so that the ratio. Then (in weak* topology in distribution), where and with The Marchenko–Pastur law also arises as the free Poisson law in free probability theory, having rate 1/\lambda and jump size \sigma^2.
Moments
For each k \geq 1, its k-th moment is
Some transforms of this law
The Stieltjes transform is given by for complex numbers z of positive imaginary part, where the complex square root is also taken to have positive imaginary part. The Stieltjes transform can be repackaged in the form of the R-transform, which is given by The S-transform is given by For the case of \sigma=1, the \eta-transform is given by where X satisfies the Marchenko-Pastur law. where For exact analyis of high dimensional regression in the proportional asymptotic regime, a convenient form is often which simplifies to The following functions and, where X satisfies the Marchenko-Pastur law, show up in the limiting Bias and Variance respectively, of ridge regression and other regularized linear regression problems. One can show that and V(u)= T'(u).
Application to correlation matrices
For the special case of correlation matrices, we know that \sigma^2=1 and \lambda=m/n. This bounds the probability mass over the interval defined by Since this distribution describes the spectrum of random matrices with mean 0, the eigenvalues of correlation matrices that fall inside of the aforementioned interval could be considered spurious or noise. For instance, obtaining a correlation matrix of 10 stock returns calculated over a 252 trading days period would render. Thus, out of 10 eigenvalues of said correlation matrix, only the values higher than 1.43 would be considered significantly different from random.
This article is derived from Wikipedia and licensed under CC BY-SA 4.0. View the original article.
Wikipedia® is a registered trademark of the
Wikimedia Foundation, Inc.
Bliptext is not
affiliated with or endorsed by Wikipedia or the
Wikimedia Foundation.