Finding the distribution of a random variable made of a random vector











up vote
0
down vote

favorite












Firstly let's explain some signs used later:





  1. $y_1, ldots, y_2$ are random variables,


  2. $mathbb{E}(y_i) = mu_i$,


  3. $text{Cov}(y_i, y_j) = sigma_{ij}$,


  4. $Y = (y_1 ldots y_n)^{T}$,


  5. $mathbb{E}(Y) = mu = (mu_1 ldots mu_n)^{T}$,


  6. $text{Cov}(Y) = mathbb{E}[(Y- mu)(Y - mu)^{T}]$.


Now we can define a random vector $Y$ with normal distribution - $N(mu, Sigma)$.

Let's consider a random variable:
$$Z = (Y-mu)^{T} Sigma^{-1}(Y-mu).$$
What is the distribution of $Z$? How can it be found?

I know that one method would be to find expected value and covariance but I don't know how. Are there any other possibilities?










share|cite|improve this question






















  • isn't it just a Chi-squared distribution? since Z is as sort of "square" of standard normals?
    – Ramiro Scorolli
    Nov 20 at 22:47










  • @RamiroScorolli pretty much! Typically you diagonalise the quadratic form and then rewrite it as a sum of independent non-central Chi-squared random variables
    – Nadiels
    Nov 20 at 23:21















up vote
0
down vote

favorite












Firstly let's explain some signs used later:





  1. $y_1, ldots, y_2$ are random variables,


  2. $mathbb{E}(y_i) = mu_i$,


  3. $text{Cov}(y_i, y_j) = sigma_{ij}$,


  4. $Y = (y_1 ldots y_n)^{T}$,


  5. $mathbb{E}(Y) = mu = (mu_1 ldots mu_n)^{T}$,


  6. $text{Cov}(Y) = mathbb{E}[(Y- mu)(Y - mu)^{T}]$.


Now we can define a random vector $Y$ with normal distribution - $N(mu, Sigma)$.

Let's consider a random variable:
$$Z = (Y-mu)^{T} Sigma^{-1}(Y-mu).$$
What is the distribution of $Z$? How can it be found?

I know that one method would be to find expected value and covariance but I don't know how. Are there any other possibilities?










share|cite|improve this question






















  • isn't it just a Chi-squared distribution? since Z is as sort of "square" of standard normals?
    – Ramiro Scorolli
    Nov 20 at 22:47










  • @RamiroScorolli pretty much! Typically you diagonalise the quadratic form and then rewrite it as a sum of independent non-central Chi-squared random variables
    – Nadiels
    Nov 20 at 23:21













up vote
0
down vote

favorite









up vote
0
down vote

favorite











Firstly let's explain some signs used later:





  1. $y_1, ldots, y_2$ are random variables,


  2. $mathbb{E}(y_i) = mu_i$,


  3. $text{Cov}(y_i, y_j) = sigma_{ij}$,


  4. $Y = (y_1 ldots y_n)^{T}$,


  5. $mathbb{E}(Y) = mu = (mu_1 ldots mu_n)^{T}$,


  6. $text{Cov}(Y) = mathbb{E}[(Y- mu)(Y - mu)^{T}]$.


Now we can define a random vector $Y$ with normal distribution - $N(mu, Sigma)$.

Let's consider a random variable:
$$Z = (Y-mu)^{T} Sigma^{-1}(Y-mu).$$
What is the distribution of $Z$? How can it be found?

I know that one method would be to find expected value and covariance but I don't know how. Are there any other possibilities?










share|cite|improve this question













Firstly let's explain some signs used later:





  1. $y_1, ldots, y_2$ are random variables,


  2. $mathbb{E}(y_i) = mu_i$,


  3. $text{Cov}(y_i, y_j) = sigma_{ij}$,


  4. $Y = (y_1 ldots y_n)^{T}$,


  5. $mathbb{E}(Y) = mu = (mu_1 ldots mu_n)^{T}$,


  6. $text{Cov}(Y) = mathbb{E}[(Y- mu)(Y - mu)^{T}]$.


Now we can define a random vector $Y$ with normal distribution - $N(mu, Sigma)$.

Let's consider a random variable:
$$Z = (Y-mu)^{T} Sigma^{-1}(Y-mu).$$
What is the distribution of $Z$? How can it be found?

I know that one method would be to find expected value and covariance but I don't know how. Are there any other possibilities?







probability random-variables






share|cite|improve this question













share|cite|improve this question











share|cite|improve this question




share|cite|improve this question










asked Nov 20 at 21:46









Hendrra

1,025416




1,025416












  • isn't it just a Chi-squared distribution? since Z is as sort of "square" of standard normals?
    – Ramiro Scorolli
    Nov 20 at 22:47










  • @RamiroScorolli pretty much! Typically you diagonalise the quadratic form and then rewrite it as a sum of independent non-central Chi-squared random variables
    – Nadiels
    Nov 20 at 23:21


















  • isn't it just a Chi-squared distribution? since Z is as sort of "square" of standard normals?
    – Ramiro Scorolli
    Nov 20 at 22:47










  • @RamiroScorolli pretty much! Typically you diagonalise the quadratic form and then rewrite it as a sum of independent non-central Chi-squared random variables
    – Nadiels
    Nov 20 at 23:21
















isn't it just a Chi-squared distribution? since Z is as sort of "square" of standard normals?
– Ramiro Scorolli
Nov 20 at 22:47




isn't it just a Chi-squared distribution? since Z is as sort of "square" of standard normals?
– Ramiro Scorolli
Nov 20 at 22:47












@RamiroScorolli pretty much! Typically you diagonalise the quadratic form and then rewrite it as a sum of independent non-central Chi-squared random variables
– Nadiels
Nov 20 at 23:21




@RamiroScorolli pretty much! Typically you diagonalise the quadratic form and then rewrite it as a sum of independent non-central Chi-squared random variables
– Nadiels
Nov 20 at 23:21










1 Answer
1






active

oldest

votes

















up vote
1
down vote



accepted










You have that $X$ is distributed $N(mu,Sigma)$ so:



$(X-mu)sim N(0,Sigma)$
and



$Sigma^{-1/2}(X-mu)sim N(0,Sigma^{-1/2}cdotSigmacdot{Sigma^{-1/2}}^{'})$



$Sigma^{-1/2}(X-mu)sim N(0,Sigma^{-1/2}cdotSigma^{-1/2}({Sigma^{1/2}}^{'}cdotSigma^{1/2})cdot{Sigma^{-1/2}}^{'})$ Since $Sigma^{-1/2}$ is symmetric by construction (use an orthogonal eigendecomposition) this leads to:



$Sigma^{-1/2}(X-mu)sim N(0,I)$ i.e. a standard normal.



Calculating the square of this new random variable gives us:
$(Sigma^{-1/2}(X-mu))^{'}cdot Sigma^{-1/2}(X-mu)=(X-mu)^{'}Sigma^{-1}(X-mu)$ Which is precisely $Z$

Since it's the square of a Standard Normal, the distribution will be Chi-Squared with k (dimension of the vector $y$) df






share|cite|improve this answer





















  • Thank you very much! Your solution is very smart and elegant :)
    – Hendrra
    Nov 21 at 7:57






  • 1




    Your welcome! Glad you found it useful
    – Ramiro Scorolli
    Nov 21 at 8:06











Your Answer





StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3006947%2ffinding-the-distribution-of-a-random-variable-made-of-a-random-vector%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes








up vote
1
down vote



accepted










You have that $X$ is distributed $N(mu,Sigma)$ so:



$(X-mu)sim N(0,Sigma)$
and



$Sigma^{-1/2}(X-mu)sim N(0,Sigma^{-1/2}cdotSigmacdot{Sigma^{-1/2}}^{'})$



$Sigma^{-1/2}(X-mu)sim N(0,Sigma^{-1/2}cdotSigma^{-1/2}({Sigma^{1/2}}^{'}cdotSigma^{1/2})cdot{Sigma^{-1/2}}^{'})$ Since $Sigma^{-1/2}$ is symmetric by construction (use an orthogonal eigendecomposition) this leads to:



$Sigma^{-1/2}(X-mu)sim N(0,I)$ i.e. a standard normal.



Calculating the square of this new random variable gives us:
$(Sigma^{-1/2}(X-mu))^{'}cdot Sigma^{-1/2}(X-mu)=(X-mu)^{'}Sigma^{-1}(X-mu)$ Which is precisely $Z$

Since it's the square of a Standard Normal, the distribution will be Chi-Squared with k (dimension of the vector $y$) df






share|cite|improve this answer





















  • Thank you very much! Your solution is very smart and elegant :)
    – Hendrra
    Nov 21 at 7:57






  • 1




    Your welcome! Glad you found it useful
    – Ramiro Scorolli
    Nov 21 at 8:06















up vote
1
down vote



accepted










You have that $X$ is distributed $N(mu,Sigma)$ so:



$(X-mu)sim N(0,Sigma)$
and



$Sigma^{-1/2}(X-mu)sim N(0,Sigma^{-1/2}cdotSigmacdot{Sigma^{-1/2}}^{'})$



$Sigma^{-1/2}(X-mu)sim N(0,Sigma^{-1/2}cdotSigma^{-1/2}({Sigma^{1/2}}^{'}cdotSigma^{1/2})cdot{Sigma^{-1/2}}^{'})$ Since $Sigma^{-1/2}$ is symmetric by construction (use an orthogonal eigendecomposition) this leads to:



$Sigma^{-1/2}(X-mu)sim N(0,I)$ i.e. a standard normal.



Calculating the square of this new random variable gives us:
$(Sigma^{-1/2}(X-mu))^{'}cdot Sigma^{-1/2}(X-mu)=(X-mu)^{'}Sigma^{-1}(X-mu)$ Which is precisely $Z$

Since it's the square of a Standard Normal, the distribution will be Chi-Squared with k (dimension of the vector $y$) df






share|cite|improve this answer





















  • Thank you very much! Your solution is very smart and elegant :)
    – Hendrra
    Nov 21 at 7:57






  • 1




    Your welcome! Glad you found it useful
    – Ramiro Scorolli
    Nov 21 at 8:06













up vote
1
down vote



accepted







up vote
1
down vote



accepted






You have that $X$ is distributed $N(mu,Sigma)$ so:



$(X-mu)sim N(0,Sigma)$
and



$Sigma^{-1/2}(X-mu)sim N(0,Sigma^{-1/2}cdotSigmacdot{Sigma^{-1/2}}^{'})$



$Sigma^{-1/2}(X-mu)sim N(0,Sigma^{-1/2}cdotSigma^{-1/2}({Sigma^{1/2}}^{'}cdotSigma^{1/2})cdot{Sigma^{-1/2}}^{'})$ Since $Sigma^{-1/2}$ is symmetric by construction (use an orthogonal eigendecomposition) this leads to:



$Sigma^{-1/2}(X-mu)sim N(0,I)$ i.e. a standard normal.



Calculating the square of this new random variable gives us:
$(Sigma^{-1/2}(X-mu))^{'}cdot Sigma^{-1/2}(X-mu)=(X-mu)^{'}Sigma^{-1}(X-mu)$ Which is precisely $Z$

Since it's the square of a Standard Normal, the distribution will be Chi-Squared with k (dimension of the vector $y$) df






share|cite|improve this answer












You have that $X$ is distributed $N(mu,Sigma)$ so:



$(X-mu)sim N(0,Sigma)$
and



$Sigma^{-1/2}(X-mu)sim N(0,Sigma^{-1/2}cdotSigmacdot{Sigma^{-1/2}}^{'})$



$Sigma^{-1/2}(X-mu)sim N(0,Sigma^{-1/2}cdotSigma^{-1/2}({Sigma^{1/2}}^{'}cdotSigma^{1/2})cdot{Sigma^{-1/2}}^{'})$ Since $Sigma^{-1/2}$ is symmetric by construction (use an orthogonal eigendecomposition) this leads to:



$Sigma^{-1/2}(X-mu)sim N(0,I)$ i.e. a standard normal.



Calculating the square of this new random variable gives us:
$(Sigma^{-1/2}(X-mu))^{'}cdot Sigma^{-1/2}(X-mu)=(X-mu)^{'}Sigma^{-1}(X-mu)$ Which is precisely $Z$

Since it's the square of a Standard Normal, the distribution will be Chi-Squared with k (dimension of the vector $y$) df







share|cite|improve this answer












share|cite|improve this answer



share|cite|improve this answer










answered Nov 20 at 23:34









Ramiro Scorolli

64513




64513












  • Thank you very much! Your solution is very smart and elegant :)
    – Hendrra
    Nov 21 at 7:57






  • 1




    Your welcome! Glad you found it useful
    – Ramiro Scorolli
    Nov 21 at 8:06


















  • Thank you very much! Your solution is very smart and elegant :)
    – Hendrra
    Nov 21 at 7:57






  • 1




    Your welcome! Glad you found it useful
    – Ramiro Scorolli
    Nov 21 at 8:06
















Thank you very much! Your solution is very smart and elegant :)
– Hendrra
Nov 21 at 7:57




Thank you very much! Your solution is very smart and elegant :)
– Hendrra
Nov 21 at 7:57




1




1




Your welcome! Glad you found it useful
– Ramiro Scorolli
Nov 21 at 8:06




Your welcome! Glad you found it useful
– Ramiro Scorolli
Nov 21 at 8:06


















draft saved

draft discarded




















































Thanks for contributing an answer to Mathematics Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.





Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


Please pay close attention to the following guidance:


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3006947%2ffinding-the-distribution-of-a-random-variable-made-of-a-random-vector%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Probability when a professor distributes a quiz and homework assignment to a class of n students.

Aardman Animations

Are they similar matrix