Central Limit Theorem for not identical distributed but independent centered random variables with variance...
$begingroup$
so let's assume we have independent random variables $X_1,X_2, X_3, ldots$ with
$$mathbb{E}[X_k]=0 mbox{ and } mathbb{Var}[X_k]=sigma_k^2=1 quad forall kinmathbb{N}. $$
We define $$s_n^2:= sum_{k=1}^n mathbb{E}[(X_k-mathbb{E}[X_k])^2]=sum_{k=1}^nsigma_k^2=n.$$
Now we check Lindenberg's condition: So for $varepsilon>0$ we must check
$$limlimits_{nrightarrow infty} frac{1}{s_n^2}sum_{k=1}^n mathbb{E}[(X_k-mathbb{E}[X_k])^2 cdot mathbf{1}_{|X_k| > varepsilon s_n^2} ]
=limlimits_{nrightarrow infty} frac{1}{n} sum_{k=1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ].$$
We know,
$$mathbb{E}[X_k^2 ]=1,$$
so
$$mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]$$
converges quicker than $$frac{1}{n},$$
whch means we find an $Ninmathbb{N}$ such that for every $ngeq N$ we have
$$mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]< frac{1}{n}, $$
which means for every $varepsilon>0$ we have
$$limlimits_{nrightarrow infty} frac{1}{n} sum_{k=1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ] leq limlimits_{nrightarrow infty} frac{N}{n} + frac{1}{n} sum_{k=N+1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]< limlimits_{nrightarrow infty} frac{N}{n} + + frac{1}{n^2 }=0,$$
so we know that the Central Limit Theorem holds.
Is that right?
Edit:
What we really need is uniform integrability of ${ X_k^2: kinmathbb{N}} $$ and that gives us that Lindeberg holds.
Otherwise we can construct $X_j$ with $$P(X_j =-j^2 )=P(X_j =j^2 ) = j^{-4}/2$$ and Lindeberg does not hold!
probability-theory central-limit-theorem
$endgroup$
add a comment |
$begingroup$
so let's assume we have independent random variables $X_1,X_2, X_3, ldots$ with
$$mathbb{E}[X_k]=0 mbox{ and } mathbb{Var}[X_k]=sigma_k^2=1 quad forall kinmathbb{N}. $$
We define $$s_n^2:= sum_{k=1}^n mathbb{E}[(X_k-mathbb{E}[X_k])^2]=sum_{k=1}^nsigma_k^2=n.$$
Now we check Lindenberg's condition: So for $varepsilon>0$ we must check
$$limlimits_{nrightarrow infty} frac{1}{s_n^2}sum_{k=1}^n mathbb{E}[(X_k-mathbb{E}[X_k])^2 cdot mathbf{1}_{|X_k| > varepsilon s_n^2} ]
=limlimits_{nrightarrow infty} frac{1}{n} sum_{k=1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ].$$
We know,
$$mathbb{E}[X_k^2 ]=1,$$
so
$$mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]$$
converges quicker than $$frac{1}{n},$$
whch means we find an $Ninmathbb{N}$ such that for every $ngeq N$ we have
$$mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]< frac{1}{n}, $$
which means for every $varepsilon>0$ we have
$$limlimits_{nrightarrow infty} frac{1}{n} sum_{k=1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ] leq limlimits_{nrightarrow infty} frac{N}{n} + frac{1}{n} sum_{k=N+1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]< limlimits_{nrightarrow infty} frac{N}{n} + + frac{1}{n^2 }=0,$$
so we know that the Central Limit Theorem holds.
Is that right?
Edit:
What we really need is uniform integrability of ${ X_k^2: kinmathbb{N}} $$ and that gives us that Lindeberg holds.
Otherwise we can construct $X_j$ with $$P(X_j =-j^2 )=P(X_j =j^2 ) = j^{-4}/2$$ and Lindeberg does not hold!
probability-theory central-limit-theorem
$endgroup$
add a comment |
$begingroup$
so let's assume we have independent random variables $X_1,X_2, X_3, ldots$ with
$$mathbb{E}[X_k]=0 mbox{ and } mathbb{Var}[X_k]=sigma_k^2=1 quad forall kinmathbb{N}. $$
We define $$s_n^2:= sum_{k=1}^n mathbb{E}[(X_k-mathbb{E}[X_k])^2]=sum_{k=1}^nsigma_k^2=n.$$
Now we check Lindenberg's condition: So for $varepsilon>0$ we must check
$$limlimits_{nrightarrow infty} frac{1}{s_n^2}sum_{k=1}^n mathbb{E}[(X_k-mathbb{E}[X_k])^2 cdot mathbf{1}_{|X_k| > varepsilon s_n^2} ]
=limlimits_{nrightarrow infty} frac{1}{n} sum_{k=1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ].$$
We know,
$$mathbb{E}[X_k^2 ]=1,$$
so
$$mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]$$
converges quicker than $$frac{1}{n},$$
whch means we find an $Ninmathbb{N}$ such that for every $ngeq N$ we have
$$mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]< frac{1}{n}, $$
which means for every $varepsilon>0$ we have
$$limlimits_{nrightarrow infty} frac{1}{n} sum_{k=1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ] leq limlimits_{nrightarrow infty} frac{N}{n} + frac{1}{n} sum_{k=N+1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]< limlimits_{nrightarrow infty} frac{N}{n} + + frac{1}{n^2 }=0,$$
so we know that the Central Limit Theorem holds.
Is that right?
Edit:
What we really need is uniform integrability of ${ X_k^2: kinmathbb{N}} $$ and that gives us that Lindeberg holds.
Otherwise we can construct $X_j$ with $$P(X_j =-j^2 )=P(X_j =j^2 ) = j^{-4}/2$$ and Lindeberg does not hold!
probability-theory central-limit-theorem
$endgroup$
so let's assume we have independent random variables $X_1,X_2, X_3, ldots$ with
$$mathbb{E}[X_k]=0 mbox{ and } mathbb{Var}[X_k]=sigma_k^2=1 quad forall kinmathbb{N}. $$
We define $$s_n^2:= sum_{k=1}^n mathbb{E}[(X_k-mathbb{E}[X_k])^2]=sum_{k=1}^nsigma_k^2=n.$$
Now we check Lindenberg's condition: So for $varepsilon>0$ we must check
$$limlimits_{nrightarrow infty} frac{1}{s_n^2}sum_{k=1}^n mathbb{E}[(X_k-mathbb{E}[X_k])^2 cdot mathbf{1}_{|X_k| > varepsilon s_n^2} ]
=limlimits_{nrightarrow infty} frac{1}{n} sum_{k=1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ].$$
We know,
$$mathbb{E}[X_k^2 ]=1,$$
so
$$mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]$$
converges quicker than $$frac{1}{n},$$
whch means we find an $Ninmathbb{N}$ such that for every $ngeq N$ we have
$$mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]< frac{1}{n}, $$
which means for every $varepsilon>0$ we have
$$limlimits_{nrightarrow infty} frac{1}{n} sum_{k=1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ] leq limlimits_{nrightarrow infty} frac{N}{n} + frac{1}{n} sum_{k=N+1}^n mathbb{E}[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} ]< limlimits_{nrightarrow infty} frac{N}{n} + + frac{1}{n^2 }=0,$$
so we know that the Central Limit Theorem holds.
Is that right?
Edit:
What we really need is uniform integrability of ${ X_k^2: kinmathbb{N}} $$ and that gives us that Lindeberg holds.
Otherwise we can construct $X_j$ with $$P(X_j =-j^2 )=P(X_j =j^2 ) = j^{-4}/2$$ and Lindeberg does not hold!
probability-theory central-limit-theorem
probability-theory central-limit-theorem
edited Feb 4 at 16:19
Martin Sleziak
44.7k10119272
44.7k10119272
asked Dec 11 '18 at 16:34
cptflintcptflint
208
208
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
It may be not true that $mathbb{E}left[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} right]$ is of order $1/n$. For example, if $X_1$ is such that its tail $Pr(leftlvert X_1rightrvert >t)sim t^{-2}(log t)^{-2}$, then $mathbb{E}[X_1^2 cdot mathbf{1}_{|X_1| > varepsilon n} ]$ is of order $1/log n$.
Note that it would suffices to have uniform integrability, that is,
$$
lim_{Rto +infty}sup_{kgeqslant 1}mathbb{E}left[X_k^2 cdot mathbf{1}_{|X_k| > R} right]=0.
$$
Otherwise, the are counter-examples.
$endgroup$
$begingroup$
I think we have uniform integrability, because $sigma_k^2=1$, but we haven't unform integrability of the family $X_k^2$, right?
$endgroup$
– cptflint
Dec 11 '18 at 23:24
$begingroup$
We indeed have integrability of each $X_k$ but in general not uniform integrability, unless you have other assumptions.
$endgroup$
– Davide Giraudo
Dec 12 '18 at 9:44
$begingroup$
I think we need $exists p>2, C>0: left[ forall k inN: EW[|X_k|^p ] leq C right]$, right? Then I have unfirom integrability of $X_k^2$, which means that we can use Lindeberg.
$endgroup$
– cptflint
Dec 12 '18 at 9:58
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3035474%2fcentral-limit-theorem-for-not-identical-distributed-but-independent-centered-ran%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
It may be not true that $mathbb{E}left[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} right]$ is of order $1/n$. For example, if $X_1$ is such that its tail $Pr(leftlvert X_1rightrvert >t)sim t^{-2}(log t)^{-2}$, then $mathbb{E}[X_1^2 cdot mathbf{1}_{|X_1| > varepsilon n} ]$ is of order $1/log n$.
Note that it would suffices to have uniform integrability, that is,
$$
lim_{Rto +infty}sup_{kgeqslant 1}mathbb{E}left[X_k^2 cdot mathbf{1}_{|X_k| > R} right]=0.
$$
Otherwise, the are counter-examples.
$endgroup$
$begingroup$
I think we have uniform integrability, because $sigma_k^2=1$, but we haven't unform integrability of the family $X_k^2$, right?
$endgroup$
– cptflint
Dec 11 '18 at 23:24
$begingroup$
We indeed have integrability of each $X_k$ but in general not uniform integrability, unless you have other assumptions.
$endgroup$
– Davide Giraudo
Dec 12 '18 at 9:44
$begingroup$
I think we need $exists p>2, C>0: left[ forall k inN: EW[|X_k|^p ] leq C right]$, right? Then I have unfirom integrability of $X_k^2$, which means that we can use Lindeberg.
$endgroup$
– cptflint
Dec 12 '18 at 9:58
add a comment |
$begingroup$
It may be not true that $mathbb{E}left[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} right]$ is of order $1/n$. For example, if $X_1$ is such that its tail $Pr(leftlvert X_1rightrvert >t)sim t^{-2}(log t)^{-2}$, then $mathbb{E}[X_1^2 cdot mathbf{1}_{|X_1| > varepsilon n} ]$ is of order $1/log n$.
Note that it would suffices to have uniform integrability, that is,
$$
lim_{Rto +infty}sup_{kgeqslant 1}mathbb{E}left[X_k^2 cdot mathbf{1}_{|X_k| > R} right]=0.
$$
Otherwise, the are counter-examples.
$endgroup$
$begingroup$
I think we have uniform integrability, because $sigma_k^2=1$, but we haven't unform integrability of the family $X_k^2$, right?
$endgroup$
– cptflint
Dec 11 '18 at 23:24
$begingroup$
We indeed have integrability of each $X_k$ but in general not uniform integrability, unless you have other assumptions.
$endgroup$
– Davide Giraudo
Dec 12 '18 at 9:44
$begingroup$
I think we need $exists p>2, C>0: left[ forall k inN: EW[|X_k|^p ] leq C right]$, right? Then I have unfirom integrability of $X_k^2$, which means that we can use Lindeberg.
$endgroup$
– cptflint
Dec 12 '18 at 9:58
add a comment |
$begingroup$
It may be not true that $mathbb{E}left[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} right]$ is of order $1/n$. For example, if $X_1$ is such that its tail $Pr(leftlvert X_1rightrvert >t)sim t^{-2}(log t)^{-2}$, then $mathbb{E}[X_1^2 cdot mathbf{1}_{|X_1| > varepsilon n} ]$ is of order $1/log n$.
Note that it would suffices to have uniform integrability, that is,
$$
lim_{Rto +infty}sup_{kgeqslant 1}mathbb{E}left[X_k^2 cdot mathbf{1}_{|X_k| > R} right]=0.
$$
Otherwise, the are counter-examples.
$endgroup$
It may be not true that $mathbb{E}left[X_k^2 cdot mathbf{1}_{|X_k| > varepsilon n} right]$ is of order $1/n$. For example, if $X_1$ is such that its tail $Pr(leftlvert X_1rightrvert >t)sim t^{-2}(log t)^{-2}$, then $mathbb{E}[X_1^2 cdot mathbf{1}_{|X_1| > varepsilon n} ]$ is of order $1/log n$.
Note that it would suffices to have uniform integrability, that is,
$$
lim_{Rto +infty}sup_{kgeqslant 1}mathbb{E}left[X_k^2 cdot mathbf{1}_{|X_k| > R} right]=0.
$$
Otherwise, the are counter-examples.
edited Dec 13 '18 at 11:08
answered Dec 11 '18 at 19:22
Davide GiraudoDavide Giraudo
127k16151264
127k16151264
$begingroup$
I think we have uniform integrability, because $sigma_k^2=1$, but we haven't unform integrability of the family $X_k^2$, right?
$endgroup$
– cptflint
Dec 11 '18 at 23:24
$begingroup$
We indeed have integrability of each $X_k$ but in general not uniform integrability, unless you have other assumptions.
$endgroup$
– Davide Giraudo
Dec 12 '18 at 9:44
$begingroup$
I think we need $exists p>2, C>0: left[ forall k inN: EW[|X_k|^p ] leq C right]$, right? Then I have unfirom integrability of $X_k^2$, which means that we can use Lindeberg.
$endgroup$
– cptflint
Dec 12 '18 at 9:58
add a comment |
$begingroup$
I think we have uniform integrability, because $sigma_k^2=1$, but we haven't unform integrability of the family $X_k^2$, right?
$endgroup$
– cptflint
Dec 11 '18 at 23:24
$begingroup$
We indeed have integrability of each $X_k$ but in general not uniform integrability, unless you have other assumptions.
$endgroup$
– Davide Giraudo
Dec 12 '18 at 9:44
$begingroup$
I think we need $exists p>2, C>0: left[ forall k inN: EW[|X_k|^p ] leq C right]$, right? Then I have unfirom integrability of $X_k^2$, which means that we can use Lindeberg.
$endgroup$
– cptflint
Dec 12 '18 at 9:58
$begingroup$
I think we have uniform integrability, because $sigma_k^2=1$, but we haven't unform integrability of the family $X_k^2$, right?
$endgroup$
– cptflint
Dec 11 '18 at 23:24
$begingroup$
I think we have uniform integrability, because $sigma_k^2=1$, but we haven't unform integrability of the family $X_k^2$, right?
$endgroup$
– cptflint
Dec 11 '18 at 23:24
$begingroup$
We indeed have integrability of each $X_k$ but in general not uniform integrability, unless you have other assumptions.
$endgroup$
– Davide Giraudo
Dec 12 '18 at 9:44
$begingroup$
We indeed have integrability of each $X_k$ but in general not uniform integrability, unless you have other assumptions.
$endgroup$
– Davide Giraudo
Dec 12 '18 at 9:44
$begingroup$
I think we need $exists p>2, C>0: left[ forall k inN: EW[|X_k|^p ] leq C right]$, right? Then I have unfirom integrability of $X_k^2$, which means that we can use Lindeberg.
$endgroup$
– cptflint
Dec 12 '18 at 9:58
$begingroup$
I think we need $exists p>2, C>0: left[ forall k inN: EW[|X_k|^p ] leq C right]$, right? Then I have unfirom integrability of $X_k^2$, which means that we can use Lindeberg.
$endgroup$
– cptflint
Dec 12 '18 at 9:58
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3035474%2fcentral-limit-theorem-for-not-identical-distributed-but-independent-centered-ran%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown