Iteration method to solve $(I-A)vec x=vec b$











up vote
0
down vote

favorite












Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}

where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.



When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}

If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}

I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?










share|cite|improve this question
























  • It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
    – Algebraic Pavel
    11 hours ago










  • I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
    – Jiexiong687691
    7 hours ago










  • So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
    – Algebraic Pavel
    7 hours ago

















up vote
0
down vote

favorite












Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}

where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.



When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}

If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}

I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?










share|cite|improve this question
























  • It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
    – Algebraic Pavel
    11 hours ago










  • I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
    – Jiexiong687691
    7 hours ago










  • So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
    – Algebraic Pavel
    7 hours ago















up vote
0
down vote

favorite









up vote
0
down vote

favorite











Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}

where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.



When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}

If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}

I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?










share|cite|improve this question















Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}

where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.



When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}

If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}

I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?







linear-algebra numerical-linear-algebra






share|cite|improve this question















share|cite|improve this question













share|cite|improve this question




share|cite|improve this question








edited 7 hours ago

























asked 22 hours ago









Jiexiong687691

355




355












  • It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
    – Algebraic Pavel
    11 hours ago










  • I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
    – Jiexiong687691
    7 hours ago










  • So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
    – Algebraic Pavel
    7 hours ago




















  • It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
    – Algebraic Pavel
    11 hours ago










  • I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
    – Jiexiong687691
    7 hours ago










  • So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
    – Algebraic Pavel
    7 hours ago


















It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago




It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago












I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago




I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago












So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago






So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago












1 Answer
1






active

oldest

votes

















up vote
-1
down vote













If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}

Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}

Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.






share|cite|improve this answer





















  • I'm not sure this is correct though.
    – Jiexiong687691
    6 hours ago











Your Answer





StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














 

draft saved


draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2996365%2fiteration-method-to-solve-i-a-vec-x-vec-b%23new-answer', 'question_page');
}
);

Post as a guest
































1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes








up vote
-1
down vote













If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}

Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}

Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.






share|cite|improve this answer





















  • I'm not sure this is correct though.
    – Jiexiong687691
    6 hours ago















up vote
-1
down vote













If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}

Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}

Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.






share|cite|improve this answer





















  • I'm not sure this is correct though.
    – Jiexiong687691
    6 hours ago













up vote
-1
down vote










up vote
-1
down vote









If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}

Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}

Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.






share|cite|improve this answer












If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}

Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}

Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.







share|cite|improve this answer












share|cite|improve this answer



share|cite|improve this answer










answered 6 hours ago









Jiexiong687691

355




355












  • I'm not sure this is correct though.
    – Jiexiong687691
    6 hours ago


















  • I'm not sure this is correct though.
    – Jiexiong687691
    6 hours ago
















I'm not sure this is correct though.
– Jiexiong687691
6 hours ago




I'm not sure this is correct though.
– Jiexiong687691
6 hours ago


















 

draft saved


draft discarded



















































 


draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2996365%2fiteration-method-to-solve-i-a-vec-x-vec-b%23new-answer', 'question_page');
}
);

Post as a guest




















































































Popular posts from this blog

Probability when a professor distributes a quiz and homework assignment to a class of n students.

Aardman Animations

Are they similar matrix