Iteration method to solve $(I-A)vec x=vec b$

Multi tool use
up vote
0
down vote
favorite
Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}
where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.
When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}
If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}
I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?
linear-algebra numerical-linear-algebra
add a comment |
up vote
0
down vote
favorite
Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}
where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.
When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}
If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}
I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?
linear-algebra numerical-linear-algebra
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}
where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.
When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}
If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}
I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?
linear-algebra numerical-linear-algebra
Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}
where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.
When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}
If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}
I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?
linear-algebra numerical-linear-algebra
linear-algebra numerical-linear-algebra
edited 7 hours ago
asked 22 hours ago


Jiexiong687691
355
355
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago
add a comment |
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago
add a comment |
1 Answer
1
active
oldest
votes
up vote
-1
down vote
If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}
Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}
Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
-1
down vote
If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}
Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}
Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
add a comment |
up vote
-1
down vote
If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}
Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}
Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
add a comment |
up vote
-1
down vote
up vote
-1
down vote
If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}
Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}
Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.
If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}
Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}
Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.
answered 6 hours ago


Jiexiong687691
355
355
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
add a comment |
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
add a comment |
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2996365%2fiteration-method-to-solve-i-a-vec-x-vec-b%23new-answer', 'question_page');
}
);
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
WpBq YFhdNNP9,XDsz1HlboHkwoon1m,b Cn n3,VyahyfP,WMHbxAN4vOecVxTZK5Plv3ihtJZHqXog8SGe0lFfzH2uLIyPu fCy4cB
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago