Iteration method to solve $(I-A)vec x=vec b$
up vote
0
down vote
favorite
Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}
where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.
When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}
If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}
I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?
linear-algebra numerical-linear-algebra
add a comment |
up vote
0
down vote
favorite
Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}
where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.
When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}
If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}
I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?
linear-algebra numerical-linear-algebra
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}
where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.
When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}
If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}
I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?
linear-algebra numerical-linear-algebra
Construct $A =QLambda Q^T$. $Q$ is found by applying $QR$ factorization to $B=$randn($n$), and $Lambda$ is defined to be
begin{align*}
Lambda = mathrm{diag}(lambda_1,lambda_2,ldots,lambda_n),
end{align*}
where $(lambda_i)_{i=1}^n$ is a colloction of iid random variables and $lambda_1$ is uniform on $[-1,1]$. It's clear that $|A|<1$. Let $vec b=$rand($n,1$), which means its entries are uniformly distributed random variables on $[0,1]$.
When solving $(I - A)vec x = vec b$, I apply the Neumann series iteration as follows:
begin{align*}
vec x_0 &= text{initial guess},\
vec x_j &= Avec x_{j-1} + b, quad j = 1,2,3ldots.
end{align*}
If I define the number of iterations $k^*$ as
begin{align*}
k^* = min { k : |(I-A) vec x_k - vec b| < epsilon}.
end{align*}
I found that $k^*$ increases as $n$ increases. I know this is intuitively true, but how do I verify this fact rigorously?
linear-algebra numerical-linear-algebra
linear-algebra numerical-linear-algebra
edited 7 hours ago
asked 22 hours ago
Jiexiong687691
355
355
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago
add a comment |
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago
add a comment |
1 Answer
1
active
oldest
votes
up vote
-1
down vote
If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}
Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}
Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
-1
down vote
If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}
Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}
Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
add a comment |
up vote
-1
down vote
If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}
Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}
Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
add a comment |
up vote
-1
down vote
up vote
-1
down vote
If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}
Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}
Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.
If $vec x$ is the actual solution, then we have
begin{align*}
|(I-A) vec x_k - vec b|&=|(I-A) vec x_k - vec b-((I-A)vec x-vec b)|\
&=|(I-A) (vec x_k - vec x)|\
&leq |I-A|| vec x_k - vec x|\
&leq |I-A|frac {|A|^k}{1-|A|}sqrt{n}
end{align*}
Therefore, it's equivalent to define $k^*$ as
begin{align*}
k^* = min { k : |I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon}.
end{align*}
Thus, if $epsilon$ is fixed and as $n$ increases, I have to increase $k$ to make sure $|I-A|frac {|A|^k}{1-|A|}sqrt{n} < epsilon$. Therefore, as $n$ increases, $k^*$ increases.
answered 6 hours ago
Jiexiong687691
355
355
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
add a comment |
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
I'm not sure this is correct though.
– Jiexiong687691
6 hours ago
add a comment |
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2996365%2fiteration-method-to-solve-i-a-vec-x-vec-b%23new-answer', 'question_page');
}
);
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
It looks like $|A|$ might depend on $n$. If you had $|A|leq c < 1$ for some $c$ independently of $n$, then you might expect $k^*$ to be independent of $n$.
– Algebraic Pavel
11 hours ago
I mean $k^*$ is definitely depend on $n$, and I want to know why.@AlgebraicPavel
– Jiexiong687691
7 hours ago
So again my (maybe somewhat hidden) question. Does $|A|$ depend on $n$? I suppose that larger $n$ is, more eigenvalues are located close to $1$. That might be the reason.
– Algebraic Pavel
7 hours ago