Updated belief with Bayes' rule
$begingroup$
Let ${x_0,x_1}$ be to states. Suppose the reward is $1$ in state $x_1$, and in state $x_0$ it is $1$ with probability $r$ and $0$ with probability $1-r$, with $rin(0,1)$.
Bob has a belief $pin [0,1]$ over the states $x_0$ and $x_1$, i.e., $p$ is the probability that the true state is $x_1$ according Bob.
Suppose the true state is $x_0$. If $pin[0,1)$ and Bob observes a reward of $0$, he updates his belief according to Bayes' rule and is new belief is $0$.
Suppose now that $p=1$, that is Bob is sure that the true state is $x_1$ when it is actually $x_0$, and suppose the Bob observes a reward of $0$.
Bayes' rule in this case would give "$frac{0}{0}$".
My question is, Bob being Bayesian, will his new belief be $0$ or $1$, and why?
bayesian
$endgroup$
add a comment |
$begingroup$
Let ${x_0,x_1}$ be to states. Suppose the reward is $1$ in state $x_1$, and in state $x_0$ it is $1$ with probability $r$ and $0$ with probability $1-r$, with $rin(0,1)$.
Bob has a belief $pin [0,1]$ over the states $x_0$ and $x_1$, i.e., $p$ is the probability that the true state is $x_1$ according Bob.
Suppose the true state is $x_0$. If $pin[0,1)$ and Bob observes a reward of $0$, he updates his belief according to Bayes' rule and is new belief is $0$.
Suppose now that $p=1$, that is Bob is sure that the true state is $x_1$ when it is actually $x_0$, and suppose the Bob observes a reward of $0$.
Bayes' rule in this case would give "$frac{0}{0}$".
My question is, Bob being Bayesian, will his new belief be $0$ or $1$, and why?
bayesian
$endgroup$
1
$begingroup$
What does it mean for a state to be true?
$endgroup$
– user593746
Dec 18 '18 at 20:29
$begingroup$
@Zvi It could be for example raining/not raining. Bob (at home) would believe that it is raining when actually it is not.
$endgroup$
– S. Pel
Dec 19 '18 at 10:41
add a comment |
$begingroup$
Let ${x_0,x_1}$ be to states. Suppose the reward is $1$ in state $x_1$, and in state $x_0$ it is $1$ with probability $r$ and $0$ with probability $1-r$, with $rin(0,1)$.
Bob has a belief $pin [0,1]$ over the states $x_0$ and $x_1$, i.e., $p$ is the probability that the true state is $x_1$ according Bob.
Suppose the true state is $x_0$. If $pin[0,1)$ and Bob observes a reward of $0$, he updates his belief according to Bayes' rule and is new belief is $0$.
Suppose now that $p=1$, that is Bob is sure that the true state is $x_1$ when it is actually $x_0$, and suppose the Bob observes a reward of $0$.
Bayes' rule in this case would give "$frac{0}{0}$".
My question is, Bob being Bayesian, will his new belief be $0$ or $1$, and why?
bayesian
$endgroup$
Let ${x_0,x_1}$ be to states. Suppose the reward is $1$ in state $x_1$, and in state $x_0$ it is $1$ with probability $r$ and $0$ with probability $1-r$, with $rin(0,1)$.
Bob has a belief $pin [0,1]$ over the states $x_0$ and $x_1$, i.e., $p$ is the probability that the true state is $x_1$ according Bob.
Suppose the true state is $x_0$. If $pin[0,1)$ and Bob observes a reward of $0$, he updates his belief according to Bayes' rule and is new belief is $0$.
Suppose now that $p=1$, that is Bob is sure that the true state is $x_1$ when it is actually $x_0$, and suppose the Bob observes a reward of $0$.
Bayes' rule in this case would give "$frac{0}{0}$".
My question is, Bob being Bayesian, will his new belief be $0$ or $1$, and why?
bayesian
bayesian
asked Dec 18 '18 at 15:47
S. PelS. Pel
12
12
1
$begingroup$
What does it mean for a state to be true?
$endgroup$
– user593746
Dec 18 '18 at 20:29
$begingroup$
@Zvi It could be for example raining/not raining. Bob (at home) would believe that it is raining when actually it is not.
$endgroup$
– S. Pel
Dec 19 '18 at 10:41
add a comment |
1
$begingroup$
What does it mean for a state to be true?
$endgroup$
– user593746
Dec 18 '18 at 20:29
$begingroup$
@Zvi It could be for example raining/not raining. Bob (at home) would believe that it is raining when actually it is not.
$endgroup$
– S. Pel
Dec 19 '18 at 10:41
1
1
$begingroup$
What does it mean for a state to be true?
$endgroup$
– user593746
Dec 18 '18 at 20:29
$begingroup$
What does it mean for a state to be true?
$endgroup$
– user593746
Dec 18 '18 at 20:29
$begingroup$
@Zvi It could be for example raining/not raining. Bob (at home) would believe that it is raining when actually it is not.
$endgroup$
– S. Pel
Dec 19 '18 at 10:41
$begingroup$
@Zvi It could be for example raining/not raining. Bob (at home) would believe that it is raining when actually it is not.
$endgroup$
– S. Pel
Dec 19 '18 at 10:41
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3045315%2fupdated-belief-with-bayes-rule%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3045315%2fupdated-belief-with-bayes-rule%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
$begingroup$
What does it mean for a state to be true?
$endgroup$
– user593746
Dec 18 '18 at 20:29
$begingroup$
@Zvi It could be for example raining/not raining. Bob (at home) would believe that it is raining when actually it is not.
$endgroup$
– S. Pel
Dec 19 '18 at 10:41