Hacker News new | past | comments | ask | show | jobs | submit login
Bayes' Theorem Illustrated (lesswrong.com)
160 points by astrofinch on March 4, 2012 | hide | past | favorite | 13 comments



Bayes' rule is quite easy to understand as a Venn diagram, though the linked article doesn't seem to use this fact. But here's a blog-post that does: http://oscarbonilla.com/2009/05/visualizing-bayes-theorem/


Being able to prove the Total Prob. Theorem and from there the Bayes Theorem has helped me solve problems (granted from a textbook and not real-life ones).

-> In the problem, the sample space comes divided into mutually disjoint portions.

-> Using the definition of probability, we can compute joint distribution from the a-priori distributions.

-> Using the definition of conditional probability, we can flip around the inference direction.

I usually find that all problems (Naive-Bayes spam, cancer) etc. all show this pattern.


This works well for the cancer example. I'm not picturing how it would work for the Monty Hall problem. Guess it's time to open the drawing app.



The Venn diagram makes visualizing the update so easy, you start to wonder why the Bayes rule is a "thing" at all.

It works especially well with the examples, like Yudkowsy's breast cancer screeening example.


http://www-biba.inrialpes.fr/Jaynes/cc02m.pdf

Jaynes argues here (pg 221) that examples were Venn diagrams apply are special cases. According to Jaynes, Bayes theorem is more general than that.


There should be a law that you only get one paragraph and one figure when explaining Bayes' rule.


I'll give it a shot and get back to you. Should be doable.


Why?


This


I don't quite get the steps after cutting off the other branches. The original diagram didn't seem to get updated.


The original diagram isn't important any more. It is replaced by the new values that are the results of the experiment. Kind of like:

  world = get_world()
  for experiment in experiments():
    world = combine(world, experiment())
The original world doesn't exist after the first experiment. The experiment has provided us a new world.


lovely explanation , very clear!




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: