SECTION 2: Solutions from Meeting 3 exercises
Run this code for problems 3E1-3E4.
p_grid <- seq( from=0 , to=1 , length.out=1000 )
prior <- rep( 1 , 1000 )
likelihood <- dbinom( 6 , size=9 , prob=p_grid )
posterior <- likelihood * prior
posterior <- posterior / sum(posterior)
set.seed(100)
samples <- sample( p_grid , prob=posterior , size=1e5 , replace=TRUE )
hist(samples,probability = TRUE)
library(rethinking)
dens(samples)
plot(p_grid,posterior)
3E1. How much posterior probability lies below p=0.2?
length(samples[samples<0.2])/length(samples) # from sampling from posterior
sum( posterior[ p_grid < 0.2 ] ) # from posterior directly
3E2. How much posterior probability lies above p=0.8?
length(samples[samples>0.8])/length(samples) # from sampling from posterior
sum( posterior[ p_grid > 0.8 ] ) # from posterior directly
3E3. How much posterior probability lies between p=0.2 and p=0.8?
length(samples[samples>=0.2 & samples<=0.8])/length(samples) # from sampling from posterior
sum( posterior[ p_grid>=0.2 & p_grid <= 0.8 ] ) # from posterior directly
3E4. 20% of the posterior probability lies below which value of
p?
quantile(samples,0.2) # from sampling from posterior
sum(posterior[p_grid<0.5165]) # checking agains posterior
3M1. Suppose the globe tossing data had turned out to be 8 water in
15 tosses. Construct the posterior distribution, using grid
approximation. Use the same flat prior as before.
p_grid <- seq( from=0 , to=1 , length.out=1000 )
prior <- rep( 1 , 1000 )
likelihood <- dbinom( 8 , size=15 , prob=p_grid )
posterior <- likelihood * prior
posterior <- posterior / sum(posterior)
set.seed(100)
samples <- sample( p_grid , prob=posterior , size=1e5 , replace=TRUE )
hist(samples,probability = TRUE)
library(rethinking)
dens(samples)
plot(p_grid,posterior)
3M3. Construct a posterior predictive check for this model and data.
This means simulate the distribution of samples, averaging over the
posterior uncertainty in p. What is the probability of observing 8 water
in 15 tosses?
p_grid <- seq( from=0 , to=1 , length.out=1000 )
prior <- rep( 1 , 1000 )
likelihood <- dbinom( 8 , size=15 , prob=p_grid )
posterior <- likelihood * prior
posterior <- posterior / sum(posterior)
set.seed(100)
samples <- sample( p_grid , prob=posterior , size=1e5 , replace=TRUE )
# hist(samples,probability = TRUE)
postPred<-rbinom(n=10000,size=15,prob=samples)
hist(postPred)
sum(postPred==8)/length(postPred)
3M4. Using the posterior distribution constructed from the new (8/15)
data, now calculate the probability of observing 6 water in 9
tosses.
postPred<-rbinom(n=1000000,size=9,prob=samples)
sum(postPred==6)/length(postPred)
3M5. Start over at 3M1, but now use a prior that is zero below p=0.5
and a constant above p=0.5. This corresponds to prior information that a
majority of the Earth’s surface is water. Repeat each problem above and
compare the inferences. What difference does the better prior make? If
it helps, compare inferences (using both priors) to the true value
p_grid <- seq( from=0 , to=1 , length.out=1000 )
prior <- rep( 1 , 1000 )
prior<-ifelse(p_grid<=0.5,0,1)
likelihood <- dbinom( 8 , size=15 , prob=p_grid )
posterior <- likelihood * prior
posterior <- posterior / sum(posterior)
set.seed(100)
samples <- sample( p_grid , prob=posterior , size=1e5 , replace=TRUE )
hist(samples,probability = TRUE)
library(rethinking)
dens(samples)
plot(p_grid,posterior)
3M3 with new prior. Construct a posterior predictive check for this
model and data. This means simulate the distribution of samples,
averaging over the posterior uncertainty in p. What is the probability
of observing 8 water in 15 tosses?
postPred<-rbinom(n=10000,size=15,prob=samples)
sum(postPred==8)/length(postPred)
3M4 with new prior. Using the posterior distribution constructed from
the new (8/15) data, now calculate the probability of observing 6 water
in 9 tosses.
postPred<-rbinom(n=1000000,size=9,prob=samples)
sum(postPred==6)/length(postPred)
This is an R Markdown
Notebook. When you execute code within the notebook, the results appear
beneath the code.
Try executing this chunk by clicking the Run button within
the chunk or by placing your cursor inside it and pressing
Cmd+Shift+Enter.
plot(cars)
Add a new chunk by clicking the Insert Chunk button on the
toolbar or by pressing Cmd+Option+I.
When you save the notebook, an HTML file containing the code and
output will be saved alongside it (click the Preview button or
press Cmd+Shift+K to preview the HTML file).
The preview shows you a rendered HTML copy of the contents of the
editor. Consequently, unlike Knit, Preview does not
run any R code chunks. Instead, the output of the chunk when it was last
run in the editor is displayed.
LS0tCnRpdGxlOiAiUiBOb3RlYm9vayIKb3V0cHV0OiBodG1sX25vdGVib29rCi0tLQoKCgpTRUNUSU9OIDI6IFNvbHV0aW9ucyBmcm9tIE1lZXRpbmcgMyBleGVyY2lzZXMKClJ1biB0aGlzIGNvZGUgZm9yIHByb2JsZW1zIDNFMS0zRTQuCgpgYGB7cn0KcF9ncmlkIDwtIHNlcSggZnJvbT0wICwgdG89MSAsIGxlbmd0aC5vdXQ9MTAwMCApCnByaW9yIDwtIHJlcCggMSAsIDEwMDAgKQpsaWtlbGlob29kIDwtIGRiaW5vbSggNiAsIHNpemU9OSAsIHByb2I9cF9ncmlkICkKcG9zdGVyaW9yIDwtIGxpa2VsaWhvb2QgKiBwcmlvcgpwb3N0ZXJpb3IgPC0gcG9zdGVyaW9yIC8gc3VtKHBvc3RlcmlvcikKc2V0LnNlZWQoMTAwKQpzYW1wbGVzIDwtIHNhbXBsZSggcF9ncmlkICwgcHJvYj1wb3N0ZXJpb3IgLCBzaXplPTFlNSAsIHJlcGxhY2U9VFJVRSApCmhpc3Qoc2FtcGxlcyxwcm9iYWJpbGl0eSA9IFRSVUUpCgpsaWJyYXJ5KHJldGhpbmtpbmcpCmRlbnMoc2FtcGxlcykKCnBsb3QocF9ncmlkLHBvc3RlcmlvcikKYGBgCgoKCjNFMS4gIEhvdyBtdWNoIHBvc3RlcmlvciBwcm9iYWJpbGl0eSBsaWVzIGJlbG93IHA9MC4yPwpgYGB7cn0KbGVuZ3RoKHNhbXBsZXNbc2FtcGxlczwwLjJdKS9sZW5ndGgoc2FtcGxlcykgIyBmcm9tIHNhbXBsaW5nIGZyb20gcG9zdGVyaW9yCgpzdW0oIHBvc3RlcmlvclsgcF9ncmlkIDwgMC4yIF0gKSAjIGZyb20gcG9zdGVyaW9yIGRpcmVjdGx5CgpgYGAKCgozRTIuICBIb3cgbXVjaCBwb3N0ZXJpb3IgcHJvYmFiaWxpdHkgbGllcyBhYm92ZSBwPTAuOD8KYGBge3J9Cmxlbmd0aChzYW1wbGVzW3NhbXBsZXM+MC44XSkvbGVuZ3RoKHNhbXBsZXMpICMgZnJvbSBzYW1wbGluZyBmcm9tIHBvc3RlcmlvcgoKc3VtKCBwb3N0ZXJpb3JbIHBfZ3JpZCA+IDAuOCBdICkgIyBmcm9tIHBvc3RlcmlvciBkaXJlY3RseQoKYGBgCgozRTMuICBIb3cgbXVjaCBwb3N0ZXJpb3IgcHJvYmFiaWxpdHkgbGllcyBiZXR3ZWVuIHA9MC4yIGFuZCBwPTAuOD8KCmBgYHtyfQpsZW5ndGgoc2FtcGxlc1tzYW1wbGVzPj0wLjIgJiBzYW1wbGVzPD0wLjhdKS9sZW5ndGgoc2FtcGxlcykgIyBmcm9tIHNhbXBsaW5nIGZyb20gcG9zdGVyaW9yCgpzdW0oIHBvc3RlcmlvclsgcF9ncmlkPj0wLjIgJiBwX2dyaWQgPD0gMC44IF0gKSAjIGZyb20gcG9zdGVyaW9yIGRpcmVjdGx5CgpgYGAKCgozRTQuICAyMCUgb2YgdGhlIHBvc3RlcmlvciBwcm9iYWJpbGl0eSBsaWVzIGJlbG93IHdoaWNoIHZhbHVlIG9mIHA/CgpgYGB7cn0KcXVhbnRpbGUoc2FtcGxlcywwLjIpICMgZnJvbSBzYW1wbGluZyBmcm9tIHBvc3RlcmlvcgoKc3VtKHBvc3RlcmlvcltwX2dyaWQ8MC41MTY1XSkgIyBjaGVja2luZyBhZ2FpbnMgcG9zdGVyaW9yCmBgYAoKM00xLiAgU3VwcG9zZSB0aGUgZ2xvYmUgdG9zc2luZyBkYXRhIGhhZCB0dXJuZWQgb3V0IHRvIGJlIDggd2F0ZXIgaW4gMTUgdG9zc2VzLiBDb25zdHJ1Y3QgdGhlIHBvc3RlcmlvciBkaXN0cmlidXRpb24sIHVzaW5nIGdyaWQgYXBwcm94aW1hdGlvbi4gVXNlIHRoZSBzYW1lIGZsYXQgcHJpb3IgYXMgYmVmb3JlLgoKYGBge3J9CnBfZ3JpZCA8LSBzZXEoIGZyb209MCAsIHRvPTEgLCBsZW5ndGgub3V0PTEwMDAgKQpwcmlvciA8LSByZXAoIDEgLCAxMDAwICkKbGlrZWxpaG9vZCA8LSBkYmlub20oIDggLCBzaXplPTE1ICwgcHJvYj1wX2dyaWQgKQpwb3N0ZXJpb3IgPC0gbGlrZWxpaG9vZCAqIHByaW9yCnBvc3RlcmlvciA8LSBwb3N0ZXJpb3IgLyBzdW0ocG9zdGVyaW9yKQpzZXQuc2VlZCgxMDApCnNhbXBsZXMgPC0gc2FtcGxlKCBwX2dyaWQgLCBwcm9iPXBvc3RlcmlvciAsIHNpemU9MWU1ICwgcmVwbGFjZT1UUlVFICkKaGlzdChzYW1wbGVzLHByb2JhYmlsaXR5ID0gVFJVRSkKCmxpYnJhcnkocmV0aGlua2luZykKZGVucyhzYW1wbGVzKQoKcGxvdChwX2dyaWQscG9zdGVyaW9yKQpgYGAKCgozTTMuICBDb25zdHJ1Y3QgYSBwb3N0ZXJpb3IgcHJlZGljdGl2ZSBjaGVjayBmb3IgdGhpcyBtb2RlbCBhbmQgZGF0YS4gVGhpcyBtZWFucyBzaW11bGF0ZSB0aGUgZGlzdHJpYnV0aW9uIG9mIHNhbXBsZXMsIGF2ZXJhZ2luZyBvdmVyIHRoZSBwb3N0ZXJpb3IgdW5jZXJ0YWludHkgaW4gcC4gV2hhdCBpcyB0aGUgcHJvYmFiaWxpdHkgb2Ygb2JzZXJ2aW5nIDggd2F0ZXIgaW4gMTUgdG9zc2VzPwoKYGBge3J9CnBfZ3JpZCA8LSBzZXEoIGZyb209MCAsIHRvPTEgLCBsZW5ndGgub3V0PTEwMDAgKQpwcmlvciA8LSByZXAoIDEgLCAxMDAwICkKbGlrZWxpaG9vZCA8LSBkYmlub20oIDggLCBzaXplPTE1ICwgcHJvYj1wX2dyaWQgKQpwb3N0ZXJpb3IgPC0gbGlrZWxpaG9vZCAqIHByaW9yCnBvc3RlcmlvciA8LSBwb3N0ZXJpb3IgLyBzdW0ocG9zdGVyaW9yKQpzZXQuc2VlZCgxMDApCnNhbXBsZXMgPC0gc2FtcGxlKCBwX2dyaWQgLCBwcm9iPXBvc3RlcmlvciAsIHNpemU9MWU1ICwgcmVwbGFjZT1UUlVFICkKIyBoaXN0KHNhbXBsZXMscHJvYmFiaWxpdHkgPSBUUlVFKQpwb3N0UHJlZDwtcmJpbm9tKG49MTAwMDAsc2l6ZT0xNSxwcm9iPXNhbXBsZXMpCgpoaXN0KHBvc3RQcmVkKQoKc3VtKHBvc3RQcmVkPT04KS9sZW5ndGgocG9zdFByZWQpCgpgYGAKCgoKM000LiAgVXNpbmcgdGhlIHBvc3RlcmlvciBkaXN0cmlidXRpb24gY29uc3RydWN0ZWQgZnJvbSB0aGUgbmV3ICg4LzE1KSBkYXRhLCBub3cgY2FsY3VsYXRlIHRoZSBwcm9iYWJpbGl0eSBvZiBvYnNlcnZpbmcgNiB3YXRlciBpbiA5IHRvc3Nlcy4KCmBgYHtyfQpwb3N0UHJlZDwtcmJpbm9tKG49MTAwMDAwMCxzaXplPTkscHJvYj1zYW1wbGVzKQpzdW0ocG9zdFByZWQ9PTYpL2xlbmd0aChwb3N0UHJlZCkKYGBgCgoKM001LiAgU3RhcnQgb3ZlciBhdCAzTTEsIGJ1dCBub3cgdXNlIGEgcHJpb3IgdGhhdCBpcyB6ZXJvIGJlbG93IHA9MC41IGFuZCBhIGNvbnN0YW50IGFib3ZlIHA9MC41LiBUaGlzIGNvcnJlc3BvbmRzIHRvIHByaW9yIGluZm9ybWF0aW9uIHRoYXQgYSBtYWpvcml0eSBvZiB0aGUgRWFydGjigJlzIHN1cmZhY2UgaXMgd2F0ZXIuIFJlcGVhdCBlYWNoIHByb2JsZW0gYWJvdmUgYW5kIGNvbXBhcmUgdGhlIGluZmVyZW5jZXMuIFdoYXQgZGlmZmVyZW5jZSBkb2VzIHRoZSBiZXR0ZXIgcHJpb3IgbWFrZT8gSWYgaXQgaGVscHMsIGNvbXBhcmUgaW5mZXJlbmNlcyAodXNpbmcgYm90aCBwcmlvcnMpIHRvIHRoZSB0cnVlIHZhbHVlIAoKYGBge3J9CnBfZ3JpZCA8LSBzZXEoIGZyb209MCAsIHRvPTEgLCBsZW5ndGgub3V0PTEwMDAgKQpwcmlvciA8LSByZXAoIDEgLCAxMDAwICkKcHJpb3I8LWlmZWxzZShwX2dyaWQ8PTAuNSwwLDEpCmxpa2VsaWhvb2QgPC0gZGJpbm9tKCA4ICwgc2l6ZT0xNSAsIHByb2I9cF9ncmlkICkKcG9zdGVyaW9yIDwtIGxpa2VsaWhvb2QgKiBwcmlvcgpwb3N0ZXJpb3IgPC0gcG9zdGVyaW9yIC8gc3VtKHBvc3RlcmlvcikKc2V0LnNlZWQoMTAwKQpzYW1wbGVzIDwtIHNhbXBsZSggcF9ncmlkICwgcHJvYj1wb3N0ZXJpb3IgLCBzaXplPTFlNSAsIHJlcGxhY2U9VFJVRSApCmhpc3Qoc2FtcGxlcyxwcm9iYWJpbGl0eSA9IFRSVUUpCgpsaWJyYXJ5KHJldGhpbmtpbmcpCmRlbnMoc2FtcGxlcykKCnBsb3QocF9ncmlkLHBvc3RlcmlvcikKYGBgCjNNMyB3aXRoIG5ldyBwcmlvci4gIENvbnN0cnVjdCBhIHBvc3RlcmlvciBwcmVkaWN0aXZlIGNoZWNrIGZvciB0aGlzIG1vZGVsIGFuZCBkYXRhLiBUaGlzIG1lYW5zIHNpbXVsYXRlIHRoZSBkaXN0cmlidXRpb24gb2Ygc2FtcGxlcywgYXZlcmFnaW5nIG92ZXIgdGhlIHBvc3RlcmlvciB1bmNlcnRhaW50eSBpbiBwLiBXaGF0IGlzIHRoZSBwcm9iYWJpbGl0eSBvZiBvYnNlcnZpbmcgOCB3YXRlciBpbiAxNSB0b3NzZXM/CmBgYHtyfQoKcG9zdFByZWQ8LXJiaW5vbShuPTEwMDAwLHNpemU9MTUscHJvYj1zYW1wbGVzKQpzdW0ocG9zdFByZWQ9PTgpL2xlbmd0aChwb3N0UHJlZCkKCmBgYAoKM000IHdpdGggbmV3IHByaW9yLiAgVXNpbmcgdGhlIHBvc3RlcmlvciBkaXN0cmlidXRpb24gY29uc3RydWN0ZWQgZnJvbSB0aGUgbmV3ICg4LzE1KSBkYXRhLCBub3cgY2FsY3VsYXRlIHRoZSBwcm9iYWJpbGl0eSBvZiBvYnNlcnZpbmcgNiB3YXRlciBpbiA5IHRvc3Nlcy4KCmBgYHtyfQpwb3N0UHJlZDwtcmJpbm9tKG49MTAwMDAwMCxzaXplPTkscHJvYj1zYW1wbGVzKQpzdW0ocG9zdFByZWQ9PTYpL2xlbmd0aChwb3N0UHJlZCkKYGBgCgoKCgoKClRoaXMgaXMgYW4gW1IgTWFya2Rvd25dKGh0dHA6Ly9ybWFya2Rvd24ucnN0dWRpby5jb20pIE5vdGVib29rLiBXaGVuIHlvdSBleGVjdXRlIGNvZGUgd2l0aGluIHRoZSBub3RlYm9vaywgdGhlIHJlc3VsdHMgYXBwZWFyIGJlbmVhdGggdGhlIGNvZGUuIAoKVHJ5IGV4ZWN1dGluZyB0aGlzIGNodW5rIGJ5IGNsaWNraW5nIHRoZSAqUnVuKiBidXR0b24gd2l0aGluIHRoZSBjaHVuayBvciBieSBwbGFjaW5nIHlvdXIgY3Vyc29yIGluc2lkZSBpdCBhbmQgcHJlc3NpbmcgKkNtZCtTaGlmdCtFbnRlciouIAoKYGBge3J9CnBsb3QoY2FycykKYGBgCgpBZGQgYSBuZXcgY2h1bmsgYnkgY2xpY2tpbmcgdGhlICpJbnNlcnQgQ2h1bmsqIGJ1dHRvbiBvbiB0aGUgdG9vbGJhciBvciBieSBwcmVzc2luZyAqQ21kK09wdGlvbitJKi4KCldoZW4geW91IHNhdmUgdGhlIG5vdGVib29rLCBhbiBIVE1MIGZpbGUgY29udGFpbmluZyB0aGUgY29kZSBhbmQgb3V0cHV0IHdpbGwgYmUgc2F2ZWQgYWxvbmdzaWRlIGl0IChjbGljayB0aGUgKlByZXZpZXcqIGJ1dHRvbiBvciBwcmVzcyAqQ21kK1NoaWZ0K0sqIHRvIHByZXZpZXcgdGhlIEhUTUwgZmlsZSkuIAoKVGhlIHByZXZpZXcgc2hvd3MgeW91IGEgcmVuZGVyZWQgSFRNTCBjb3B5IG9mIHRoZSBjb250ZW50cyBvZiB0aGUgZWRpdG9yLiBDb25zZXF1ZW50bHksIHVubGlrZSAqS25pdCosICpQcmV2aWV3KiBkb2VzIG5vdCBydW4gYW55IFIgY29kZSBjaHVua3MuIEluc3RlYWQsIHRoZSBvdXRwdXQgb2YgdGhlIGNodW5rIHdoZW4gaXQgd2FzIGxhc3QgcnVuIGluIHRoZSBlZGl0b3IgaXMgZGlzcGxheWVkLgoK