SECTION 2: Solutions from Meeting 3 exercises

Run this code for problems 3E1-3E4.

p_grid <- seq( from=0 , to=1 , length.out=1000 )
prior <- rep( 1 , 1000 )
likelihood <- dbinom( 6 , size=9 , prob=p_grid )
posterior <- likelihood * prior
posterior <- posterior / sum(posterior)
set.seed(100)
samples <- sample( p_grid , prob=posterior , size=1e5 , replace=TRUE )
hist(samples,probability = TRUE)

library(rethinking)
dens(samples)

plot(p_grid,posterior)

3E1. How much posterior probability lies below p=0.2?

length(samples[samples<0.2])/length(samples) # from sampling from posterior

sum( posterior[ p_grid < 0.2 ] ) # from posterior directly

3E2. How much posterior probability lies above p=0.8?

length(samples[samples>0.8])/length(samples) # from sampling from posterior

sum( posterior[ p_grid > 0.8 ] ) # from posterior directly

3E3. How much posterior probability lies between p=0.2 and p=0.8?

length(samples[samples>=0.2 & samples<=0.8])/length(samples) # from sampling from posterior

sum( posterior[ p_grid>=0.2 & p_grid <= 0.8 ] ) # from posterior directly

3E4. 20% of the posterior probability lies below which value of p?

quantile(samples,0.2) # from sampling from posterior

sum(posterior[p_grid<0.5165]) # checking agains posterior

3M1. Suppose the globe tossing data had turned out to be 8 water in 15 tosses. Construct the posterior distribution, using grid approximation. Use the same flat prior as before.

p_grid <- seq( from=0 , to=1 , length.out=1000 )
prior <- rep( 1 , 1000 )
likelihood <- dbinom( 8 , size=15 , prob=p_grid )
posterior <- likelihood * prior
posterior <- posterior / sum(posterior)
set.seed(100)
samples <- sample( p_grid , prob=posterior , size=1e5 , replace=TRUE )
hist(samples,probability = TRUE)

library(rethinking)
dens(samples)

plot(p_grid,posterior)

3M3. Construct a posterior predictive check for this model and data. This means simulate the distribution of samples, averaging over the posterior uncertainty in p. What is the probability of observing 8 water in 15 tosses?

p_grid <- seq( from=0 , to=1 , length.out=1000 )
prior <- rep( 1 , 1000 )
likelihood <- dbinom( 8 , size=15 , prob=p_grid )
posterior <- likelihood * prior
posterior <- posterior / sum(posterior)
set.seed(100)
samples <- sample( p_grid , prob=posterior , size=1e5 , replace=TRUE )
# hist(samples,probability = TRUE)
postPred<-rbinom(n=10000,size=15,prob=samples)

hist(postPred)

sum(postPred==8)/length(postPred)

3M4. Using the posterior distribution constructed from the new (8/15) data, now calculate the probability of observing 6 water in 9 tosses.

postPred<-rbinom(n=1000000,size=9,prob=samples)
sum(postPred==6)/length(postPred)

3M5. Start over at 3M1, but now use a prior that is zero below p=0.5 and a constant above p=0.5. This corresponds to prior information that a majority of the Earth’s surface is water. Repeat each problem above and compare the inferences. What difference does the better prior make? If it helps, compare inferences (using both priors) to the true value

p_grid <- seq( from=0 , to=1 , length.out=1000 )
prior <- rep( 1 , 1000 )
prior<-ifelse(p_grid<=0.5,0,1)
likelihood <- dbinom( 8 , size=15 , prob=p_grid )
posterior <- likelihood * prior
posterior <- posterior / sum(posterior)
set.seed(100)
samples <- sample( p_grid , prob=posterior , size=1e5 , replace=TRUE )
hist(samples,probability = TRUE)

library(rethinking)
dens(samples)

plot(p_grid,posterior)

3M3 with new prior. Construct a posterior predictive check for this model and data. This means simulate the distribution of samples, averaging over the posterior uncertainty in p. What is the probability of observing 8 water in 15 tosses?


postPred<-rbinom(n=10000,size=15,prob=samples)
sum(postPred==8)/length(postPred)

3M4 with new prior. Using the posterior distribution constructed from the new (8/15) data, now calculate the probability of observing 6 water in 9 tosses.

postPred<-rbinom(n=1000000,size=9,prob=samples)
sum(postPred==6)/length(postPred)

This is an R Markdown Notebook. When you execute code within the notebook, the results appear beneath the code.

Try executing this chunk by clicking the Run button within the chunk or by placing your cursor inside it and pressing Cmd+Shift+Enter.

plot(cars)

Add a new chunk by clicking the Insert Chunk button on the toolbar or by pressing Cmd+Option+I.

When you save the notebook, an HTML file containing the code and output will be saved alongside it (click the Preview button or press Cmd+Shift+K to preview the HTML file).

The preview shows you a rendered HTML copy of the contents of the editor. Consequently, unlike Knit, Preview does not run any R code chunks. Instead, the output of the chunk when it was last run in the editor is displayed.

LS0tCnRpdGxlOiAiUiBOb3RlYm9vayIKb3V0cHV0OiBodG1sX25vdGVib29rCi0tLQoKCgpTRUNUSU9OIDI6IFNvbHV0aW9ucyBmcm9tIE1lZXRpbmcgMyBleGVyY2lzZXMKClJ1biB0aGlzIGNvZGUgZm9yIHByb2JsZW1zIDNFMS0zRTQuCgpgYGB7cn0KcF9ncmlkIDwtIHNlcSggZnJvbT0wICwgdG89MSAsIGxlbmd0aC5vdXQ9MTAwMCApCnByaW9yIDwtIHJlcCggMSAsIDEwMDAgKQpsaWtlbGlob29kIDwtIGRiaW5vbSggNiAsIHNpemU9OSAsIHByb2I9cF9ncmlkICkKcG9zdGVyaW9yIDwtIGxpa2VsaWhvb2QgKiBwcmlvcgpwb3N0ZXJpb3IgPC0gcG9zdGVyaW9yIC8gc3VtKHBvc3RlcmlvcikKc2V0LnNlZWQoMTAwKQpzYW1wbGVzIDwtIHNhbXBsZSggcF9ncmlkICwgcHJvYj1wb3N0ZXJpb3IgLCBzaXplPTFlNSAsIHJlcGxhY2U9VFJVRSApCmhpc3Qoc2FtcGxlcyxwcm9iYWJpbGl0eSA9IFRSVUUpCgpsaWJyYXJ5KHJldGhpbmtpbmcpCmRlbnMoc2FtcGxlcykKCnBsb3QocF9ncmlkLHBvc3RlcmlvcikKYGBgCgoKCjNFMS4gIEhvdyBtdWNoIHBvc3RlcmlvciBwcm9iYWJpbGl0eSBsaWVzIGJlbG93IHA9MC4yPwpgYGB7cn0KbGVuZ3RoKHNhbXBsZXNbc2FtcGxlczwwLjJdKS9sZW5ndGgoc2FtcGxlcykgIyBmcm9tIHNhbXBsaW5nIGZyb20gcG9zdGVyaW9yCgpzdW0oIHBvc3RlcmlvclsgcF9ncmlkIDwgMC4yIF0gKSAjIGZyb20gcG9zdGVyaW9yIGRpcmVjdGx5CgpgYGAKCgozRTIuICBIb3cgbXVjaCBwb3N0ZXJpb3IgcHJvYmFiaWxpdHkgbGllcyBhYm92ZSBwPTAuOD8KYGBge3J9Cmxlbmd0aChzYW1wbGVzW3NhbXBsZXM+MC44XSkvbGVuZ3RoKHNhbXBsZXMpICMgZnJvbSBzYW1wbGluZyBmcm9tIHBvc3RlcmlvcgoKc3VtKCBwb3N0ZXJpb3JbIHBfZ3JpZCA+IDAuOCBdICkgIyBmcm9tIHBvc3RlcmlvciBkaXJlY3RseQoKYGBgCgozRTMuICBIb3cgbXVjaCBwb3N0ZXJpb3IgcHJvYmFiaWxpdHkgbGllcyBiZXR3ZWVuIHA9MC4yIGFuZCBwPTAuOD8KCmBgYHtyfQpsZW5ndGgoc2FtcGxlc1tzYW1wbGVzPj0wLjIgJiBzYW1wbGVzPD0wLjhdKS9sZW5ndGgoc2FtcGxlcykgIyBmcm9tIHNhbXBsaW5nIGZyb20gcG9zdGVyaW9yCgpzdW0oIHBvc3RlcmlvclsgcF9ncmlkPj0wLjIgJiBwX2dyaWQgPD0gMC44IF0gKSAjIGZyb20gcG9zdGVyaW9yIGRpcmVjdGx5CgpgYGAKCgozRTQuICAyMCUgb2YgdGhlIHBvc3RlcmlvciBwcm9iYWJpbGl0eSBsaWVzIGJlbG93IHdoaWNoIHZhbHVlIG9mIHA/CgpgYGB7cn0KcXVhbnRpbGUoc2FtcGxlcywwLjIpICMgZnJvbSBzYW1wbGluZyBmcm9tIHBvc3RlcmlvcgoKc3VtKHBvc3RlcmlvcltwX2dyaWQ8MC41MTY1XSkgIyBjaGVja2luZyBhZ2FpbnMgcG9zdGVyaW9yCmBgYAoKM00xLiAgU3VwcG9zZSB0aGUgZ2xvYmUgdG9zc2luZyBkYXRhIGhhZCB0dXJuZWQgb3V0IHRvIGJlIDggd2F0ZXIgaW4gMTUgdG9zc2VzLiBDb25zdHJ1Y3QgdGhlIHBvc3RlcmlvciBkaXN0cmlidXRpb24sIHVzaW5nIGdyaWQgYXBwcm94aW1hdGlvbi4gVXNlIHRoZSBzYW1lIGZsYXQgcHJpb3IgYXMgYmVmb3JlLgoKYGBge3J9CnBfZ3JpZCA8LSBzZXEoIGZyb209MCAsIHRvPTEgLCBsZW5ndGgub3V0PTEwMDAgKQpwcmlvciA8LSByZXAoIDEgLCAxMDAwICkKbGlrZWxpaG9vZCA8LSBkYmlub20oIDggLCBzaXplPTE1ICwgcHJvYj1wX2dyaWQgKQpwb3N0ZXJpb3IgPC0gbGlrZWxpaG9vZCAqIHByaW9yCnBvc3RlcmlvciA8LSBwb3N0ZXJpb3IgLyBzdW0ocG9zdGVyaW9yKQpzZXQuc2VlZCgxMDApCnNhbXBsZXMgPC0gc2FtcGxlKCBwX2dyaWQgLCBwcm9iPXBvc3RlcmlvciAsIHNpemU9MWU1ICwgcmVwbGFjZT1UUlVFICkKaGlzdChzYW1wbGVzLHByb2JhYmlsaXR5ID0gVFJVRSkKCmxpYnJhcnkocmV0aGlua2luZykKZGVucyhzYW1wbGVzKQoKcGxvdChwX2dyaWQscG9zdGVyaW9yKQpgYGAKCgozTTMuICBDb25zdHJ1Y3QgYSBwb3N0ZXJpb3IgcHJlZGljdGl2ZSBjaGVjayBmb3IgdGhpcyBtb2RlbCBhbmQgZGF0YS4gVGhpcyBtZWFucyBzaW11bGF0ZSB0aGUgZGlzdHJpYnV0aW9uIG9mIHNhbXBsZXMsIGF2ZXJhZ2luZyBvdmVyIHRoZSBwb3N0ZXJpb3IgdW5jZXJ0YWludHkgaW4gcC4gV2hhdCBpcyB0aGUgcHJvYmFiaWxpdHkgb2Ygb2JzZXJ2aW5nIDggd2F0ZXIgaW4gMTUgdG9zc2VzPwoKYGBge3J9CnBfZ3JpZCA8LSBzZXEoIGZyb209MCAsIHRvPTEgLCBsZW5ndGgub3V0PTEwMDAgKQpwcmlvciA8LSByZXAoIDEgLCAxMDAwICkKbGlrZWxpaG9vZCA8LSBkYmlub20oIDggLCBzaXplPTE1ICwgcHJvYj1wX2dyaWQgKQpwb3N0ZXJpb3IgPC0gbGlrZWxpaG9vZCAqIHByaW9yCnBvc3RlcmlvciA8LSBwb3N0ZXJpb3IgLyBzdW0ocG9zdGVyaW9yKQpzZXQuc2VlZCgxMDApCnNhbXBsZXMgPC0gc2FtcGxlKCBwX2dyaWQgLCBwcm9iPXBvc3RlcmlvciAsIHNpemU9MWU1ICwgcmVwbGFjZT1UUlVFICkKIyBoaXN0KHNhbXBsZXMscHJvYmFiaWxpdHkgPSBUUlVFKQpwb3N0UHJlZDwtcmJpbm9tKG49MTAwMDAsc2l6ZT0xNSxwcm9iPXNhbXBsZXMpCgpoaXN0KHBvc3RQcmVkKQoKc3VtKHBvc3RQcmVkPT04KS9sZW5ndGgocG9zdFByZWQpCgpgYGAKCgoKM000LiAgVXNpbmcgdGhlIHBvc3RlcmlvciBkaXN0cmlidXRpb24gY29uc3RydWN0ZWQgZnJvbSB0aGUgbmV3ICg4LzE1KSBkYXRhLCBub3cgY2FsY3VsYXRlIHRoZSBwcm9iYWJpbGl0eSBvZiBvYnNlcnZpbmcgNiB3YXRlciBpbiA5IHRvc3Nlcy4KCmBgYHtyfQpwb3N0UHJlZDwtcmJpbm9tKG49MTAwMDAwMCxzaXplPTkscHJvYj1zYW1wbGVzKQpzdW0ocG9zdFByZWQ9PTYpL2xlbmd0aChwb3N0UHJlZCkKYGBgCgoKM001LiAgU3RhcnQgb3ZlciBhdCAzTTEsIGJ1dCBub3cgdXNlIGEgcHJpb3IgdGhhdCBpcyB6ZXJvIGJlbG93IHA9MC41IGFuZCBhIGNvbnN0YW50IGFib3ZlIHA9MC41LiBUaGlzIGNvcnJlc3BvbmRzIHRvIHByaW9yIGluZm9ybWF0aW9uIHRoYXQgYSBtYWpvcml0eSBvZiB0aGUgRWFydGjigJlzIHN1cmZhY2UgaXMgd2F0ZXIuIFJlcGVhdCBlYWNoIHByb2JsZW0gYWJvdmUgYW5kIGNvbXBhcmUgdGhlIGluZmVyZW5jZXMuIFdoYXQgZGlmZmVyZW5jZSBkb2VzIHRoZSBiZXR0ZXIgcHJpb3IgbWFrZT8gSWYgaXQgaGVscHMsIGNvbXBhcmUgaW5mZXJlbmNlcyAodXNpbmcgYm90aCBwcmlvcnMpIHRvIHRoZSB0cnVlIHZhbHVlIAoKYGBge3J9CnBfZ3JpZCA8LSBzZXEoIGZyb209MCAsIHRvPTEgLCBsZW5ndGgub3V0PTEwMDAgKQpwcmlvciA8LSByZXAoIDEgLCAxMDAwICkKcHJpb3I8LWlmZWxzZShwX2dyaWQ8PTAuNSwwLDEpCmxpa2VsaWhvb2QgPC0gZGJpbm9tKCA4ICwgc2l6ZT0xNSAsIHByb2I9cF9ncmlkICkKcG9zdGVyaW9yIDwtIGxpa2VsaWhvb2QgKiBwcmlvcgpwb3N0ZXJpb3IgPC0gcG9zdGVyaW9yIC8gc3VtKHBvc3RlcmlvcikKc2V0LnNlZWQoMTAwKQpzYW1wbGVzIDwtIHNhbXBsZSggcF9ncmlkICwgcHJvYj1wb3N0ZXJpb3IgLCBzaXplPTFlNSAsIHJlcGxhY2U9VFJVRSApCmhpc3Qoc2FtcGxlcyxwcm9iYWJpbGl0eSA9IFRSVUUpCgpsaWJyYXJ5KHJldGhpbmtpbmcpCmRlbnMoc2FtcGxlcykKCnBsb3QocF9ncmlkLHBvc3RlcmlvcikKYGBgCjNNMyB3aXRoIG5ldyBwcmlvci4gIENvbnN0cnVjdCBhIHBvc3RlcmlvciBwcmVkaWN0aXZlIGNoZWNrIGZvciB0aGlzIG1vZGVsIGFuZCBkYXRhLiBUaGlzIG1lYW5zIHNpbXVsYXRlIHRoZSBkaXN0cmlidXRpb24gb2Ygc2FtcGxlcywgYXZlcmFnaW5nIG92ZXIgdGhlIHBvc3RlcmlvciB1bmNlcnRhaW50eSBpbiBwLiBXaGF0IGlzIHRoZSBwcm9iYWJpbGl0eSBvZiBvYnNlcnZpbmcgOCB3YXRlciBpbiAxNSB0b3NzZXM/CmBgYHtyfQoKcG9zdFByZWQ8LXJiaW5vbShuPTEwMDAwLHNpemU9MTUscHJvYj1zYW1wbGVzKQpzdW0ocG9zdFByZWQ9PTgpL2xlbmd0aChwb3N0UHJlZCkKCmBgYAoKM000IHdpdGggbmV3IHByaW9yLiAgVXNpbmcgdGhlIHBvc3RlcmlvciBkaXN0cmlidXRpb24gY29uc3RydWN0ZWQgZnJvbSB0aGUgbmV3ICg4LzE1KSBkYXRhLCBub3cgY2FsY3VsYXRlIHRoZSBwcm9iYWJpbGl0eSBvZiBvYnNlcnZpbmcgNiB3YXRlciBpbiA5IHRvc3Nlcy4KCmBgYHtyfQpwb3N0UHJlZDwtcmJpbm9tKG49MTAwMDAwMCxzaXplPTkscHJvYj1zYW1wbGVzKQpzdW0ocG9zdFByZWQ9PTYpL2xlbmd0aChwb3N0UHJlZCkKYGBgCgoKCgoKClRoaXMgaXMgYW4gW1IgTWFya2Rvd25dKGh0dHA6Ly9ybWFya2Rvd24ucnN0dWRpby5jb20pIE5vdGVib29rLiBXaGVuIHlvdSBleGVjdXRlIGNvZGUgd2l0aGluIHRoZSBub3RlYm9vaywgdGhlIHJlc3VsdHMgYXBwZWFyIGJlbmVhdGggdGhlIGNvZGUuIAoKVHJ5IGV4ZWN1dGluZyB0aGlzIGNodW5rIGJ5IGNsaWNraW5nIHRoZSAqUnVuKiBidXR0b24gd2l0aGluIHRoZSBjaHVuayBvciBieSBwbGFjaW5nIHlvdXIgY3Vyc29yIGluc2lkZSBpdCBhbmQgcHJlc3NpbmcgKkNtZCtTaGlmdCtFbnRlciouIAoKYGBge3J9CnBsb3QoY2FycykKYGBgCgpBZGQgYSBuZXcgY2h1bmsgYnkgY2xpY2tpbmcgdGhlICpJbnNlcnQgQ2h1bmsqIGJ1dHRvbiBvbiB0aGUgdG9vbGJhciBvciBieSBwcmVzc2luZyAqQ21kK09wdGlvbitJKi4KCldoZW4geW91IHNhdmUgdGhlIG5vdGVib29rLCBhbiBIVE1MIGZpbGUgY29udGFpbmluZyB0aGUgY29kZSBhbmQgb3V0cHV0IHdpbGwgYmUgc2F2ZWQgYWxvbmdzaWRlIGl0IChjbGljayB0aGUgKlByZXZpZXcqIGJ1dHRvbiBvciBwcmVzcyAqQ21kK1NoaWZ0K0sqIHRvIHByZXZpZXcgdGhlIEhUTUwgZmlsZSkuIAoKVGhlIHByZXZpZXcgc2hvd3MgeW91IGEgcmVuZGVyZWQgSFRNTCBjb3B5IG9mIHRoZSBjb250ZW50cyBvZiB0aGUgZWRpdG9yLiBDb25zZXF1ZW50bHksIHVubGlrZSAqS25pdCosICpQcmV2aWV3KiBkb2VzIG5vdCBydW4gYW55IFIgY29kZSBjaHVua3MuIEluc3RlYWQsIHRoZSBvdXRwdXQgb2YgdGhlIGNodW5rIHdoZW4gaXQgd2FzIGxhc3QgcnVuIGluIHRoZSBlZGl0b3IgaXMgZGlzcGxheWVkLgoK