• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site
Master 2019/2020

Bayesian Statistics: From Concept to Data Analysis

Type: Elective course (Comparative Social Research)
Area of studies: Sociology
Delivered by: School of Sociology
When: 2 year, 1 module
Mode of studies: distance learning
Instructors: Christian Fröhlich
Master’s programme: Comparative Soсial Research
Language: English
ECTS credits: 4
Contact hours: 2

Course Syllabus

Abstract

This course introduces the Bayesian approach to statistics, starting with the concept of probability and moving to the analysis of data. We will learn about the philosophy of the Bayesian approach as well as how to implement it for common types of data. We will compare the Bayesian approach to the more commonly-taught Frequentist approach, and see some of the benefits of the Bayesian approach. In particular, the Bayesian approach allows for better accounting of uncertainty, results that have more intuitive and interpretable meaning, and more explicit statements of assumptions. This course combines lecture videos, computer demonstrations, readings, exercises, and discussion boards to create an active learning experience. For computing, you have the choice of using Microsoft Excel or the open-source, freely available statistical package R, with equivalent content for both options. The lectures provide some of the basic mathematical development as well as explanations of philosophy and interpretation. Completion of this course will give you an understanding of the concepts of the Bayesian approach, understanding the key differences between Bayesian and Frequentist approaches, and the ability to do basic data analyses. The course is a Massive Open Online Course delivered at Coursera platform (https://www.coursera.org/learn/bayesian-statistics). Students are required to attend the course and take an oral examination at HSE for completing the course. The examination is taken after completion of the course during examination weeks. The full syllabus is published at the course website. (https://www.coursera.org/learn/bayesian-statistics). The course doesn’t require special previous knowledge and competences. Only for students of Comparative Social Research programme
Learning Objectives

Learning Objectives

  • Provide students understanding of the basic principles of Bayesian analysis
  • Provide students the opportunities which this statistical method offers for social scientists and its limitations
Expected Learning Outcomes

Expected Learning Outcomes

  • To ger knowledge about the philosophy of the Bayesian approach as well as how to implement it for common types of data
  • Apply Bayesian methods to the analysis of real data sets
  • Properly report the results of Bayesian analysis in research papers
Course Contents

Course Contents

  • Week 1: Probability and Bayes' Theorem
    In this module, we review the basics of probability and Bayes’ theorem. In Lesson 1, we introduce the different paradigms or definitions of probability and discuss why probability provides a coherent framework for dealing with uncertainty. In Lesson 2, we review the rules of conditional probability and introduce Bayes’ theorem. Lesson 3 reviews common probability distributions for discrete and continuous random variables.
  • Week 2: Statistical Inference
    This module introduces concepts of statistical inference from both frequentist and Bayesian perspectives. Lesson 4 takes the frequentist view, demonstrating maximum likelihood estimation and confidence intervals for binomial data. Lesson 5 introduces the fundamentals of Bayesian inference. Beginning with a binomial likelihood and prior probabilities for simple hypotheses, you will learn how to use Bayes’ theorem to update the prior with data to obtain posterior probabilities. This framework is extended with the continuous version of Bayes theorem to estimate continuous model parameters, and calculate posterior probabilities and credible intervals
  • Week 3: Priors and Models for Discrete Data
    In this module, you will learn methods for selecting prior distributions and building models for discrete data. Lesson 6 introduces prior selection and predictive distributions as a means of evaluating priors. Lesson 7 demonstrates Bayesian analysis of Bernoulli data and introduces the computationally convenient concept of conjugate priors. Lesson 8 builds a conjugate model for Poisson data and discusses strategies for selection of prior hyperparameters
  • Week 4: Models for Continuous Data
    This module covers conjugate and objective Bayesian analysis for continuous data. Lesson 9 presents the conjugate model for exponentially distributed data. Lesson 10 discusses models for normally distributed data, which play a central role in statistics. In Lesson 11, we return to prior selection and discuss ‘objective’ or ‘non-informative’ priors. Lesson 12 presents Bayesian linear regression with non-informative priors, which yield results comparable to those of classical regression
Assessment Elements

Assessment Elements

  • non-blocking MOOC final results (certificate/another document).
  • non-blocking oral exam
Interim Assessment

Interim Assessment

  • Interim assessment (1 module)
    After attending the MOOC it is required to present the final results (certificate or another document - C). The document has to be submitted to the study office immediately after completion of the course. After successful completion of the course an examination is undertaken. Prerequisite for attending the examination is submission of the certificate to the study office. The examination grade (E) is the final grade for the course. Final control: oral group exam. The overall course grade (G) (10-point scale) is calculated as a sum of G = C*0.7+ E*0.3
Bibliography

Bibliography

Recommended Core Bibliography

  • Bolstad, W. M. (2017). Introduction to Bayesian Statistics (Vol. Third edition). Hoboken, N.J.: Wiley. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=1342637
  • Harney, H. L. (2016). Bayesian Inference : Data Evaluation and Decisions (Vol. 2nd ed). Switzerland: Springer. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=1301176

Recommended Additional Bibliography

  • Donovan, T. M., & Mickey, R. M. (2019). Bayesian Statistics for Beginners : A Step-by-step Approach. Oxford: OUP Oxford. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=2139683
  • Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2014). Bayesian Data Analysis (Vol. Third edition). Boca Raton: Chapman and Hall/CRC. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=nlebk&AN=1763244
  • Li, K., & Principe, J. C. (2019). Functional Bayesian Filter. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsarx&AN=edsarx.1911.10606