• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • А
  • А
  • А
  • А
  • А
Обычная версия сайта

Бакалаврская программа «Программа двух дипломов по экономике НИУ ВШЭ и Лондонского университета»

Data Science for Economics

2019/2020
Учебный год
ENG
Обучение ведется на английском языке
4
Кредиты
Статус:
Курс по выбору
Когда читается:
4-й курс, 1, 2 модуль

Course Syllabus

Abstract

The course consists of three parts: 1. Introduction to programming; 2. Overview of the most commonly used machine learning algorithms; 3. Time permitting, an introduction to causal inference and applications of machine learning algorithms to causal inference. In the first part of the course students will learn basic programming using computing language R. Obtained skills will allow to implement all methods taught subsequently. Additionally, students will learn how to explore and analyse structured and un-structured data sets. Finally, provided introduction to programming will also be useful in subsequent courses in econometrics and economics. At first, to gain intuition, we will study how to solve the problem in a brute force manner and then explore R packages and built in functions to deal with a problem in the most efficient manner. In the second part of the course we will focus on most commonly used machine learning algorithms. We will cover regression techniques (parametric, nonparametric and high-dimensional), classification methods, resampling methods, model selection, unsupervised learning and text analysis (time permitting). Finally, in the last part of the course we will cover research papers which have recently applied machine learning methods to causal inference in economics. Course Pre-requisites: Statistics; Mathematics for Economists. In the second part of the course I will present and derive statistical properties of various estimators. To be able to follow this part of the course students should have a certain level of mathematical maturity. In practice, this means that students should have done some simple mathematical proofs before taking this class (for example, understand “epsilon-delta” arguments in the context of limits of sequences).
Learning Objectives

Learning Objectives

  • The objective of this course is to provide students with a hands on introduction to data science in economics (or more broadly to data science in the social sciences).
  • At the end of the course students should have developed the following skills: Ability to write simple computer programs using computing language R;
  • Implement basic machine learning algorithms;
  • Understand assumptions and statistical properties of machine learning algorithms;
  • Be able to use machine learning algorithms to solve real world business problems.
Expected Learning Outcomes

Expected Learning Outcomes

  • explain how the data science is used in industry and in academia
  • be able to manipulate basic data structures used in the computing language R
  • solve data science problems implementing control structures and functions
  • implement data.table framework
  • be able to avoid unnecessary control structures
  • write basic regular expressions
  • extract and summarize the data from .html and .xml files
  • apply basic ideas of statistical learning
  • derive OLS estimator both in the univariate and in the multivariate case
  • analyse unbiasedness, consistency and obtain asymptotic distribution of these estimators
  • implement OLS estimator in the computing language R, analyse their properties using Monte – Carlo simulations and also apply OLS estimation techniques to the real data
  • Implement logit and linear (quadratic) discriminant analysis using the computing language R
  • Implement both model selection techniques and bootstrap methods using the computing language R
  • Implement estimators of linear model selection on the computer, using the computing language R
  • be able to study properties of kernel estimators using Monte – Carlo techniques and apply these estimators on real datasets using the computing language R
  • be able to use non – parametric techniques
  • implement algorithms (regression trees, classification trees, bagging, random forest, boosting) using the computing language R
  • implement algorithms (maximal margin classifier, support vector classifier, support vector machine) using the computing language R
  • implement PCA, K – Means clustering, Hierarchical clustering using the computing language R
  • explain how machine learning methods are used in the causal inference in the “conditional on observables” framework.
Course Contents

Course Contents

  • Introduction to Data Science In Economics
    Overview of the course. Data science process. Overview of the usage of machine learning algorithms in economics. General introduction to R and Rstudio. Data types and classes in R. R objects. Subsetting of R objects
  • Control Structures and Functions
    Control structures in R: if – else, for loops, nested for loops, while loops, repeat loops, next, break. Functions in R
  • Vectorized Computation and Data Aggregation
    Usage of “apply” family in R. Usage of a data.table package in R
  • Working With Text and the Web
    Usage of a stringr package in R. Regular expressions in R. The structure of HTML and XML documents. Writing simple XML and HTML parsers.
  • Introduction to Statistical Learning
    Classification and regression, bias – variance tradeoff, mean squared error, in sample and out of sample mean squared error, parametric and nonparametric statistical models. First look at ordinary least squares (OLS) estimator.
  • Large Sample Properties of OLS
    Review of “asymptotic tools”. “Linear plus noise representation” of OLS. Derivation of asymptotic properties of OLS. OLS in the matrix form.
  • Classification
    Introduction to the logistic regression. Estimation of the logistic regression via MLE. Discussion of the statistical properties of MLE. Linear discriminant analysis, quadratic discriminant analysis.
  • Resampling Methods
    Cross – Validation, jacknife, bootstrap, subsampling
  • Linear Model Selection and Regularization
    Best subset selection, stepwise forward selection, backward forward selection, dimension reduction methods. Ridge regression. Lasso regression
  • Nonparametric Estimation
    Polynomial regression, step functions, basis functions, regression splines, smoothing splines, kernel – methods, generalized additive models.
  • Tree Based Methods
    Decision trees, bagging, random forests, boosting.
  • Support Vector Machines
  • Unsupervised Learning
  • Topics in Causal Inference
Assessment Elements

Assessment Elements

  • non-blocking assignment 1-4
    4 assignments, 15% each
  • non-blocking Final Exam
Interim Assessment

Interim Assessment

  • Interim assessment (2 module)
    0.6 * assignment 1-4 + 0.4 * Final Exam
Bibliography

Bibliography

Recommended Core Bibliography

  • Alexandre Belloni, Victor Chernozhukov, & Christian Hansen. (2014). High-Dimensional Methods and Inference on Structural and Treatment Effects. Journal of Economic Perspectives, (2), 29. https://doi.org/10.1257/jep.28.2.29
  • Einav, L., & Levin, J. (2014). Economics in the age of big data. Science, 346(6210), 1–6. https://doi.org/10.1126/science.1243089
  • Gareth James, Daniela Witten, Trevor Hastie, Rob Tibshirani, & Maintainer Trevor Hastie. (2013). Type Package Title Data for An Introduction to Statistical Learning with Applications in R Version 1.0. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.28D80286
  • Sendhil Mullainathan, & Jann Spiess. (2017). Machine Learning: An Applied Econometric Approach. Journal of Economic Perspectives, (2), 87. https://doi.org/10.1257/jep.31.2.87

Recommended Additional Bibliography

  • Murphy, K. P. (2012). Machine Learning : A Probabilistic Perspective. Cambridge, Mass: The MIT Press. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=480968