Probability Theory and Mathematical Statistics
- Probability theory and Statistics provides an essential basis in probability theory and mathematical statistics and educates students how to use these principles in practice. Another implicit purpose of PT&Stat is to guide the rst steps in students' research by suggesting more challenging topics and problems to the interested students. This kind of activity develops self-study skills and critical thinking, emphasizes importance of working with literature and provides many more helpful skills
- Be aware of different definitions of probability, the axioms of probability and their use for derivation of major probabilistic relationships. Know the basic counting methods and principles of combinatorics.
- Be able to use the concept of conditional probability, law of total probability, notion of independence, collectively exhaustive events.
- Understand what is meant by a random variable. Know how to use the probability mass functions for calculating the basic characteristics of a discrete random variable (expected value, variance). Be aware of commonly used discrete distributions.
- Know and be able to use alternative ways of describing a continuous random variable - probability density function and cumulative distribution function. Know how to calculate basic characteristics of a continuous random variable. Be aware of commonly used continuous distributions.
- Know how to work with a multivariate random variable using the joint probability distribution. Be able to detect the indepedent random variables, calculate the marginal and conditional distributions, covariance and correlation between the variables.
- Understand the role of limit theorems in the probability theory. Be able to use the Markov and Chebyshev inequalities in practice. Be able to implement the central limit theorem.
- Be able to use the methods of descriptive statistics to summarize and visualize the raw data.
- Be able to derive and use the main sampling distributions - for mean, proportion and variance
- Be able to estimate the main characteristics of a random variable by means of point or interval estimates. Know how to construct and interpret the confidence intervals for mean, proportion and variance.
- Understand the principles of hypothesis testing. Be able to perform tests for population mean, proportion and variance.
- Be able to build, assess the quality and make predictions with the linear regression model.
- Axioms of probabilityThe definition of probability. Interpretations of probability. Counting methods. Combinatorial analysis: permutations, combinations, Partitions, multinomial coefficients. Sampling with and without replacement. Sample space and events. Axioms of probability. Probability as a continuous set function. Venn diagrams.
- Conditional probability and independenceConditional probability. Independent events, mutually exclusive events. Exhaustive events. The law of total probability. Bayes' theorem. Probability trees.
- Discrete random variablesRandom variables. Discrete and continuous distributions. Cumulative distribution function and its properties. Probability mass function. Common discrete distributions: uniform, binomial, Poisson distributions. Sequences of Bernoulli trials. Expected value, variance and their properties. Functions of a random variable
- Continuous random variablesProperties of continuous random variables. Prob- ability density function. Expectation and variance of continuous random variables. Common continuous distributions (uniform, exponential, normal, chi-squared, F-distribution, Student's t- distribution) . The normal approximation of the binomial distribution.
- Jointly distributed random variablesJoint distributions of random variables. Independent random variables. Expected values, covariance. Sums of independent random variables. Conditional distributions. Marginal distributions. Conditional expectation and variance. Joint probability distribution of functions of random variables. Properties of multivariate normal distribution
- Limit theoremsMarkov's and Chebyshev's inequalities. Laws of large numbers for Bernoulli summands. The Poisson limit theorem. Weak and strong laws of large numbers. The central limit theorem. Convergence in probability.
- Methods of descriptive statisticsThe nature of statistics. Population, bias, parameters, sampling. Quantitative and categorical variables. Data presentation: dot plot , histogram, steam-and-leaf. Measures of location: mean, median, mode. Quartiles and percentiles. Measures of spread: range, variance and standard deviation, interquartile range
- Ideas of sampling and sampling distributionsSampling distributions. Sampling distributions for the mean. Distribution of the sample variance
- Point and interval estimatesProperties of estimators: bias, variance, mean squared error. Consistency. Finding estimators: method of moments, least squares, maximum likelihood. Confidence intervals for the mean of a normal population. Intervals for mean dierences (paired, unpaired samples) . Confidence intervals for proportions (single proportion, differences between proportions) . Confidence intervals for variance.
- Hypothesis testingNull and alternative hypotheses. One- and two-sided alternative hypotheses. Test statistics and critical regions, signicance levels. Type I and Type II errors. p-values. Level and power of the statistical test. Testing hypotheses about population means and proportions. Link to condence intervals. Two-sample tests. Testing hypotheses about population variances. Categorical data and nonparametric methods: contingency tables and the chi-squared test . Goodness-of-t tests
- Linear regression modelThe simple linear regression model. Least squares method. Coecient of determination. Means and variances for slope and intercept. Interval estimates for tted values. Prediction with the regression model. Multiple Regression. The model for multiple linear regression. Least squares tting. Collinearity. Diagnostic plots.
- Interim assessment (2 module)0.4 * Final Exam + 0.18 * Home assignments + 0.03 * in-class activity + 0.39 * In-class tests
- Biswas, D. (2019). Probability and Statistics: Volume I. [N.p.]: New Central Book Agency. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=2239779
- Blitzstein, J. K., & Hwang, J. (2019). Introduction to Probability, Second Edition (Vol. Second edition). Boca Raton, FL: Chapman and Hall/CRC. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=nlebk&AN=2024519
- Balakrishnan, N., Koutras, M. V., & Konstantinos, P. (2019). Introduction to Probability : Models and Applications. Hoboken, NJ: Wiley. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=2097342
- Ghahramani, S. (2018). Fundamentals of Probability : With Stochastic Processes (Vol. Fourth edition). Boca Raton, FL: Chapman and Hall/CRC. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=1875108
- Linde, W. (2017). Probability Theory : A First Course in Probability Theory and Statistics. [N.p.]: De Gruyter. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=1438416
- Linton, O. B. (2017). Probability, Statistics and Econometrics. London, United Kingdom: Academic Press. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=1200673
- Samuel Goldberg. (2013). Probability : An Introduction. [N.p.]: Dover Publications. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=1152975