University of Technology Sydney

37457 Advanced Bayesian Methods

Warning: The information on this page is indicative. The subject outline for a particular session, location and mode of offering is the authoritative source of all information about the subject for that offering. Required texts, recommended texts and references in particular are likely to change. Students will be provided with a subject outline once they enrol in the subject.

Subject handbook information prior to 2024 is available in the Archives.

UTS: Science: Mathematical and Physical Sciences
Credit points: 8 cp
Result type: Grade and marks

Requisite(s): 36103 Statistical Thinking for Data Science
These requisites may not apply to students in certain courses.
There are course requisites for this subject. See access conditions.
Anti-requisite(s): 37458 Advanced Bayesian Methods

Description

This subject covers advanced Bayesian methods for statistical data analyses and inference. Principles of the underlying methodology, based on graph theory, is also covered. Models include generalised linear models, linear mixed models and generalised additive models. The 'R', 'JAGS' and 'Stan' computing environments are used for analysis of a wide array of data sets.

Subject learning objectives (SLOs)

Upon successful completion of this subject students should be able to:

1. Have a thorough understanding of the roles of estimation and prediction in advanced data analysis.
2. Formulate regression models for analysis of a complicated data set. Complications may include data with repeated measures or a categorical response variable. Models include generalised linear models and mixed models.
3. Fit such models and perform subsequent analyses and diagnostics using the computer packages "R", "BUGS" and/or "Stan".
4. Derive expressions used for fitting and inference in generalised linear and mixed models.
5. Write independent code in the R language.
6. Write reports that summarise the results of statistical analyses.
7. Evaluate and analyse recent statistical literature.

Course intended learning outcomes (CILOs)

This subject also contributes specifically to the development of following course intended learning outcomes:

  • Appraise advanced knowledge and critically evaluate and question the information's source and relevance, with a focus on applications of mathematical methodologies to quantitative finance problem solving. (1.1)
  • Investigate complex and challenging real-world problems in the areas of quantitative finance by critically evaluating information and solutions and conducting appropriate approaches to independent research. (2.1)
  • Develop and present complex ideas and justifications using appropriate communication approaches from a variety of methods (oral, written, visual) to communicate with mathematicians, data analysts, scientists,industry, and the general public. (5.1)

Contribution to the development of graduate attributes

1. Disciplinary knowledge and its appropriate application.

The lectures and weekly assignment and laboratory exercises impart skills necessary in a number of mathematical disciplines and demonstrate how to apply these skills to a variety of problems.

2. Research, inquiry and critical thinking.

A major component of the weekly assignment and laboratory exercises is the consideration of how best to both quantitatively and/or qualitatively solve a given question. Statisticians who work in industry are often required to solve problems and this subject imparts the skills necessary to solve both routine and complex problems in any discipline.

5. Communication.

The weekly assignment and laboratory exercises illustrate how to present written solutions to statistical problems using appropriate professional language.

Teaching and learning strategies

The presentation of this subject consists of 2 hours of lectures, 1 hour of computer laboratory and a 1 hour help session with weekly assignments when necessary.

Face-to-face classes will incorporate a range of teaching and learning strategies including presentations, discussion of readings and solving quantitative exercises on whiteboard and collaborative group work. These will be complemented by independent student reading to prepare for the class where they will use the information to participate in discussions and solve exercises. These discussion sessions are inquiry-led, with students given a question or topic to dissect in more detail through critical questioning and investigation. Since this is a 6cp subject, we expect that students will need to do about 10 hours per week to master the material.

Most students will attend three hours of classes each week and spend about 7 hours per week reading the reference book, solving the exercises handed out in class and reviewing the solutions provided to class exercises. Feedback in the format of partial worked solutions will be provided for these exercises (and the weekly assignments) and there will be opportunities to ask questions about these in class and in labs. The partial solutions are also provided online for flexible access.

Content (topics)

Graph theory; probabilistic graph theory; Bayesian inference; Bayesian inference engines; generalized linear models; generalized linear mixed models; generalized additive models.

Assessment

Assessment task 1: Assignments

Intent:

This assessment item addresses the following graduate attributes:

1. Disciplinary knowledge

2. Research, inquiry and critical thinking

5. Communication

Objective(s):

This assessment task addresses subject learning objective(s):

1, 2, 3, 4, 5, 6 and 7

This assessment task contributes to the development of course intended learning outcome(s):

1.1, 2.1 and 5.1

Type: Exercises
Groupwork: Individual
Weight: 60%
Criteria:

1. Correct application of knowledge and procedures of the data analysis;

2. Correct interpretation of questions and terminology;

3. Correct choice of reasoning and proof;

4. Appropriate and correct implementation of solutions using industry standard software;

5. Clear communication using correct statistical terminology.

Assessment task 2: Exam

Intent:

This assessment item addresses the following graduate attributes:

1. Disciplinary knowledge

2. Research, inquiry and critical thinking

5. Communication

Objective(s):

This assessment task addresses subject learning objective(s):

1, 2 and 6

This assessment task contributes to the development of course intended learning outcome(s):

1.1, 2.1 and 5.1

Type: Examination
Groupwork: Individual
Weight: 40%
Criteria:

The exam will take the format similar to weekly assignments (i.e. short answers, derivation and data analysis) where students will be assessed on

1. Correct application of knowledge and procedures of the data analysis;

2. Correct interpretation of questions and terminology;

3. Correct choice of reasoning and proof;

4. Clear communication using correct statistical terminology.

Minimum requirements

Students must obtain a mark of 50 or higher to pass the subject.

Required texts

All subject materials are provided by the lecturer to the students.

References

Gelman, A., Carlin, J.B., Stern, H.S., Dunson, D.B., Vehtari, A. and Rubin, D.B. (2014). Bayesian Data Analysis, Third Edition. Boca Raton, Florida: CRC Press.

Faraway, J.J. (2006). Extending the Linear Model with R. Boca Raton, Florida: Chapman & Hall/CRC Press.

Harezlak, J., Ruppert, D. and Wand, M.P. (2018). Semiparametric Regression with R. New York: Springer.

McCulloch, C.E., Searle, S.R and Neuhaus, J.M. (2008). Generalized, Linear, and Mixed Models, Second Edition. New York: Wiley.

Other resources

The R computing environment and some add-on packages will be used extensively in this subject.