41091 Data Systems6cp; Forms of attendance and mode of delivery in this subject have changed to enable social distancing and reduce the risks of spreading COVID-19 in our community.
Requisite(s): 48024 Applications Programming OR 41082 Introduction to Data Engineering
Fields of practice: Data Engineering program
This subject introduces the concepts of systems engineering for complex, data-centric systems. It explores the lifecycle of data-centric systems from initial design through to system development, then production and ongoing management. Students learn about Extract, Transform, Load processes for building data pipelines, using Python for data engineering and reporting, the Hadoop ecosystem and cloud infrastructure providers of data systems. The subject is project based. Students do a combination of workshops on data engineering topics and project work as a team.
Spring session, City campus
Detailed subject description.