Data Engineering Systems

  • Pre-approved electives
  • IDS 706
  • Credits: 3
  • Instructor: Noah Gift

Data Engineering Systems is a course about data and how to manage and build systems. Divided into two halves, part 1 focuses on Relational Databases. These systems are the most common type of database used today and are found in applications ranging from holding cell phone contact lists (both Android and iOS use SQLlite3 internally) to managing every aspect of a large bank or insurance company. The second half is dedicated to the concept that a one size database solution doesn’t fit anyone. Concepts covered include data lakes, serverless data engineering and NoSQL databases which are part of how cloud-native technologies are used to perform data engineering, MLOps, and Cloud Architecture.