Skip to main content Link Search Menu Expand Document (external link)

Theoretical Foundations of Data Science I

DSC 40A, Summer Session II 2025 at UC San Diego πŸ‘‹

Summer 2025

CENTR 222

TUE, THUR 5:00PM - 7:50PM

Please note that updates to the syllabus specific for the Summer 2025 Remote Session have been posted, check them out here! syllabus update link. Office Hours are listed under the Calendat tab.

For Office Hours, both in person and on zoom, check the Calendar tab on the left for links, times, and locations.

Week 1 - Modeling, Loss Functions, & Simple Linear Regression
πŸ“˜ Read Chapter 1, Pages 1-12
πŸ“˜ Read Chapter 2, Pages 1-7
πŸ“˜ Read The Spread Notes
🍿 Watch Ahmed's Calc Review

πŸ§‘β€πŸ«  Tue Aug 5

LEC 1 Introduction to Modeling (Live)
blank filled recording

LEC 2 Empirical Risk Minimization
blank filled recording

HOPS 0 Linear Algebra Bootcamp (For the Soul)
problems

HOPS 1 How to Prove it! (Look Over Independently)
problems solutions

SUR Welcome Survey

HW Homework 0 (Do Not Turn In! "practice HW")
problems template solutions

πŸ§‘β€πŸ«  Thu Aug 7

LEC 3 Comparing Loss Functions
blank filled recording

LEC 4 Simple Linear Regression
blank filled recording

HOPS 2 Loss Functions & Risk (Watch Lecture 3 beforehand!)
problems recording solutions

HOPS 3 MSE vs MAE vs Huber (Watch Lecture 4 beforehand!)
problems recording solutions

HW Homework 1 Released
Welcome Survey
problems template solutions

πŸ§‘β€πŸ«  Tue Aug 12

LEC 5 Simple Linear Regression, Continued
blank filled recording

LEC 6 Dot Products and Projections
blank filled recording

HOPS 4 Simple OLS Regression (Watch Lecture 5 beforehand!)
problems recording solutions

HOPS 5 Regression & Linear Algebra (Watch Lecture 6 beforehand!)
problems recording solutions

DEMO Simple Linear Regression + Huber Loss

DISC Groupwork 1 (Submit Handwritten, Individually! for Extra Credit Only)
problems
walkthrough solutions

πŸ§‘β€πŸ«  Thu Aug 14

LEC 7 Orthogonal Projections
blank filled recording

LEC 8 Regression and Linear Algebra
blank filled recording

HOPS 6 Regression in the Real World (Watch Lectures 7,8 beforehand!)
problems code solutions

DEMO Demo 2 - Interaction Terms

HW Homework 2 Released
problems template code

Week 3 - Feature Engineering & Gradient Descent
πŸ“˜ Read Chapter 1, Pages 16-17
πŸ“˜ Read Notes on Convexity

πŸ§‘β€πŸ«  Tue Aug 19

LEC 9 Multiple Linear Regression
blank filled recording

LEC 10 Feature Engineering, Gradient Descent
blank filled recording

HOPS 7 Feature Engineering + Normal Equations (Watch Lecture 10 beforehand!)
problems data

HOPS Midterm Review (Zoom + Recorded)
problems recording

DISC Groupwork 2 (Submit Handwritten, Individually! for Extra Credit Only)
problems recording solutions

πŸ§‘β€πŸ«  Thu Aug 21

Midterm Midterm Exam (Take Home)

LEC 11 Gradient Descent, Continued
blank filled recording

HOPS 8 Gradient Descent (Look Over Independently)
problems solutions

DEMO Loss Surface Navigation + Regularization

HW Homework 3 Released

Week 4 - Probability & Combinatorics
πŸ“˜ Read Probability Roadmap
πŸ“˜ Read Probability Textbook Chapters 1–2

πŸ§‘β€πŸ«  Tue Aug 26

LEC 12 Foundations of Probability
blank filled recording

LEC 13 Combinatorics
blank filled recording

HOPS 9 Gradient Descent Again (Watch Lecture 11 beforehand!)
problems code

HOPS 10 Conditional Probability (Watch Lecture 13 beforehand!)
problems

DISC Groupwork 3 (Submit Handwritten, Individually! for Extra Credit Only)
problems solutions

πŸ§‘β€πŸ«  Thu Aug 28

LEC 14 More Combinatorics Examples
blank filled recording

LEC 15 Bayes' Theorem and Independence
blank filled recording

HOPS 11 Approaching Probability Problems (no associated lecture - good for context!)
problems

HOPS 12 Combinatoric Problems (Watch Lecture 15 beforehand!)
problems

DEMO Probability + Real World DS Practices

HW Homework 4 Released

Week 5 - NaΓ―ve Bayes & Final Review
πŸ“˜ Read Notes on Conditional Independence

πŸ§‘β€πŸ«  Tue Sep 2

LEC 16 Independence and Conditional Independence
blank filled recording

LEC 17 NaΓ―ve Bayes
blank filled recording

HOPS 13 Bayes Theorm vs Frequentist (Watch Lecture 17 beforehand!)
problems

HOPS 14 NaΓ―ve Bayes (Watch Lecture 17 beforehand!)
problems

DEMO Demo 6 - Multi-armed Bandit

DISC Groupwork 4 (Submit Handwritten, Individually! for Extra Credit Only)
problems solutions

πŸ§‘β€πŸ«  Thu Sep 4

LEC 18 More NaΓ―ve Bayes, Review
blank filled recording

LEC 19 Conclusion + Final Exam Review (Take Home + Oral Exam Component)

DEMO Demo K-Means Clustering

🏠  Sat Sep 6

EXAM Final Exam