Skip to main content Link Search Menu Expand Document (external link)

Theoretical Foundations of Data Science I

DSC 40A, Fall 2024 at UC San Diego

Gal Mishne
she/her/hers

gmishne@ucsd.edu

Lecture(s): MWF 4:00-4:50PM Pepper Canyon Hall 106

Jump to the current week Assignment Solutions

Week 0 - Introduction to Modeling

Fri Sep 27

LEC 1 Introduction to Modeling
                       

SUR Welcome Survey

Week 1 - Loss Functions
📘 Read Note 1, Pages 1-12, xkcd.

Mon Sep 30

LEC 2 Empirical Risk Minimization
                       

DISC 1 Groupwork 1 (due Friday Oct. 4th)
                  

Wed Oct 2

LEC 3 Empirical Risk Minimization
                       

Fri Oct 4

LEC 4 Comparing loss functions
                       

Week 2 – Simple Linear Regression
📘 Read the spread notes and Note 2, Pages 1-7, xkcd.

Mon Oct 7

LEC 5 Prediction with features
                       

DISC 2 Groupwork 2
                  

Wed Oct 9

LEC 6 Linear regression
                       

Fri Oct 11

LEC 7 Linear regression continued     

HW 1 due Homework 1
                     

Week 3 – Linear Algebra: Dot products and projections
🎥 Watch 3blue1brown, xkcd.

Mon Oct 14

LEC 8 Linear algebra - vectors and dot product
                       

DISC 3 Groupwork 3
                  

Wed Oct 16

LEC 9 Linear algebra - span and projections     

Fri Oct 18

LEC 10 Linear algebra - matrices and projections     

HW 2 due Homework 2 - DUE 10/19 @ 11:59PM
                     

Week 4 - Multiple Linear regression and linear algebra
📘 Read Note 2, Pages 10-19, xkcd.

Mon Oct 21

LEC 11 Regression and Linear algebra
                       

DISC 4 Groupwork 4
                  

Wed Oct 23

LEC 12 Multiple Linear Regression
                       

Fri Oct 25

LEC 13 Feature Engineering
                       

HW 3 due Homework 3
                     

Week 5 – Gradient Descent
📘 Optional: see these notes on convexity, webcomic name.

Mon Oct 28

LEC 14 Gradient descent
                       

DISC 5 Groupwork 5
                  

Wed Oct 30

LEC 15 Gradient descent and convexity
                           

Fri Nov 1

LEC 16 Gradient descent and convexity       

HW 4 due Homework 4
                     

Week 6 – Probability
📘 Read Janine's probability roadmap and Chapters 1 and 2 of this probability textbook, xkcd.

Wed Nov 6

LEC 17 Foundations of Probability
                       

Fri Nov 8

LEC 18 Conditional probability
                       

Week 7 - Combinatorics

Mon Nov 11

CANCELLED Veteran's Day

Wed Nov 13

LEC 19 Sampling
                         

DISC 6 Groupwork 6 - DUE 11/13
                  

Fri Nov 15

LEC 20 Combinatorics
                       

HW 5 due Homework 5
                     

Week 8 - Combinatorics and Bayes Theorem
📘 xkcd.

Mon Nov 18

LEC 21 Combinatorics continued
                       

DISC 7 Groupwork 7
                  

Wed Nov 20

LEC 22 Total probability and Bayes Theorem
                       

Fri Nov 22

LEC 23 Bayes Theorem and Independence
                       

Week 9 - Bayes Classifier
📘 xkcd, xkcd, xkcd .

Mon Nov 25

LEC 24 Bayes Theorem and Naive Bayes Classifier
                       

DISC 8 Groupwork 8
                  

HW 6 due Homework 6
                     

Wed Nov 27

LEC 25 Naive Bayes Classifier and text classification
                       

Week 10 - Classification and k-means clustering

Mon Dec 2

LEC 26 Naive Bayes Classifier and clustering
                       

DISC 9 Groupwork 9
                  

Wed Dec 4

LEC 27 k-means clustering
                       

Fri Dec 6

LEC 28 Review / Practice Exam
                     

HW 7 due Homework 7 - NO SLIP DAY