# Theoretical Foundations of Data Science I 🥑

DSC 40A, Fall 2022 at UC San Diego

📅Midterm Schedule: The Midterm is scheduled for 28th October 2022. The midterm will be in-person for a duration of 1 hour. It will take place during lecture hours of each batch at the same location as that of the lectures. Students must attend the session they are enrolled in. |

### Mahdi Soleymani

**he/him**

msoleymani@ucsd.edu

**Lecture:** MWF 4PM-4:50PM, PCYNH 122

### Week 0 – Welcome to DSC 40A! 👋

- Sep 23
**LEC 1 Son**Introduction, Learning From Data, Annotated**LEC 1 Mahdi**Introduction, Learning From Data, Annotated

### Week 1 – Empirical Risk Minimization🔍

- Sep 26
**LEC 2 Son**Minimizing Mean Absolute Error, Annotated**LEC 2 Mahdi**Minimizing Mean Absolute Error, Annotated, Code- Sep 28
**LEC 3 Son**MSE and Empirical Risk Minimization, Annotated**LEC 3 Mahdi**MSE and Empirical Risk Minimization, Annotated, Code- Sep 29
**Group1 OUT**Groupwork 1 Write-up- Sep 30
**LEC 4 Son**Spread, Other Loss Functions, Gradient Descent, Annotated**LEC 4 Mahdi**Spread, Other Loss Functions, Annotated**HW1 OUT**Homework 1 Write-up

### Week 2 – Gradient Descent📈

- Oct 3
**LEC 5 Son**Gradient Descent and Convexity, Annotated**LEC 5 Mahdi**Gradient Descent, Annotated**DISCUSSION 1**Discussion 1**GROUP1 DUE**Submit before 11:59pm on Gradescope- Oct 5
**LEC 6 Son**Simple Linear Regression**LEC 6 Mahdi**Gradient Descent, Convexity, Annotated, Code- Oct 6
**Group2 OUT**Groupwork 2 Write-up- Oct 7
**HW1 DUE**Submit before 2pm on Gradescope**LEC 7 Son**Simple Linear Regression Cont**LEC 7 Mahdi**Convexity, Linear Regression, Annotated**HW2 OUT**Homework 2 Write-up

### Week 3 – Linear Regression

- Oct 10
**LEC 8 Son**More Simple Linear Regression**LEC 8 Mahdi**Simple Linear Regression, Annotated**DISCUSSION 2**Discussion 2**GROUP2 DUE**Submit before 11:59pm on Gradescope- Oct 12
**LEC 9 Son**Regression and Linear Algebra**LEC 9 Mahdi**More Simple Linear Regression, Annotated, Code- Oct 13
**Group3 OUT**Groupwork 3 Write-up- Oct 14
**HW2 DUE**Submit before 2pm on Gradescope**LEC 10 Son**Regression and Linear Algebra Cont.**LEC 10 Mahdi**Linear Algebra and Regression, Annotated**HW3 OUT**Homework 3 Write-up

### Week 4 – Linear Regression and Feature Engineering

- Oct 17
**LEC 11 Son**Multiple Linear Regression and Feature Engineering, Code**LEC 11 Mahdi**Regression and Linear Algebra, Annotated, Code**DISCUSSION 3**Discussion 3**GROUP3 DUE**Submit before 11:59pm on Gradescope- Oct 19
**LEC 12 Son**Multiple LR and Feature Engineering Cont, Code**LEC 12 Mahdi**Multiple LR and Feature Engineering, Annotated, Code- Oct 20
**Group4 OUT**Groupwork 4 Write-up- Oct 21
**HW3 DUE**Submit before 2pm on Gradescope**LEC 13 Son**Feature Engineering and Taxonomy of ML, Code**LEC 13 Mahdi**Feature Engineering, Annotated, Code

### Week 5 – Midterm!

- Oct 24
**LEC 14 Son**ML and Clustering**LEC 14 Mahdi**Feature Engineering, Clustering, Annotated, Code**DISCUSSION 4**Discussion 4- Oct 26
**LEC 15 Son**Clustering, Code**LEC 15 Mahdi**Review Session- Oct 28
**Midterm**Midterm Exam❗**HW4 OUT**Homework 4 Write-up

### Week 6 – Probability

- Oct 31
**LEC 16 Son**Clustering and Probability**LEC 16 Mahdi**Clustering, Annotated, Code**DISCUSSION 5**Discussion 5- Nov 2
**LEC 17 Son**Midterm Overview**LEC 17 Mahdi**Introduction to Probability, Annotated- Nov 3
**Group5 OUT**Groupwork 5 Write-up- Nov 4
**LEC 18 Son**Foundation of Probability**LEC 18 Mahdi**Conditional Probability, Annotated**HW5 OUT**Homework 5 Write-up**HW4 DUE**Submit before 11:59pm on Gradescope

### Week 7 – Probability and Combinatorics

- Nov 7
**LEC 19 Son**Combinatorics**LEC 19 Mahdi**Conditional Probability, Combinatorics, Annotated**DISCUSSION 6**Discussion 6**GROUP5 DUE**Submit before 11:59pm on Gradescope- Nov 9
**LEC 20 Son**Law of Total Probability, Code**LEC 20 Mahdi**More Combinatorics, Law of Total Probability, Annotated, Code- Nov 10
**Group6 OUT**Groupwork 6 Write-up- Nov 11
**LEC Son**N/A (Veteran’s Day)**LEC Mahdi**N/A (Veteran’s Day)**HW6 OUT**Homework 6 Write-up**HW5 DUE**Submit before 11:59pm on Gradescope

### Week 8 – More Probability

- Nov 14
**LEC 21 Mahdi**Bayes’ Theorem, Independence, Annotated**DISCUSSION 7**Discussion 7**GROUP6 DUE**Submit before 11:59pm on Gradescope- Nov 16
**LEC 22 Son**Independence and Classification**LEC 22 Mahdi**Independence, Conditional Independence, Annotated- Nov 17
**Group7 OUT**Groupwork 7 Write-up- Nov 18
**LEC 23 Son**Naive Bayes**LEC 23 Mahdi**Classification and Conditional Independence, Annotated**HW7 OUT**Homework 7 Write-up**HW6 DUE**Submit before 2:00pm on Gradescope

### Week 9 – Naive Bayes

- Nov 21
**LEC 24 Son**More Naive Bayes, Code**LEC 24 Mahdi**Naive Bayes, Annotated, Code**DISCUSSION 8**Discussion 8**GROUP7 DUE**Submit before 11:59pm on Gradescope- Nov 23
**LEC 25 Son**Logistic Regression and MLE**LEC 25 Mahdi**Naive Bayes, Annotated- Nov 26
**HW8 OUT**Homework 8 Write-up

### Week 10 – Last Week!

- Nov 28
**HW7 DUE**Submit before 2:00pm on Gradescope**LEC 26 Son**LR and MLE Cont- Nov 30
**LEC 27 Son**Course summary- Dec 2
**LEC 28 Son**Review problems**LEC 28 Mahdi**Annotated- Dec 3
**Final**Final Exam❗

### Week 11 – Enjoy Your Break!

- Dec 6
**HW8 DUE****Optional!!**Submit before 2:00pm on Gradescope