Lecture 24 - Deep Neural Networks

Objectives

• Understand the mathematical structure of deep neural networks with dense layers.

• Derive a loss function for regression tasks.

• Cast the loss minimization problem as a stochastic optimization problem.

• Use the stochastic gradient descent algorithm to solve a stochastic optimization problem.