ICME Summer Workshop: Introduction to Deep Learning

XCME011 - Introduction to Deep Learning

Overview

This workshop will present modern neural network based techniques that are used in supervised learning. We will cover the basic fundamentals required to understand how neural networks work and on applications of neural networks to problems in computer vision and natural language processing.

Prerequisites: basic concepts from linear algebra, such as vectors and matrices, calculus, such as differentiation, and probability theory, such as random variables, probability distributions and expectations. Familiarity with the python programming language and Tensorflow also required.

A good introduction to the required background material can be found here.

Topics Include

1.1 Introduction to Neural Networks

• single neuron, activation
• multiple layers
• regularization

1.2 Fundamentals of Deep Learning

• linear algebra
• vector calculus
• gradient descent
• supervised learning

1.3 Fully-Connected networks

• history/Motivation of deep learning
• fully-connected layers
• activation functions
• regularization
• loss functions
• training neural networks as computational graphs
• Example) character recognition on MNIST data

2. Computer vision and Natural Language Processing (NLP)

• convolutional layers
• pooling layers
• image classification and segmentation with convolutional networks
• grammars/vocabularies for NLP
• recurrent layers
• enhanced recurrent networks with long-short term memory layers and gated-recurrent units
• analysis/Considerations of deep recurrent networks

3.1 Tensorflow walkthrough of image classification with convolutional networks

• image classification with convolutional networks

3.2 Tensorflow walkthrough of next character prediction with recurrent networks

• next character prediction on the Penn treebank dataset

The ICME offers summer workshops to students, partners, and the wider community (first come first served, in that order). These day-long workshop happen from August 14-18, 2017, from 9:00am to 4:45 pm. To view other workshop descriptions, or to get general information about the ICME Summer Workshop Series, click here.

ICME Summer Workshops are open to participants 18 years and older. If you are under the age of 18 and would like to participate, please contact the program administrator. 

Important Notes:

• Please note that these are not Stanford for-credit courses.
• Stanford academic and non-academic staff may register under the 'Faculty' ticket type. 
• Room locations, information on what to bring, and directions to campus will be provided to those who register in advance of each workshop.
• These workshops are open to participants 18 years and older. If you are under the age of 18 and would like to participate, please inquire with icme-contact@stanford.edu
• If you have questions, please contact the ICME via email icme-contact@stanford.edu

Questions? Please contact ICME