Matt Smith

Guest Lecture @ Make School

Make School at 1:15 on 2020-02-20

Please contact me if you want the slides.

DSC Transformer & Attention Workshop

MC4045 at 6:30 on 2019-04-03

• Slides

NLP Reading Group

Meets in MC4042 at 4:30-5:30 every Thursday.

UPDATE: NLP Reading Group is now finished. Thank you for attending! :)

Meeting 5 (2019-04-04)

Paper coverage:

• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
• Deep Visual-Semantic Alignments for Generating Image Descriptions
• Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
• The Evolved Transformer
• Universal Transformers

Links:

• Slides
• Universal Transformer Animation

Meeting 4 (2019-03-21)

Paper coverage:

• Deep contextualized word representations
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
• Deep Visual-Semantic Alignments for Generating Image Descriptions

Links:

• Slides

Meeting 3 (2019-03-14)

Paper coverage:

• Neural Machine Translation by Jointly Learning to Align and Translate
• Character-Aware Neural Language Models
• Deep contextualized word representations
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Links:

• Slides

Meeting 2 (2019-03-07)

Paper coverage:

• Neural Machine Translation by Jointly Learning to Align and Translate
• Hierarchical Attention Networks for Document Classification
• Attention Is All You Need
• Improving Language Understanding by Generative Pre-Training

Links:

• Slides
• Attention? Attention by Lilian Weng
• GPT-1 Blog Post
• GPT-2 Blog Post

Meeting 1 (2019-02-28)

Paper coverage:

• A Neural Probabilistic Language Model
• word2vec -- The amazing power of word vectors
• Understanding LSTM Networks
• The Unreasonable Effectiveness of Recurrent Neural Networks

Links:

• Slides
• Music generated with char-lstm

NLP Workshop

• Starter notebook
• Backup (completed) notebook
• Slides

Popular Dishes Presentation

Slides