Engineering in Computer Science and Artificial Intelligence

Introduction to Natural Language Processing N-gram language models; smoothing; interpolation; backoff Deep learning for NLP Introduction to PyTorch and PyTorch Lightning Monolingual and multilingual word embeddings, sense and concept embeddings Neural language models: recurrent and Transformer-based (BERT, XLM-RoBERTa, GPT-x, etc.) Large Language Models: pretraining and finetuning Computational lexical semantics Computational lexicons: WordNet Multilingual semantic networks: BabelNet Word embeddings vs. contextualized word embeddings vs. sense embeddings Word Sense Disambiguation and Entity Linking Multilinguality in Natural Language Processing Computational sentence-level semantics Neural Semantic Role Labeling and Semantic Parsing Natural Language Generation and Question Answering Neural Machine Translation

No prerequisite.

Jurafsky and Martin. Speech and Language Processing, Prentice Hall, third edition.

In class attendance.

Homework submission + oral presentation.

In class attendance.

Introduction to Natural Language Processing N-gram language models; smoothing; interpolation; backoff Deep learning for NLP Introduction to PyTorch and PyTorch Lightning Monolingual and multilingual word embeddings, sense and concept embeddings Neural language models: recurrent and Transformer-based (BERT, XLM-RoBERTa, GPT-x, etc.) Large Language Models: pretraining and finetuning Computational lexical semantics Computational lexicons: WordNet Multilingual semantic networks: BabelNet Word embeddings vs. contextualized word embeddings vs. sense embeddings Word Sense Disambiguation and Entity Linking Multilinguality in Natural Language Processing Computational sentence-level semantics Neural Semantic Role Labeling and Semantic Parsing Natural Language Generation and Question Answering Neural Machine Translation

No prerequisite.

Jurafsky and Martin. Speech and Language Processing, Prentice Hall, third edition.

In class attendance.

Homework submission + oral presentation.

In class attendance.