ECE 594: Mathematical Models of Language

Note:

(1) This is an evolving schedule.

(2) The readings are based on the list of books in the Logistics page.

(3) All course videos are available in our course channel.

Date	Topic/Paper	Presenter(s)	Readings	Assignment
01/18	Introduction	Prof. Bhat
01/20	Word-level models–Naive Bayes slides	Prof. Bhat.	JM_3 4.1-7 optional (4.8-10)
01/25	Word-level models–Logistic Regression slides	Prof. Bhat	JE 2.5-6
01/27	Finding Deceptive Opinion Spam by Any Stretch of the Imagination (ACL Test of Time Award 2021) Word representations: A simple and general method for semi-supervised learning (ACL Test of Time Award 2020)	Yong's slides Jiachen's slides
02/01	Models of meaning slides	Prof. Bhat	JM_3 6.1-8
02/03	Unsupervised Word Sense Disambiguation Rivaling Supervised Methods (ACL Test of Time Award 2020) Lightweight Lexical and Semantic Evidence for Detecting Classes Among Wikipedia Articles	Vincent's slides Keyu's slides		Assignment1[link] Due 02/11@11:59pm
02/08	Sequence-level models slides	Prof. Bhat	JE Chapter 6 SLP_3 9.1-4
02/10	Efficient estimation of word representations in vector space Deep contextualized word representations	Hanyin's slides Viraj's slides		Assignment2 [link] Due 02/27@11:59pm
02/15	Low-resource NLP slides	Prof. Bhat
02/17	What Kind of Language is Hard to Language Model? Analysis Methods in Neural Language Processing: A Survey	Neeraj Sophie		Project proposals due 02/18 (proposal Latex template)
02/22	Transfer Learning in NLP and Summarization slides	Prof. Bhat	JM_3 11.1-3
02/24	Summarization slides	Prof. Bhat		Assignment3 [link] Due 03/11@11:59pm
03/01	Dialog slides	Prof. Bhat	JM_3 24.1-5
03/03	Exploring and Predicting Transferability Across NLP Tasks On Faithfulness and Factuality in Abstractive Summarization	Po-Hao's slides Viraj
03/08	Question Answering slides	Prof. Bhat	JM_3 23.1-2, 23.5-7
03/10	Towards a Human-like Open-Domain Chatbot Can You Put it All Together: Evaluating Conversational Agents’ Ability to Blend Skills	Rakesh's slides Qian's slides
03/15,17	SPRING BREAK
03/22	Commonsense Reasoning slides	Prof. Bhat
03/24	REALM: Retrieval Augmented Language model Pretraining Language Models as Knowledge Bases?	Haozhong's slides Vincent's slides
03/29	Project Updates			Project Presentation template
03/31	Social Bias Frames: Reasoning about Social and Power Implications of Language Language from police body camera footage shows racial disparities in officer respect	Neeraj Jiachen's slides
04/05	Generate, Prune and Select–A Pipeline for Counterspeech Generation Against Online Hate Speech Challenges in Automated Debiasing for Toxic Language Detection	Mengfei Zhenrui
04/07	Deep Reinforcement Learning-based Text Anonymization against Private-Attribute Inference Personal Information Leakage Detection in Conversations	Hanyin's slides Po-hao		Assignment 4 [link] Due 04/22@11:59pm
04/12	Navigating the Kaleidoscope of COVID-19 Misinformation Using Deep Learning Censorship of Online Encyclopedias: Implications for NLP Models	Sophie Yong's slides
04/14	Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake News Seeing Things from A Different Angle: Discovering Diverse Perspectives about Claims	Rakesh's slides Yaman's slides
04/19	Stance Classification of Context-Dependent Claims Asking the Right Question: Inferring Advice-Seeking Intentions from Personal Narratives	Mengfei Yaman's slides
04/21	Decoupling Strategy and Generation in Negotiation Dialogues Self-Supervised Euphemism Detection and Identification for Content Moderation Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings	Haozhong Qian Huimin
04/26	All That's Human Is Not Gold: Evaluating Human Evaluation of Generated Text Evaluating and Characterizing Human Rationales	Huimin Zhenrui
04/28 05/03	Project Presentation Project Presentation	Yong, Hanyin, Rakesh, Yaman Neeraj, Viraj, Huimin, Sophie