This is a collaborative work of JHU Smile Lab and CMU MSP Lab. Please cite https://arxiv.org/abs/2511.00256.
AI & ML interests
Speech and multimodal processing, Affective computing, Social signal processing, Multimodal machine learning, Multimodal foundational models, Language technology for healthcare and mental health, Multimodal behavior generative models
Recent Activity
View all activity
Organization Card
Welcome to MSP Lab
This is the organization of Multimodal Speech Processing (MSP) laboratory, part of the Language Technologies Institute at Carnegie Mellon University. Our research program is on human-centered multimodal machine intelligence and applications for speech-based interfaces. We are dedicated to advancing technology to solve theoretical problems with practical applications. Our goal is to develop methods, algorithms, and models to recognize and synthesize human verbal and non-verbal communication behaviors to improve human-machine interaction.
We will release our datasets and models through this organization, so stay tuned!
models
0
None public yet