Paul Liang, CMU

Paul Pu Liang

Email: pliang(at)cs.cmu.edu
Office: Gates and Hillman Center 8011
5000 Forbes Avenue, Pittsburgh, PA 15213
Machine Learning Department and Language Technologies Institute, School of Computer Science, Carnegie Mellon University

[CV] [google scholar] [linkedin] [github] [twitter] [instagram]

[Publications] [Honors] [Teaching] [Talks] [Activities]

I am a final-year Ph.D. student in the Machine Learning Department at Carnegie Mellon University, advised by Louis-Philippe Morency and Ruslan Salakhutdinov. I also collaborate with Manuel Blum, Lenore Blum, Jack Hessel, and Yejin Choi at Berkeley and UW/AI2.

I am on the academic job market this year. [CV] [research statement] [teaching statement] [DEI statement]

My research lies in the foundations of multimodal machine learning with applications in socially intelligent AI, human health and wellness, robotics, education, and multimedia AR/VR. As steps towards this goal, I work on:

  • Foundations of multimodal machine learning: modality heterogeneity, connections, and interactions [foundations, interactions, disagreement, MultiViz].
  • Representation learning and foundation models for multisensory and temporal data [HighMMT, MultiBench, MulT, RMFN].
  • Multimodal applications in socially intelligent AI, multimedia, healthcare, education, and robotics [CMU-MOSEI, Social-IQ, mental health, pathology, education].
  • Real-world fair, robust, interpretable, and efficient machine learning [fairness in LMs, fairness in BERT, federated learning].

  • My research is generously supported by a Siebel Scholars Award, Waibel Presidential Fellowship, Facebook PhD Fellowship, and Center for Machine Learning and Health Fellowship, and has been recognized by 3 best paper/honorable mention awards at NeurIPS workshops and ICMI 2017. I love teaching and advising, and was honored to receive the Alan J. Perlis Graduate Student Teaching Award for co-instructing courses (CMU 11-877, CMU 11-866, CMU 11-777), and organizing workshops (ICCV, NAACL, NeurIPS, ACL) and tutorials (ICML, CVPR, NAACL) on multimodal machine learning. Previously, I received an M.S. in Machine Learning and a B.S. with University Honors in Computer Science and Neural Computation from CMU, where I am grateful for the mentorship of Louis-Philippe Morency, Ruslan Salakhutdinov, Tai Sing Lee, Roni Rosenfeld, and Ryan Tibshirani. I have also been fortunate to spend time at DeepMind, Facebook AI Research, Nvidia AI, Google Research, and RIKEN Artificial Intelligence Project.

    Research opportunities: I am happy to collaborate and answer questions about my research and CMU academic programs. If you are interested, please send me an email. I especially encourage students from underrepresented groups to reach out.

    News

    Education

    Selected Publications

    (* denotes joint first-authors, see full list of publications here)

    Foundations of multimodal machine learning:

    Representation learning over multisensory and temporal data:

    Multimodal applications in social AI, mobile health, computational pathology:

    Real-world societal concerns:

    Honors

    Teaching

    Student Advising

    Some amazing students I've had the pleasure of advising:

    Academic Talks

    Professional Activities


    I have an Erdős number of 3 (Paul Erdős → Giuseppe Melfi → Erik Cambria → Paul Pu Liang).
    This page has been accessed at least several times since Feb 8, 2018.