Selected Publications


LOVM: Language-Only Vision Model Selection
Orr Zohar, Shih-Cheng Huang, Kuan-Chieh Wang, Serena Yeung
Preprint 2023
[pdf] [project page] [code]

Hyperbolic Deep Learning in Computer Vision: A Survey
Pascal Mettes, Mina Ghadimi Atigh, Martin Keller-Ressler, Jeffrey Gu, Serena Yeung
Preprint 2023

Diffusion-HPC: Generating Synthetic Images with Realistic Humans
Zhenzhen Weng, Laura Bravo-Sánchez, Serena Yeung
Preprint 2023
[pdf] [project page] [code]

NeMo: 3D Neural Motion Fields from Multiple Video Instances of the Same Action
Kuan-Chieh Wang, Zhenzhen Weng, Maria Xenochristou, Joao Pedro Araujo, Jeffrey Gu, C. Karen Liu, Serena Yeung
CVPR 2023 Highlight
[pdf][project page]

PROB: Probabilistic Objectness for Open World Object Detection
Orr Zohar, Kuan-Chieh Wang, Serena Yeung
CVPR 2023
[pdf][project page][code]

Diagnosing and Rectifying Vision Models using Language
Yuhui Zhang, Jeff Z. HaoChen, Shih-Cheng Huang, Kuan-Chieh Wang, James Zou, Serena Yeung
ICLR 2023

CryoET reveals organelle phenotypes in huntington disease patient iPSC-derived and mouse primary neurons
Gong-Her Wu, Charlene Smith-Geater, Jesús G. Galaz-Montoya, Yingli Gu, Sanket R. Gupte, Ranen Aviner, Patrick G. Mitchell, Joy Hsu, Ricardo Miramontes, Keona Q. Wang, Nicolette R. Geller, Cathy Hou, Cristina Danita, Lydia-Marie Joubert, Michael F. Schmid, Serena Yeung, Judith Frydman, William Mobley, Chengbiao Wu, Leslie M. Thompson, Wah Chiu
Nature Comm.


Learning Orientation-Invariant Representations Enables Accurate and Robust Morphologic Profiling of Cells and Organelles
James Burgess, Jeffrey J. Nirschl, Maria-Clara Zanellati, Sarah Cohen, Serena Yeung
Preprint 2022

Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning
Weixin Liang*, Yuhui Zhang*, Yongchan Kwon*, Serena Yeung, James Zou
NeurIPS 2022

Adapting Pre-trained Vision Transformers from 2D to 3D through Weight Inflation Improves Medical Image Segmentation
Yuhui Zhang, Shih-Cheng Huang, Zhengping Zhou, Matthew P. Lungren, Serena Yeung
ML4H 2022

Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recovery
Zhenzhen Weng, Kuan-Chieh Wang, Angjoo Kanazawa, Serena Yeung
3DV 2022

Adaptation of Surgical Activity Recognition Models Across Operating Rooms
Ali Mottaghi, Aidean Sharghi, Serena Yeung, Omid Mohareri

ALGES: Active Learning with Gradient Embeddings for Semantic Segmentation of Laparoscopic Surgical Images
Josiah Aklilu, Serena Yeung
MLHC 2022

Developing Medical Imaging AI for Emerging Infectious Diseases
Shih-Cheng Huang, Akshay S. Chaudhari, Curtis P. Langlotz, Nigam Shah, Serena Yeung, Matthew P. Lungren
Nature Communications

Using AI and Computer Vision to Analyze Technical Proficiency in Robotic Surgery
Janice H Yang, Emmett D Goodman, Aaron J Dawes, John V Gahagan, Micaela M Esquivel, Cara A Liebert, Cindy Kin, Serena Yeung, Brooke H Gurland
Surgical Endoscopy


Holistic 3D Human and Scene Mesh Estimation from Single View Images
Zhenzhen Weng, Serena Yeung
CVPR 2021
[pdf] [project page] [code]

Unsupervised Discovery of the Long-Tail in Instance Segmentation Using Hierarchical Self-Supervision
Zhenzhen Weng, Mehmet Giray Ogut, Shai Limonchik, Serena Yeung
CVPR 2021
[pdf] [project page] [code]

DARCNN: Domain Adaptive Region-based Convolutional Neural Network for Unsupervised Instance Segmentation in Biomedical Images
Joy Hsu, Wah Chiu, Serena Yeung
CVPR 2021
[pdf] [project page]

Staying in Shape: Learning Invariant Shape Representations using Contrastive Learning
Jeffrey Gu, Serena Yeung
UAI 2021
[pdf] [project page] [code]

GLoRIA: A Multimodal Global-Local Representation Learning Framework for Label-efficient Medical Image Recognition
Shih-Cheng Huang*, Liyue Shen*, Matthew P. Lungren, Serena Yeung
ICCV 2021
[pdf] [code]

Capturing implicit hierarchical structure in 3D biomedical images with self-supervised hyperbolic representations
Joy Hsu*, Jeffrey Gu*, Gong Her Wu, Wah Chiu, Serena Yeung
NeurIPS 2021
[pdf] [project page] [code]

Personalized Federated Learning with First Order Model Optimization
Michael Zhang, Karan Sapra, Sanja Fidler, Serena Yeung, Jose M. Alvarez
ICLR 2021

FlowVOS: Weakly-Supervised Visual Warping for Detail-Preserving and Temporally Consistent Single-Shot Video Object Segmentation
Julia Gong, F. Christopher Holsinger, Serena Yeung
BMVC 2021
[pdf] [project page]

A real-time spatiotemporal AI model analyzes skill in open surgical videos
Emmett D Goodman*, Krishna K Patel*, Yilun Zhang, William Locke, Chris J Kennedy, Rohan Mehrotra, Stephen Ren, Melody Guan, Maren Downing, Hao Wei Chen, Jevin Z Clark, Gabriel A Brat, Serena Yeung
Preprint, 2021

Using Deep Learning to Identify the Recurrent Laryngeal Nerve During Thyroidectomy
Julia Gong, F. Christopher Holsinger, Julia E. Noel, Sohei Mitani, Jeff Jopling, Nikita Bedi, Yoon Woo Koh, Lisa A. Orloff, Claudio R. Cernea, Serena Yeung
Scientific Reports
[pdf] [project page]

Deep Learning-Enabled Medical Computer Vision
Andre Esteva, Katherine Chou, Serena Yeung, Nikhil Naik, Ali Madani, Ali Mottaghi, Yun Liu, Eric Topol, Jeff Dean, Richard Socher
npj Digital Medicine


Medical Symptom Recognition from Patient Text: An Active Learning Approach for Long-Tailed Multilabel Distributions
Ali Mottaghi, Prathusha Sarma, Xavier Amatriain, Serena Yeung, Anitha Kannan
Preprint, 2020

Using Computer Vision to Automate Hand Detection and Tracking of Surgeon Movements in Videos of Open Surgery
Michael Zhang, Xiaotian Cheng, Daniel Copeland, Arjun Desai, Melody Guan, Gabriel Brat, Serena Yeung
AMIA 2020

Automatic Detection of Hand Hygiene Using Computer Vision Technology
Amit Singh, Albert Haque, Alexandre Alahi, Serena Yeung, Michelle Guo, Jill R Glassman, William Beninati, Terry Platchek, Li Fei-Fei, Arnold Milstein
Journal of the American Medical Informatics Association (JAMIA)

Adversarial Representation Active Learning
Ali Mottaghi, Serena Yeung
CVPR 2020 Workshop on Visual Learning with Limited Labels
[pdf] [bibtex] [code]

Ethical and Legal Aspects of Ambient Intelligence in Hospitals
Sara Gerke, Serena Yeung, I. Glenn Cohen
Journal of the American Medical Association (JAMA)


NIH Advisory Committee to the Director Artificial Intelligence Working Group Report
Rediet Abebe, Greg Corrado, Kate Crawford, Barbara Engelhardt, David Glazer, David Haussler, Dina Katabi, Daphne Koller, Anshul Kundaje, Eric Lander, Jennifer Listgarten, Michael McManus, Lawrence Tabak, Serena Yeung
NIH Advisory Committee to the Director Working Group on Artificial Intelligence

A Computer Vision System for Deep Learning-Based Detection of Patient Mobilization Activities in the ICU
Serena Yeung*, Francesca Rinaldo*, Jeffrey Jopling, Bingbin Liu, Rishab Mehra, N. Lance Downing, Michelle Guo, Gabriel M. Bianconi, Alexandre Alahi, Julia Lee, Brandi Campbell, Kayla Deru, William Beninati, Li Fei-Fei, Arnold Milstein
Nature Partner Journals (NPJ) Digital Medicine


Temporal Modular Networks for Retrieving Complex Compositional Activities in Video
Bingbin Liu, Serena Yeung, Edward Chou, De-An Huang, Li Fei-Fei, Juan Carlos Niebles
ECCV 2018
[pdf] [project page] [bibtex]

Neural Graph Matching Networks for Fewshot 3D Action Recognition
Michelle Guo, Edward Chou, Shuran Song, De-An Huang, Serena Yeung, Li Fei-Fei
ECCV 2018
[pdf] [project page] [bibtex]

Dynamic Task Prioritization for Multitask Learning
Michelle Guo, Albert Haque, De-An Huang, Serena Yeung, Li Fei-Fei
ECCV 2018
[pdf] [bibtex]

Computer Vision-based Descriptive Analytics of Seniors’ Daily Activities for Long-term Health Monitoring
Jun-Ting Hsieh*, Zelun Luo*, Niranjan Balachandar, Serena Yeung, Guido Pusiol, Jay Luxenberg, Grace Li, Li-Jia Li, N. Lance Downing, Arnold Milstein, Li Fei-Fei
MLHC 2018
[pdf] [bibtex]

3D Point Cloud-Based Visual Prediction of ICU Mobility Care Activities
Bingbin Liu*, Michelle Guo*, Edward Chou, Rishab Mehra, Serena Yeung, N. Lance Downing, Francesca Salipur, Jeffrey Jopling, Brandi Campbell, Kayla Deru, William Beninati, Arnold Milstein, Li Fei-Fei
MLHC 2018

Bedside Computer Vision -- Moving Artificial Intelligence from Driver Assistance to Patient Safety
Serena Yeung, N. Lance Downing, Li Fei-Fei, Arnold Milstein
New England Journal of Medicine 2018
[pdf] [bibtex]

Scaling Human-Object Interaction Recognition through Zero-Shot Learning
Liyue Shen, Serena Yeung, Judy Hoffman, Greg Mori, Li Fei-Fei
WACV 2018
[pdf] [bibtex]

Tool Detection and Operative Skill Assessment in Surgical Videos Using Region-Based Convolutional Neural Networks
Amy Jin, Serena Yeung, Jeffrey Jopling, Jonathan Krause, Dan Azagury, Arnold Milstein, Li Fei-Fei
NIPS 2017 Machine Learning for Health Workshop (Best Paper Award)
WACV 2018
[pdf] [project page] [code] [data] [bibtex]


  • For earlier publications, see here.