Update: I am joining the Computer Science department at Cornell as an Assistant Professor starting August 2024. If you are interested in collaborating or joining my group, feel free to reach out! Before joining Cornell, I am a research scientist at Google.
Contact: jjs533@cornell.edu
Accelerating scientific progress is crucial for understanding and solving challenges in our ever-changing world. My research focuses on developing computer vision & machine learning methods in workflows that require expert-in-the-loop interactions, such as for studying behavioral or medical data. I aim to optimize expert attention in real-world workflows in order to accelerate scientific discovery, addressing bottlenecks including data annotation efficiency, model interpretability, generalization (across experiments, labs, and domains), and semantic structure discovery.
Currently, I am a research scientist at Google. I recently graduated from Caltech in Computing and Mathematical Sciences, and I was co-advised by Professor Pietro Perona and Professor Yisong Yue. I am grateful to be supported by the Kortschak Scholars Program at Caltech and the NSERC Postgraduate Scholarship from the Natural Sciences and Engineering Research Council of Canada. I have been awarded Amazon AI4Science Fellowship and the Ben P.C. Chou Doctoral Prize.
Mentorship and Advising
Former:
- Pablo Backer Peral, current Caltech student
- Joshua Flashner, current Caltech student
- Patrick Rim, current Caltech student
- Victor Chen, Caltech BS 2020
- Amil Dravid, Northwestern BS 2023 (joined PhD program at Berkeley)
- Shir Goldfinger, Caltech BS 2023
- Arushi Gupta, current Caltech student
- Eric Han, Caltech BS 2021
- Eric Ma, current Caltech student
- Hongsen Qin, Caltech BS 2021
- Megan Tjandrasuwita, Caltech BS 2022 (joined PhD program at MIT)
- Albert Tseng, Caltech BS 2021 (joined PhD program at Cornell)
- Isabella Zhang, Caltech BS 2021
Select Projects
See the full list of my publications here. See our computational behavior efforts here.
- Neurosymbolic Programming for Science, AI4Science Workshop at NeurIPS
Jennifer J. Sun*, Megan Tjandrasuwita*, Atharva Sehgal*, Armando Solar-Lezama, Swarat Chaudhuri, Yisong Yue, Omar Costilla-Reyes
[paper] - Self-Supervised Keypoint Discovery in Behavioral Videos, CVPR 2022
Jennifer J. Sun*, Serim Ryou*, Roni Goldshmid, Brandon Weissbourd, John Dabiri, David J. Anderson, Ann Kennedy, Yisong Yue, Pietro Perona
[paper][project website][code] - Task Programming: Learning Data Efficient Behavior Representations, CVPR 2021 (Oral)
Awarded Best Student Paper at CVPR 2021
Jennifer J. Sun, Ann Kennedy, Eric Zhan, David J. Anderson, Yisong Yue, Pietro Perona
[paper][project website][code][video] - Learning Differentiable Programs with Admissible Neural Heuristics, NeurIPS 2020
Ameesh Shah*, Eric Zhan*, Jennifer J. Sun, Abhinav Verma, Yisong Yue, Swarat Chaudhuri
[paper][code] - View-Invariant Probabilistic Embedding for Human Pose, ECCV 2020 (Spotlight)
Jennifer J. Sun, Jiaping Zhao, Liang-Chieh Chen, Florian Schroff, Hartwig Adam, Ting Liu
[paper][code][video][project website][Google AI blog post]
[IJCV paper] - Workshops & Tutorials:
- FGVC @ CVPR 2024
- Multi-Agent Behavior @ CVPR 2023
- Neurosymbolic Programming @ NeurIPS 2022
- Multi-Agent Behavior @ CVPR 2022
- Multi-Agent Behavior @ CVPR 2021
- Affective Understanding in Video @ CVPR 2021