Helen Jin
Research Interests: Trustworthy AI, Explainable AI (XAI), Human & Machine Understanding, Student Success, AI in Education (AIED) ☀️
Welcome! I am a Ph.D. candidate in Computer and Information Science (CIS) at the University of Pennsylvania, where I am extremely grateful to be co-advised by Prof. Boon Thau Loo and Prof. Seiji Isotani. I am part of the NetDB@Penn Lab and the Penn AIED Lab, and am also affiliated with Penn NLP, ASSET, and BrachioLab.
Previously, I earned my B.A. from Columbia University ♔, with a double major in Mathematics and Computer Science and a concentration in East Asian Languages and Cultures.
My research lies at the intersection of trustworthy AI, human and machine understanding, and education, guided by two fundamental questions:
- How can we establish and sustain principled trust between humans and AI systems?
- How can we assess what humans and machines truly understand?
I develop methods to evaluate whether AI systems are reliable, aligned with domain expertise, and correct for the right reasons. Drawing in part on my experiences as an educator, I am also interested in how people learn, how we assess their understanding, and what factors contribute to their educational success.
These days, my research focuses on educational assessment, explainable models of student success, and AI in Education (AIED). I study how we can meaningfully assess student understanding, identify factors associated with educational outcomes, and develop interpretable models and approaches that help educators better support student learning and success.
I believe AI should ultimately serve humanity, not take away its joy. As we figure out how AI fits into our society (these are the early days), we need to develop both a deep understanding of the humanities and a rigorous grasp of the technology itself.
News & Highlights
- Nov 2026 Invited talk, "Beyond the Right Answer: Measuring Machine and Human Understanding," at the HAI101: Human x Artificial Intelligence lecture series, London School of Economics (LSE).
- Jul 2026 Reliability, Faithfulness, and the Limits of Post-hoc Explanations of Opaque Scientific Models at the ICML 2026 Workshop: Philosophy Meets Machine Learning (Seoul, South Korea).
- Jun 2026 Co-TA: Streamlining Automated Grading with Generative Rubrics and Distribution Simulation at iRAISE @ Festival of Learning 2026 (Seoul, South Korea).
- Feb 2026 Led the design and rollout of LLM-assisted oral assessments for CIS 5200: Machine Learning (~200 students), Penn's first large-scale replacement of written homework grading with oral assessments. Covered in The Daily Pennsylvanian.
- Dec 2025 Probabilistic Stability Guarantees for Feature Attributions at NeurIPS 2025 (San Diego, CA, USA).
Show moreShow less
- Nov 2025 Two papers at EMNLP 2025 (Suzhou, China): Probabilistic Soundness Guarantees and Adaptive Evaluations.
- Jun 2025 The FIX Benchmark: Extracting Features Interpretable to eXperts published in DMLR. Check out the FIX website for tutorials and more information!
- May 2025 Coming back to the Big Apple! 🍎 Started my internship at Amazon (AWS) as an Applied Scientist, working on agentic AI for security.
- Apr 2025 Named an AWS-AI ASSET Fellow.
Selected Publications
* equal contribution. Full list on Google Scholar.