Steve Oney

School of Information
University of Michigan
4552 Leinweber Building
2200 Hayward Street
Ann Arbor, MI 48109
 
 
Latest CV: from.so/oney_cv
http://from.so/
1 (734) 999–0246
soney@umich.edu

Education

  • Carnegie Mellon University
    PhD  in Human-Computer Interaction
    MS  in Human-Computer Interaction
    Advisors:  Brad Myers and Joel Brandt
    Committee:  Scott Hudson and John Zimmerman
    09/2008 – 04/2015
    Pittsburgh, PA
  • Massachusetts Institute of Technology
    MEng  in Computer Science
    SB  in Computer Science
    SB  in Mathematics
    09/2003 – 08/2008
    Cambridge, MA

Professional Experience

  • School of Information, University of Michigan
    Associate Professor
    09/2022 – present
    Ann Arbor, MI
  • Computer Science and Engineering, University of Michigan
    Associate Professor (by courtesy)
    09/2022 – present
    Ann Arbor, MI
  • School of Information, University of Michigan
    Assistant Professor
    09/2016 – 09/2022
    Ann Arbor, MI
  • Computer Science and Engineering, University of Michigan
    Assistant Professor (by courtesy)
    01/2017 – 09/2022
    Ann Arbor, MI
  • School of Information, University of Michigan
    Presidents Post-Doctoral Fellow
    09/2015 – 09/2016
    Ann Arbor, MI
  • Carnegie Mellon University (Human-Computer Interaction Institute)
    Graduate student and researcher
    09/2008 – 04/2015
    Pittsburgh, PA
  • Advanced Technologies Labs, Adobe Systems
    Research Intern
    03/2013 – 06/2013
    San Francisco, CA
  • Advanced Technologies Labs, Adobe Systems
    Research Intern
    06/2011 – 09/2011
    San Francisco, CA
  • IBM Research, Alamaden, Research Intern
    Research Intern
    05/2009 – 08/2009
    San Jose, CA
  • MIT Media Lab, Cognitive Machines Group
    Researcher (M.Eng)
    01/2007 – 08/2008
    Cambridge, MA

Publications

Note: The names of authors who were students at the time of publication are underlined (including my name if I was a student at the time of publication).
Labels: Best Paper Award, Honorable Mention or other recognition
Approximate acceptance rates: UIST: 22%, CHI: 23%, VL/HCC: 30%, CSCW: 25%, ICSE: 19%, IMX: 26%

Heavily-reviewed Journal Manuscripts (J)

  • April Wang, Yan Chen, John Chung, Christopher Brooks, and Steve Oney. (2021) PuzzleMe: Leveraging Peer Assessment for In-Class Programming Exercises. The ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). Toronto, Canada.
    J.4
    (PDF)
  • Mauli Pandey, Vaishnav Kameswaran, Hrishikesh Rao, Sile O'Modhrain, and Steve Oney. (2021) Understanding Accessibility and Collaboration in Programming for People with Visual Impairments. The ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). Toronto, Canada.
    * Recognition for Contribution to Diversity and Inclusion
    * J.3
    (PDF)
  • April Wang, Anant Mittal, Christopher Brooks, and Steve Oney. (2019) How Data Scientists Use Computational Notebooks for Real-Time Collaboration. The ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). Austin, TX, USA.
    J.2
    (PDF)
  • Steve Oney, Christopher Brooks, and Paul Resnick. (2018) Creating Guided Code Explanations with chat.codes. The ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). New York, NY, USA.
    J.1
    (PDF)

Heavily-reviewed Conference Papers (C)

  • Ashley Zhang, Yan-Ru Jhou, Yinuo Yang, Shamita Rao, Maryam Arab, Yan Chen, and Steve Oney. (2026) CodeStream: Augmenting Timelines with Code Annotation for Navigating Large Coding Histories. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Barcelona, Spain.
    C.41
  • Maryam Arab, Hanning Li, Rushal Butala, and Steve Oney. (2025) Co-Advisor: Learning Programming Strategies in Context. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Raleigh, NC, USA.
    C.40
    (PDF)
  • Ashley Zhang, Victor Bursztyn, Gromit Chan, Shunan Guo, Eunyee Koh, Steve Oney, and Jane Hoffswell. (2025) ConvoMap: Interactive Visualizations for Exploring Complex Conversations in Multi-Agent Systems. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Raleigh, NC, USA.
    C.39
    (PDF)
  • Yinuo Yang, Ashley Zhang, Steve Oney, and April Wang. (2025) SPARK: Real-Time Monitoring of Multi-Faceted Programming Exercises. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Raleigh, NC, USA.
    C.38
    (PDF)
  • Jiacheng Zhang, Jiawen Li, Maryam Arab, and Steve Oney. (2025) Multi-Click: Cross-Tab Web Automation via Action Generalization. The ACM Symposium on User Interface Software and Technology (UIST). Busan, Korea.
    C.37
    (PDF)
  • Ashley Zhang, Xiaohang Tang, Steve Oney, and Yan Chen. (2024) CFlow: Supporting Semantic Flow Analysis of Students' Code in Programming Problems at Scale. ACM Conference on Learning @ Scale (L@S). Atlanta, GA.
    C.36
    (PDF)
  • Lei Zhang, Jin Pan, Jacob Gettig, Steve Oney, and Anhong Guo. (2024) VRCopilot: Authoring 3D Layouts with Generative Models in VR. The ACM Symposium on User Interface Software and Technology (UIST). Pittsburgh, PA, USA.
    C.35
    (PDF)
  • Rebecca Krosnick and Steve Oney. (2024) ScrapeViz: Hierarchical Representations for Web Scraping Macros. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Liverpool, UK.
    C.34
    (PDF)
  • Mauli Pandey, Steve Oney, and Andrew Begel. (2024) Towards Inclusive Source Code Readability Based on the Preferences of Programmers with Visual Impairments. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Honolulu, Hawaiʻi.
    C.33
    (PDF)
  • April Wang, Andrew Head, Ashley Zhang, Steve Oney, and Christopher Brooks. (2023) Colaroid: A Literate Programming Approach for Authoring Explorable Multi-Stage Tutorials. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Hamburg, Germany.
    C.32
    (PDF)
  • Ashley Zhang, Yan Chen, and Steve Oney. (2023) VizProg: Identifying Misunderstandings by Visualizing Students' Coding Progress. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Hamburg, Germany.
    C.31
    (PDF)
  • Lei Zhang, Ashutosh Agrawal, Steve Oney, and Anhong Guo. (2023) VRGit: A Version Control System for Collaborative Content Creation in Virtual Reality. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Hamburg, Germany.
    C.30
    (PDF)
  • Ashley Zhang, Yan Chen, and Steve Oney. (2023) RunEx: Augmenting Regular-Expression Code Search with Runtime Values. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Washington, D.C..
    C.29
    (PDF)
  • Mauli Pandey, Sharvari Bondre, Sile O'Modhrain, and Steve Oney. (2022) Accessibility of UI Frameworks and Libraries for Programmers with Visual Impairments. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Rome, Italy.
    C.28
    (PDF)
  • Rebecca Krosnick and Steve Oney. (2022) ParamMacros: Creating UI Automation Leveraging End-User Natural Language Parameterization. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Rome, Italy.
    C.27
    (PDF)
  • Rebecca Krosnick and Steve Oney. (2021) Understanding the Challenges and Needs of Programmers Writing Web Automation Scripts. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). (Virtual/Online).
    C.26
    (PDF)
  • Yan Chen, Sang Won Lee, and Steve Oney. (2021) CoCapture: Effectively Communicating UI Behaviors on Existing Websites by Demonstrating and Remixing. ACM Conference on Human Factors in Computing Systems (CHI). (Virtual/Online).
    C.25
    (PDF)
  • Rebecca Krosnick, Fraser Anderson, Justin Matejka, Steve Oney, Walter Lasecki, Tovi Grossman, and George Fitzmaurice. (2021) Think-Aloud Computing: Supporting Rich and Low-Effort Knowledge Capture. ACM Conference on Human Factors in Computing Systems (CHI). (Virtual/Online).
    C.24
    (PDF)
  • Yan Chen, Andrés Monroy-Hernández, Ian Wehrman, Steve Oney, Walter Lasecki, and Rajan Vaish. (2020) Sifter: A Hybrid Workflow for Theme-based Video Curation at Scale. The ACM International Conference on Interactive Media Experiences (IMX). Barcelona, Spain.
    C.23
    (PDF)
  • Lei Zhang and Steve Oney. (2020) FlowMatic: An Immersive Authoring Tool for Creating Interactive Scenes in Virtual Reality. The ACM Symposium on User Interface Software and Technology (UIST). Minneapolis, MN, USA.
    C.22
    (PDF)
  • Yan Chen, Jaylin Herskovitz, Walter Lasecki, and Steve Oney. (2020) A Hybrid Crowd-Machine Workflow for Program Synthesis. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Dunedin, New Zealand.
    C.21
    (PDF)
  • Yan Chen, Gabriel Matute, April Wang, Jaylin Herskovitz, Sang Won Lee, Walter Lasecki, and Steve Oney. (2020) EdCode: Towards Personalized Support at Scale for Remote Assistance in CS Education. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Dunedin, New Zealand.
    *Best Short Paper
    * C.20
    (PDF)
  • April Wang, Zihan Wu, Christopher Brooks, and Steve Oney. (2020) Callisto: Capturing the "Why" by Connecting Conversations with Computational Narratives. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Honolulu, Hawai'i.
    C.19
    (PDF)
  • Mauli Pandey, Hari Subramonyam, Brooke Sasia, Steve Oney, and Sile O'Modhrain. (2020) Explore, Create, Annotate: Designing Digital Drawing Tools with Visually Impaired People. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Honolulu, Hawai'i.
    C.18
    (PDF)
  • Yan Chen, Mauli Pandey, Jean Song, Walter Lasecki, and Steve Oney. (2020) Improving Crowd-Supported GUI Testing with Structural Guidance. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Honolulu, Hawai'i.
    C.17
    (PDF)
  • Lei Zhang and Steve Oney. (2019) Studying the Benefits and Challenges of Immersive Dataflow Programming. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Memphis, TN, USA.
    *Best Short Paper
    * C.16
    (PDF)
  • Steve Oney, Rebecca Krosnick, Joel Brandt, and Brad Myers. (2019) Implementing Multi-Touch Gestures with Touch Groups and Cross Events. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Glasgow, Scotland.
    C.15
    (PDF)
  • Shih-Chieh Lin, Chang-Hong Hsu, Walter Talamonti, Yunqi Zhang, Steve Oney, Jason Mars, and Lingjia Tang. (2018) Adasa: A Conversational In-Vehicle Digital Assistant for Advanced Driver Assistance Features. The ACM Symposium on User Interface Software and Technology (UIST). Berlin, Germany.
    C.14
    (PDF)
  • Steve Oney, Alan Lundgard, Rebecca Krosnick, Michael Nebeling, and Walter Lasecki. (2018) Arboretum and Arbility: Improving Web Accessibility Through a Shared Browsing Architecture. The ACM Symposium on User Interface Software and Technology (UIST). Berlin, Germany.
    C.13
    (PDF)
  • Rebecca Krosnick, Sang Won Lee, Walter Lasecki, and Steve Oney. (2018) Expresso: Building Responsive Interfaces with Keyframes. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Lisbon, Portugal.
    C.12
    (PDF)
  • Yan Chen, Sang Won Lee, Yin Xie, YiWei Yang, Walter Lasecki, and Steve Oney. (2017) Codeon: On-Demand Software Development Assistance. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Denver, CO, USA.
    C.11
    (PDF)
  • Xin Rong, Shiyan Yan, Steve Oney, Mira Dontcheva, and Eytan Adar. (2016) CodeMend: Assisting Interactive Programming with Bimodal Embedding. The ACM Symposium on User Interface Software and Technology (UIST). Tokyo, Japan.
    C.10
    (PDF)
  • Yan Chen, Steve Oney, and Walter Lasecki. (2016) Towards Providing On-Demand Expert Support for Software Developers. The ACM CHI Conference on Human Factors in Computing Systems (CHI). San Jose, CA, USA.
    C.9
    (PDF)
  • Steve Oney, Brad Myers, and Joel Brandt. (2014) InterState: A Language and Environment for Expressing Interface Behavior. The ACM Symposium on User Interface Software and Technology (UIST). Honolulu, HI, USA.
    C.8
    (PDF)
  • Steve Oney, Chris Harrison, Amy Ogan, and Jason Wiese. (2013) ZoomBoard: A Diminutive QWERTY Soft Keyboard Using Iterative Zooming for Ultra-Small Devices. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Paris, France.
    C.7
    (PDF)
  • Steve Oney and Joel Brandt. (2012) Codelets: Linking Interactive Documentation and Example Code in the Editor. The ACM CHI Conference on Human Factors in Computing Systems (CHI). Austin, TX, USA.
    C.6
    (PDF)
  • Rahul Pandita, Xusheng Xiao, Hao Zhong, Tao Xie, Steve Oney, and Amit Paradkar. (2012) Inferring Method Specifications from Natural Language API Descriptions. The International Conference on Software Engineering (ICSE). Zürich, Switzerland.
    C.5
    (PDF)
  • Steve Oney, Brad Myers, and Joel Brandt. (2012) ConstraintJS: Programming Interactive Behaviors for the Web by Integrating Constraints and States. The ACM Symposium on User Interface Software and Technology (UIST). Cambridge, MA, USA.
    C.4
    (PDF)
  • Steve Oney, John Barton, Brad Myers, Tessa Lau, and Jeffrey Nichols. (2011) Playbook: Revision Control & Comparison for Interactive Mockups. International Symposium on End-User Development (IS-EUD). Torre Canne, Italy.
    C.3
    (PDF)
  • Kursat Ozenc, Miso Kim, John Zimmerman, Steve Oney, and Brad Myers. (2010) How to Support Designers in Getting Hold of the Immaterial Material of Software. The ACM Conference on Human Factors in Computing Systems (CHI). Atlanta, GA, USA.
    C.2
    (PDF)
  • Steve Oney and Brad Myers. (2009) FireCrystal: Understanding Interactive Behaviors in Dynamic Web Pages. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Corvallis, OR, USA.
    C.1
    (PDF)

Book Chapters (B)

  • Mauli Pandey, Sharvari Bondre, Vaishnav Kameswaran, Hrishikesh Rao, Sile O'Modhrain, and Steve Oney. (2023) UI Development in Mixed-Ability Software Engineering Teams. Equity, Diversity, and Inclusion in Software Engineering (EDI).
    B.2
    (PDF)
  • Brad Myers, Amy Ko, Chris Scaffidi, Steve Oney, YoungSeok Yoon, Kerry Chang, Mary Beth Kery, and Toby Li. (2016) Making End User Development More Natural. Advances in End User Development (EUD).
    B.1
    (PDF)

Refereed Posters (P), Workshops (W), Doctoral Consortiums (D), Demos (E), and Panels (A)

  • Xiangyu Zhou and Steve Oney. (2026) Simulating Human Cursor Trajectories for Path-Sensitive GUI Evaluation. Posters of the ACM CHI Conference on Human Factors in Computing Systems (CHI Posters). Barcelona, Spain.
    P.4
  • Jiacheng Zhang, Carl Fan, and Steve Oney. (2025) Understanding Challenges and Needs of Using AI in Web Automation Systems. Designing and Developing User Interfaces with AI: Advancing Tools, Workflows, and Practices (CHI2025-CompUI). Yokohama, Japan.
    W.12
    (PDF)
  • Ashley Zhang, Yinuo Yang, Maryam Arab, Yan Chen, and Steve Oney. (2025) Understanding And Guiding Student-AI Interaction In Future Programming Education. CHI 2025 Workshop on Augmented Educators and AI (CHI2025-AE&AI). Yokohama, Japan.
    W.11
    (PDF)
  • Jane Im, Himanshu Zade, Steve Oney, Pamela Wisniewski, and Kentaro Toyama. (2024) Improving Advising Relationships Between PhD Students and Faculty in Human-Computer Interaction. Extended Abstracts of the ACM CHI Conference on Human Factors in Computing Systems (CHI EA). Honolulu, Hawaiʻi.
    A.1
    (PDF)
  • April Wang, Zihan Wu, Christopher Brooks, and Steve Oney. (2024) "Don't Step on My Toes": Resolving Editing Conflicts in Real-Time Collaboration in Computational Notebooks. The IDE Workshop (IDE Workshop). Lisbon, Portugal.
    W.10
    (PDF)
  • Ashley Zhang, Xiaohang Tang, Steve Oney, and Yan Chen. (2024) Demonstration of CFlow: Supporting Semantic Flow Analysis of Students' Code in Programming Problems at Scale. Demos at the ACM Conference on Learning @ Scale (L@S Demos). Atlanta, GA.
    E.2
    (PDF)
  • Yinuo Yang and Steve Oney. (2024) VizCode: A Practical Real-time Tool for In-Class Computer Programming Tutoring. Demos at the ACM Conference on Learning @ Scale (L@S Demos). Atlanta, GA.
    E.1
    (PDF)
  • Rebecca Krosnick and Steve Oney. (2023) Promises and Pitfalls of Using LLMs for Scraping Web UIs. CHI 2023 Workshop: Future of Computational Approaches for Understanding & Adapting User Interfaces (CHI2023-CompUI). Hamburg, Germany.
    W.9
    (PDF)
  • Shiyu Xu, Ashley Zhang, and Steve Oney. (2023) How Pairing by Code Similarity Influences Discussions in Peer Learning. Late-Breaking Work at The ACM CHI Conference on Human Factors in Computing Systems (CHI LBW). Hamburg, Germany.
    P.3
    (PDF)
  • April Wang, Dakuo Wang, Jaimie Drozdal, Xuye Liu, Soya Park, Steve Oney, and Christopher Brooks. (2021) What Makes a Well-Documented Notebook? A Case Study of Data Scientists’ Documentation Practices in Kaggle. Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA). (Virtual/Online).
    P.2
    (PDF)
  • Rebecca Krosnick and Steve Oney. (2020) Toward Providing Live Feedback in Web Automation IDEs. Workshop on Live Programming (LIVE). (Virtual/Online).
    W.8
    (PDF)
  • Yan Chen, Jasmine Jones, and Steve Oney. (2020) On-Demand Collaboration in Programming. Microsoft New Future of Work Symposium (MSNFWS). (Virtual/Online).
    W.7
    (PDF)
  • Mauli Pandey, Michael Nebeling, Sun Young Park, and Steve Oney. (2019) Exploring the Tracking Needs and Practices of Recreational Athletes.. EAI International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth). Trento, Italy.
    P.1
    (PDF)
  • April Wang, Steve Oney, and Christopher Brooks. (2019) Redesigning Notebooks for Data Science Education. Human-Centered Study of Data Science Work Practices Workshop, ACM Conference on Human Factors in Computing Systems (CHI) (HuSDat). Glasgow, Scotland.
    W.6
    (PDF)
  • Louis Spinelli, Mauli Pandey, and Steve Oney. (2018) Attention Patterns for Code Animations: Using Eye Trackers to Evaluate Dynamic Code Presentation Techniques. Programming Experience (PX/18). Nice, France.
    W.5
    (PDF)
  • Yan Chen, Steve Oney, and Walter Lasecki. (2016) Expert Crowd Support Systems for Software Developers. Collective Intelligence (CI). New York, NY, USA.
    W.4
    (PDF)
  • Steve Oney, Brad Myers, and Joel Brandt. (2013) Euclase: A Live Development Environment with Constraints and FSMs. International Workshop on Live Programming at ICSE (LIVE). San Francisco, CA, USA.
    W.3
    (PDF)
  • Brad Myers, Steve Oney, YoungSeok Yoon, and Joel Brandt. (2013) Creativity Support in Authoring and Backtracking. CHI 2013 Workshop on Evaluation Methods for Creativity Support Environments . Paris, France.
    W.2
    (PDF)
  • Steve Oney. (2011) Development Tools for Interactive Behaviors. Doctoral Consortium: IS-EUD (IS-EUD DC). Torre Canne, Italy.
    D.3
    (PDF)
  • Steve Oney. (2010) Democratizing Computational Tools for Interaction Designers. Graduate Consortium: VL/HCC (VL/HCC GC). Madrid, Spain.
    D.2
    (PDF)
  • Steve Oney. (2009) Empowering Designers with Creativity Support Tools. Graduate Consortium: VL/HCC (VL/HCC GC). Corvallis, OR, USA.
    D.1
    (PDF)
  • Steve Oney, Brad Myers, and John Zimmerman. (2009) Visions for Euclase: Ideas for Supporting Creativity through Better Prototyping of Behaviors. Workshop on Computational Creativity (CHI) . Boston, MA, USA.
    W.1
    (PDF)

Preprints (R)

  • Steve Oney. (2024) EDBooks: AI-Enhanced Interactive Narratives for Programming Education. (Preprint) .
    R.1
    (PDF)

Theses (T)

  • Steve Oney. (2015) Expressing Interactivity with States and Constraints. Ph.D. Thesis (CMU). Pittsburgh, PA.
    T.2
    (PDF)
  • Steve Oney. (2008) Natural Language Search of Structured Documents. M.eng Thesis (MIT). Cambridge, MA, USA.
    T.1
    (PDF)

Grants

  • 11/2020
    $10,000
    Steve Oney (PI)
    Adobe, Inc.
  • 10/2020
    $60,000
    Designing and Building Collaborative Tools for Mixed-Ability Programming Teams
    Steve Oney (PI) (and Mauli Pandey, unofficially)
    Google Inc.
    Award for Inclusion Research
  • 09/2020
    $499,209
    Improving Web Accessibility Through Multi-Resolution Mixed-Initiative Interaction Tools
    Steve Oney (PI)
    National Science Foundation (NSF)
    IIS: Cyber-Human Systems (CHS)
  • 07/2019
    $10,875
    Applying Literate Programming Approaches to Support Semantic Annotation
    Andrea Thomer (PI) and Steve Oney (co-PI)
    The U-M Office of Research (UMOR)
  • 10/2019
    $598,926
    Scalable Remote Peer Help for Programming Education
    Steve Oney (PI), Paul Resnick, and Christopher Brooks
    National Science Foundation (NSF)
    Improving Undergraduate STEM Education: Education and Human Resources (IUSE: EHR)
  • 01/2018
    $174,981
    Designing Scalable Help Tools for Programming Courses
    Steve Oney (PI)
    National Science Foundation (NSF)
    Cyber-Human Systems (CHS) CRII
  • 11/2017
    $37,000
    Prototyping Tools to Improve Crowd Based Training for IVA Development
    Steve Oney (PI) and Walter Lasecki
    Clinc, Inc.
  • 04/2017
    $198,327
    End-User Techniques for Aggregating and Analyzing Exercise and Physical Data
    Steve Oney (PI), Michael Nebeling, and Sun Young Park
    Michigan Exercise Science & Sports Initiative

Awards

  • VL/HCC: Honorable mention
    SPARK: Real-Time Monitoring of Multi-Faceted Programming Exercises
    10/2025
  • L@S: Best paper
    CFlow: Supporting Semantic Flow Analysis of Students' Code in Programming Problems at Scale
    7/2024
  • CHI: Honorable mention
    VizProg: Identifying Misunderstandings by Visualizing Students' Coding Progress
    4/2023
  • CHI: Honorable mention
    Colaroid: A Literate Programming Approach for Authoring Explorable Multi-Stage Tutorials
    4/2023
  • CSCW: recognition for contribution to diversity and inclusion
    Understanding Accessibility and Collaboration in Programming for People with Visual Impairments
    10/2021
  • UMSI Excellence in Instruction Award
    09/2021
  • CHI: Honorable mention
    Callisto: Capturing the "Why" by Connecting Conversations with Computational Narratives
    4/2020
  • VL/HCC: Best short paper
    EdCode: Towards Personalized Support at Scale for Remote Assistance in CS Education
    8/2020
  • CHI: Honorable mention
    Implementing Multi-Touch Gestures with Touch Groups and Cross Events
    5/2019
  • CSCW: Best paper
    How Data Scientists Use Computational Notebooks for Real-Time Collaboration
    11/2019
  • VL/HCC: Best short paper
    Studying the Benefits and Challenges of Immersive Dataflow Programming
    10/2019
  • UIST: Honorable mention
    Adasa: A Conversational In-Vehicle Digital Assistant for Advanced Driver Assistance Features
    10/2018
  • University of Michigan President's Postdoctoral Fellowship
    09/2015
  • CHI: Honorable mention
    ZoomBoard: A Diminutive QWERTY Soft Keyboard Using Iterative Zooming for Ultra-Small Devices
    4/2013
  • Ford Foundation Predoctoral Fellowship
    Annual stipend of $20,000 for three years, awarded to 60 doctoral students nationwide across disciplines
    09/2009 – 05/2012
  • Google/UNCF Scholarship
    One-year scholarship for $10,000
    09/2009
  • UIST Student Innovation Contest, 1st place
    Part of winning team in most creative category
    10/2009
  • NEWMAC Academic All-Conference
    Awarded for academic success while a member of MIT's varsity track team
    09/2008
  • MIT Batttlecode Open Programming Competition Finalist
    09/2008
  • ARCS Foundation Scholarship (Pittsburgh Chapter)
    Annual stipend of $5,000 for three years. Awarded to 13 doctoral students in the Pittsburgh area (CMU & University of Pittsburgh)
    09/2008 – 05/2011

Invited Presentations

  • Stanford HCI Seminar
    Designing Tools for Remote Communication in Programming
    11/2021
    (remote)
  • Harvard Computer Science Colloquium
    Designing Tools for Remote Communication in Programming
    11/2021
    (remote)
  • Adobe Research HCI Seminar
    Designing Tools for Remote Communication in Programming
    5/2021
    (remote)
  • University of Washington DUB Seminar
    Designing Tools for Remote Communication in Programming
    12/2020
    (remote)
  • MIT CSAIL HCI Seminar
    Designing Tools for Remote Communication in Programming
    10/2020
    (remote)
  • Indiana University
    Designing Tools for Remote Communication and Collaboration
    11/2019
    Bloomington, IN
  • Williams College
    CS Colloquium—Designing Tools for More Effective Remote Communication
    11/2018
    Williamstown, MA
  • University of Wisconsin
    HCI Seminar: Designing Tools for Remote Communication Between Programmers
    11/2017
    Madison, WI
  • University of Michigan School of Information
    Programming Tools that Speak our Language
    03/2016
    Ann Arbor, MI
  • University of Notre Dame Department of Computer Science and Engineering
    Expressing Interactivity with States and Constraints
    10/2015
    South Bend, IN
  • University of Illinois at Chicago Department of Computer Science
    Expressing Interactivity with States and Constraints
    04/2015
    Chicago, IL
  • Boston University Department of Computer Science
    Expressing Interactivity with States and Constraints
    03/2015
    Boston, MA
  • FX Palo Alto Laboratory
    Expressing Interactivity with States and Constraints
    03/2015
    Palo Alto, CA
  • Stony Brook Computer Science Department
    Expressing Interactivity with States and Constraints
    03/2015
    Stony Brook, CA
  • University of California at Irvine
    Expressing Interactivity with States and Constraints
    02/2015
    Irvine, CA
  • Dagstuhl: Practical Software Testing: Tool Automation and Human Factors
    03/2010
    Dagstuhl, Germany
  • IBM Almaden Lunch Seminar
    FireCrystal: Understanding Interactive Behaviors in Dynamic Web Pages
    06/2009
    San Jose, CA

Service

    Organizing Committee

    • Steering Committee
      IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)
      2023 – 2027
    • General Chair (with Michael Nebeling)
      UIST 2026
      2026
    • Most Influential Paper Award Co-Chair
      VL/HCC 2024 and 2025
      2024 – 2025
    • Program Co-Chair (with Jácome Miguel Costa Cunha)
      IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)
      2021
    • Graduate Consortium co-chair (with Michael Lee)
      IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)
      2020

    Program Committee

    • ACM Symposium on User Interface Software and Technology (UIST)
      2017 – present
    • ACM Conference On Computer-Supported Cooperative Work And Social Computing (CSCW)
      2022
    • ACM Conference on Human Factors in Computing Systems (CHI)
      2016 – present
    • ACM International Conference on Supporting Group Work (GROUP)
      2018, 2020
    • Programming Experience Workshop (PX)
      2017 – 2020
    • International Workshop on Eye Movements in Programming (EMIP)
      2019
    • ACM Conference on Tangible, Embedded, and Embodied Interactions (TEI)
      2019
    • Tech Notes for the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS)
      2019

    Peer Review

    • IEEE Transactions of Software Engineering (TSE)
      2018
    • ACM Transactions on Computer-Human Interaction (TOCHI)
      2018
    • ACM Conference on Human Factors in Computing Systems (CHI)
      2010 – present
    • Conference on Human-Computer Interaction with Mobile Devices (MobileHCI)
      2014
    • ACM Conference on Designing Interactive Systems (DIS)
      2010, 2012
    • Philippine Journal of Science (PJS)
      2008, 2009
    • ACM UIST Operations Committee (mobile program guide)
      2013 – 2015

    Operations

    • ACM Symposium on User Interface Software & Technology (UIST)
      2011 – 2015
    • ACM CHI Operations Committee (mobile program guide)
      2012 – 2015
    • ACM ITS Operations Committee (mobile program guide)
      2013 – 2015
    • ACM UbiComp Committee (mobile program guide)
      2012
    • ACM CHI student volunteer (mobile guide development team)
      2010, 2011

    UMSI

    • UMSI Culture and Community Committee Co-Chair
      2023 – (present)
    • School of Information BSI Committee
      2018 – 2020 & 2021 – 2022
    • Faculty Advisor for UMSI chapter of Upsilon Pi Epsilon (International Honor Society for the Computing and Information Disciplines)
      2021 – present
    • School of Information Technical Curriculum Task Force
      2019 – 2020
    • University of Michigan Interactive and Social Computing (MISC) Coordinator
      2018 – 2019

    Other

    • CMU Computer Science outreach roadshow volunteer (with Women@SCS & SCS4All)
      2009 – 2015
    • CMU Human-Computer Interaction Institute (HCII) ombudsperson
      2011 – 2014
    • CMU Human-Computer Interaction Institute (HCII) visit weekend co-chair
      2010
    • CMU Human-Computer Interaction Institute (HCII) PhD lunch coordinator
      2009, 2010
    • CSE Promotion and Tenure Committee
      2025

Students Supervised

Dissertation Chair (Ph.D. Graduates)

  • Yan Chen (School of Information)
    On-Demand Collaboration in Programming
    Currently: Assistant Professor at Virginia Tech
    Fall 2015 – Fall 2020
    University of Michigan
  • Lei Zhang (School of Information)
    Designing End-user Creation Tools for Immersive Experiences
    (co-advised with Anhong Guo)
    Currently: Assistant Professor at NJIT
    Fall 2018 – Spring 2024
    University of Michigan
  • (Mauli) Maulishree Pandey (School of Information)
    Accessibility of Collaborative Programming for Blind and Visually Impaired Developers
    Currently: UX Researcher at Google
    Fall 2018 – Summer 2023
    University of Michigan
  • (April) Yi Wang (School of Information)
    Interactive Programming Interfaces for Data Science Collaboration and Learning
    (co-advised with Christopher Brooks)
    Currently: Assistant Professor at ETH Zürich
    Fall 2018 – Spring 2023
    University of Michigan
  • Rebecca Krosnick (Computer Science and Engineering)
    Improving Web Automation Tools through UI Context and Demonstration
    Currently: Software Engineer at Postman
    Fall 2017 – Summer 2023
    University of Michigan

Ph.D. Advisees (Ongoing)

  • (Ashley) Ge Zhang (School of Information)
    Fall 2021 – present
    University of Michigan
  • Jiacheng Zhang (Scool of Information)
    Fall 2023 – present
    University of Michigan

Thesis Committees (Ph.D.)

  • Hari Subramonyam (School of Information)
    Designing AI Experiences: Boundary Representations, Collaborative Processes, and Data Tools
    2021
    University of Michigan
  • Vaspol Ruamviboonsuk (Computer Science and Engineering)
    Understanding and Improving the Performance of Web Page Loads
    2020
    University of Michigan
  • Shih-Chieh Lin (Computer Science and Engineering)
    Cross-Layer System Design for Autonomous Driving
    2019
    University of Michigan
  • Sang Won Lee (Computer Science and Engineering)
    Improving User Involvement Through Live, Collaborative Creation
    2017
    University of Michigan
  • Xin Rong (School of Information)
    Neural Language Models for Data-Driven Programming Support
    2017
    University of Michigan
  • David Moon (Computer Science and Engineering)
    2023
    University of Michigan
  • Zihan Wu
    Designing and Evaluating Fine-Grained Interactive Practice Tools for Novice Programming Learners
    2025
    University of Michigan
  • Jingyuan Zhu (Computer Science and Engineering)
    2025
    University of Michigan

Thesis Chair (M.S.)

  • (Mauli) Maulishree Pandey (School of Information)
    Exploring and Designing for the Self-Tracking Needs of Recreational Athletes
    2018
    University of Michigan
  • KJ Green
    2024
    University of Michigan
  • Yue Shen
    An LLM-based Method for Tailoring Coding Tutorials
    2024
    University of Michigan
  • Carl Fan
    2024
    University of Michigan

Thesis Committees (M.S.)

  • Xunan (Andy) Zhou (School of Information)
    Conversational Agent Experience: What makes a good skill?
    2020
    University of Michigan
  • Kangning Chen (School of Information)
    Providing Examples and Tool Support for Novice AR Creators
    2020
    University of Michigan
  • Katy Madier (School of Information)
    Enabling Low-cost Co-located Virtual Reality Experiences
    2019
    University of Michigan
  • Jiaqi Wu
    Exploring Bridges Between Creative Coding and Visual Generative AI
    2024
    University of Michigan

Thesis Chair (Undergraduate)

  • Yinuo Yang
    2024
    University of Michigan

Other Mentees

  • Hussain Alafaireet. MSI Researcher
  • Rushal Butala
  • Niu Chang. Undergraduate Summer Intern
  • Erin Deutschman. Explore CS Research Mentee
  • Carl Fan
  • Natalie Gross. UMSI, Undergraduate Researcher
  • Yunjie Guo. Michigan CSE Undergraduate Researcher
  • Jaylin Herskovitz. Former Undergraduate Researcher. Now Ph.D. student at Michigan (CSE)
  • Tisha Jain
  • Shweta Kumar
  • Hanning Li
  • Ruidong Liu. Undergraduate researcher. Now Ph.D. student at Cornell University
  • Gabriel Matute. Former Undergraduate Researcher. Now Ph.D. student at UC Berkeley
  • Jamie Neumann. UMSI, Undergraduate Researcher
  • Rebecca Parada. UMSI, Undergraduate Researcher
  • Tami Van Omen. Undergraduate researcher
  • Ningqi Wang. Undergraduate Intern. MS Student at Carnegie Mellon
  • Yisen Wang. Explore CS Research Mentee.
  • Zihan Wu. Undergraduate Summer Intern. Currently: UMSI PhD Student
  • Jie Wei Wu. MSI Researcher. Now: Google Software Engineer
  • Jessica Wu. Former Undergraduate Researcher. Now Software Engineer at Amazon
  • Yin Xie. Former MS researcher. Now interaction designer at Internet Brands
  • Johnathan Yan. Undergraduate Researcher
  • Yinuo Yang
  • YiWei Yang. Former CSE Undergraduate Researcher. Now Ph.D. student at the University of Washington
  • Muhan Zhao. Michigan CSE Undergraduate Researcher
  • Yuan Zhou. Undergraduate Summer Intern. Georgia Tech M.S.
  • Licheng Zhu. MSI Researcher. Now: Senior User Experience Researcher at Thompson Reuters

Press

Patent

  • US Patent number 9,495,134. "Methods and Apparatus for Code Segment Handling" Brandt, J. & Oney, S.
    11/2016