[Go to site: main page, start]

Amy Pavel

Amy Pavel headshot

Email amypavel@berkeley.edu

Office SDH 415

Twitter @amypavel

Publications Google Scholar

Curriculum Vitae PDF

Research Group
Ph.D. Students: Mina Huh, Karim Benharrak, Ananya Gubbi Mohanbabu, Meng Chen, Yi-Hao Peng (co-advised with Jeffrey P. Bigham)
Masters and Undergraduates: Aadit Barua, Akhil Iyer, Katie Clark, Sumaya Al-Bedaiwi, Ujjaini Das, Jerry He, Sarah Zheng
Recent Alumni: Doeun Lee, Pranav Venkatesh, Tess Van Daele, Yuning Zhang, Daniel Killough, Jalyn Derry, Aochen Jiao, Soumili Kole, Chitrank Gupta

I am an Assistant Professor in the Department of Electrical Engineering and Computer Sciences at the University of California, Berkeley and a Visiting Faculty Resesarcher at Google Research. Before joining UC Berkeley, I spent three wonderful years (Spring 2022-Spring 2025) as an Assistant Professor in the Department of Computer Science at the University of Texas at Austin.

I was previously a postdoc at Carnegie Mellon University, a Research Scientist at Apple, and I received my PhD from UC Berkeley EECS. I regularly teach a Computer Science class that covers the design and development of user interfaces (Introduction to Human-Computer Interaction). Prior versions include CS160 at UC Berkeley in 2018 and CS378 at UT Austin in 2022.

Current UC Berkeley Students: I am actively recruiting UC Berkeley students for research positions in my lab! Check out this document (CalNet ) to learn more and apply.


Prospective Students, Visitors, Interns, and Postdocs: I recruit PhD students every year. Please apply directly to the UC Berkeley EECS PhD program and list me as a potential advisor. For other questions or positions, please read these FAQs before reaching out.

Research Highlights

GenAssist

UIST 2023 – Best Paper Award

A thumbnail depicting four generated image options of a young chef cooking dinner and their descriptions.A thumbnail depicting four generated image options of a young chef cooking dinner and their descriptions.

PDF | Project Page

CrossA11y

UIST 2022 – Best Paper Award

A thumbnail depicting CrossA11y's computational approach that compares video frames with the corresponding audio.A thumbnail depicting CrossA11y's computational approach that compares video frames with the corresponding audio.

PDF | Project Page | Video

Rescribe

UIST 2020

On one side, a set of extended audio description sentences with their corresponding frames, and in the other column a set of inline audio description sentences and the same frames. The shortened descriptions are as follows: `Shots of lavender in a farmers market' is shortened to `Shots of lavender', `Red flowers against a white house and blue sky' is shortened to `Red flowers', `a courtyard and a pool' is not shortened, `Gaby bikes along a path' is shortened to `Close up of french fries', and `Close up of tater tots and french fries' is shortened to `Close up of french fries'On one side, a set of extended audio description sentences with their corresponding frames, and in the other column a set of inline audio description sentences and the same frames. The shortened descriptions are as follows: `Shots of lavender in a farmers market' is shortened to `Shots of lavender', `Red flowers against a white house and blue sky' is shortened to `Red flowers', `a courtyard and a pool' is not shortened, `Gaby bikes along a path' is shortened to `Close up of french fries', and `Close up of tater tots and french fries' is shortened to `Close up of french fries'

PDF | Video | Talk

Long-Form VQA

COLM 2024 – Oral Spotlight

A thumbnail of longform visual question answers across humans, GPT-4V and Gemini. Each answer sentence is labeled with a discourse role (e.g., confirmation, answer) and information source (e.g., image quality, image content).A thumbnail of longform visual question answers across humans, GPT-4V and Gemini. Each answer sentence is labeled with a discourse role (e.g., confirmation, answer) and information source (e.g., image quality, image content).

Project Page

Research Summary

As a systems researcher in Human-Computer Interaction and Accessibility, I embed machine learning technologies (e.g., Natural Language Processing) into new human interactions that I then deploy to test. Using my systems, remote content creators more effectively collaborate, video authors efficiently create accessible descriptions for blind users, and instructors help students to learn and retain key points. To inform future systems that capture what is important to domain experts and people with disabilities, I also conduct and collaborate on in-depth qualitative (e.g., AAC communication, memes) and quantitative studies (e.g., 360° Video, VR Saliency). My research goal is to make communication effective and accessible.

Research Papers

Thesis and Technical Reports

Amy Pavel

PhD in Computer Science, University of California, Berkeley

Advisors: Bjoern Hartmann and Maneesh Agrawala

Additional committee members: Eric Paulos, Abigail De Kosnik

Posters, Demos, and Workshops

A thumbnail of the creation tool workflow converting images into multiple tactile format: embossings, bas-relief models, and 3D models.A thumbnail of the creation tool workflow converting images into multiple tactile format: embossings, bas-relief models, and 3D models.

Katie Clark, Amy Pavel

ASSETS 2025 Posters and Demos

Work

Assistant ProfessorUniversity of California, Berkeley

Department of Electrical Engineering and Computer Sciences

July 2025

Affiliate Assistant Professor (0% time)University of Texas at Austin

Department of Computer Science

July 2025June 2026

Visiting Faculty Researcher (20% time)Google

Google Research

October 2024December 2025

Assistant ProfessorUniversity of Texas at Austin

Department of Computer Science

January 2022June 2025

Research Scientist (50% time)Apple Inc

AI/ML

Machine Intelligence Accessibility Group

July 2019January 2022

Postdoctoral Fellow (50% time)Carnegie Mellon University

HCII

Supervised by Professor Jeffrey P. Bigham

January 2019October 2021

Graduate ResearcherUniversity of California, Berkeley

Visual Computing Lab

Advised by Professors Björn Hartmann and Maneesh Agrawala

September 2013January 2019

Research InternAdobe

Creative Technologies Lab

Advised by Principal Scientist Dan Goldman

Summer 2014, Summer 2015

Undergraduate ResearcherUniversity of California, Berkeley

BiD Lab, Visual Computing Lab

Advised by Professors Björn Hartmann and Maneesh Agrawala

June 2011September 2013

Teaching

InstructorUT Austin

CS 378: Introduction to Human-Computer Interaction

Spring 2025

InstructorUT Austin

CS 395T: Human-Computer Interaction Research

Fall 2024

InstructorUT Austin

CS 378: Introduction to Human-Computer Interaction

Spring 2024

InstructorUT Austin

CS 395T: Human-Computer Interaction Research

Fall 2023

InstructorUT Austin

CS 378: Introduction to Human-Computer Interaction

Spring 2023

InstructorUT Austin

CS 378: Introduction to Human-Computer Interaction

Spring 2022

InstructorUC Berkeley

CS 160: User interface design and development

Summer 2018

Graduate student instructorUC Berkeley

CS 160: User interface design and development

Summer 2017

Student project advisorUC Berkeley

NWMEDIA 190: Making Sense of Cultural Data

Fall 2017

InstructorUC Berkeley

CS Kickstart, intro CS for incoming freshmen women

Summer 2012

TeacherUC Berkeley

Berkeley Engineers and Mentors

2009 - 2010