UROP Openings

Have a UROP opening you would like to submit?

Please fill out the form.

Submit your UROP opening

Augmenting Human Empathy using ML


Term:

Spring-Summer

Department:

MAS: Media Arts and Sciences

Faculty Supervisor:

Pattie Maes

Faculty email:

pattie@media.mit.edu

Apply by:

As soon as possible.

Contact:

Camilo Rojas: camilorq@media.mit.edu

Project Description

“Project Us” aims to help people develop their sense of empathy. It uses machine learning to analyze interlocutors’ signals (e.g., tone of voice, electrodermal activity, -soon- visual cues, etc.) during conversations, and feeds the emotional content back to them in real-time. This technologically-enhanced feedback loop aims to enable each partner to "feel" the other’s emotions and corroborate it with context data, in a way that could result in a gradual training of their “empathy muscle". Results from our experimental studies show that users experience an increased level of attention, as well as awareness of self and others. Short video: vimeo.com/472542308 Our aim with this research is to offer insights into the fundamental social dynamics of an increasingly technologically mediated world. What qualities affect how well someone understands our emotional states in digital communications? Could surfacing and sharing affective information about our bodies’ emotional responses augment this process? We currently have two prototypes that yielded exciting results in pilot experiments, using a wearable (paper: dl.acm.org/doi/abs/10.1145/3393914.3395882 ) and a web service (paper on the works) The student(s) will be part of a team composed of members from MIT and Wellesley. The output of this research will also be part of a commission by the Science Gallery in Melbourne, for transforming the project into a (demo/art) experience for the general public. This will be part of their Mental exhibition in 2021 (https://opencall.sciencegallery.com/mental). The work can be fully remote and independent of location. Desired background: Machine Learning, natural language / audio processing, graphic design, data visualisation, web infrastructure, user studies OR software dev. If you don't have the background, but you are highly motivated to participate in the project, please apply (projectus@media.mit.edu). Please find in the links below additional information: Videos: vimeo.com/472542308 youtube.com/watch?v=y167xQE11eg Latest paper: https://dl.acm.org/doi/abs/10.1145/3393914.3395882 Project website: https://www.media.mit.edu/projects/project-us/overview/

Pre-requisites

Desired background: Machine Learning, natural language / audio processing, graphic design, data visualisation, web infrastructure, user studies OR software dev. If you don't have the background, but you are highly motivated to participate in the project, please apply (projectus@media.mit.edu).