Zoom+Making Online Meetings More Expressive
An experimental interaction design project that makes online meetings more expressive through shared canvases, gesture-driven reactions, background tools, and real-time visual filters.
Introduction Video
1
Pick the Background Color
You can change the background color that represents your mood in real time.
2
Emoji Reaction
Emoji reactions through gestures create a more active and playful video communication experience.
3
Background Manipulation
Shared canvas interactions make the meeting background more flexible, useful, and expressive, including drawing on another participant's canvas.
Presentation mode gives remote participants the feeling of being together in one place.
Something more interactive and fun.
Where I started
Remote meetings can feel disconnected because facial expressions, gestures, and body language are harder to read through delayed video communication.
Standard video conferencing reactions are limited, making it difficult for participants to express mood, energy, and spontaneous responses naturally.
Designing the experience
Designed and prototyped shared Zoom background canvases with color, drawing, gesture, emoji, and filter interactions.
Trained gesture and expression models with Teachable Machine, then connected the model outputs to p5.js and ml5 visual effects.
Tested the prototype in Zoom using Processing, chromakey screens, OBS, and real-time video streams.
Learnings & reflection
Small visual reactions can make remote communication feel more immediate when normal body language cues are weakened.
Machine-learning prototypes need simple controls and clear feedback so expressive features feel lightweight rather than distracting.