logoYuvraj Gupta
HomeAboutProjectsSkillsContact
Resume
logoYuvraj Gupta
Back to Projects

Emotion Copilot – Private Video Calls With an AI Participant

A solo build for the Open Agents Hackathon. A video conferencing platform with real-time emotion analysis, live transcription with speaker identification, AI meeting summaries, and a voice-enabled agent that joins the call, answers questions, and speaks back. The point was privacy: peer-to-peer WebRTC calls, session-only processing, zero data retention, deployed on the decentralized Akash Network with Venice for private inference.

WebRTCBrowser-side face and emotion detectionSpeech-to-text with speaker diarizationVenice AI
View CodeLive Demo
Emotion Copilot – Private Video Calls With an AI Participant Screenshot

Project Features

🔒

Zero Data Retention

Calls are peer-to-peer and analysis happens per session. Nothing is stored after the meeting ends.

😐

Live Emotion Read

Confident, engaged, confused, or frustrated, tracked from facial cues in real time and shown alongside the transcript.

🗣️

An Agent in the Room

The AI participant listens, answers questions out loud when addressed, and produces the summary when the call ends.

🌐

Decentralized Hosting

Runs on Akash with Venice for inference, so neither the video nor the transcript touches a centralized AI provider.

Project Info

Duration

02/2026

Role

Sole Developer

Team Size

Solo Project

Status

Hackathon Submission

Technologies Used

  • • WebRTC
  • • Browser-side face and emotion detection
  • • Speech-to-text with speaker diarization
  • • Venice AI
  • • Akash Network

Watch It Run

Emotion Copilot demo

A live call with real-time emotion tags, running transcription, and the AI participant answering out loud.

Project Gallery

A Live Call
A Live Call
Peer-to-peer WebRTC video with the transcript filling in on the right as people speak.
Emotion Panel
Emotion Panel
Meeting mood and per-participant state, read from facial cues in real time.
Meeting Insights
Meeting Insights
Key points and action items generated while the call is still running.
Adding the AI Participant
Adding the AI Participant
Name it, pick a voice, give it instructions, and it joins the room like anyone else.
The Assistant Speaking
The Assistant Speaking
Asked a question out loud, the agent answers in the call and its reply lands in the transcript.
Join Screen
Join Screen
Camera and microphone check, then straight into a private call with the copilot ready.

Interested in This Project?

I'm always excited to discuss my projects and share insights about the development process. Feel free to reach out if you'd like to know more!

Get In TouchView More Projects

Yuvraj Gupta

AI Engineer building multi-agent systems, production retrieval, and research that ships. San Francisco.

Quick Links

  • Home
  • About
  • Projects
  • Skills
  • Contact

Get In Touch

📍San Francisco, CA
📧yuvrajgupta1808@gmail.com

© 2026 Yuvraj Gupta. All rights reserved.