What it is
A Tavus video agent talks to the customer. A Pine Computer does the work.
The customer asks for a warranty claim and the video agent starts it. The Computer signs in to the support portal, reads the warranty, finds the order and fills in the claim, on a live screen beside the call.
- When the Computer needs something only the customer has, the video agent asks for it.
- The customer can hang up to go and find it. The claim waits, signed in, and the next call picks up the thread.
- The video agent reads the claim back and gets a clear yes before the Computer submits.
- The claim number is checked against the portal's own records, and a summary comes back as a PDF.
- The portal password goes in as a secret: it is typed on the Computer and the model never sees it.
In the film
One recorded call. A customer tells Riley, the video agent, that their air purifier will not turn on and asks for a replacement.
Beside the call, the Computer signs in to the support portal and fills in the warranty claim. It needs the serial number, so Riley asks the customer for it.
How it was built
The video agent has three tools: start the claim, pass on an answer, and read where the claim stands. None of them waits for the work. Starting the claim is one call to Pine's agent on the Computer.
turn = await session.agent.run(goal, {
secrets,
}) When the agent on the Computer asks a question or finishes, the server tells the page, and the page puts it into the video agent's context so it speaks next. Everything is real except the portal, which is a demonstration support site.
Run it
You need Node.js 22 or later, a Pine Computer project with an API key, and a Tavus API key.
git clone https://github.com/PineComputer/pine-computer
cd pine-computer/examples/tavus-video-agent
npm install
cp .env.example .env.local
npm run setup:tavus
npm run dev To see the whole claim without a call, npm run rehearse runs it through the same tools and answers as the customer would.