The ESP Private Agents Platform (https://agents.espressif.com) is a platform that allows building and hosting AI Agents for your organisation (more in the blog). The Agents Platform can be used to create conversational AI Agents that you can communicate with using an Espressif powered device. This repository contains the firmware SDK and examples that implement the device side features for communicating with these agents.

The examples in this repository primarily pull together the display, mic, speaker, etc. in a meaningful way. Additionally they have some local tools that the agent can execute. These local tools run on the device itself.

The firmware can talk to any agent (with matching tools) but they are pre-configured with some "Default Agents". The agent can be changed by replacing the default agent with your own custom agent created through the ESP Private Agents Platform.

This is a generic firmware that is expected to work with most agents created with ESP Private Agents Platform. This firmware supports local tools like set_emotion, set_volume, set_reminder, get_local_time. You may refer this for more details.

Default Agent: friend

This firmware supports Matter Controller functionality and Thread Border Router functionality, apart from the common Agents functionality that is described above. It supports tools like get_device_list, set_volume, set_emotion, set_reminder, get_local_time. You may refer this for more details. Users can control other compatible Matter devices using natural voice commands

Default Agent: matter_controller

The examples support the following boards out of the box:

1. ESP-VoCat Core Board v1.2
2. ESP-BOX-3
3. M5Stack-CoreS3
4. M5Stack Thread Border Router(M5Stack-CoreS3 + M5Stack Module Gateway H2) (with H2 Module for Thread Border Router functionality)

You can head over to examples to build and flash the examples yourself.

Or, the fastest way to try out ESP Private Agents firmware is to flash the examples using ESP Launchpad from the links below:

Flash the examples using ESP Launchpad from the links below and then refer the setup guide in the respective examples for the next steps.

Agent	Friend (Based on voice_chat example)	Matter Controller (Based on matter_controller example)
Setup Guide	Setup Guide	Setup Guide
ESP-VoCat	Flash Now	Flash Now
ESP-BOX-3	Flash Now	Flash Now
M5Stack CoreS3	Flash Now	Flash Now
M5Stack CoreS3 + M5Stack Module Gateway H2	Flash Now	Flash Now