Give your AI agent five senses.
m5ai connects AI agents to the phones and smart devices people already own, so an agent can see, hear and sense the world through them, with the owner deciding what it may use.
Senses your agent can borrow
Most of these sensors are already in the room. m5ai turns them into senses an agent can ask for, one at a time.
-
Sight
Phone cameras, home cameras
Read a label, check whether the stove is still on, describe what is on the table.
-
Hearing
Phone microphones, smart speakers
Notice the doorbell or a crying baby, follow a conversation, take a voice request.
-
Touch
Motion sensors, wearables, haptics
Feel a fall or a sudden stop, and answer back with a tap on the wrist.
-
Smell
Air quality and gas sensors, purifiers
Notice smoke, a gas leak or stale air, and open a window through a connected device.
-
Taste
Connected kitchen devices, chemical sensors
Help in the kitchen: tell when food has spoiled or a dish needs more salt.
How it works
No new hardware. The agent and the device never need to know each other's internals.
-
Connect your devices
Pair the phone and smart devices you already have. Each one shows up as a set of senses it can offer.
-
Your agent asks for a sense
An agent requests sight, hearing or another sense through one API, without writing code for each device.
-
You approve it
You choose which agent may use which sense, and for how long. You can take it back at any time.
Senses are lent, not taken
- An agent gets a sense only after the device owner approves it, one sense and one agent at a time.
- Raw camera and microphone data is processed on the device wherever possible. The agent receives what it asked for, not the whole stream.
- Every time an agent uses a sense, it is recorded, so you can see who used what and when.
Works with what is already in the room
We are starting with the devices people carry and live with every day.
- iOS and Android phones
- Smart speakers
- Home cameras
- Wearables
- Air quality sensors
- Smart home hubs
Building an agent that needs to sense the world?
Tell us what your agent should be able to see, hear or feel. We are working with a small group of early teams.
Request early access