ROBOTICS R&D PILOT STACK

MANTIS is our embodied-AI pilot stack.

A live RobotOps cockpit and validation framework for Jetson-powered robotics — connecting vision, speech, memory, service health, safety gates, and supervised action into one operator surface.

SSE LIVE

OBSERVATION-ONLY

JETSON ORIN

MEMORY FABRIC

QA TRIPWIRES

ROS2 BRIDGES

CD5 / MANTIS-A1LIVEOBSERVATION-ONLYORIN-1GPU62°C 41%CPU58°C 38%RAM12.4 / 32 GBPOWERMAXN 18WTHERMALFAN 47%NVP MODELMODE 0ACTIVE SCENARIOS/scenario/describe-sceneDescribe SceneTARGET ≤ 1800msPASS/scenario/voice-loopVoice LoopTARGET ≤ 2400msPASS/scenario/safety-probeSafety ProbeTARGET ≤ 200msPASSMOTHERPChermes142mshoncho12msriva88msORINvlm240msros2-bridge4msedge18msSSE LIVE • 142ms • SUPERVISED

MANTIS is where we integrate the hard parts of embodied AI: perception, speech, memory, edge telemetry, supervised actions, and real-time operator visibility.

▮ WHY MANTIS

Robots do not fail in one place.

Embodied AI systems fail across surfaces — models, memory, speech, frontend contracts, containers, edge devices, ROS2 bridges, cache versions, and physical safety boundaries. MANTIS exists to make those failures visible before they reach the operator or customer.

01 / SURFACE

Multimodal complexity

Vision, language, speech, memory, and actions must stay synchronized.

02 / SURFACE

Edge reality

Jetson thermals, RAM, power, containers, and services affect behavior.

03 / SURFACE

Operator trust

Every proposed action needs visible state, traceability, and supervision.

04 / SURFACE

Demo reliability

Customer-visible regressions become reusable tripwires.

▮ SYSTEM TOPOLOGY

MANTIS is not one model.

It is the orchestration and validation layer around a distributed embodied-AI stack.

INFERENCE · MEMORY · SPEECH

MotherPC

LLM / HERMES

RIVA SPEECH

HONCHO MEMORY

EMBED SERVICE

TRITON INFERENCE

EDGE · BRIDGES · TELEMETRY

MANTIS-Orin

VLM

ROS2 BRIDGES

JETSON TELEMETRY

CONTAINER HEALTH

EDGE SERVICES

OPERATOR · SCENARIO · SAFETY

CD5 Cockpit

SCENARIO RUNNER

LIVE VITALS

SAFETY STATE

SERVICE HEALTH

CX CANARIES

▮ THE OPERATOR SURFACE

CD5: the operator surface for MANTIS.

CD5 turns the robotics stack into a live control surface: service health, Orin vitals, memory state, speech state, scenario execution, safety posture, and container status in one interface.

/api/orin/vitals

Live Orin telemetry

GPU, CPU, RAM, thermals, power, fan, disk, and NVP model.

/api/services/health

Service health

MotherPC and Orin services tracked independently.

/scenario/run

Scenario runner

Run vision, memory, speech, and safety probes from one panel.

/sse/state

SSE live state

Operator view updates continuously without page refresh.

/trace/raw

Raw trace access

Debug the exact endpoint, response, and failure path.

/containers

Container visibility

Know which services are running, absent, paused, or degraded.

▮ REPEATABLE PROBES

Repeatable scenarios, not one-off demos.

Every scenario is a repeatable probe. MANTIS treats demos as testable flows, not theatrical one-offs.

/scenario/describe-scene
Describe Scene
TARGETunder 1800ms
RAW TRACE
/scenario/count-objects
Count Objects
TARGETunder 1600ms
RAW TRACE
/scenario/ask-mantis
Ask MANTIS
TARGETunder 2200ms
RAW TRACE
/scenario/remember-fact
Remember a Fact
TARGETunder 600ms
RAW TRACE
/scenario/recall-fact
Recall a Fact
TARGETunder 800ms
RAW TRACE
/scenario/voice-loop
Voice Loop
TARGETunder 2400ms
RAW TRACE
/scenario/asr-probe
ASR Probe
TARGETunder 700ms
RAW TRACE
/scenario/tts-probe
TTS Probe
TARGETunder 900ms
RAW TRACE
/scenario/safety-probe
Safety Probe
TARGETunder 200ms
RAW TRACE

▮ CONTINUITY LAYER

Memory is infrastructure, not a prompt trick.

Honcho, Embed, and Bus form the continuity layer behind MANTIS.

memory.honcho

Honcho

Persistent agent and user memory for goals, preferences, instructions, and context.

memory.embed

Embed

Semantic retrieval for previous observations, transcripts, scene descriptions, and task context.

memory.bus

Bus

Event flow between vision, speech, memory, UI, ROS2, and service health.

MANTIS uses memory to make robot interaction continuous across turns, sessions, users, and environments. The operator can verify when memory is used, when it is stale, and when it is unavailable.

▮ SAFETY POSTURE

Observation-first. Action-gated. Operator-visible.

MANTIS separates perception and proposed action from physical actuation. Operators can inspect what the system saw, remembered, proposed, and blocked before any motion path is enabled.

OBSERVATION-ONLY

Proposed actions are read-only unless motion controllers are explicitly enabled.

▮ ACTION PROPOSALS ARE VISIBLE

▮ MOTION IS GATED

▮ SERVICE STATE IS INSPECTABLE

▮ SAFETY POSTURE IS ALWAYS SHOWN

▮ OPERATOR SUPERVISION REMAINS CENTRAL

▮ CX TRIPWIRES

Green tests are not enough. The customer experience must be green.

MANTIS converts escaped demo failures into reusable canary gates. If a frontend/backend contract drifts, a stale asset ships, or one user action creates duplicate side effects, the framework rejects the lane before it closes.

VERIFIES · FRONTEND TO BACKEND
Response Shape Parity
Verifies the fields the frontend reads actually exist in backend responses.
frontend reads payload.status. backend returns no status field.
VERIFIES · HTML TO JS BUILD TAG
Cache-Bust Agreement
Verifies served HTML and JavaScript agree on the active build tag.
index.html build a1c4 / app.js build b9f2
VERIFIES · ONE ACTION ONE EFFECT
Duplicate Action UUID
Verifies one user action cannot trigger duplicate side effects.
action uuid 7f31 emitted twice within 800ms.

A previous voice issue passed server-side checks but failed in customer testing because frontend and backend response shapes disagreed. MANTIS now turns that class of failure into a reusable detector.

CD5.GATE.A1 — CUSTOMER-EXPERIENCE TRIPWIRE TRIO

▮ CURRENT STATUS

Pilot stack under active R&D.

STAGE

Pilot / R&D framework

FOCUS

Embodied-AI operations and validation

HARDWARE

MotherPC + Jetson Orin

RUNTIME

Multimodal services + ROS2 bridges

SAFETY

Observation-first, supervised action

DIRECTION

Field-ready RobotOps framework

MANTIS is the current proving ground for our robotics architecture. The goal is not to hide complexity, but to make it observable, testable, and safe to operate.

▮ BUILT FOR

Built first for robotics builders.

01

Robotics labs

Repeatable embodied-AI demos with live health and traceability.

02

Jetson · ROS2 teams

Edge telemetry, model services, bridges, and containers in one cockpit.

03

Field demo engineers

Know what failed before the customer does.

04

AI platform teams

Convert customer-visible failures into reusable gates.

05

Technical pilot partners

Bring a real robot stack and validate it under supervised operation.

▮ NEXT

Bring your robotics stack. Make it observable, demo-ready, and failure-aware.

SEE IT. REMEMBER IT. MONITOR IT. GATE IT.

▮ MANTIS · A1