Live AI Service · Robotonix Labs

AI Robotic Hand Controller

Control your robotic arm in real-time using just your hand gestures. Powered by MediaPipe AI vision and Web Serial API — no installation needed.

Start Controlling Join a Workshop

🧠 MediaPipe AI ⚡ Web Serial API 🦾 Arduino 🎓 STEM Project

🤖 Robotics Labs

🧠 Artificial Intelligence

⚙️ Industrial Automation

🎓 STEM Education

🔬 Science Workshops

💡 Innovation Programs

🏫 School Collaborations

🚀 Summer Camps

🤖 Robotics Labs

🧠 Artificial Intelligence

⚙️ Industrial Automation

🎓 STEM Education

🔬 Science Workshops

💡 Innovation Programs

🏫 School Collaborations

🚀 Summer Camps

🦾 Live Controller

Hand Gesture Control Panel

Connect your Arduino and start the camera to control your robotic arm with real-time hand tracking.

🔌

Connection Setup

Step 1 — Connect Arduino · Step 2 — Start Camera & AI

Status

Waiting for Arduino connection...

Camera Feed — Hand Detection

📷

Start Camera to see live feed

🖐 Finger States

Thumb

—

Index

—

Middle

—

Ring

—

Pinky

—

📡 Signal Data

Serial Signal

—

Fingers Open

—

AI Status

Idle

⚙️ Technology

How It Works

Four steps from your hand gesture to the robotic arm movement.

Step 01

🔌

Connect Arduino

Plug your Arduino via USB. The Web Serial API lets Chrome/Edge talk directly to the hardware — no drivers or software needed.

Step 02

🧠

AI Hand Tracking

MediaPipe's hand landmarker detects 21 key points on your hand in real-time, powered by GPU acceleration right in your browser.

Step 03

📡

Send Serial Data

Finger states (0 = closed, 1 = open) are packed into a 5-character string and sent via serial only when the gesture changes.

Step 04

🦾

Control the Arm

The Arduino reads the string and drives servo motors to mirror your hand gesture on the physical robotic arm in real-time.