The system integrates a wearable electrode suit, smart glasses with an embedded camera, motion tracking, and a multimodal AI model similar to GPT-4.1. Its defining feature is the ability to drive muscle movement in real time, enabling users to perform unfamiliar tasks without pre-programmed routines.

At its core is EMS technology, which delivers low-level electrical pulses to activate specific muscle groups. While EMS has been used in rehabilitation and skill training, earlier implementations relied on fixed scripts. This new system introduces contextual awareness by combining visual input, body posture data, and AI reasoning to generate task-specific movement instructions dynamically.

A dedicated anatomical safety layer ensures that all movements remain within human physical limits. If the AI generates an unsafe command, the system redistributes motion across multiple joints. In laboratory testing, this significantly reduced errors compared to baseline AI models without such constraints.

In practice, users can interact with the system via voice commands. For example, when asked to open an unfamiliar window, the AI identifies the mechanism and guides the user’s hand, wrist, and arm through the correct sequence. User studies also showed that participants could detect and correct system errors, maintaining active control during task execution.

The researchers highlight three near-term applications: home-based rehabilitation, industrial training to reduce onboarding time and injury risk, and assistive mobility for visually impaired users through direct physical guidance.

Despite its promise, the system faces challenges, including the need for individualized electrode calibration, discomfort from electrical stimulation, and cybersecurity concerns. No commercial timeline has been announced.

The project received the Best Paper Award at ACM CHI 2026 in Barcelona, underscoring its significance in advancing human–computer interaction research.

According to Newatlas