Dots
Body movement-recognition system that helps amputees and people with disability to use smart devices
Access to digital information is an important right in our society, as it defines if one can integrate into society and get away from “digital exclusion”. The world is entering this hand-gesture controlled devices, but it will be difficult to accommodate disabilities. Disability is often highly individual, which is not reflected in machine learning.Dots is an inclusive interface for future spatial computing, which empowers the disabled person to design their way to interact with Mixed Reality and Internet-of-things, based on their body conditions.Dots is a two-point body gesture recognizing system. Each dot contains one IMU sensor, which can be attached to any movable body parts. After a simple calibration process, with the inertial-navigation technology, the relative motion between any two body parts can be sensed, which represents the four fundamental units in 3D-interface (selecting, moving, rotating, scaling). The user can enjoy the full control of any spatial interfaces