In today’s world, controlling devices has become second nature. By clicking a button on a remote control or tapping a smartphone icon, the control is literally at our fingertips. However, for individuals with limited fine motor skills, these simple tasks can often be out of reach, making them rely heavily on the assistance of others.
SmartGaze, a project funded through the Xjenza Malta FUSION SmartCities programme, aims to provide a hands-free solution for smart device control. The innovative system continuously tracks the user’s position and gaze direction, enabling seamless interaction with devices by simply looking at them.
The technology also integrates a smart wearable glasses equipped with electrodes to measure electrooculography (EOG). By analysing predefined eye movements, such as looking up, down, left, or right, amongst others, the system activates specific control functions. For example, a user can connect to a television by gazing at it, change the channel with upward or downward eye movements, or adjust the volume using left and right eye movements.
During initial trials with healthy participants, the system successfully enabled control of seven different devices in a test environment, including motorized blinds, fans, lamps, and air conditioners. Through collaboration with Agenzija Sapport, the project extended testing to individuals with mobility impairments. The system was further customized for a wheelchair-bound participant, who successfully controlled three devices within their field of view.
By combining position tracking, gaze direction, and intuitive control mechanisms, SmartGaze offers a transformative solution for individuals with mobility challenges, empowering them to interact with their surroundings effortlessly and independently.
This project was coordinated by Prof. Tracey Camilleri and made possible through the contributions of Prof. Kenneth Camilleri, Dr Nathaniel Barbara, Mr Salah Ad-Din Ahmed Youbi and Ing. Matthew Mifsud. The team members come from the Department of Systems and Control Engineering and the Centre for Biomedical Cybernetics.
With extensive experience in processing EOG signals, particularly for the development of human-machine interface systems, the team welcomes anyone interested in this area for future collaborations.
