[PDF]

Towards Controlling IoT Devices to Utilise Brain, Eye Movement, and Facial Muscle Signals to Control a Smart TV: A Preliminary Study


Hadeel Abed

17/05/2024

Supervised by Nhat (Nick) Pham; Moderated by Stuart M Allen

Imagine that someday in the near future, all the smart devices in our homes and offices could be controlled automatically through our thoughts, eye blinks, or just some facial expressions. We will take a small step in this project to achieve this sci-fi vision. We will use a novel biosensing platform called Earable, which has been developed and tested in our lab. The Earable platform has the form factor of a smart earphone and can provide highly sensitive biosignals from the brain (EEG), eyes (EOG), and facial muscles (EMG). This is a demo video of the platform (https://www.youtube.com/watch?v=6K-zi5BIqZ0). There are three tasks to complete for this project.

(1) Bring up the Earable system to capture brain, eye, and muscle biosignals (the hardware and software will be provided), (2) design a scenario to automatically control IoT/smart home devices (smart light bulbs, coffee makers, etc.), (3) implement a system to process the biosignals and control the devices by following the designed scenario.


Initial Plan (05/02/2024) [Zip Archive]

Final Report (17/05/2024) [Zip Archive]

Publication Form