This presentation by Frischl from Biestwaden introduces the "Ice and Disabilities" project, a volunteer-driven initiative dedicated to providing accessible, open-source communication aids for individuals suffering from severe neurological conditions like ALS and MS. The project arose from the frustration with expensive, inaccessible commercial eye-tracking devices that often arrive too late for patients. The speaker details their journey through researching existing eye-tracking technologies and developing a low-cost (€20) prototype using off-the-shelf components and open-source software (like Optikey), enabling eye-controlled typing. While demonstrating the initial success of their prototype, the team acknowledges significant challenges ahead, including simplifying user setup, compensating for head movements, and exploring simpler applications like a "call staff" button for hospices. The presentation concludes with a call for community involvement to refine and expand their solutions, bridging the gap between technology and the needs of those with limited mobility.
Summarizing the "Ice and Disabilities" Project: Open-Source Eye-Tracking for ALS/MS Patients
0:00 Project Mission: The "Ice and Disabilities" project aims to leverage technology to assist chronically ill patients, particularly those with ALS and MS, in their daily lives by providing communication aids.
1:02 The Challenge of ALS: ALS is a progressive neurological disease that leads to gradual paralysis, eventually rendering individuals unable to move or speak. However, eye movement often remains intact, presenting an opportunity for communication.
1:55 Commercial Barriers: Existing commercial eye-tracking communication devices (iTrackers) are very expensive (e.g., €7,000+) and have excessively long waiting periods, often making them inaccessible to patients who may not survive long enough to receive them.
2:42 Project Motivation: Motivated by these challenges, the team decided to develop an open-source, affordable eye-tracking solution to provide immediate communication support.
3:16 Understanding Eye Tracking: Eye-tracking systems utilize cameras to detect eye movements and translate them into XY coordinates on a screen, allowing for computer interaction (e.g., virtual keyboards). More advanced systems use infrared cameras to precisely track the pupil.
5:47 Project Requirements: The initiative required affordable eye-tracker hardware, software to interpret the tracking data, and communication software to facilitate typing or other interactions.
6:22 Leveraging Open-Source: They found promising open-source software on GitHub, including "Optikey" (a communication keyboard for patients) and eye-tracking software, covering two of their three core needs.
7:00 Prototype Development: An initial, albeit bulky, eye-tracking module was assembled for approximately €20, using an infrared camera and custom-written software to enable eye-controlled typing. This was later made lighter and more practical.
8:50 Outreach and User Engagement: The team created a website, engaged in public relations, and, critically, established direct contact with affected individuals and hospices, conducting weekly visits to an ALS patient.
10:00 Key Development Challenges: User feedback highlighted that the current solution is "extremely complicated" to set up and use. A major technical hurdle is compensating for head movements, which requires integrating a second camera to track the screen's position relative to the head. This refinement is estimated to take 6-12 months.
11:14 Simpler Solutions & Hospice Needs: The project discovered that even simpler eye-gaze interactions (e.g., looking left or right) could be profoundly impactful, such as activating a "call staff" button in hospices, easing anxieties for both patients and relatives.
12:31 Ongoing Work & Open Principles: The project continues to work on simplifying the technology, improving head movement compensation, and fostering an open-source environment by publishing their software and knowledge.
13:06 Call for Collaboration: They invite volunteers to contribute in various areas, including writing, technical setup, software development (especially mobile applications), hardware/software research, 3D modeling, and general promotion.
14:47 Q&A - Technical & Funding Aspects: The system's infrared technology works effectively with dark eyes. The project, initially volunteer-run, now receives support from a social organization (IFB Foundation) and is exploring further funding avenues.
16:00 Q&A - Commercial Alternatives & Cost: The speaker acknowledges that commercial gaming eye-trackers (e.g., Tobii, around €250) are effective and less "fiddly" to set up, recommending them if affordable. The project aims to help those who cannot afford even these lower-cost commercial options.
17:27 Q&A - Keyboard Functionality: The "Optikey" software is highly versatile, offering not only a full keyboard but also modes with larger, pre-defined tiles for common phrases (e.g., "I'm hungry") and a mouse mode.
20:40 Q&A - Gaze Selection Mechanism: To select an item, users typically gaze at it for a configurable duration (a timer runs out). Blinking is generally not used as an input method due to potential tracking instability, and input methods need to adapt to patients' varied remaining abilities.
22:45 Q&A - Smartphone Integration: The project encourages users to explore existing smartphone capabilities; Google's "Look to Speak" app and Apple's integrated eye-tracking features (iOS 18) offer basic gaze-based communication, promoting user independence.