Brain game
Samuel Kunz is hard at work on his training regimen. At the next Cybathlon, he will be up against 11 other athletes , competing in a virtual car race in which he controls the vehicle using only his thoughts. Each week, Paulina Kratka – a Bachelor’s student from the Neural Control of Movement Lab – visits him in Frauenfeld to help him train. She starts by placing a cap on his head studded with 64 electrodes and filling each electrode cavity with an electrolyte gel to ensure good contact between the electrodes and his scalp. Then she plugs the cable from the cap into a signal amplifier. This is connected to a laptop on which the game runs. Samuel Kunz is the pilot of the ETH Zurich Brain Computer Interface (BCI) team. He has had tetraplegia since a swimming accident in the Limmat river in the summer of 2014. Despite his disability, he completed his degree in mechanical engineering at ZHAW and now works as a design engineer. “I’m a total technophile,” he says. “When my therapist told me about the Cybathlon, I was immediately keen to take part.”
Steered by the egg
For this year’s Cybathlon, Nicole Wenderoth, an ETH Professor at the Neural Control of Movement Lab, is working closely with Professor Cuntai Guan from Nanyang Technological University (NTU) in Singapore. Guan’s group specialises in electroencephalography (EEG) and neural signal processing. In neuroscience, EEG is used to measure the electrical activity of the brain. With the right algorithms, it can also be used to play computer games.
“We use EEG to record all the signals from the cerebral cortex,” explains Rea Lehner, Senior Researcher in Future Health Technologies and manager of the ETH BCI team. “So we start out with a complete mess of different brain signals.” She says that the biggest challenge is to filter out the signals the pilot uses to control their avatar in the computer game and identify them using machine learning. In the case of Lehner’s BCI team, the signals of most interest come from the motor cortex in the rear portion of the frontal lobe. Published research has shown that these signals are suitable for establishing a brain-computer interface (BCI) due to their distinct activity.
The Cybathlon team, which is supported by Rehaklinik Zihlschlacht and the company Brain Products, spent almost two years optimising the signal processing algorithm. This is what converts the electrical signals from Samuel Kunz’s motor cortex into movements on the screen – and it has to be as consistent and accurate as possible. Four commands are required to play the game. To steer his vehicle left, Kunz thinks about moving his left hand. When the racetrack curves to the right, he thinks about his right hand. To drive straight ahead, he has to relax as much as possible – and when the game racetrack is plunged into darkness, he has to switch on the headlights by thinking about moving both hands at the same time. Different patterns are activated in the cortex region depending on his thoughts. These are recorded via EEG and converted into control signals using algorithms. “The training is exhausting,” says Kunz. “Trying to move my body in my thoughts is a bit like being trapped in a dense, sticky substance like honey,” he adds, though he emphasises that things have improved markedly since he first started, when he felt like he was encased in concrete. Gradually regaining a mental feel for his own body has taken a great deal of rehabilitation and training.
In December 2019, Rea Lehner relocated from Zurich to the Singapore-ETH Centre. She wanted to be in the same place as her research partners so they could work together even more closely in the months leading up to the Cybathlon. While the Singapore team wrestles with the algorithm, training is in full swing in Zurich. Every session has a program running in the background that analyses the algorithm’s performance. “The number of training sessions we run with a specific algorithm is key, because the algorithm adapts to the pilot, and the pilot gets used to the algorithm,” says Lehner. Deciding when the time has come to stop developing the algorithm is a tricky business, she adds.
Interest from tech companies
Unlike other technologies showcased at the Cybathlon, the brain-computer interface is still a long way from its first practical application, one example of which might be controlling a wheelchair by thought alone. The problem is that preparing and using an electrode cap is a cumbersome task, and signal conversion is highly complex. Right now, it is easier to rely on signals from muscles that are still active, such as the eyelids. Signals produced in this way are considerably stronger than so-called thought signals.
Nevertheless, there is already huge interest in BCIs from businesses, with Google and Facebook already investing millions in the field. Voice recognition was a major leap forward for smartphones and tablets, but mind control is the next big thing. Tesla founder Elon Musk is also developing BCIs through his company Neuralink, where a team of over 90 researchers is working on projects such as tiny implantable electrodes. Making this tech safe for human use is still some way off, however, and Lehner has some concerns about this invasive form of BCIs: “Implanting electrodes directly in the brain obviously gives you much clearer signals than a cap,” she says. “But in terms of patient benefits, I think those kinds of interventions are only justified in exceptional cases.” The potential complications can be severe, and scientists have yet to carry out long-term studies on large cohorts. Lehner hopes rapid progress in the development of non-invasive BCI technologies will ensure invasive technologies are reserved for exceptional cases.
Victory Nap
At the Cybathlon, Kunz will compete against 11 international BCI teams . To complete the 500-metre race, he will have to execute each of the four commands four times, without knowing in advance in which order he will need to do so. The current favourite is the team led by former EPFL Professor José Millán, which won the 2016 Cybathlon. The biggest challenge we pilots face, says Kunz, is to avoid moving our face muscles, as this causes serious signal interference. His best result to date came after a post-lunch nap. “But I’m not sure I’ll be able to take that kind of nap right before the race, where there are thousands of people in the crowd,” says Kunz.
This text has been published in the current issue of the
Globe
magazine.
The Cybathlon has been postponed until 19–20 September 2020 due to the coronavirus.
Further information