The Cybathlon team, which is supported by Rehaklinik Zihlschlacht and the company Brain Products, spent almost two years optimising the signal processing algorithm. This is what converts the electrical signals from Samuel Kunz’s motor cortex into movements on the screen – and it has to be as consistent and accurate as possible. Four commands are required to play the game. To steer his vehicle left, Kunz thinks about moving his left hand. When the racetrack curves to the right, he thinks about his right hand. To drive straight ahead, he has to relax as much as possible – and when the game racetrack is plunged into darkness, he has to switch on the headlights by thinking about moving both hands at the same time. Different patterns are activated in the cortex region depending on his thoughts. These are recorded via EEG and converted into control signals using algorithms. “The training is exhausting,” says Kunz. “Trying to move my body in my thoughts is a bit like being trapped in a dense, sticky substance like honey,” he adds, though he emphasises that things have improved markedly since he first started, when he felt like he was encased in concrete. Gradually regaining a mental feel for his own body has taken a great deal of rehabilitation and training.
In December 2019, Rea Lehner relocated from Zurich to the Singapore-ETH Centre. She wanted to be in the same place as her research partners so they could work together even more closely in the months leading up to the Cybathlon. While the Singapore team wrestles with the algorithm, training is in full swing in Zurich. Every session has a program running in the background that analyses the algorithm’s performance. “The number of training sessions we run with a specific algorithm is key, because the algorithm adapts to the pilot, and the pilot gets used to the algorithm,” says Lehner. Deciding when the time has come to stop developing the algorithm is a tricky business, she adds.
Interest from tech companies
Unlike other technologies showcased at the Cybathlon, the brain-computer interface is still a long way from its first practical application, one example of which might be controlling a wheelchair by thought alone. The problem is that preparing and using an electrode cap is a cumbersome task, and signal conversion is highly complex. Right now, it is easier to rely on signals from muscles that are still active, such as the eyelids. Signals produced in this way are considerably stronger than so-called thought signals.
Nevertheless, there is already huge interest in BCIs from businesses, with Google and Facebook already investing millions in the field. Voice recognition was a major leap forward for smartphones and tablets, but mind control is the next big thing. Tesla founder Elon Musk is also developing BCIs through his company Neuralink, where a team of over 90 researchers is working on projects such as tiny implantable electrodes. Making this tech safe for human use is still some way off, however, and Lehner has some concerns about this invasive form of BCIs: “Implanting electrodes directly in the brain obviously gives you much clearer signals than a cap,” she says. “But in terms of patient benefits, I think those kinds of interventions are only justified in exceptional cases.” The potential complications can be severe, and scientists have yet to carry out long-term studies on large cohorts. Lehner hopes rapid progress in the development of non-invasive BCI technologies will ensure invasive technologies are reserved for exceptional cases.
At the Cybathlon, Kunz will compete against 11 international BCI teams
. To complete the 500-metre race, he will have to execute each of the four commands four times, without knowing in advance in which order he will need to do so. The current favourite is the team led by former EPFL Professor José Millán, which won the 2016 Cybathlon. The biggest challenge we pilots face, says Kunz, is to avoid moving our face muscles, as this causes serious signal interference. His best result to date came after a post-lunch nap. “But I’m not sure I’ll be able to take that kind of nap right before the race, where there are thousands of people in the crowd,” says Kunz.