Skip to main content

Brain-computer Interfaces Decode Handwriting


By: Allison Kubo
Image Credit: Nature 593, 249-254(2021)

The study participant, T5, was paralyzed from the neck down, but it was translated onto the screen when he imagined writing. Brain-computer interfaces (BCI) aim to restore function to those who have difficulty or even lost the ability to move or speak. And, yes, it would allow you to control a computer with your brain. New research published in Nature on May 12 shows progress in restoring writing to those who have suffered paralysis. Study participant T5, given this denomer to maintain their privacy, used BCI type at near the speed of the control group with high accuracy. They achieved 94.1% raw accuracy and greater than 99% accuracy with an autocorrect function.

How does this work? Studies have shown that even after years of paralysis, thinking about the desired movement still activates the necessary parts of the brain. The researchers instructed T5 to “imagine” writing with a pen on lined paper. The brain fired their signals but something in the communication, a spinal cord injury, for example, stopped it from moving to the hand. However, by detecting the brain signals using two microelectrodes positioned on the skull near the brain that controls the right-hand movement (precentral gyrus), the signal can be translated to words by the computer rather than the hand. Of course, just a raw electromagnetic signal from the brain would be impossible to decode. But by training the model using several recordings of known signals, researchers can match the signals to known letters.

Why does this work? This recent study was able to increase typing speeds to 90 words per minute. Compared to the point-and-click typing or methods using eye movements, measured at only 40 characters per minute, this offers a significant improvement. Point-and-click methods have people move a cursor on a screen and detect the signals similarly. Although this method is perhaps more varied since it could be applied to games, websites, etc., it is limited by how fast the computer can decode the detected signals. This is far slower than decoding handwriting signals. One possible explanation is that writing is a far more varied signal than moving a cursor in a straight line. The curves of the letters vary over time but moving a cursor is more constant motion in a single direction.

The method is not yet available widely to those who would need it. But it offers a new option to restore precious communication to those who suffer from spinal cord injuries or diseases such as ALS.


Popular Posts

How 4,000 Physicists Gave a Vegas Casino its Worst Week Ever

What happens when several thousand distinguished physicists, researchers, and students descend on the nation’s gambling capital for a conference? The answer is "a bad week for the casino"—but you'd never guess why.

Ask a Physicist: Phone Flash Sharpie Shock!

Lexie and Xavier, from Orlando, FL want to know: "What's going on in this video ? Our science teacher claims that the pain comes from a small electrical shock, but we believe that this is due to the absorption of light. Please help us resolve this dispute!"

The Science of Ice Cream: Part One

Even though it's been a warm couple of months already, it's officially summer. A delicious, science-filled way to beat the heat? Making homemade ice cream. (We've since updated this article to include the science behind vegan ice cream. To learn more about ice cream science, check out The Science of Ice Cream, Redux ) Image Credit: St0rmz via Flickr Over at Physics@Home there's an easy recipe for homemade ice cream. But what kind of milk should you use to make ice cream? And do you really need to chill the ice cream base before making it? Why do ice cream recipes always call for salt on ice?