{"id":27781,"date":"2024-05-29T02:27:12","date_gmt":"2024-05-29T07:27:12","guid":{"rendered":"https:\/\/ustower.net\/?p=27781"},"modified":"2024-05-29T02:27:18","modified_gmt":"2024-05-29T07:27:18","slug":"bilingual-ai-brain-implant-helps-stroke-survivor-communicate-in-spanish-and-english","status":"publish","type":"post","link":"https:\/\/ustower.net\/?p=27781","title":{"rendered":"Bilingual AI brain implant helps stroke survivor communicate in Spanish and English"},"content":{"rendered":"\n<p class=\"has-medium-font-size\"><a href=\"https:\/\/changlab.ucsf.edu\/\">Scientists at the University of California, San Francisco<\/a>&nbsp;have developed a&nbsp;<a href=\"https:\/\/link.springer.com\/article\/10.1038\/s41551-024-01207-5\">bilingual brain implant<\/a>&nbsp;that uses artificial intelligence to help a stroke survivor communicate in Spanish and English for the first time.<\/p>\n\n\n\n<p class=\"has-medium-font-size\">Nearly a dozen scientists from the university\u2019s Center for Neural Engineering and Prostheses have worked for several years to design a decoding system that could turn the man&#8217;s brain activity into sentences in both languages and&nbsp;<a href=\"https:\/\/x.com\/ChangLabUcsf\/status\/1792619527093522606\">display them on a screen<\/a>.<\/p>\n\n\n\n<p class=\"has-medium-font-size\">An&nbsp;<a href=\"https:\/\/link.springer.com\/article\/10.1038\/s41551-024-01207-5\">article published May 20 in Nature Biomedical Engineering<\/a>&nbsp;outlining their research identifies the man as Pancho. At age 20, he became severely paralyzed as a result of a stroke he had in the early 2000s. Pancho can moan and grunt but can&#8217;t articulate clear words. He is a native Spanish speaker who learned English as an adult.<\/p>\n\n\n\n<p class=\"has-medium-font-size\">Under the leadership of&nbsp;<a href=\"https:\/\/changlab.ucsf.edu\/our-team\">Dr. Edward Chang<\/a>, a neurosurgeon who serves as co-director of the Center for Neural Engineering and Prostheses, Pancho received a&nbsp;<a href=\"https:\/\/www.nejm.org\/doi\/10.1056\/NEJMoa2027540\">neural implant in February 2019<\/a>, allowing scientists to start tracking his brain activity.<\/p>\n\n\n\n<p class=\"has-medium-font-size\">By using an AI method known as a neural network, researchers were able to train Pancho&#8217;s implant to decode words based on the brain activity produced when he attempted to articulate them. This AI training method basically allows the brain implant, known scientifically as a brain-computer interface device, to process data in a way that is somewhat similar to the human brain.<\/p>\n\n\n\n<p class=\"has-medium-font-size\">By 2021, the technology had significantly helped restore Pancho&#8217;s ability to communicate,&nbsp;<a href=\"https:\/\/www.nejm.org\/doi\/10.1056\/NEJMoa2027540\">but only in English<\/a>.<\/p>\n\n\n\n<p class=\"has-medium-font-size\">\u201cSpeech decoding has primarily been shown for monolinguals but half the world is bilingual with each language contributing to a person\u2019s personality and worldview,\u201d&nbsp;<a href=\"https:\/\/x.com\/ChangLabUcsf\/status\/1792619519996997897\">Chang&#8217;s research group said on X<\/a>. \u201cThere is a need to develop decoders that let bilinguals communicate with both languages.\u201d<\/p>\n\n\n\n<p class=\"has-medium-font-size\">However, the 2021 research served as the foundation to develop the decoding system that later made Pancho\u2019s brain implant bilingual in Spanish and English.<\/p>\n\n\n\n<h2 class=\"wp-block-heading has-medium-font-size\"><strong>Allowing a language switch based on preference<\/strong><strong><\/strong><\/h2>\n\n\n\n<p class=\"has-medium-font-size\">After discovering that Pancho&#8217;s brain&nbsp;<a href=\"https:\/\/x.com\/ChangLabUcsf\/status\/1792619529891385567\">had &#8220;cortical activity&#8221; across both languages<\/a>&nbsp;years after he became paralyzed, the scientists realized they could leverage that to train a bilingual brain implant without the need to train separate language-specific decoding systems.<\/p>\n\n\n\n<p class=\"has-medium-font-size\">&#8220;We leveraged this finding to demonstrate transfer learning across languages. Data collected in a first language could significantly expedite training a decoder in the second language,&#8221;&nbsp;<a href=\"https:\/\/x.com\/ChangLabUcsf\/status\/1792619535063040296\">Chang\u2019s research group said on X<\/a>, because it is&nbsp;<a href=\"https:\/\/x.com\/ChangLabUcsf\/status\/1792619531744972973\">based on the brain activity produced by<\/a>&nbsp;&#8220;the intended vocal-tract movements of the participant, irrespective of the language.&#8221;<\/p>\n\n\n\n<p class=\"has-medium-font-size\">In 2022, the scientists sought out to prove that. They again used the artificial neural network to train Pancho&#8217;s brain implant on the distinct neural activity produced by his bilingual speech.<\/p>\n\n\n\n<p class=\"has-medium-font-size\">According to their findings, Pancho was able to use the bilingual decoding system powering his brain implant to &#8220;participate in a conversation, switching between [both] languages on the basis of preference.&#8221;<\/p>\n\n\n\n<p class=\"has-medium-font-size\">The study ultimately shows &#8220;the feasibility of a bilingual speech neuroprosthesis,&#8221; or bilingual brain implant, and provides a glimpse into how this type of technology has the &#8220;potential to restore more natural communication&#8221; among bilingual speakers with paralysis, according to the May 20 article.<\/p>\n\n\n\n<p class=\"has-medium-font-size\"><a href=\"https:\/\/www.nbcnews.com\/news\/latino\/bilingual-ai-brain-implant-spanish-english-stroke-patient-rcna154295\">Nbcnews<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Scientists at the University of California, San Francisco&nbsp;have developed a&nbsp;bilingual brain implant&nbsp;that uses artificial intelligence to help a stroke survivor communicate in Spanish and English for the first time. Nearly a dozen scientists from the university\u2019s Center for Neural Engineering and Prostheses have worked for several years to design a decoding system that could turn [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":27782,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5783],"tags":[4149,28689,3065,7371,2910],"class_list":["post-27781","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sci-tech","tag-artificial-intelligence","tag-bilingual-brain-implants","tag-san-francisco","tag-scientists","tag-university-of-california"],"_links":{"self":[{"href":"https:\/\/ustower.net\/index.php?rest_route=\/wp\/v2\/posts\/27781","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ustower.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ustower.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ustower.net\/index.php?rest_route=\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/ustower.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=27781"}],"version-history":[{"count":1,"href":"https:\/\/ustower.net\/index.php?rest_route=\/wp\/v2\/posts\/27781\/revisions"}],"predecessor-version":[{"id":27783,"href":"https:\/\/ustower.net\/index.php?rest_route=\/wp\/v2\/posts\/27781\/revisions\/27783"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ustower.net\/index.php?rest_route=\/wp\/v2\/media\/27782"}],"wp:attachment":[{"href":"https:\/\/ustower.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=27781"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ustower.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=27781"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ustower.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=27781"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}