{"id":23654,"date":"2023-09-27T15:44:03","date_gmt":"2023-09-27T15:44:03","guid":{"rendered":"https:\/\/blackrockneurotech.com\/?post_type=webinars&#038;p=23654"},"modified":"2025-03-24T22:46:59","modified_gmt":"2025-03-24T22:46:59","slug":"a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn","status":"publish","type":"webinars","link":"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/","title":{"rendered":"A high-performance neuroprosthesis for speech decoding and avatar control using ECoG &#8211; Kaylo Littlejohn"},"content":{"rendered":"\n<p><strong>Talk Description:<\/strong> <\/p>\n\n\n\n<p>Speech neuroprostheses have the potential to restore communication to people living with paralysis, but naturalistic speed and expressivity are elusive. Here we use high-density surface recordings of the speech cortex in a clinical-trial participant with severe limb and vocal paralysis to achieve high-performance real-time decoding across three complementary speech-related output modalities: text, speech audio and facial-avatar animation. We trained and evaluated deep-learning models using neural data collected as the participant attempted to silently speak sentences. For text, we demonstrate accurate and rapid large-vocabulary decoding with a median rate of 78 words per minute and median word error rate of 25%. For speech audio, we demonstrate intelligible and rapid speech synthesis and personalization to the participant\u2019s pre-injury voice. For facial-avatar animation, we demonstrate the control of virtual orofacial movements for speech and non-speech communicative gestures. The decoders reached high performance with less than two weeks of training. Our findings introduce a multimodal speech-neuroprosthetic approach that has substantial promise to restore full, embodied communication to people living with severe paralysis.<\/p>\n\n\n\n<p><strong>About the speaker:<\/strong> <\/p>\n\n\n\n<p>Kaylo&nbsp;Littlejohn is an EECS Ph.D. student at UC Berkeley advised by Professor Gopala K. Anumanchipalli and Dr. Edward F. Chang. His research is focused on restoring lost function to those who have severe paralysis via the use of speech and avatar neuroprostheses.&nbsp;Kaylo&#8217;s research enabled the first demonstration of intelligible speech-synthesis from neural activity in a person who has lost the ability to communicate.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"author":2,"featured_media":23658,"template":"","locations":[50],"webinar-categories":[51],"class_list":["post-23654","webinars","type-webinars","status-publish","has-post-thumbnail","hentry","locations-virtual","webinar-categories-webinar"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.0 (Yoast SEO v27.0) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>A high-performance neuroprosthesis for speech decoding and avatar control using ECoG - Kaylo Littlejohn | Webinars | Blackrock Neurotech<\/title>\n<meta name=\"description\" content=\"In this Webinar: Talk Description: Speech neuroprostheses have the potential to restore communication to people living with paralysis, but naturalistic speed and\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A high-performance neuroprosthesis for speech decoding and avatar control using ECoG - Kaylo Littlejohn | Webinars | Blackrock Neurotech\" \/>\n<meta property=\"og:description\" content=\"In this Webinar: Talk Description: Speech neuroprostheses have the potential to restore communication to people living with paralysis, but naturalistic speed and\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/\" \/>\n<meta property=\"og:site_name\" content=\"Blackrock Neurotech\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/blackrockneuro\/\" \/>\n<meta property=\"article:modified_time\" content=\"2025-03-24T22:46:59+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/Copy-of-Copy-of-Webinar-Email-Header_Template.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1050\" \/>\n\t<meta property=\"og:image:height\" content=\"600\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@blackrockneuro_\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/\",\"url\":\"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/\",\"name\":\"A high-performance neuroprosthesis for speech decoding and avatar control using ECoG - Kaylo Littlejohn | Webinars | Blackrock Neurotech\",\"isPartOf\":{\"@id\":\"https:\/\/blackrockneurotech.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/Copy-of-Copy-of-Webinar-Email-Header_Template.png\",\"datePublished\":\"2023-09-27T15:44:03+00:00\",\"dateModified\":\"2025-03-24T22:46:59+00:00\",\"description\":\"In this Webinar: Talk Description: Speech neuroprostheses have the potential to restore communication to people living with paralysis, but naturalistic speed and\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/#primaryimage\",\"url\":\"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/Copy-of-Copy-of-Webinar-Email-Header_Template.png\",\"contentUrl\":\"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/Copy-of-Copy-of-Webinar-Email-Header_Template.png\",\"width\":1050,\"height\":600},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blackrockneurotech.com\/#website\",\"url\":\"https:\/\/blackrockneurotech.com\/\",\"name\":\"Blackrock Neurotech\",\"description\":\"A neurotech company.\",\"publisher\":{\"@id\":\"https:\/\/blackrockneurotech.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blackrockneurotech.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/blackrockneurotech.com\/#organization\",\"name\":\"Blackrock Neurotech\",\"url\":\"https:\/\/blackrockneurotech.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blackrockneurotech.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/2023\/06\/Blackrock-Neurotech.jpg\",\"contentUrl\":\"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/2023\/06\/Blackrock-Neurotech.jpg\",\"width\":200,\"height\":200,\"caption\":\"Blackrock Neurotech\"},\"image\":{\"@id\":\"https:\/\/blackrockneurotech.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/blackrockneuro\/\",\"https:\/\/x.com\/blackrockneuro_\",\"https:\/\/www.instagram.com\/blackrockneuro\/\",\"https:\/\/www.youtube.com\/@BlackrockNeurotech\",\"https:\/\/www.linkedin.com\/company\/blackrock-neurotech\/\"]}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"A high-performance neuroprosthesis for speech decoding and avatar control using ECoG - Kaylo Littlejohn | Webinars | Blackrock Neurotech","description":"In this Webinar: Talk Description: Speech neuroprostheses have the potential to restore communication to people living with paralysis, but naturalistic speed and","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/","og_locale":"en_US","og_type":"article","og_title":"A high-performance neuroprosthesis for speech decoding and avatar control using ECoG - Kaylo Littlejohn | Webinars | Blackrock Neurotech","og_description":"In this Webinar: Talk Description: Speech neuroprostheses have the potential to restore communication to people living with paralysis, but naturalistic speed and","og_url":"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/","og_site_name":"Blackrock Neurotech","article_publisher":"https:\/\/www.facebook.com\/blackrockneuro\/","article_modified_time":"2025-03-24T22:46:59+00:00","og_image":[{"width":1050,"height":600,"url":"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/Copy-of-Copy-of-Webinar-Email-Header_Template.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@blackrockneuro_","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/","url":"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/","name":"A high-performance neuroprosthesis for speech decoding and avatar control using ECoG - Kaylo Littlejohn | Webinars | Blackrock Neurotech","isPartOf":{"@id":"https:\/\/blackrockneurotech.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/#primaryimage"},"image":{"@id":"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/#primaryimage"},"thumbnailUrl":"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/Copy-of-Copy-of-Webinar-Email-Header_Template.png","datePublished":"2023-09-27T15:44:03+00:00","dateModified":"2025-03-24T22:46:59+00:00","description":"In this Webinar: Talk Description: Speech neuroprostheses have the potential to restore communication to people living with paralysis, but naturalistic speed and","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blackrockneurotech.com\/webinars\/a-high-performance-neuroprosthesis-for-speech-decoding-and-avatar-control-using-ecog-kaylo-littlejohn\/#primaryimage","url":"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/Copy-of-Copy-of-Webinar-Email-Header_Template.png","contentUrl":"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/Copy-of-Copy-of-Webinar-Email-Header_Template.png","width":1050,"height":600},{"@type":"WebSite","@id":"https:\/\/blackrockneurotech.com\/#website","url":"https:\/\/blackrockneurotech.com\/","name":"Blackrock Neurotech","description":"A neurotech company.","publisher":{"@id":"https:\/\/blackrockneurotech.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blackrockneurotech.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blackrockneurotech.com\/#organization","name":"Blackrock Neurotech","url":"https:\/\/blackrockneurotech.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blackrockneurotech.com\/#\/schema\/logo\/image\/","url":"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/2023\/06\/Blackrock-Neurotech.jpg","contentUrl":"https:\/\/blackrockneurotech.com\/wp-content\/uploads\/2023\/06\/Blackrock-Neurotech.jpg","width":200,"height":200,"caption":"Blackrock Neurotech"},"image":{"@id":"https:\/\/blackrockneurotech.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/blackrockneuro\/","https:\/\/x.com\/blackrockneuro_","https:\/\/www.instagram.com\/blackrockneuro\/","https:\/\/www.youtube.com\/@BlackrockNeurotech","https:\/\/www.linkedin.com\/company\/blackrock-neurotech\/"]}]}},"_links":{"self":[{"href":"https:\/\/blackrockneurotech.com\/wp-json\/wp\/v2\/webinars\/23654","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blackrockneurotech.com\/wp-json\/wp\/v2\/webinars"}],"about":[{"href":"https:\/\/blackrockneurotech.com\/wp-json\/wp\/v2\/types\/webinars"}],"author":[{"embeddable":true,"href":"https:\/\/blackrockneurotech.com\/wp-json\/wp\/v2\/users\/2"}],"version-history":[{"count":4,"href":"https:\/\/blackrockneurotech.com\/wp-json\/wp\/v2\/webinars\/23654\/revisions"}],"predecessor-version":[{"id":23660,"href":"https:\/\/blackrockneurotech.com\/wp-json\/wp\/v2\/webinars\/23654\/revisions\/23660"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blackrockneurotech.com\/wp-json\/wp\/v2\/media\/23658"}],"wp:attachment":[{"href":"https:\/\/blackrockneurotech.com\/wp-json\/wp\/v2\/media?parent=23654"}],"wp:term":[{"taxonomy":"locations","embeddable":true,"href":"https:\/\/blackrockneurotech.com\/wp-json\/wp\/v2\/locations?post=23654"},{"taxonomy":"webinar-categories","embeddable":true,"href":"https:\/\/blackrockneurotech.com\/wp-json\/wp\/v2\/webinar-categories?post=23654"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}