The First-Ever Live Performance with an AI Singing Voice Clone | ElevenLabs Impact

Please welcome Gabby Lieieber who leads impact at 11 Labs. [music] [music] Good afternoon. I'm Gabby Liboitz. I am a certified speech language therapist and I lead our impact program on the partnerships team. In 2024, our partnerships team identified a growing need among individuals with motor neuron disease, also known as ALS, and uncovered a use case for our technology that we never could have imagined. For those of you who may not be familiar, ALS is a neurodeenerative condition that progressively affects the nerves controlling muscle movement. Over time, many individuals with ALS lose the ability to walk, to move their hands, to eat, and to speak. Throughout all of this, their minds often remain fully intact. They still think, feel, and create as they always have, but their bodies no longer allow them to express it. Many of these individuals communicate by typing messages one letter at a time using eyetracking devices. And when they finish typing out that message, the voice that speaks the words is often generic, robotic, and a textto-spech voice. This allows these individuals to get their basic needs met, but not to be truly heard until they discovered 11 Labs. When individuals came to us having found our voice cloning technology, they told us something that we will never forget. They felt like they had been given a piece of their identity back. Not only were they communicating more, they were staying in their jobs longer. They were writing and producing audio books, performing stand-up comedy, renewing their vows, and reading stories to their grandchildren. A nonprofit supporting individuals with ALS came to 11 Labs with an ask. They wondered if we would consider giving away 30,000 free voices to support all of the individuals in the United States living with ALS. And 11 Labs said, "We want to give back 1 million voices." Today, through the 11 Labs impact program, any individual with permanent voice loss, not just from ALS, but from any condition, including headneck cancer, stroke, multiple sclerosis, and the clinicians supporting them, get free access to 11 Labs technology for life. We also provide free hands-on audio editing for those individuals to ensure that the voice they use to communicate with every day truly represents who they are on the inside. We also provide free access to our technology for nonprofit organizations. And to date, we have supported over 450 nonprofits across healthcare, education, and culture and empowered over 7,000 free voices. And this is just the beginning. Today, I want to highlight the individuals at the heart of this work. Starting by showing you a short trailer for a documentary we created called 11 Labs 11 Voices which is premiering at South by Southwest this March narrated by Sir Michael Kaine. Around the world millions face medical conditions that take away their ability to speak. Loved ones are left missing the familiar sound of their voice. 11 Labs is on a mission to help them reclaim it. Through our technology, we give people back the sound of themselves. In 11 films, here are some of those extraordinary people telling their stories in their own voice. 11 stories, 11 voices, 11 labs. [applause] Thank you. And now I'd like to invite our very special guest, Patrick Darling, to the stage. [music] Hi Patrick, if you wouldn't mind, would you please introduce yourself to the audience? My name is Patrick Darling and it is great to be here with you all. I was born and raised in the East Midlands of England before finding home in the city of Bristol in 2011. I've been a voice actor, a barista, a barber, a boatman, a gamer, a painter, and a YouTube content creator. But above all things, I have been a musician. At the age of 29, I developed the life devastating illness of motor neurone disease, also called ALS. Now, four years later, I have lost the ability to sing and play my instruments, but I still continue to compose and produce my music. Before you found 11 Labs, how were you communicating? Had you tried traditional tools like voice banking, and what were those experiences like for you? When my voice was starting to fail, I began seeing uh [sighs and gasps] a speech therapist um who mentioned uh voice banking where you record your voice to save it for when you can't use your own anymore. I struggled with that because by that stage my voice had already changed. It felt like we were saving the wrong voice. Uh, I want to take you back to the moment that you heard your 11 Labs voice clone for the first time. What was that like for you? The first time I heard the voice, I thought it was amazing. It sounded exactly like I had before. And you literally wouldn't be able to tell the difference. I will not say what the first word I made my new voice say, but I can tell you that it began with F and ended in K. Nice. When you started using your 11 Labs voice with the people closest to you, your family, your friends, how did those conversations change and what was their reaction to hearing your voice again? Reactions from my friends and family have varied and some laughed with joy and disbelief. But when I played it to my parents, they both cried and maybe it felt like they had their son back. Music has always been a really big part of who you are. Can you tell us the role that music has played in your life? I've been a musician and a composer from roughly the age of 14. Being predominantly self-taught, I learned to play bass guitar, acoustic guitar, electric guitar, piano, melodica, mandolin, and tenner, banjo. My biggest love though was singing, which I did in the genres of Irish folk and heavy metal. I've spent most of my musical life performing live in various bands. Uh sadly, I have lost the ability to sing and play my instruments due to motor neurone disease uh or ALS as it is also called. Despite this, most of my time these days is spent still continuing to compose and produce my music. Doing so feels more important than ever to me now. As your voice began to change due to ALS, you started working with your speech therapist and a fantastic member of our impact team, Richard Cave, on something incredibly personal, your singing 11 Labs voice clone. I'd like you to take us through that journey. What did it feel like to lose your singing voice? And what has it meant to you to find it again in this new way? It was not as easy as creating my speaking voice. I had no highquality recordings of myself singing. We had to use audio from videos on people's phones shot in noisy pubs. And a couple of recordings of me singing in my kitchen, again, recorded on my phone. Losing my ability to sing had a deeply profound and devastating effect on me. So, it's become easy for me to feel a lot of regret uh for not having recorded myself more before it was gone. That being said, the 11 Labs voice that we've created is wonderful. 11 Labs did amazing and it definitely sounds like me. Just kind of feels like a different version of me. Hey, look. It appears that your friends Nick on mandolin and Harry on violin have joined us on stage. Now Patrick's speaking voice clone has given him Yes. Patrick's 11 Labs voice clone has given him the ability to speak in his own voice again. But what you're about to hear has never been done before. This is the world premiere of Patrick's 11 Labs singing voice clone. And this is the first time that an individual with ALS has performed an original song live on stage with a personalized singing voice clone powered by 11 Labs and 11 music. Patrick, before we listen, please introduce your band and tell us a bit about the song. So, the musicians who join me on stage are Nick Cocking and Harry Mah, who are members of the Kaye House band, which is the Irish folk band that I spent 11 years performing with before my early retirement. Nick and Harry have composed their own parts to accompany the song you're about to hear. The lyrics in the song have been taken and repurposed from a song I wrote many years ago called Ghost of a Man I Never Met. Lyrically, it's an introspective song um with a few different deeper meanings within it, but on the surface it's a song dedicated to my great-grandfather who passed away before I was born. I wish I could play that song for you today, but the uh technology currently doesn't allow me to control the voice beyond the words it says. Nevertheless, Richard and I worked hard to create this music in 11 Labs, which is an original piece of work that we hope you will like. I don't believe [singing and music] in God, but I believe in me. I believe in [singing] all the things that I could be. So I drink a few and it's his to you. My heart of much regret. A somber host to the gloomy ghost of a man I never met. I don't believe [music and singing] in God Yeah, I believe [singing and music] in all the things that all of us could be. So I sit and dwell on that tolling bell that calls for you, my friend. All the haunting chime for years that we never got to spend. Cuz I love to see just what you'd make of me and all the things we could and would have been Now through the photographs. Perhaps to join our path. I wish you'd land near because there's more than a few things I'd say to you. If only you could hear. Yeah. Through the boat [singing] and graphs that join our well. I wish that you would step [singing and music] because maybe it's then all the grief again. For a while I could [music] forget. just what you make of me. All the things we could [music] have been. Yeah. I'd love to see And all the [singing] things we never got to be. Harry, [cheering] what does it mean to you to be able to perform with Patrick again? It means everything. Honestly, this silence has been so painful for Patrick and we've missed him so much. And to be able to perform with him and it's like even though his voice has already been prepared, it is just the same as when we were performing with him live on the stage. I feel your presence, Patrick, so strongly. this like your [snorts] passion coming through and your generous heart or everything that you've put to make this music happen. I know it's been a really massive deal and Richard as well has been really there with you. I'm so grateful that we can do this. Grateful to 11 Labs as well. It's massive. It's really massive. Thank you. Uh, for once I'm lost for words, which anyone knows me is very unusual. It's It's just remarkable. Me and Patty were on stage for over 10 years together. And it's been two years since, excuse me, it's been two years since we last played together. And I It's just remarkable. Thank you to Richard. Thank you to 11 Labs. Thank you to everybody and the amazing work. And let's try and get this out there for more people. Yeah. Patrick, [applause] do you have any closing thoughts you'd like to leave the audience with? The technology that you create changes lives. And when implemented with compassion, it can provide hope, support, and meaning to people in ways you can't fully appreciate without having lived it yourself. If I had a wish for 11 Labs, it would be to keep developing the technology so I can have even more control as a singer and composer. This is amazing technology. So, let's keep developing it to be even more incredible. For now, though, I want to say to everyone here and everyone involved in 11 Labs, from the bottom of my heart, thank you. Well, thank you, Patrick, for sharing your voice with us. And thank you