DirebearCoat Posted May 25 Share Posted May 25 I don't know nothing about modding! So, if I sound ignorant about stuff related to modding, that's why. I've got this mod called RDO (Relationship Dialog Overhaul). Where, in some cases, the recorded voice acting was made up of spliced together words from many other lines. In this way, they were able to create new lines of dialog for the followers. It was a time intensive, hair pulling, ordeal for these modders to make it so that the spliced together words flowed out smoothly as naturally spoken sentences. I think they did a great job. What if they just typed the dialog that they wanted, and had AI copy the voice of a specific follower or NPC, and the AI would use the existing voice to say the newly written dialog lines? There's probably more to it then just typing the lines of dialog. Perhaps the modder has to put in ques for the AI to shout the dialog, or to whisper, or to say it while sobbing, while laughing, etc. Now, imagine those modders who make entire DLC's where you have new quests and whatnot. Your player character goes in with Lydia, and she just says the same lines she's been saying since Vanilla Skyrim, or Oldrim as many players call it. Lydia saying the same old lines would kind of be immersion breaking. Using the AI, the modders would be able to create entirely new lines of dialog for Lydia for their mod. On their end, they would record the AI generated dialog, but at the player's end, AI wouldn't be needed. It would just be an audio file that is cued and played at the right time, when Lydia, Jordis, Valdimar, Ra'ya, etc is supposed to say something. All of their other NPC's in their DLC Skyrim mod would also have AI voice their lines. All that would be needed is a sample of voiced lines for the AI to learn to copy. Heck! They could even do a voice for Dragonborn. The player selects the line he want's Dragonborn to say. The AI would voice Dragonborn's line. Then the NPC, quest giver would give their appropriate AI voiced lines. It would be kind of like the original Star Wars: The Old Republic. Where your character had voiced dialog. Did any of that make sense? Is something like that doable? I see them use AI voices in Youtube videos. So, I figured modders could use something similar when creating new lines for followers to say, or when creating new quest lines to add to the world of Skyrim. I hope I made sense. Link to comment Share on other sites More sharing options...
anjenthedog Posted May 25 Share Posted May 25 Somewhere around here (Nexus) there's an AI mod (some sort of chatgpt like thing) that provides AI generated responses from NPCs. As I recall from watching a promo video or two along the way, it applies not only to text but to voiced NPC behavior. Sorry I can't point you directly to it. For whatever reason, I chose not to install, and I lost track. good luck Link to comment Share on other sites More sharing options...
DirebearCoat Posted May 25 Author Share Posted May 25 Yes. I saw a review for that. But it has some requirements that Steam and or Bethseda don't like. So, it's an iffy mod. It works great, but it's in some kind of grey zone. I think what I was talking about is that modders use it to generate the voice acting for their created content, so that they don't have to go through the headaches that the creators of RDO had to go through, when they made their mod. In this case, the gamer would not need to be connected to any AI's when playing the DLC content. The voice acting would be AI generated and would just be the audio file installed as part of the mod. (If that makes sense.) Link to comment Share on other sites More sharing options...
scorrp10 Posted May 27 Share Posted May 27 Yes, I been experimenting with ElevenLabs. I.e. I put together in a single file a whole bunch of phrases from 'FemaleYoungEager' voice type, used it to train the AI voice, and now I can pretty much do whatever dialogue I want using this voice. Now, with all the potential copyright ramifications, I doubt this mod will ever be made public. But is is a fun exersize nonetheless. Link to comment Share on other sites More sharing options...
DirebearCoat Posted May 28 Author Share Posted May 28 22 hours ago, scorrp10 said: Yes, I been experimenting with ElevenLabs. I.e. I put together in a single file a whole bunch of phrases from 'FemaleYoungEager' voice type, used it to train the AI voice, and now I can pretty much do whatever dialogue I want using this voice. Now, with all the potential copyright ramifications, I doubt this mod will ever be made public. But is is a fun exersize nonetheless. Yes! That video clip is a perfect example! The voiced dialog was all AI and all the creator had to do was type the dialog, and do a few other things. But if the modders wrote all of the lines, how would it be a copyright issue? Link to comment Share on other sites More sharing options...
scorrp10 Posted May 29 Share Posted May 29 It uses voice of the actor that produced that voice type Link to comment Share on other sites More sharing options...
DirebearCoat Posted June 1 Author Share Posted June 1 It could still be used for original content with new NPCs when making mods that expand and adds new quests... You'd just have to get new voice samples to train the AI... No? Link to comment Share on other sites More sharing options...
Cheyron Posted June 1 Share Posted June 1 On 5/27/2024 at 3:13 PM, scorrp10 said: Yes, I been experimenting with ElevenLabs. I.e. I put together in a single file a whole bunch of phrases from 'FemaleYoungEager' voice type, used it to train the AI voice, and now I can pretty much do whatever dialogue I want using this voice. Now, with all the potential copyright ramifications, I doubt this mod will ever be made public. But is is a fun exersize nonetheless. You can use AI voice generated content in your mod, you aren't selling it. I do it in my publicly offered mod on Nexus and so do a bunch of other mods. I would lmao if Bethesda sent me a cease and desist for my mod!! I made it to the big time MA! Link to comment Share on other sites More sharing options...
DirebearCoat Posted June 2 Author Share Posted June 2 11 hours ago, Cheyron said: You can use AI voice generated content in your mod, you aren't selling it. I do it in my publicly offered mod on Nexus and so do a bunch of other mods. I would lmao if Bethesda sent me a cease and desist for my mod!! I made it to the big time MA! You use the voices of the in game characters for the new dialogue that you create? Or do you use your own custom voices? Link to comment Share on other sites More sharing options...
Cheyron Posted June 2 Share Posted June 2 4 hours ago, DirebearCoat said: You use the voices of the in game characters for the new dialogue that you create? Or do you use your own custom voices? nice try bethesda lawyer... actually wait, i don't care. Send me my cease and desist!! I use Skyrim character voices. It would be silly if they spoke their vanilla dialogue and then said a line from my mod in a totally different voice lol. Link to comment Share on other sites More sharing options...
Recommended Posts