Latest / And Now For Something Completely Machinima / S6 E241 Machinima News Omnibus (Sept 2026)
Transcript
- Damien Valentine 01:00 Hello, my name is David Valentine, and I'm here with my co-host Tracy Harwood for another episode of Anapurna Compute Machinima. This week we're going to be discussing the news. Ricky and Phil are not joining us this week. I'm kind of suspicious by the timing of their absence and the re-release of Halo as a remake of the first game. So we'll see what happened there, and I'm sure Phil's going to kill me for saying that. Tracy Harwood 01:36 Indeed. Damien Valentine 01:39 Right. Like I said, we're going to be covering the news. So, Tracy, why don't you tell us what you found first? Tracy Harwood 01:46 Sure, I've I've only got a couple of things. I've got I've got something to say about them, of course. I'm not sure you're going to like one of the things I'm going to talk about, but we'll give it a go anyway. In actual fact, though, you might love it. It's drama mansa. The first thing I want to just touch on something called drama mancer. You might love it, or you might kind of think this is further evidence of human civilization reaching its natural conclusion. Damien, you know, you you you you decide. So Drama Mancer it kind of comes from the storytelling lab at Midjourney. It's not a conventional game development platform, but it's kind of described as an AI powered game engine in the style of a visual novel, although I think it's more accurately understood as a kind of experimental, interactive storytelling platform. So it's not quite the same as some of these other sort of generative tools. Really, it's not because the author, either the you know the person that puts their information into the platform itself. It basically they are the ones that establish the narrative framework, and that means the style, the characters, the scenes, and the kind of important events. And then the player, the person that picks up the you know the virtual book if you like or the the digital book can then basically respond in a sort of natural language way rather than kind of selecting from different predetermined dialog options really and what happens is the LLM interprets those actions and generates the next part of the story, whilst basically attempting to remain inside the original author's intended narrative world. And what I find interesting is that Drama Mancer is, you know, it's doing much more than using AI to write a story, it's it's using something called storylets, and these are kind of small narrative units governed by conditions and outcomes. And the AI basically joins those authored elements together in a in a response to what the player does. So there is still an authored dramatic architecture underneath this kind of apparent freedom, but the AI is deciding how those elements should be realized moment to moment. Its researchers kind of explicitly describe the central challenge with it in in its development as one of reconciling authorial intent with player agency, and the obvious attraction is that it kind of might move or remove even one of the great burdens really of branching narrative if. You're a writer. You'll no longer basically have to anticipate and manually author every conceivable route through the through the game. It it kind of gives also players much greater expressive freedom into kind of clicking agree or refuse or attack. You can kind of describe what response you want to want to your character to take, but of course that also raises the question of where authorship now sits. I think the human creates the possibility of space. The player supplies the intention, and this model performs the connective narrative labor between the two, and the question you got to ask then is, who then has actually written the resulting playthrough of this game, this this drama as it kind of unfolds? I don't know, actually. When I think about it, my best guess is you're you've you've basically got something here that's in the end it's it's kind of co-created, co-produced, and co-consumed, co-prosumed. I think you might describe that as is that term. I'm not sure. Now, of course, there's going to be some reservations, which maybe Damian, you're going to elaborate on in a minute. I'll give you my thoughts about what those are. I mean, one of the things clearly is: does natural language freedom actually produce genuinely meaningful agency, or is it merely giving you more elaborate illusions of choice. I don't know. Another thing I thought about is: can the system maintain character, and you know the causality of what you've written, or the tone and the dramatic pacing that you want over a sustained story? Again, I'm not sure. Will every response be accommodating? I mean, good drama often depends upon resistance and frustration and consequences, not simply just sort of letting a player kind of do whatever they like. So I guess that's another kind of interesting point that you might want to explore if you're going to have a go with this. Tracy Harwood 07:27 And then another thing is, if the LLM generates the kind of connective material, will different stories begin to acquire a similar linguistic texture? I guess that's a distinct possibility, and I guess if we're thinking mid journey ish, you know, that's not too far afield from thinking about everything being kind of teal and orange. Maybe I don't know. And then I suppose from our experience, the world of machinima, what happens when a player deliberately pushes against the author's intended boundaries, and I think that, for me, could probably be the most interesting aspect of this as a toolset. Now, the research team actually acknowledges these problems, and of course, it remains a sort of an experimental research system, rather than a kind of finished placement replacement, even for Twine or an RPG maker or any kind of conventional game engine, really. But I will put a link to the paper, and there, there's a link to launch it. And actually, I was going to give it a go myself just to see how this thing worked, but the day I went to do it, which was a few days after this paper hit my feed, unfortunately, it was offline. When I first looked at it, it was fine. There's quite a lot of games on it already. When I went to have a look at it, I was going to have a go at creating something offline, and I don't know whether that's because it's already got a heap of backlash, or it was just overrun with people trying to have a go with it. So you know, maybe demand. I think for machinima creators, I can imagine this becoming interesting when the kind of dynamically produced narrative is kind of connected to animated characters and environments, and at the moment, I think it's primarily just text and kind of selected imagery. But it points, I think, towards a system in which performers could improvise with AI-driven characters inside a kind of an authored Story world producing a different dramatic performance actually on every run through. I think that would make it a bit like directing improvisation or theater in a virtual environment. Whether the AI is an actor or a dramaturg or you know game master or and kind of a. Usually confident auto I don't know auto complete system of I guess that's something we will debate over the the coming months. I don't know if you had a chance to have a look at this, Damian, before we we came to today's session. Did you? Damien Valentine 10:20 No, I didn't. But I can. I'll say that just from listening to you describe it, it's not me at all that I want to use myself. Tracy Harwood 10:28 No, Damien Valentine 10:28 which I'm sure is a huge shock to anyone who's listened to me talk about AI and previous use installments. So as you've been describing it, I've been trying to think about how this would apply to games, and I was thinking about games like Mass Effect, where there's an overall story, but it kind of branches, and there's different ways through. And I was thinking about you know some of the conversations that show up in the game, and sometimes you know they'll give you different options of how to respond to this character you're talking to, or some situation, and sometimes there is no option for what exactly you'd want to do. So this may do that, but I was also starting to think, well, how far will it go? Because you could take the decision using this kind of. If this kind of technology was in a game, you could take it in a direction. So you keep choosing options that aren't necessarily what is going to drive the story forward, and get to a point where it is actually now impossible to continue the story. So, what would happen then? Would the game have to figure out a way to get back on track, or Tracy Harwood 11:46 is Damien Valentine 11:46 it just going to stop? And there's another game. It wasn't really about stories. It was a it's a strategy game where it's a very old strategy game called XCOM Tarot from the Deep, and the idea is you control this organization, and you have to stop an alien invasion. And the way you do that is you send your troops out on missions, and you capture alien technology in the aliens themselves, and you research them, and eventually you figure out where the aliens are coming from, and then you can launch a mission to go and blow it up. But there was a glitch in the game, in this this is the second game in the in the series. There's a glitch in it because they rushed it out and they never fixed it. If you research things in the wrong order, essential things you need to research to complete the game will not show up ever. So you cannot beat it, and the only way to do it is really unless you're very lucky and just happen to research the correct things in the right order, is to find the proper research guide and just follow that because you know people have put that online. Because in the first game, it didn't matter what order you can research things in any order you wanted, and eventually it would lead you to the final clues to go off to defeat the aliens, but for some reason they messed up in the sequel, and it does. It's not even an order that makes sense in context of the game, and you know you could he's doing something like this. I know that that's a very different situation, but unless this was done really well, you could find yourself in a situation where you've taken the story in a way that breaks the game, and you can't finish Tracy Harwood 13:30 it. Very, very likely. I would say that's a distinct outcome of this, and maybe that's the point. Damien Valentine 13:36 Yeah, Tracy Harwood 13:37 I don't know. I've got it. I when I when I do eventually get back into it if indeed it comes back online. I there were so there were quite a few other things on it that I was going to have a look at, and some of them were like manga type stories which looked quite interesting, and some others I would suggest are just people having a little play with it to see what they could kind of produce, but I thought it it looked intriguing enough for me to sort of have a bit more of a play with and see what it actually actually does. So I was I was I was interested in this one. I thought this looked a more novel use of AI than simply generating an image or an animation, or a or a you know a bunch of dialog. This to me is a little bit more intriguing, but we'll see. We'll see. And I, you know, I don't expect you to. Damien Valentine 14:35 I was trying to be objective when I know. It's not for me. It's not. I know. Tracy Harwood 14:39 I fully appreciate it's not for you. I think it's, yeah, yeah. But I'm fascinated by what it what its potential might be, and to me, it makes better sense to use it in this kind of way than it does for some of the other things that we're seeing it used for. In any event, we'll see, no doubt. I'm sure we'll come back to it. So the second one, the second story that I wanted to. Sort of touch on second thing that I wanted to touch on is to do with the pioneers in Second Life and Second Life and cinema, particularly. I'm going to share with you on our show notes a link to a live panel and audience Q and A recorded at Silver City on the 25th of July this year, which featured Second Life pioneers Phalan Fairchild, Chantel Harvey, Toxic Ninges, Pet Love Pet Shop, Safia Widishins, and I think there was others, but you know those are enough for to be kind of going on with. Suffice to say, these are some of the people who have helped establish machinima in Second Life, and they are in this live stream talking recorded live stream. They're talking about how they first became involved and how a machinima culture grew around Second Life, and what comes through it is that these kind of early creators were not really entering a platform designed principally as a kind of filmmaking package? They they recognized that it's kind of avatars, it's user built sets, it's kind of camera controls and performances and social networks and whatnot could be repurposed into a production environment, and machinima therefore emerged through that that kind of act of creative misuse, or perhaps a better term might be creative discovery. I think Phalen is a particularly strong example in the discussion, she joined Second Life at the end of 2002. Initially becoming involved in community events and virtual world design, and she subsequently taught herself editing and visual effects software when she recognized Second Life's storytelling potential. And her work included the kind of virtual sitcom divas and the mixed reality kind of psychological thriller harbinger, and something I find important here is that these pioneers were rarely only filmmakers; they were simultaneously writers, performers, camera operators, set builders, costume designers, event organizers, and and fundamentally, they're also community developers. And the the platform itself did not provide neatly and a kind of a you know a neat pipeline for producing machinima. So in effect, what happened was that it's their practice that kind of became what I would describe as extraordinarily hybrid, and I think it'd be fair to say that it's a community dimension really that comes through. I mean, for example, Machinima Mondays was founded in 2009 by Chantel with Phalen, with Topsic, and others that are that are in this video, and it developed and and is continuing today even as a regular space where creators can kind of you know screen their work, exchange kind of feedback, share sets and props, and kind of help newcomers acquire the the techniques. It's a really vibrant environment that Chantelle's managed to keep going. And it's worth noting, of course, that Second Life machinima really complicates the usual idea that machinima is made by capturing action from a game. I mean, it is a game, but it's not A game with the mechanics that we typically understand understand them to be. Second Life, you know, kind of has no compulsory game or predetermined narrative as such. It's kind of users construct the environments and the identities and the costumes and the performances, and then you know, often the sort of social institutions surrounding the production as well. I mean, it's closer really to a collectively maintained virtual studio system, and because the creators appeared through avatars, their virtual identities could really become the artistic identities they have in their own right. So Phalen, for example, wasn't merely a screen character controlled by an external filmmaker. That avatar became a writer, a director, a performer, and you know a recognized cultural figure within the world, as did all of the others. So it's a really interesting discussion to to listen to, and and it kind of reflects on you know their emergence as creators through the machinimas that they created and through the skills that they developed and shared, and I think. Tracy Harwood 19:59 Fascinates me about placing this story, you know, this sort of this you know live stream video in the context of the other discussion that we've just had about drama Mansa. Is that really interestingly? They kind of describe two very different ways that the barriers to virtual storytelling are being lowered or have been lowered. I mean, Drama Mancer, for example, tries to reduce the technical and authorial burden through automation. The AI generates narrative material between the kind of points established by the author, and Second life's pioneers reduced the barrier socially. I mean, people exchanged knowledge, they shared resources, they built communities, and collectively learned how to bend a virtual world towards filmmaking. I think one of these models asks what the machine can take over, and the other really reminds us what becomes possible when creators teach one another. And I think the the future really of machinima will probably involve both of these types of models. But I wouldn't want to, you know, I wouldn't want the apparent convenience of the first to kind of make us forget that the cultural achievements of the second are actually really pretty significant in the context of what we're talking about. So there you go. There's another thing to have a look at when you get a minute or two for an hour. That's it. That's it. That's my news, David. Damien Valentine 21:41 All right. Well, I'm going to be talking about iClone now with my news. I need to preface this by saying I've been having some PC problems. So the things I'm about to talk about, I have not had a chance to try out myself yet, but I'm really looking forward to once I get my desktop back up and running. So first thing is reallution where SIGGRAPH again to the PC problems. I have not had a chance to catch up on everything they talked about there, and of course SIGGRAPH has actually happened now from the from the time of recording. But two of the things that have come out of it is first the RTX renderer, which is something that I've been really looking forward to ever since they teased it earlier this year. Realiser put out a video saying basically a thing of what's coming to iClone throughout the year, and this is the one that really caught my eye. And I remember Phil talking about it, and he was quite intrigued by this as well. And so the idea is, within iClone, they're going to release a free plugin that, if you have an NVIDIA RTX card, you can then switch to the RTX renderer within iClone that will let you do ray tracing rendering without having to export to NVIDIA Omniverse or some other tool. It's all going to be done within iClive. Now, about a week ago, the open beta was released. You can, as it's an open beta, you can just sign up for it free, and you can download it and give it a try. They've already released one update to it. Again, not tried it, so I can't say too much about it. When you go into the beta, there's the forum, and they talk about some of the features they are not working yet. So, from the way they describe it, it sounds like they are going to be added, but they're just not ready yet. Things like the particle effects system that is built into Icon-that's something I'm quite excited about because since I've been rendering with NVIDIA Omniverse, those particle effects do not transfer over either, so I've allowed to use an omniverse particle effects within my projects, and some of them are really difficult to get set up. Whereas I really miss the iClone ones, which are a lot more straightforward but still look really good. So that was something that they're aware of. Doesn't work yet with the RTX plugin, but I think they're going to add it, which should be really good for me because I I want these easy explosions and not have necessary weapons that gets fired because with Star Wars, you see all the lasers flying around. It's not like a modern day stuff where you don't necessarily have to show the bullets flying because they're moving so fast. It doesn't matter if you can't see them because you wouldn't anyway. But with something like lasers, you need to see them, and the only way to do it is to manually do every single. And the big battles that takes quite some time to do, and you know I'm looking forward to having that back again. Also, the other thing about the the built-in like laser weapon shots, it does the impacts for me as well. So when it hits something, you get a little debris thing. It appears on the object, and the breeze shoots out, and there's a little bullet hole. And I'm again, I miss having that without having to do it myself. So I really hope that Real Vision do add that back in and quickly. There's some other there's a list of other things coming with similar things, but they're aware they're not working yet, but they're working on it. The update adds some makes a few things a little bit more streamlined from the notes, like a read through it, some bug fixing, you know, as you'd expect an update to have. Damien Valentine 25:55 So yeah, I'm really excited to try this one when it's like PC is fixed, and I can download and install it. And it'll be interesting to see what Phil has to say about it when he again is able to try it out and see what he can do with it. So I do remember him saying that was the one thing I think we can put forward throughout most of the seasons that he did. Tracy Harwood 26:19 Brilliant. And do you use AcuFace as well? Damien Valentine 26:22 AcuFace, I use AccuFace One, and so AcuFace Two is the new one. Again, I've not had a chance to try it out or even have a proper read of all the new features yet. It's very useful. AcuFace One being able to do the facial motion capture from video. My understanding is it they change that, so it will. If you're doing full body video motion capture, it will read your face when you're doing that, and so that can be useful or not depending on how close you are to the camera and how good your camera is that picking up your that kind of level of detail, and you're just doing your body. Don't necessarily have to have high quality footage. You have to. It has to be able to see the body lightly. Your legs, arms, and what you're doing has to be visible. So, as anyone's watching this video now of me talking, see my arms moving around in my head. Can't see my legs. That'd be useless. And you know you can't wear a skirt or a dress because again, legs need to be visible. So you have to be wearing trousers or shorts or something like that. As long as it can get an idea of what your your body goes from, it can it can do it. So it's the same with the face. If it can't see your face properly, you're going to get some very interesting results. So what I do is my approach to using Active Face One is to animate the scene and have all the characters animated and moving around, which I've done the full body version capturing just through the video or through the suit I have, and then I will place the camera. You know, just get an idea of where they hold the camera to be and all that. I will then make it full screen, and then I will hold my phone up like this, so it's my face is pretty much like that, Tracy Harwood 28:24 yeah. Damien Valentine 28:25 And then I act out the scene on my face for each character. So you know, looking, you know, characters go something's happening over there. So I'll look over there or do that. You have to be very subtle with it because if you do that, stop visible. Yeah. So just just tiny little movements like this have really dramatic impact on the characters because you feel like we're not doing anything, but it makes the character move a lot more than your thinkers go to move. Tracy Harwood 28:57 Yeah. Yeah. Damien Valentine 28:58 Also, what I like to do is have my headphones on, and I can listen to the dialog and the scene playing out, and then I can either say it myself, trying to match the tone of the recording, or just mime it, which doesn't necessarily work quite as well. Yeah, but then it it will capture your mouth movement and all the facial detail of little ticks and things in a way that when I first started, I was just I wasn't doing the mouth movement because I kind of redoes the lip sync and does that really well. So I was just doing eye movement, eyebrows, stuff like that. But then I realized it wasn't capturing anything down here because I wasn't doing anything down here, and you don't necessarily think about it until you try it and actually think, oh, there's a lot more happening than you realize. So you do need to actually save the lives. Yeah, Tracy Harwood 29:54 all the muscles are connected, and all the Damien Valentine 29:56 yeah. So it's fascinating learning how all of that works. So hopefully, this new AcuPh two is like that, more powerful, because obviously iClone have improved the character meters since AcuCh one. So there's a lot more options for facial animation, and so they need to kind of catch up with the facial motion capture technology to fully take advantage of that as well. Tracy Harwood 30:20 Yeah, it certainly sounds quite sophisticated stuff. Damien Valentine 30:23 Yeah. So again, once I get my PC up and running again, I'll try that out as well because it's a very useful tool. Tracy Harwood 30:31 Brilliant. Damien Valentine 30:32 Yeah. Tracy Harwood 30:34 Well, that's it then for this. Yeah. Damien Valentine 30:36 So only a short news segment, but Tracy Harwood 30:39 well, that's Damien Valentine 30:40 important news. It's important news for the iPhone and AI Tracy Harwood 30:45 followers. Damien Valentine 30:46 Of course, one other thing I will say is this news came out not long after we finished recording our last news segment, and Real Vision seemed to know when we do that and make some other announcements that we didn't weren't able to cover because you didn't know about them till two days later. Tracy Harwood 31:03 Yes, indeed. Damien Valentine 31:04 So again, I wonder what they're going to announce this week coming. Tracy Harwood 31:08 No doubt there'll be stuff. I'm sure. Damien Valentine 31:12 Yeah. Anyway, I think that wraps up the news for this month. So again, from me and Tracy, thank you. Tracy Harwood 31:20 Welcome. Thank you. Damien Valentine 31:21 I hope Ricky and Phil are enjoying the Halo campaign relaunch or whatever they call it. Yep. And we'll be back next month with some more films and maybe some more news. So we'll see how that goes. Tracy Harwood 31:35 Lovely. Great to see you, Damien. Take care. Damien Valentine 31:38 Bye.