Latest / Systems and Power / The Gaming Industry ISN'T READY for What AI Is Doing - Shesh Gupta | Systems and Power Episode #15
Transcript
- Moses Parente: Hello everyone, welcome back to the Systems Empower Podcast. I'm your host, Moses Parente. Today I am joined with data scientist, AI researcher, and author of Generative AI for game development, crafting narrative worlds with machines, Sesh Narayan Gupta. Thank you so much for coming to the podcast. Welcome. Shesh Narayan Gupta: Thanks Moses for having me here and I'm excited to discuss about my work with you. Moses Parente: Of course. One other thing that I also thought was very interesting about was also your background in data science and and also AI research. If you could just tell the the audience a little bit about about yourself and your and your background and what you did. Shesh Narayan Gupta: Okay, so I have been working in data world for almost about 15 years. And I would say when AI was actually AI. So I have been working in that direction for so long. I came here in the United States to do my masters because I had a really... good interest in that area. And once I completed my masters, I started working for a big financial institution here in the United States Moses Parente: Mm. Shesh Narayan Gupta: within the same domain. And one of my professors in Northeastern University kicked that spark in me to like, you know, start looking towards the research area and dig more details about how the things are done, look towards the interesting questions, find something which most of the layman people will not do, I would say in that area. And that's how it started. And I have been associated with him since 2022. And we have done a lot of research related to the data biasing, the fairness, and how it could be applied to different areas, game being one of the applications of those research. Moses Parente: Awesome, awesome. And since you just did write write a book on on AI in game development, what what I guess came to your mind saying that, we actually have t let me go write a whole book on generative AI in game develop in game in game development and how will that affect the future? Like what got you to I guess write write a whole book on that? Shesh Narayan Gupta: Okay, so I think if you read the title like it definitely makes people ask questions how a data scientist is writing a book on the generative AI. not. Okay and what drew me in was the chance to see how AI responds to a person in a way that you can immediately experience, right? So my earlier work, as I mentioned, involved using data, support business decisions, and doing all sort of things which is around that. But the games, it gives an added dimensions. It gives the opportunity to see does it make for the systems or I would say that the system has to make sense in the middle of a conversation like real time conversation, right? So that's what drew me to explore this concept. And again, I can explain you a little bit better way by giving you an example. imagine. you meeting a character in a game who remembers that you helped them earlier, then you can ask the question in your own words and they respond in a way that fits their personality and what has happened in the game. And creating that experience actually brings together the data, the language, the memory, the rules, and those are all kind of questions of applied AI which actually I want to to explore. This led me to write the book Generative AI for Game Development and I'm so happy to see it being used as a reference material in few of the northeastern courses which teachers are teaching is specifically related to game development and use of AI in branding and Interesting fact that my second book is also coming this December, which is an extension of the concept of what I wrote here. So the current book explains about how the AI is essential in storytelling, gaming, and then applying those concepts to other industries. The second book will be more focused upon more towards gaming area and more inclined towards exploring how specifically we can apply those concepts just to the So, yeah. Moses Parente: When you said back when when you're talking to the characters in the game and they re and they can give responses based on how their personality is, based on based on like how their character certain characteristics are. Is it kind of like I guess you know, like those choose your own adventure games like for example, kind of like like God of War or something like that? And you get to kinda and based on what actions you take, like it dictates like the rest of the story of like what's that's supposed to happen. You is that like I guess the types of games that you intended for AI to actually be integrated in? Shesh Narayan Gupta: Okay. So I think that's a very great question and I would say that's the primary objective but it doesn't stop just there right. Think Moses Parente: Mm. Shesh Narayan Gupta: about whatever scenarios where somebody has to respond to you based on the actions which you did previously in the game. The most viable fit for those kind of games are the role playing game which you just mentioned but it couldn't be extended to any other concepts like making an educational game which use the concepts of storytelling and teaches something right Moses Parente: Mm. Shesh Narayan Gupta: that can be extended to those kind of games as well but To answer your point, yes, those are the primary areas where I have explored the application of AI because that gives a larger context of exploring how the models behind the narrative actually works. What are the implications? What happens when we do certain things? And what happens when we let those models go freely and invent what they want to invent? Moses Parente: Hm. I know that guardrails have been a big part of the discussion about AI right now, especially when it comes to like Shesh Narayan Gupta: Mm-hmm. Moses Parente: a government level or even on a personal user level. How would you say that guardrails and ethics would affect AI when it's being put into these games? Shesh Narayan Gupta: Okay, so let me give you an example. think it's more easier to explain you with an example. Moses Parente: Of course. Shesh Narayan Gupta: So, yeah, so let's say we are in a role playing game kind of situation and we both have like same statistics and same in game everything. We have done the similar kind of quests and we are at the same level, right? Now let's say there is a online campaign going on where we both as a player want to go and enjoy that campaign inside the game. Now but it depends on an NPC who's guarding the entry to that campaign and it lets you in based on like your interactions with it. Now assume that we are interacting in similar fashions but it lets me enter the game but it doesn't let you enter the game right Moses Parente: Mm. Shesh Narayan Gupta: and it happens because what What did identify while it was responding or as a matter of fact. the behind the background model, it identifies you as a male and it identifies me as a female and intentionally or non intentionally it lets me in because of the decisioning it's making and it doesn't let you in or it could be the other way around. It could say that you know it's a male and that's why I will let that player go in. It's a female. I won't let that player go in because of those minor differences in the gender right. Does it sounds fair enough? No my my understanding is no and that's where the guardrails come in between. Is the model appropriately responding and how do we put a guardrails in a way that the model which is interacting in a live conversations or communication is responding or behaving as it's supposed to. That's where the guardrail comes and there could be multiple ways which can implement the guardrails but the key idea is the guardrail has to be there otherwise we are letting the model to you know take the decisions which they are not supposed to in they are not supposed to take or maybe it's not counted as a fair decision as a matter of fact. Remuted. Moses Parente: I'm so sorry. I was I didn't realize I was muted for a second. But I I definitely did also wanna ask, what would like I guess your your favorite games that you you would like to play though? 'Cause now now that we're in the topic of gaming. I know we're a little getting a little bit off topic, but out of curiosity I definitely wanted to hear it from you. Like you're Shesh Narayan Gupta: Yeah, yeah. So I think I do like role playing an adventure game. So as you mentioned, God of War. Dead Redemption, those kind of games. I have also tried Diablo where like these kind of interactions or the choices makes a lot of differences. Like The Witcher 3, The Mass Effect where they like the whole game direction could change by you taking a different route or different conversations and whatnot. So yeah, I do like those kind of games. It's not that I'm against of all the other genres, but I think that's where I like I think spending my time the most. Moses Parente: no, no, that's completely fine. I think I mean personally I also love role role playing games. God of War was definitely one of my favorite ones that I've always l that I've always loved, especially the the new ones. I'm very excited for to see the the new ones come out also. And that's why when when you were talking about putting our artificial intelligence and these types of games and then also having I guess also talking about guardrails. I was very I think it's very intriguing to see like where does the future of these of these types of new innovations and artificial intelligence take place at the more games are are coming out. I know that there was a lot like I mean GTA six they just came out with their with their new trailer and unfortunately their pushing it back a l a a little bit. I don't know if you played too much d did you ever like play GTA when you were like growing up or or not not really. Shesh Narayan Gupta: Hi Dave, I enjoyed playing them a lot but back in days I think the resources were not that prominent so I do remember playing a couple of sessions on my local PCs which was not brilliant like nowadays. The infrastructures are getting... like way more accessible and the hardwares are getting more and more powerful but I do recall playing GTA 5, GTA 4, GTA Vice City. So yeah, I would say definitely I'm a fan of GTA for sure. Moses Parente: I I think it's also funny very interesting that you're actually able to date in the game in in GTA 6 and at least that's what like they Shesh Narayan Gupta: What the? Moses Parente: they've been talking about. And that you can actually have like real relationships with these with with with like the characters and whatever decisions that you make will actually affect the relationships that you will have with that said character and in the future of the game. And and that's what it when you were talking about artificial intelligence inside games, you you kinda did remind me a little bit of what was being talked about for that. Shesh Narayan Gupta: Yeah, I do recall that the game company did. claim that they have not used any sort of AI in that particular segment of the game. Like it's completely designed by the gamers and the coders and whatnot. But it brings me to the interesting point. And I do see the future of gaming or as a matter of fact, similar kind of applications going in that directions where like the AI will be implemented heavily and they will be the like I would say engine where all those kind of decisions or narrative will be. will be monitored or driven through. And that's where I think the work which I have done will become more and more prominent and it will make more sense when we go toward that direction. So for example, how does it matter to add additional level of checks or additional level of guardrails when it's a real time communication system, be a game or be any other thing? And does it make sense to add those checks? because it very well may add additional latencies when it's responding or taking the decisions. Moses Parente: Mm-hmm. One thing that I was also interested was that you were talking about, you know, back going back to the earlier conversation when you were saying that the decisions that the character makes will affect the gameplay for like what happens in the future. Do the NPCs in like, let's say, these the games that you're talking about, will they be able to remember the decisions of what your character of like the player's character did for like months at a time, like how how long will they be able to like remember the decisions that ha that the player made in the game and how long will that be of taking effect for the NPCs in the game? Shesh Narayan Gupta: Yeah, that's a very relevant and interesting question I would say. So I think as I already mentioned in our conversation earlier that the hardware are getting more and more accessible. They are getting more and more cheaper and they are getting more and more powerful. Now I would like to make this conversation a little bit comparatively. assume Moses Parente: Of course. Shesh Narayan Gupta: that, yeah, so what I'm going to do is, and as a matter of fact, the comparison is essentially relative. event here because how the NPC is responding is actually. it's not an NPC, it's essentially maybe a large language model or some sort of similar model which is taking the inputs and then providing the like the dialogues or directing the story how it flows, right? And these models are to some extent, right, are limited in the term of how much they can ingest, how much they can spit out, and it's also tied with the costing, right? So to answer your question, how much they can ingest depends on what background model you are using and what's the context window, right? If Moses Parente: wow. Shesh Narayan Gupta: context window is big enough, one million or even more than that, it means that the model can retain or the model can take a long list of actions which you have taken, provided that your gaming is creating a sort of memory or sort of a log, which I think it's not very expensive operations is just Like every time when you interact, it's an input and output operations, it can be 10 in milliseconds. But given that your game is able to record those interactions, your backend model has a bigger context window. It can go up till like 30 days, 60 days, 70 days. And if the developers design it in an efficient way that every certain days, compact whatever interactions you had and create a new log. So let's say 100 lines of interactions which you had until day 10 on 11th day, it becomes like, let's say three lines of interactions, right? So 100 line composed or decomposed into just three lines of interaction summarizing everything. the developer can use like text summarization and whatever features for the AI model. So, which means that it can keep on ingesting and keep on taking the memory for as long as you want and as long as the context Moses Parente: Mm. Shesh Narayan Gupta: window is applying. Does it make sense? Moses Parente: yes, it it it does. I think it's actually really cool that in like instead of like MPCs just being like the standard MPC NPCs that you have in video games and forgive me if I don't know the exact like I guess terminology that they all use in game dev. I'm not a a game a game developer. But I think it's cool that a lot of the NPCs are actually basically in a sense from what I'm understanding, basically miniature learning language models that basically just kind of put in whatever input that you the character are playing in the game and then they kind of regurgitate that kind of like how you will with a regular chat bot. Shesh Narayan Gupta: Exactly, exactly and that's how I think it's the best way to understand it understand those because NPCs are not a real person right they are just a character which is created using some 3D rendering and in behind how they are responding could either be scripted which is the traditional way of how the games are being developed. most likely till now. But as I foresee, more and more large language models would be utilized to actually create games, which deviates from that traditional methodology, which is essentially using a large language model in behind to generate a narrative or a story or a dialogue which is different for different games depending on what the actions they do and how their personality evolves within the game. So the comparison or the statement which you use is like accurate. Moses Parente: It what well assuming that well more like when A AI becomes or games become a lot more AI heavy, what do you think should always remain deterministic in a game, even though games will continue to adopt more and more AI in the future? Shesh Narayan Gupta: Yeah, and I think it's a good decision and I would also like to take an example there, but I would summarize the crux first and then I will explain it. So Moses Parente: Of course. Shesh Narayan Gupta: things which does something important has to be deterministic. Now I'll give you an example. So let's assume in a role playing game or maybe any adventure game as well, there is always an urge or a need to buy something to improve your inventory, to improve your stats, right? say if I talk about Red Dead Redemption oftentimes you will go to a shopkeeper and buy bullets you buy new guns right you go to the blacksmith to improve it. Now assuming that you let the AI to decide freely It's not deterministic. It could create problems. Now, as an example, let's say I went to a shopkeeper and I say that you promised me I visited you next week and you promised me to give a new gun. Right. Now, if it's totally dependent on the AI, the player could like very well persuade them using the chart or use the audio system to give them that gun which is actually be only provided after doing certain missions or after doing after reaching some stats by just persuading the AI and like misleading them and letting them go. Now that's something which shouldn't happen because it's completely breaking the end game and gamers experience because I can very well like you know mislead the AI systems and get what I want earlier in the game which is not supposed to do. That's where I put the checks. That's where I made the thing deterministic. Okay, you are okay to. converse with the NPCs, say whatever they want, receive a different response based on your actions, but you are not supposed to get a gun which is very exclusive or which can only be obtained at certain point. That has to Moses Parente: Mm. Shesh Narayan Gupta: be a deterministic decision. Moses Parente: Okay, and you would also say that the guardrails that are being put in place in a game, like for ethics reasons and for also like user experience reasons, those should also be deterministic as well. Shesh Narayan Gupta: It should be deterministic in a way that it's not creating something which is unfair for a certain specific group. If I look at our previous example, me being female, you being male, you are entered, I'm not being entered just because I'm a female character and that campaigns require some heavy built person. Let's say it's a construction campaign, right? It's not, I would say it's not fair. So. making the guardrail in a way that it leads to a fair decision could be deterministic and it's a good practice to make them deterministic because we know that for a similar situation the age or the gender or some other stereotyping shouldn't work and we can make those as a deterministic rule or maybe put it in as a prompt injection that doesn't matter what happens these kinds of minute differences shouldn't lead to a completely different decision. Moses Parente: Mm. I think that that's a that's a really good way of explaining it. And I especially like the example that you talked about of going back to when you say, like, let's say you are playing a game and you know like when you have to get like currency to like let's say buy an item. Let's say I want to upgrade my tier one sword to a tier two sword. Or Shesh Narayan Gupta: Mm-hmm. Moses Parente: I have to if I want to get like a certain staff that I will need to beat to do to to play the next level, Shesh Narayan Gupta: us. Moses Parente: I need to go do this certain side quest to be able to get that. Like that has to be deterministic because you can't net necessarily like use artificial intelligence to kind of essentially cheat your way through the game. I d I think that's a really good good way of explaining why some things need to be deterministic in a game to make sure that w every user has a fairer chan a fair playing field. Shesh Narayan Gupta: Yeah and one more contrast I would like to make it's not just limited to games we are using game as a lens to explain it it's essentially applicable to other areas as well so for an example the IVR system right now are getting also like better and better the chat bots for different applications are getting better and better now if we do the same thing like mislead the IVR system. to reach to a certain department or the other way around. The IVRS gets something which misleads it to get to a different department which I am not supposed to is also something similar which I would want to put deterministic rules upon. Like let's say if I'm talking about prices or anything else about the project product, I'm sorry, it has to go to the product the not to the operations team or maybe to the pricing team, not to the claims team. That rule also has to be deterministic. We shouldn't let the chatbot or the IVR system, the AI system which is defining where to go based on certain transcriptions or the way a customer is speaking. we cannot let those systems decide on their own. There has to be deterministic rules. Like if the context is coming out to be pricing, then only I'm supposed to route it to pricing. Otherwise, no. Moses Parente: You actually reminded me of of another question that I did wanna bring up because You mentioned back back to NPCs and how they're essentially like w in a world or I mean in a game that's largely AI driven, a lot of the NPCs are essentially operating as miniature chat bots. And I was thinking about like during our conversation, what would h imagine the event of let's say the player he's talking to, he or she is talking to an NPC, and the Shesh Narayan Gupta: Mm-hmm. Moses Parente: NPC, which is a learning language model in this scenario, creates a storyline or an event in the game that it's not necessarily designed to happen. Not necessarily a glitch, but because it's a a chat bot, it creates a storyline that's not necessarily like in the game. And Going back to having deterministic guardrails, what do you say like that's also something that you would want to apply to these NPCs slash chat bots in this a in like future AI driven games? Shesh Narayan Gupta: absolutely. Because when we move towards characters and whatnot, it's very well that it's a chat bot given the freedom. It can create something totally which is irrelevant to the game or the situation. And that's where the deterministic rules comes into the play. So I think in future, more focus. has to be given towards when to use AI versus when to use your deterministic rules. And it could be very well implemented using appropriate prompts. Like for an example, I can use a JSON example, I can use a JSON structure and I can feed it as a prerequisite to my local language model and that JSON structure or as a matter affect whatever. text input I want to give. It can simply say that you are so and so like let's say you are an NPC in a medieval environment and you are only supposed to either give responses which is related to maybe a dark village or a dark forest. So these kind of deterministic rules we can put it in and provide it to the local language model upfront and then we can give an additional context now take an input what a user or a player is giving to you apply those deterministic rules and guardrails on top of that and then create the situations and also we can limit the results also by saying in the prompt itself that the results should only be confined to either a dark forest or maybe a river or something like that. So you see what's happening here. Even though the dialogue is coming from the end user or the player, the deterministic rules or the guardrails are telling the local language model to consider only certain context or certain situations and provide the output which is only confined to those certain limited outcomes. Let's say only to the forest, go to the forest or go to the river, right? No more imagining and generating something on their own. Moses Parente: Hmm. Okay. Because essentially I mean I mean these MPCs slash learning language models in in this case, they're they essentially have unlimited dialogue and they can largely have a lot more options of what they can do than your traditional MPCs which are largely just rather scripted, have a certain set of few rules to like select in depending on which event the the main character or the player takes. What guardrails I I did I mean not necessarily guardrails, but like what preventative measures I guess were you did you want to describe on what you can do to prevent the prayer the players trying to jailbreak these NPCs to whether to hack the game or do sa or do whatever they want. What preventative measures I guess did you what would you w discuss about To make sure that doesn't happen. Shesh Narayan Gupta: Yeah, so I think as I mentioned earlier, what are the acceptable outcomes and in what context they can speak and they're not supposed to deviate from their responses based on certain differences in stereotyping the genders and age and whatnot. These kind of predefined rules. Moses Parente: Mm. Shesh Narayan Gupta: is something which is needed. And I think I have a lot of chapters in my book which talks about it, like how you can make sure the ethical consideration is make sure how Moses Parente: Mm-hmm. Shesh Narayan Gupta: you can make sure that your game is not generating freely out of something which is not even correlated. These are all explained with concrete examples. And the way to put it, make sure that all those design principles rules are already in place and those are pre-fed or they are fed when we are asking a local language model. So it goes as a part of a context. So those predefined rules are going as a part of a context so that when the response is coming out of it, it may be a different variation but it is very much confined within the boundaries which the game is relying on. Moses Parente: Okay. Okay. Okay. I I I really like the way how you broke down how NPCs operate in an AI driven game, but also there's a lot there's a a lot more to just NPCs than just sl I mean, there's a lot more to a whole game than just NPCs from what I see. There's a lot of story story driven like story driven branches and then a lot of world building as well. How does AI, in your opinion, affect the story? the storytelling and the story building part of these games. Shesh Narayan Gupta: I think it's the same concept, right? So because these language models can create numerous amount of story out of one single sentence or a given context, it makes sense to limit the way it progresses. Now as an example, if I leave the NPC dialogue and the conversation behind, let's say I take an example of how do I procedurally create environments using the generative AI. So I can very well use a diffusion model to create images. I can use combination of the models and their MPC servers with different rendering, rendering softwares like Blender and whatnot to create the assets. But when to present those assets at what moment of time would again be like for an example, I can create different variations of like broken house or a building or a landmark, but when to make the bandit camp appear, when to make church appear, when to make a wagon appear, depends on what deterministic rules are telling me and whether those guardrails or the rules are placed there or not. So for example, I as a player say something about bandit or Moses Parente: Yeah. Shesh Narayan Gupta: if in my previous conversation there is a discussion about bandit, the rules might. trigger the creation of bandit camp in the environment immediately after those conversations and can generate a quest which can say that you know destroy the bandit camp because that's what my conversation was all about. So what I'm trying to say here is we can still use the generative models to create the assets to create this storyline But those deterministic rules will guide when to present what to the users. Moses Parente: Mm. Now I like how you you explained that, especially when your let's say your graph You're crafting an AI generated game that's largely, let's say, in a medieval dark fantasy world. And of course, you have, let's say, you want your story to largely be centered around, hey, the main character goes on the hero's journey, has to, let's say, rescue so and so, has to collect XYZ trinket, but also making sure that the guardrails, while they're And deterministic guardrails are being put in there to make sure that the the world and the story that's being built is largely centered around that theme of like the dark medieval Shesh Narayan Gupta: Yep. Moses Parente: world. Because the last thing we need to see is like let's say you're making a world and then you're in a forest, but then you see like a Star Destroyer or a Death Star or like or s or some crazy sci-fi generated thing that was not supposed to be intended out there, but those guardrails would keep it in that theme essentially, and and to make sure that it stays consistent in the world building that's being done. Shesh Narayan Gupta: Yeah. And that's the purpose of the deterministic rule or the guardrail or the safety check or whatever you want to call. One thing though I do want to make sure that the audience are understanding here is implementing the deterministic rule or the additional guardrail and checks serves the purpose as long as it's not, you know, it's not creating frictions how the end user experience is coming out to be. For example, I can put an additional checker or an additional model to check whether the responses which my NPC is giving to a person is following the defined rule. But would it mean that the additional checker or additional step which I am checking or additional model which I am putting in behind. bringing or introducing a noticeable lag or noticeable latency, right? So that completely breaks the concept of gaming experience or as a matter of fact, any other real time conversation system, let's say the IVR system. So I'm adding an additional check on an IVR system, but that IVR system has now started responding 10 second leads. I would not like it as a customer. I would say that I have to keep waiting for the system to respond to me or to give something which is meaningful to me. So that's one important distinction which I want to bring it here. Adding the guardrails, adding the determinist rule is good as long as it's not creating any other fiction. And I think we did a study related to fairness and latency trade-off which talks about it. But that's an important point which I want to bring in our conversation here. Yes, need to add guardrails. Yes, we need to add deterministic rules. But we have to make sure at the same time it's not impacting something which is also as important as the way it responds, which is latency in our scenario. Moses Parente: yeah, of course, 'cause at the end of the day we all want the the gamers to have the best experience as much as possible. And we want to make sure that it's steering but not necessarily limiting the the experiences of the users. Shesh Narayan Gupta: Yes, yes. So if an NPC is taking like 15 seconds to just to respond to you, just because there are two models checking whether it is supposed to respond, what is supposed to respond or do what is supposed to do. Me as a gamer, it doesn't make sense to me. I would rather not interact with NPC and do something else in the game than wait for the response to come back and say that, yeah, it's responding the way it should respond, right? That completely breaking the game experience. Moses Parente: yeah, 'cause like they'll definitely be like, I'd rather fight the bandits or like the bad guys or like the skeletons or or w whatever bat villain minion archetype that the game has played then rather than just talk to the the MPC, like let's say it's a villager or a or a wandering traveler and they're stay they're just taking like like you just see it see it loading and you're like, come on, hurry up, let l let me go play the game Shesh Narayan Gupta: Yeah, yeah, yeah, how to defeat the boss. no, you know what? Don't don't don't tell me anything. I'm going to go Moses Parente: Ha ha ha Shesh Narayan Gupta: and swing my sword anyways. Yeah, exactly. Right. So deterministic Moses Parente: Yeah. Shesh Narayan Gupta: rule is needed. Gardner is needed to the point where it's not creating any fictions. Moses Parente: Do you think that that also applies in the I guess the building the characteristics of the main avatars that the people are also playing as. Like let's say the like j just to I guess describe the the point that I'm making. Like let's say your character he has like the archetype of like let's say he's like either a hothead or he's stoic or he's a leader, he likes so Shesh Narayan Gupta: Mm-hmm. Moses Parente: and so, or she likes so and so, the the character doesn't like XYZ, things like that. Do you think there's also guardrails that you would want to put on the that determine the characteristics of the player as well to make sure that the the character remains consistent to the story. Shesh Narayan Gupta: Absolutely. because it doesn't make any sense to, you know, start interacting for like, you know, a serious person in a comic way, right? So let's say I'm a warrior and when I'm talking to you as an NPC or maybe I'm talking to a NPC who's a warrior, I would not expect a kind of a poem in return, right? I would not want that person to reply as a poet, right? that completely breaks the archetype and whatnot. So yes, that kind of thing is also needed. And again, the principle is always the same. You have to guide the AI, you have to put guardrails and rules into the AI so that it follows what it's supposed to follow and just do not create something which is completely opposite. And that's one thing which is very transferable. to non-gaming applications as well. You want your AI systems, which is working in behind, to follow what you want to follow rather than inventing something which is not completely correlated. Moses Parente: Mm. One thing I also was curious about was your thoughts on like I guess this is largely a lot for fighting or at least video games that have fight scenes in it. I per I personally love those ones as as well as many others. But how does AI and artif AI affect the fighting portions of a vil of a of a video game, especially like when there's like combat involved, how is the the character that you're fighting, how does that p take into play? And especially for the the you the the player, how does that also affect it as well? Shesh Narayan Gupta: Okay, so I think it could affect in different ways, but whatever we are talking, if we try to connect the dots from behind, let's say you get an in-game weapon, which is supposed to be received after certain stats earlier in the game, because there is no guardrail. It's definitely is gonna benefit you to defeat the boss earlier in the game, right? Or maybe, you try to deceive an NPC which is a very core character to give you the secret to defeat the boss earlier in the game just by talking to it or conversing in a persuading or a misleading way that's also something which can, you know, rig your fight, I would say. So it's more of a like getting your character in a position to defeat the enemy earlier in the game as compared to what happens in the real time. Because when it happens in the real time, it's very hard to control the behavior. The AI would not be able to control the behavior. like now the boss is supposed to hit you and you're supposed to die with a certain moves but it can very well control what's the stat of your weapon do you Moses Parente: Mm. Shesh Narayan Gupta: know the weak point do you know the secret and whether you can utilize to you know rig the fighting in your direction i would say Moses Parente: Of course. I I mean okay, thank you. I really do appreciate that. I think 'cause that was always always one thing that I was I was curious about is that how does AI affect combat scenes and combat combat gameplays like when the main character is supposed to be fighting let's say like your regular NPC minions that don't really that are largely supposed to be defeated fairly easily as compared to like a a boss fight. Like does the the boss also like learn your moves as the more you as the more you play? Are there supposed to be like certain weak points that can you take advantage of XYZ? How does the weapons that you're you're you you're playing with how the how do those stats correlate? Into what you're trying to fight the boss with. So I thought that was a really cool explanation of like how all that affec affects it. Shesh Narayan Gupta: Yeah, and there could be other aspect to it. It could be very well that the AI system could be used to enhance the enemy's understanding of what you are trying to do, right? And it's not a new concept. I think there are games which use AI engine in behind to... make your enemy encounter even more frequent or less frequent as you progress or as you take decisions. So let's say for an example I know there are games like alien games so what they do is if you are if you have an intention to go ahead and fight the boss like head to head they will make your boss to be like secretive and do silent attacks as compared to if you do silent attack, stealth attack, they will make your boss to understand those kind of thing and you know use their minion to come and attack. There are games like that and I am foreseeing these kind of things are going to happen more and more and like more engines or more decisioning systems around that are going to be built which will be complementing the decisioning or the last language system where on the one end those components the large language component or the chatbot component would enhance the storytelling enhance the way you interact with NPC on the other hand these you know learning systems the combat system will enhance your enemy to you know learn how you interact and how to tackle you so it's both Moses Parente: I think this is cool, especially as as this can I guess the way how you explained it, it it can be applied both in like your regular storytelling games but also in like your massive on online games that you play with hundreds and thousands of other people as well. All all at the same time. So I think that's really cool. Shesh Narayan Gupta: Yeah. Moses Parente: and yeah, also I don't I don't know if you're you're gonna watch the new Street Fighter movie that's gonna come out. I don't know if you Shesh Narayan Gupta: absolutely. Unfortunately, I'm not getting the appropriate time here, but I have watched like the previous versions of Street Fighter, Street Fighter 2, the movie. So I'm into it and I love playing the game as well. So it's like for sure. when it's a question. Moses Parente: Okay. no. I mean I I've always loved Ryu, but Zayn Geef was always probably like one of my favorite characters in Street Fighter 2. Shesh Narayan Gupta: Yeah, because it's a combination of, I would Moses Parente: Ha ha ha. Shesh Narayan Gupta: say, brawn with some comic sense, I would say. So it's always good to see how he reacts to certain situations. Moses Parente: Yeah. Shesh Narayan Gupta: I'm excited to see how he is being represented in this movie. Moses Parente: yeah, especially I I've always been a fan of c like combat games like In Injustice too. I mean Injustice Gods Among Us was one of my favorites when I when I when I would when I was growing up. And Shesh Narayan Gupta: Mm-hmm. Moses Parente: Mortal Kombat actually I played it a little bit. I thought that was actually really, really cool as well. And but o overall I think the whole aspects of like comp like combat and in video games and how AI will be applied to that in the future will be like in the future. So I was really I thought it was really interesting to see your perspective from all of that. Shesh Narayan Gupta: Yeah, and as I mentioned, the game is just a lens. It's applied AI, which could be applied to all kinds of terms, Moses Parente: Mm many other fields. Shesh Narayan Gupta: all kind of real-time communication. Games gives us the ability to You know, create the situations quickly and validate the things which we want to validate. Validate like the IVR system might be little difficult to replicate, but the games creating the situations, defining the rules, defining the situations, whether adding an additional layer of checkers, additional layer of guardrails are behaving the way it is. It's easier with the games and also one good thing about games. games are, it helps to explain the concepts to persons who are not very much into an AI. I can take an example of game and talk to my six-year-old, and he would be able to understand as compared to if I start explaining him what is a large language model, what is a deterministic rule, what is probabilistic, right? If I start talking in that language, my six-year-old will not be able to understand. But if he plays the game and if I give him the example, you you spoken to this NPC or the character like this, and that's why he's responding because he knows what you spoke. It's easier for him to understand. Moses Parente: I really I really like that, especially because obviously like mo the average person, they're not going to be able to understand all the low level details of like what agentic AI is, what a learning language model is, and everything like that. And even me still, I'm I'm learning a lot as I as I continue on. But I think the your ability to explain everything in basically a in the presence of games in the lens of gaming makes it a lot more easier for people to understand and to even be able to apply it into other fields that are not necessarily gaming and or even just overall general knowledge. I think the more people just learn about this and are aware of the technological advances of the world that's happening around them, it's better for everyone as a societ as a society. Shesh Narayan Gupta: Yeah, and I think that's why I'm glad that the concepts of my book are being taught in classes. As I mentioned, it's being utilized in two of the Northeastern courses. I also use the same books concept with a nonprofit educational organizations called Humanitarians.ai to create four prototype games. which is intended to teach people about loons, right? So the project is in progress. the nonprofit organization is in connect with the appropriate institution. And they are exploring the possibility that that educational game, which I created based on my book concept, could be used in their kiosk where the people who are coming to that museum or a facility can learn about the loons with the meaning or with playing the games. And I'm really happy to see those kind of things are being leveraged using the concept. And I'm seeing that the thing which I want to explain to people via my book, or as you mentioned, helping the society to adopt and get something out of it, it's happening. It's in progress, but it's happening. Moses Parente: Awesome. Well thank you very much. And as we right right before we conclude this this episode, is there any way for where can people find you and where can they find your work? Shesh Narayan Gupta: so far, that's a great question. I think I'm on LinkedIn. You can find my name. The book is available in Springer Nature website itself. If if if the audience if in the audience there are any students I think it's available free to them they can use their institution login and and it's based on my knowledge it's available for institution for free of use I have seen like around 6400 accesses of my book already and it's haven't been even six months to be honest so Moses Parente: Nice. Shesh Narayan Gupta: I have seen like people using the book it's available for students to grab it. And yeah, I'm available anyway. So there are many ways to reach out to me. yeah, LinkedIn is the most prominent way to reach out to me, but there are other ways as well, like to reach out to me as well. Moses Parente: And you are actually coming out with your second book later this year, correct? Shesh Narayan Gupta: Yes, it's coming around mid of December. And again, the same concept, it's like with the Springer Nature, I think the book is already up, but it's not published yet. And it's the next step of this book writing series. So it's more towards more towards gaming and more towards more technical concepts. How do I implement those deterministic rules? encoding and how do I code those as compared to the current book which is more towards like the concepts how it can be transferred to another areas not just gaming's and and yeah so I'm pretty much excited and I wanted to see like what what the second book could do on top of the first book and how it can help people who enjoyed or who learned the concept to actually now implement it using the second books examples. Moses Parente: Mm. And remind me of the title of the incoming book again real quick. Shesh Narayan Gupta: Okay, so the second book is called Leveraging Generative AI in Unity Game Development. So it's targeting specifically Unity because that tool is being used heavily and the recent introduction of their MCP capability makes it a right time to explore those kind of scenarios and those kind of discussions and using the concepts to actual implementations. Moses Parente: Awesome, awesome. Well, thank you so much for coming onto the podcast. We really appreciate it. Be sure to check out his book, Generative AI for game development, crafting narrative worlds with machines. So thank you again for coming and hope you have a great day. Shesh Narayan Gupta: Well, thank you so much for calling me and letting me Moses Parente: Yeah. Shesh Narayan Gupta: explain to your audience what a simple concept of language model could do to a game or, as a matter of fact, to other applications. And I really appreciate talking to you, especially related to the games. Moses Parente: Awesome. Of course. Thank you again for coming.