Latest / Neon Protocol / Signal vs. Noise: XR and AI
Transcript
- Gene Feldman: So on tonight's episode, we have Mr. Bob Stone. He's gonna be our guest speaker. He ⁓ is a university professor an XR expert. I'm gonna actually let him introduce himself, ⁓ but I'm so proud he is going to be joining our panel today as our guest, because he's actually just ⁓ told me recently that he's going to be receiving a lifetime achievement award, which is. Adita Manny. Adita explores spatial computing, immersive platforms, and the future of presence. His perspective bridges XR, storytelling, and human experience, asking how emerging interfaces change not just what we see, but how we collaborate and remember. Welcome to The Neon Protocol, the show where we go inside the system shaping what comes next. If you're new here, The Neon Protocol is a conversation with operators, investors, builders, and strategists working at the edges of technology, culture, and business. Every episode brings a different perspective, but the mission stays the same. Decode how emerging technologies move from theory to real world impact. Each episode brings together members of The Neon Protocol team and a guest. fantastic because it gives us that are still that are following in his footsteps a chance to really understand that there can be success at the end of this. So, Bob, welcome to the show. We would love to have you introduce yourself. I think we all do best when we introduce ourselves. So please feel free. Bob Stone: Great pleasure to be here Gene, thanks for inviting me. ⁓ So Professor Bob Stone, I'm an emeritus professor which kind of means you do exactly the same as a normal chair professor does but you don't get paid for it. ⁓ Being in virtual reality has been the story of my life, the amount of stuff that we've done, that we've done for free, some of which is paid off, a lot of which, excuse me, has not. Gene Feldman: such as a founder, researcher, policymaker, engineer, or another leader who's actually built, researched, or shaped this work in the real world. And together we talk through what's working, what's breaking, and what's coming next. No hype cycles, no demo theater. Just people who build, scale, fund, and navigate complex systems, talking candidly about the future they're actually shaping. And if you're enjoying the show, please subscribe on Spotify, Apple Music, or YouTube. Damon Shackelford: Thank Bob Stone: But yeah, my background's in ⁓ human factors and ergonomics and the award that you alluded to, the end of life award, is from the Chartered Institute of Ergonomics and Human Factors. So they're recognising a lifetime of ⁓ craziness, know, from ⁓ working in healthcare to ⁓ spending three days in the morgue in Johannesburg, which that's another story. Gene Feldman: Every follow or share helps us grow. And tonight's NEON Protocol members that are going to help highlight what's working, what's changing, and what's about to break open are. you Damon Shackelford: You Bob Stone: to flying in helicopters on the coast of the UK and doing all kinds of crazy stuff, all of which kind of sums up my background, which is working with the real people in the real world doing real tasks and getting close to what they do and going out there and getting your hands dirty and actually doing it before you recommend the tech. And that's, as you know, being the grumpy granddad on LinkedIn, a lot of my criticisms tend to be Gene Feldman: Damon Sheckleford. Damon brings the growth stage operator view, how emerging tech becomes real revenue, real teams, and real companies. His focus sits squarely on go-to-market clarity, B2B scale, and the messy middle between vision and performance. Bob Stone: tech focus because people have blinkered. They think that's the be all and end all of getting XR right and it is not. So yes, go on, yeah, sorry. Gene Feldman: No, and I... Yeah, no, I was going to say, completely agree because I come at from the same standpoint of I came from an educational background as well. So I come at it from the human interaction. How does the, how do we accept the technology and how do we work with it? And I think one of the things you allude to is that it's got to get out of lab. It's got to get into real users because a lot of times you get these companies that have these special XR labs or everything. but they're in this lab for 10 years and nothing ever comes out of it. And then when it does, it's not great for the end user. Sorry, I get into this. ⁓ There's a new game called Crimson Desert. It's one of these new multi-massive player games, but it's getting great reviews, not for anything other than customer services listening to the end user and making the patches as necessary. Mark Grope, from one of the world's most complex logistic networks, Mark explores enterprise innovations for physical infrastructure, data, and operational scale intersect. He deploys tech into real world constraints, supply chains, reliability, and execution at global scale. Bob Stone: Absolutely right, absolutely right. Yeah, it dies. Gene Feldman: And I'm Gene Feldman. focus on the evolution of extended reality and AI as a usable, durable medium, bringing historical context and practical insight to understanding adoption patterns and the integrations needed to make them work at scale. All right, let's get into the conversation. Sorry, didn't mean to cut you off, Bob. So sorry. Bob Stone: Good. No, no, no, that's right. I mean, if they got that attitude, that's a long time in the coming because you're quite right. I mean, the number of things we see on LinkedIn which come out of I mean, I've always been against academic centers. I class myself as a reluctant academic because prior to joining university in 2003, I was actually the virtual reality company director. So I've been half my career in industry, sort of industry and half in half in academia. But The amount of money we've seen wasted over the years in academic centers of excellence where they sit in the lab, they buy all this, I've got more than you mentality equipment, and they expect people to come to labs. They expect industries to sign up to incubation units and it doesn't work. Unless you can take your magic in VR and human factors out to the people who need to see it. Gene Feldman: Mike Van. Mike operates for creativity meets system design. He deploys gamification, simulation, and experiential engagement as serious tools for learning, behavior change, and business growth, bridging XR, AI, and next-gen interaction models. Bob Stone: company directors who want to click bait on LinkedIn, we're talking to real people, forget it. And I think that's one of the things we're seeing now in XR in terms of companies that seem to come, they seem to be one shot horses. They come onto LinkedIn, said, look, I've got this fantastic training system to teach you how to spray paint or teach you how to put a fire out. ⁓ It actually uses a real fire extinguisher. Yep. And then you never hear from them again. You don't hear from them again at all. So I think we're at a little bit of tectonic plate type shift time in XR, which we really need to start putting out messages there about lessons learned and people need to take them seriously. Gene Feldman: you completely agree. Like a couple of weeks ago, we actually had any Eden on. He wrote a book called the XR. I just come. The XR, the extended reality blueprint. Sorry, Annie, if I mispronounced the book. But ⁓ it what she really did is capture a lot of the lessons that we've learned from Europe, from what you've done. ⁓ And really put this really great. visualization together, kind of helping people. Because one of my biggest fears with this, I kind of look at with you, but I look at it as an ebb and flow, is that what's going to happen as we're pulling back on XR right now, we're racing AR and AI, that once XR kind of comes back up, we're going to be back right back at the starting point again, because we've, we've kind of isolated, we started doing it with NFTs, and then AI, AR and It's realizing that it doesn't have to be a one or the other. XR has great potential when it comes to training, learning and development. And factories have been seeing out just great results from it lately. Bob Stone: Mmm. right. ⁓ the other thing that, and certainly when you mentioned training, which is one of the areas I've ⁓ ⁓ spent a lot of my time in, it's, ⁓ seen and I've been involved in projects ⁓ are incredible when it comes to ⁓ graphics that we achieve, the interactivity that we achieve, ⁓ mixed reality to blending the real with the virtual. And still at the end of it, it doesn't get uptaken. doesn't get taken up with probably the better phrase simply because the when we are approached to do by a sponsor to do the work in the first place trying to get these guys to tell us what is it you need to adopt this tech? Where is it going to actually feature in your training regime? That is always, always a killer. Do you have to add days or hours to your current training program to take it in? If you do. they shut the door in your face. And how much is it going to cost? much do I need to train the trainer? What's the return on investment? Do I need to buy spare headsets or the kind of almost non-tangible things that you need to take into consideration as well as selling them some glitzy tech with some nice graphics. And I think what you say is right. Gene Feldman: ⁓ I know I completely agree. It reminds me of the times when people will just, well, like AI, we can talk about this for a second. I've never seen software integrated as fast as I've seen AI integrate. There was very little pushback. Once people realized it's here, it was just accepted. And then people realized it can be checked as their digital transformation. Bob Stone: Mmm. Gene Feldman: and realizing that, okay, they just knocked out two birds with one stone. But really, at what point is enough enough? I think sometimes we start throwing this out and we get the Jurassic Park question of, just because we can, should we? Do we need everything in the kitchen sink? Why don't we just have one solid solution first? Let it do one solid thing, and then let's build it from there. Mike Vann: Yeah, that's not how it works, Gene. You know that everyone runs fast and then ⁓ they look at the carnage and decide where are we and should this live? And I think I mean we're seeing it. We do a lot of work for large enterprise on the development side and they're all demanding you know AI in every part of the workflow. But because we came from XR, what we're showing them is well. look at this immersive training experience with AI powered NPCs inside of these environments. It takes it to this completely different level that, you know, as Bob said, right, these business leaders, they don't even realize it's possible and they have a hard time putting real like business KPIs and metrics around that to determine value. And that's right. We've always struggled against this, but by combining the two things, and I'd love to hear Bob's thoughts on some of this. We can do amazing amazing things and I think the question is what can like young people who are looking at these industries and saying how do I use my game development skills or my I'm in XR but I'm not sure if I should stay here, know, how should they be leveraging and looking at AI and and building great solutions to kind of keep this industry moving forward because because we all know that it's possible Bob Stone: Yeah, it's interesting questions there. mean, I've not been as close to AI as I might have been how I stayed in academia and pushed the XR side of what we're doing forward. even now, with some of the smaller projects, the unfunded projects I'm doing, some in fact, with my youngest son, AI is really changing the game when it comes to things like content design. The fact now that you can actually go to an AI package, and there are three or four of them, and you can input your text and you can get out a model. We were talking earlier, just before we came online, we were talking earlier about Loch Ness, Loch Ness Monster. With the AI tools that I use, there's no reason why you couldn't get a fully rigged, fully animated Loch Ness Monster and get it to appear in something that looks like Loch Ness and away you go. To do that before, know, turn the clock back 10 years to do that would cost an absolute arm and a leg because people spend all their time building the building the 3D models and forgetting about the narrative. And this is what I keep on telling my students. You will not get a degree if all you're doing is building a three dimensional model of a tree. A, when you can buy that from places like CG Trader, TurboSquid, wherever. Or B, you can get onto GROK or ChapGPT and you can have one within literally five minutes in incredible detail. with animation. So for me, I mean, there are other areas where I believe AI will help the XR industry. But just on the start, and certainly to motivate kids who want to get involved, who don't want to be auto desk or 3D studio modelers, they don't need to be, the tools are there. Gene Feldman: Yeah, but we have But I think we also run a risk. I don't know if you've heard the Disney announcement over the past couple of days. Disney's firing or letting go, sorry, not firing. They are reducing their workforce. Sorry, I've been recently a part of a workforce reduction. ⁓ But they're reducing their workforce by a thousand artists. Damon Shackelford: You Bob Stone: Mm-hmm. Gene Feldman: Because what they're going to have do now is one person working AI building all future models off of all the art they've already created. Bob Stone: Yeah. Yeah. Mike Vann: Is creativity at risk here because everyone believes that AI can just replace 80 % of it? I think so, and I think we need to be careful. Humans bring creativity. Can AI do that job? Not yet. Damon Shackelford: and Gene Feldman: Well, you bring up a great point. One of my favorite quotes that I've ever heard, and I may misquote it a little bit, but Joe Walsh from the Eagles, to me, one of the most outstanding guitar players in the world. And they asked him in an interview a couple of years ago and they said, do you think AI could write a song? And his response was something like, can AI destroy a hotel room in a drunken rage? Can AI do this? Then AI can't write a rock song. And I'm like, Bob Stone: Hehehehehe ⁓ Damon Shackelford: Much. Gene Feldman: you know, it brings up a good point. And I like this conversation because it's kind of alluding to kind of where I kind of wanted to drive it to because ⁓ I think we all as change agents, we all look for our inspiration and we all look for our solutions. What can be, and we tend to, you know, either look for movies, you know, or TV shows, or for me, you know, even going back to Jules Verne. ⁓ And there's been a recent movie lately that I'm surprised a lot of people in AI and AR haven't been talking about. It was recently called Atlas. It was a Netflix movie, which for Lopez talking about it's basically AI integration with AR about being able to narrow link with AI. And instead of wearing an AR device, it basically controls your synapses and is able to render images through through the brainwaves. And so, but yeah, but it's an interesting concept because what it shows is the, to me, what I like about it is not that Jennifer Lopez or the story or this, but when you look at the tech in it, shows how we can work with it rather than us being a slave to AI or being against it. Damon Shackelford: Yeah, control hallucination. Gene Feldman: but also how AI, I know we're talking a lot about AI, but I want to get back to XR is how AI can work in conjunction with XR to further the XR. Because like I said, I don't think it's one or the other. They're the same coin, just different sides. And so, yeah. Bob Stone: Mm. Mike Vann: I mean, listen, just on that point, Gene, and I know Damon has experience in this as well, ⁓ Bob's right. Like the first step is we can accelerate every XR project because the tools are giving us the ability to be more efficient. That should mean we can do a lot more XR, whether it's military or government or enterprise or down to ⁓ kids doing school projects. They can go out and do Gaussian splatting and scanning and creating assets now. Now they're not as good as what we would build in Unity or Unreal at those levels, but they are getting there quickly. And so the ability to just generate environments and objects should allow us to do more and hopefully more results in good work that can be funded and pushed forward. I'm just an optimist, so I know a lot of people, like you have to be to keep doing this, but right. Gene Feldman: Bye! Bob Stone: ⁓ yeah. Yeah. Mike Vann: just think that's a good first step. Now, beyond that, there's many, many things that we can do inside of XR to take full advantage of everything that AI can do in terms of ⁓ experiences and really deep things that ⁓ couldn't do before. So I think we should be excited about it. And I think that people are. think people in the XR industry are fully embracing it. Bob Stone: Yeah, I would agree with that. As well as the supporting people to be creative, which I think is absolutely vital, because there's nothing more soul destroying than trying to knit polygons together and then suddenly finding if you put it into Unity and then you have to transfer it into the latest version of Unity, the animation doesn't work anymore. I think the thing with AI and some of the tools that you could put it back into the AI and say, look, it doesn't work. do some remedial work on this and give me something new. That's going to as a toolkit for the XR developer, absolutely fantastic. I believe it's already making an impact in believable, you said MPCs, believable virtual humans, ⁓ virtual humans that can show empathy and particularly for example in psychiatry and psychology applications with one-to-one interaction. The other area that I think from a defence perspective, I'm surprised that very, from what I've seen, very few people have actually grasped on this yet, but using AI to actually give the guy who is watching what the trainee is doing an objective assessment of that trainee's performance by integrating physiological variables, eye tracking, GSR, ⁓ EEG, ⁓ free levels of cortisol in the blood, blah, blah, all these complex things that are happening. At the time the guy is doing the training, why are you being distracted by that? Why you should be focusing on that? I believe AI is going to be an absolutely indispensable tool for analyzing training or human performance in real time. Absolutely essential. And the list goes on. Damon Shackelford: to the performance factors. Mike Vann: Good point. Gene Feldman: No, I agree. mean, like we've talked like within the Neon Protocol, we've actually been talking about a company that's been growing out of Germany called Rambler. And what Rambler does is they use any camera to record somebody's physical actions. The camera will then send the video through the AI analytic AI engine. All the engine does is put the steps. in a process creates a standard operating procedure and then can take the video and add AR elements on top of it to add highlighting or to do this. So we actually, I actually watched them do a demo for an espresso machine. I mean, mean, it literally walks you right through it. You can wear either a mixed reality headset or a camera, but it was a really fantastic because it didn't create ⁓ an onus of development. And what I mean by that is a lot of times when we look at these things, people say, I want this, I want it tomorrow. Well, it's going to take probably six months to at least Idle or I ideated. Then you got to build it. Then you have to review it. Then you have, mean, we're looking at maybe a year to two years for really something. So I know it can be done much sooner now, but I'm just ballparking. But, But now we're getting to where we can do it a little bit faster. But I don't think people understand that it does take that time to circle it around. And now that we're getting better tools such as GUI interfaces, we're getting people that typically aren't as deep giving the freedom to actually create this. Damon Shackelford: so so Bob Damon Shackleford ⁓ Yes, your daily friend from LinkedIn Daleks first I ever responded to your post on the ⁓ ⁓ Daleks ⁓ version, sorry ⁓ Bob Stone: Damon, yeah, pleased to meet you sir. Oh right, the Daleks. Yeah, Daleks, yeah. Mike Vann: Thank Damon Shackelford: Oh, and I came from the engineering direct application side of XR, making everything works and you know, the pop-up company would do something and they would sell it to a big enterprise company and then the enterprise company has to actually do something with it. Maybe it works and maybe it doesn't, usually it doesn't. And if it does, typically the software solution provider, be it XR, AR, VR. Bob Stone: you Damon Shackelford: Variety gets bought up then by a bigger system and shut down. So, you know, you're kind of left hanging and then lately I've switched over to the I'm a conference director now for events So I make experiences for people like you and Mike and Jean to be able to come together and talk about these things and kvetch about what you know What should be happening? So let me play devil's advocate a little bit on something that was said earlier about the about the tools the advancements and and by the way, Jean I love whoever was thinking forward on it atlas Bob Stone: Yeah. Yeah. Damon Shackelford: strengths-based, you know, what render engine actually works. it's the human brain. Why don't we just use that instead of an external piece of hardware? Love that. ⁓ Bob, ⁓ tools really are getting easier and easier to use. Devil's advocate, Sidemy, says, but shouldn't the younger generations experience ⁓ of the pain and soul-sucking destruction of making polygons work ⁓ order to appreciate and use their new tools ⁓ handily? Mike Vann: you ⁓ Gene Feldman: Hahaha Damon Shackelford: know, by golly, we had to walk uphill at, you know, both directions in snow to get to school. They should too. Bob Stone: That's a very good question. Well, I don't know. I've got a couple of grandkids who are pretty deep down on the autistic scale. And watching them use Minecraft and various other packages to build their 3D. I think when you watch the joy they get, it may not be the highest fidelity 3D, but my God, once they got something that is animated and they've linked it up to a... Damon Shackelford: Yeah Uh-huh. Bob Stone: a special Lego piece of kit and they've done that creation, it stirs them on. And we saw this in, although it was polygon by polygon, in the early days when I was getting students to do projects, a lot of them went on to quite interesting jobs and even in academia, they looked back and said, I remember we were doing this project in... one of the guys went to Carnegie Mellon and he was saying he remembered all the hassle he went through to get. What was it? was a boat on water with a flapping sail and he went through nights and nights nights trying to make that work. It was Blender, I think he was using Blender, which was not particularly clever at the time. But yes, there are instances where they look back on us elderly. Mike Vann: Mm-hmm. Bob Stone: a little bit of love and affection ⁓ we just a little bit of affection because we used to go on and ⁓ them to do things that were ⁓ quite torturous but they take that lesson, they take that further forward. ⁓ think ⁓ ⁓ seen students and my grandkids and my youngest who's next door currently working, he's a full-time adult carer by the way but Damon Shackelford: Just a little. Bob Stone: ⁓ He does this 3D, he does some of the 3D work for me. Otherwise he's out on the streets. ⁓ But just seeing the look on their face when they've achieved something and other people are rating what they've achieved because they've used something that may be AI based but tells a story. So it's not just a robot like looking man, which is the first ever 3D graphic that I ever did on a Sinclair ZX81, would you believe, all those years ago, with a 16K add-on pack. It's actually 3D that animates, collides with objects. it's just the motivation they get. So I don't know. Do you really want to torch them by making them Damon Shackelford: 16k Mike Vann: It's still there, they're just getting there faster. Bob Stone: Yeah, they all get, they get in the front. Yeah. Damon Shackelford: Is it? Gene Feldman: I think so. And Damon, I will throw out Master Yoda's advice. are, Masters are what they grow beyond. We are what they grow beyond. That, you know, they build off of what we've done. You know, I mean, even if you look at like the advancement of the modern guitar, nobody thought any way like Eddie Van Halen would ever exist. You know, so I think there's a balance between it. That yes, the experience of learning that hardship, but also they're experiencing different hardships, but they're also, because they don't have to go through our same hardships, they're able to innovate at a faster rate. Bob Stone: Yeah Damon Shackelford: So user experience may vary. Gene Feldman: I, yeah, sure. But, but you have to look at the ones, I think the ones that get passionate like all of us, you know, I mean, I, I always been a VR passion, but I didn't get into it till about 10 years ago. You know what? By reading Bob's work, which thank you for sacrificing for me, you know, it, it, it, you know, allowed that acceleration to where I was able to say, all right, it's Bob Stone: Yeah, yeah. And I think we... Damon Shackelford: You Bob Stone: ⁓ fuck. Gene Feldman: These five things have already been tried moving on. You know, and I think that, I think that's where it kind of gets into it. opens up. However, as an educator, they need experience to learn. They need something, you know, and Damon Shackelford: Moving on. Bob Stone: Yeah, I agree. I think the other thing is that I can't remember who was I was talking to recently about what is it that us elderly have to offer and are people going to are people going to listen to us anymore? And thinking, well, you know, when they when you tell them what you've done, all the exciting things you've done and you tell them about mistakes. And my God, know, my team and I have made some absolute bloopers. of mistakes in VR in the past. You know, on at least two occasions, possibly, we didn't, but almost losing two contracts. It's talking to them about the pitfalls, about, especially if they want to take it further, if they want to go and find a course where they can develop these skills that they've learned, or they want to set up their own startup. And God knows, between the four of us, got enough experience, we've got enough mental and physical scars to help them. Avoid the mistakes that people are making. Gene Feldman: Oh, especially. Yes, but it's also too, think, I think it's I think there's an arrogance of youth that we all had is that, OK, you know, you can tell me how your mistakes, but I can do it better. You know, I think we also have to fight that a little. It's not a bad thing, yeah, but it's those it's that arrogance that gave us all of our scars in reality. You know, it's like, yeah, I can do better. I can do it different. But as we're talking about. Bob Stone: Yeah. Yeah. Damon Shackelford: scars. you Bob Stone: I still get the scoring on LinkedIn and the hair loss because you still get the people coming back, you still get the vibes in LinkedIn feedback when this so-called lovable curmudgeon, Damon Shackelford: ⁓ well, you've inter- and the hair loss. ⁓ my goodness. ⁓ it's okay. I'm used to it. Mark G.: LinkedIn feedback when you know this so-called level level curmudgeon Bob Stone: ⁓ Absolutely. Damon Shackelford: Well, and now for something completely different. On an optimistic question, you've seen a lot of the repetitive nature and you have your scars, you've made your mistakes and you've shared that with some of the younger generations. What one area do you see that they've picked up and advanced that surprises you? mean, there are lot of places where they're repeating the mistakes. know, those are easy to point out. But where's one of the really good areas where you see them making the aha moment? Gene Feldman: Yeah! Damon Shackelford: and not repeating your mistakes and actually advancing well. Bob Stone: I wish you'd sent me that question in an email so I could have a think about it before we had the podcast. Some of us LinkedIn lovable curmudgeon still use LinkedIn, lately they still use email however you know. That's a very good question. I don't think I can actually answer that. I know, gasp, shock, You know, I've at things where... Damon Shackelford: ⁓ Email? What's that? Is that one of those newfangled technologies? Gene Feldman: Nothing like being put on the spot. Damon Shackelford: You What? Bob Stone: I've been hoping for an aha moment in haptics. Hasn't come, won't come for at least a couple of decades more. That's controversial, I know. Things like smell, there's been some fantastic stuff being done in the US introducing smell, which I think is the next big challenge for virtual reality when you're talking about making experiences memorable and enjoyable. Damon Shackelford: Hmm. Bob Stone: There's obviously the brain computer interface side of things, which we do have a lot of youngsters. OK, I'm not including Elon Musk in on this, but we do have a lot of youngsters who are pushing forward with their own little small projects in labs. That might be one area where we see a breakout. It's got the same potential impact as some of the... the young guys coming on to BattleBots with something that looks as if it's not going to win and it does. Me being a really big BattleBots fan. So that was a stinker of a question, I have to say. Damon Shackelford: And it does, yeah. Gene Feldman: Hahaha Mike Vann: follow up with one and ⁓ have interest in this. We've done some projects, but I know you have a lot of experience, ⁓ Healthcare. ⁓ have you seen in healthcare and what do you think the future of ⁓ and immersive in healthcare looks like? I mean, it feels like they're really embracing it and it's rolling. ⁓ think it's an area that everybody should look at if they're focusing on the business. Damon Shackelford: people leave the PR, yeah. Bob Stone: Yeah, yeah, I couldn't agree more. Health care has been one of the main core areas that's kept me going since the 90s, in all honesty. Health care is also one of these areas where you will get an awful lot of hype. we were talking earlier on about companies coming on with this fantastic demonstration of how you interact with patients by the bedside using Quest 3. And you look at it and you think, that's not going to work. That's not going to go anywhere. can't walk up with your Quest 3 hand controller, pick up the patient's notes and read them. There's something not quite right about them. But if you look at psychology, so if you look, for example, at PTSD, the work that Skip Ritzer has done, for example, if you look at healthcare for care homes and hospices, okay, now it's a bit of a niche population, but towards the back end of my recent career, taking this stuff. into whether it's 360 video or fully interactive VR, taking this stuff into hospitals and care homes, you can change people's lives at the end of their life. And nothing I've ever done in healthcare has been more satisfying than that. Training, yes. I think mixed reality training where you are interacting with a physical body or a physical instrument or something physical, but then getting all the what ifs. and the distractions and the complications being displayed using VR or AR during the process. That's got a lot going for it. I healthcare is still, I said this in the 1990s, that healthcare is the, I think, probably the biggest potential for XR, but it also gives the biggest number of challenges in interacting with patients, not just on the physical level, but on the psychological level as well. Damon Shackelford: Hmm. Bob Stone: So that's where I think... Mike Vann: care and government are the two most challenging and those are the ones you went directly into so you must really want the fight ⁓ Bob Stone: ⁓ yeah, ⁓ Gene Feldman: Yeah But about healthcare, you actually lead into an ⁓ interesting concept for me, because I healthcare has ⁓ shown some great use cases over the years. was the meta use case that gave the results ⁓ that came out, I think, at OC6. ⁓ one of the things that I've actually started thinking about, because my wife's in the medical industry. So as I kind of always explored that she's always looked at it. And lately, honestly, we've been watching The Pit. So in all fairness on HBO, great show and start thinking about that. They're you know, they have a big problem with the charting. OK, we're on an AI ⁓ that can separate our voices, that can give us our entire script. ⁓ we saw the AI pin that came out years ago. Why can't we can now combine now looking at from what the use case of the pit to now seeing that why can't we have a device that they can wear from the minute they start work that dictates everything they do and then AI comprises those notes at the end of the shift and now you have the full chart ready to go real time. And so. And this is what leads into it. So you get the inspiration from watching a TV show and knowing what type of tech is either out there or coming forward. And we've talked about our scarring. And I know, Bob, everybody loves picking your brain about all these different topics. So I'm going to hit you with something completely different, our inspiration well. You know, ⁓ as we start looking at these use cases and how we overcome our scars and stay optimistic and always looking at something new. You know, like for me, I mentioned the pit, really one of my biggest inspirations, I know I talk about trying a lot, but there was a movie back in the eighties. was Natalie Woods last movie brainstorm. And the whole concept of the movie was being as an empathy builder, being able to record somebody's brainwaves and allowing somebody else to relive it, which to me as 11, 12, 13 years old was just. Damon Shackelford: So. Gene Feldman: completely blew my mind as a concept. And then Tron comes out, now it gives the great visual of how it can be done, you know, in an abstract way. So for me, I know, you know, we've had our conversations about Doctor Who and Space 1999. So really, as we get through these scars, how do you stay optimistic? What's your inspiration? You know, as I've shared mine, was really kind of curious to help people, to know, for people to know where they can go to start getting ideas for use cases. If that makes sense. Bob Stone: Yeah, again, it's a very good... It does make sense. I turn the clock back to 1960s. You say Doctor Who. Doctor Who was ⁓ a major step forward for me because I used to find cardboard boxes and get into cardboard boxes and draw control panels on the side. That was my virtual reality. had the Doctor Who's TARDIS, his time and relative dimension in space machine, in a cardboard box. And I come out of the cardboard box... Damon Shackelford: Thank you. Bob Stone: And then good old imagination kicked in and I was facing a Dalek or on some foreign planet and it went on from there. Some of the great stuff that came out of Irwin Allen, like Voyage to the Bottom of the Sea, Land of the Giants and all those great science fiction films. Land of the Giants is fantastic. You're being, crashing on a planet where everything is super scaled. That's where the inspiration came from me. Damon Shackelford: Mm-hmm. Bob Stone: It's some of the early computer games and really reinforced my interest in virtual reality. In fact, I'm a great believer that the so-called serious games community back in the eternal century actually saved VR in terms of the way it forced companies like Nvidia to put their electronics to make these fantastically beautiful games work. there are certain games that kept me inspired. I one was ⁓ Colony ⁓ David Adams. ⁓ computer generated wireframe, true 3D, ⁓ colony existing on a planet, you have to get to the bottom and rescue all the kids. ⁓ that was just an absolute game changer for me in terms of ⁓ was the first 3D game that I ever ⁓ ⁓ then you had things like, obviously Unreal, we mentioned Unreal already, but the original Unreal when the, ⁓ not only did the game come out, but you had the Unreal.exe, UnrealEd.exe, and all the beautiful virtual reality examples that some of my previous colleagues brought out, and so it goes on. And I think that's where a lot of the inspiration should have gone, but didn't, because the computer games, like the Call of Duty and all, and Okay, with Half-Life being the exception, because I was a really big Half-Life fan, became same old, same old. It was the same old, start off in Russia, get on a boat, shoot a few people up, get into Afghanistan, shoot a few people up. And it was just the same old formula all the way through. yeah, in many respects, that's what the kids wanted. They wanted a good old shoot-em-up to perform. was probably their parents wanted to put them in a corner. Damon Shackelford: Yeah, the dopamine formula. Bob Stone: forget about them for hours on end. But today... Gene Feldman: But to be fair, we had Pac-Man, so I don't think there was much variation in that game. Bob Stone: Well, this is true. Yes, Pac-Man. ⁓ I won't even go into some of Mark G.: Jouse Galactica. Damon Shackelford: I'm sorry. Gene Feldman: I had to give a hot take, sorry. Bob Stone: But today, yeah, where do they go? ⁓ Gene Feldman: Cause it just seems like it's, don't know, lately it just doesn't seem like there's anything special and it's like, don't want to go, people don't want to go back to the past. You it's like you talk about Jules Verne and it's like eyes glaze over. Bob Stone: Yes, it's a real shame because I still have quite a few games. I mean, I've got an old laptop somewhere where I have some of the games and I show them to the grandkids and you can see that it glazes over. I mean, you remember things like Space Quest and those fantastic 2D little sprites that you used to control. mean, they were fantastic. They were fantastic because of the content, not because of the tech. You really wanted to... Use your mind to work out how to jump over this and then go down and get the treasure from the monster and then move on to the next level. You have to think about it. Whereas a lot of the stuff you see now is mindless. It's mindless violence. I mean, don't mind a bit of mindless violence. I quite enjoy it. ⁓ I could shoot them up on screen. But to inspire people to do what we do now, that's a challenge. That's a real challenge. Gene Feldman: Stress relief. Damon Shackelford: You Gene Feldman: Absolutely. Because what I also find too, it's hard to stay motivated when you are the mo- sorry, I'm stealing an Iron Maiden lyric who motivates the motivator. You know, is that we're always the one kind of initiating change, you know, and, know, when we get around to conferences or get around this, it's a blast because we get to share and sorry, we're not islands amongst ourselves. But for people getting into this, I think sometimes the feeling of being so lost. as well as all the roadblocks that are put up in front of them, you know, because a lot of times when companies start this, they're like, all right, whoever's going to take this on understanding it's gambling your career. It's, you know, you're the one putting, you know, putting the risk out. And so how do we get people to not only accept that, But then to start looking at how can it can be applied to get back, go full circle back to our original question, our original conversations. How can we get them to identify from the inspiration now, what individual tasks we can replicate or we can accomplish in XR where XR can prove valuable for that end user. So, you if we were to take the Star Trek analogy, you know, Star Trek gave us the visual, visual of the communicator to the Troy quarter. And now we're all walking around with them. And I, and then I can tell you, I was one those people in the eighties that every time I clicked my flip phone, did, you know, absolutely. You know, so, and that's showing how pop culture can directly influence this, but. When I say pop culture, that's the inspiration. Somebody saw that and decided to create it. And with the technology that exists today. So I guess it's kind of coming back to that is what are your thoughts? know, what do you use to help kind of identify those end use cases for those end users through the year inspiration? Does that make sense? Kind of where I'm going with it. Bob Stone: Yeah, yeah, I mean, I tend to, I've been over the last few years, been reusing some of the projects that we've done in the past. So for example, you know, one of my students did a, an alpine, an alpine scene where the sun goes down and Northern lights come up. Although she did it beautifully in Unity. it's, it's, last, it's last at the time. And, you know, we've been giving that, that demonstration with all the peaceful music to again, to not just to people in care homes and hospices, but in schools as well. And what that tends to do, what I've found that tends to do is it starts making people talk. And not is it just people comparing what they see to what they've done in the past, but asking for experiences that are close to them. So for example, if you put elderly people into a Vyflow headset, and I love the Vyflow headset, because it's cheap and cheerful. it does 360 but if you put them in the cockpit where I was flying the Spitfire with courtesy of my wife for our anniversary and you put them in the cockpit and they fly over to west of the UK, the amount of information that comes out of these people is unbelievable. It takes them back to what their husband did or what they did and you put them on the front of a steam train where they can look around on Gene Feldman: You Bob Stone: on one of the preserved heritage lines in the UK. And then they start talking to you about, wouldn't it be nice if, could you put that 360 camera, that RICO, theater, the hell it is, or Insta360, could you put that in the garden of the house that I used to live? And things like 3D scanning, we've done a lot of work with Matterport recently. People who want... Damon Shackelford: Hmm. Bob Stone: We did a 3D scan, a complete 3D scan of a preserved nuclear submarine in the southwest. And then we were invited to do the same on the Russian submarine that's moored up in the River Medway just east of London. And again, it's showing people numerous, numerous examples. And I mentioned, about my YouTube site, my YouTube site online, pointing people at this and saying, look, this is what we've done before. How would you like this tailored for your particular needs? What else could you add to this that would make an experience for you? And that seems to be quite successful. Gene Feldman: No, that's very nice. Yeah, because I mean, because you always run into that thing of, really, you know, I think the number one question people will ask anybody getting into this is, OK, what can you use it for? And if you don't have answers ready to go and you don't have to have the solution, just, OK, here's what I'm thinking. can work. So like for me, I know this kind of gets back to a previous conversation. I've seen it work wonderfully with negotiation. negotiation is a very unique art form. And you watching movies, watching a movie or watching, ⁓ was it the antique road show where they're doing the negotiation? That's not a true negotiation. If you've ever been in ⁓ street markets, you will see true negotiation. It's a very unique art form. And for me, I've always been fascinated by the idea that training You know, got these negotiation vendors that will train people. And if the two parties have had the same training, it's the same. All it is, is just one giant negotiation exercise. You know, whereas you start bringing in XR and AI, now you can run people through these entire scenarios where, you know, the, AI avatars responding real time, no scripting, but also by it being an XR, you now get an emotional component. Bob Stone: Hmm hmm hmm Gene Feldman: you now get the threat, it now is kind of hitting on the flight or fight that you're always fighting through a negotiation. know, because there are sometimes we encounter those situations where emotions can get charged and you have to learn how to control them. And by doing this, it's kind of teaching them is where I've kind of seen some great experience with this. And it all really kind of comes down from the inspiration of, you know, watching people. you know, go into Walmart or to, you know, a retail store, trading it like it's a street market and trying to negotiate a price doesn't work like that. Bob Stone: Yeah. So another area where I've seen similar responses from the end users to his heritage, and as Mark will know, heritage is my passion, just using virtual or XR to turn back time and make invisible things visible again. And remember, and this is where we could have really have done with an XR AI design tool. But back in 2020, which is the 400th anniversary of pilgrims set in sail from the UK, ⁓ from England over to the New World, ⁓ side of the pond. We saw complete change in people's behaviours by allowing them to walk along what was called the Barbican, the old Sutton Pool, from where the Mayflower set sail. We actually had smell, so we had smell of ⁓ feces, animal feces, urine. really bad perfume from ladies of the night, cetera, et cetera. And, oh no, was really good. The people who came, we had, say again? Gene Feldman: Remind me never to go through this experience. Damon Shackelford: We already did that in college. We already did that in college. The smells. Sorry. Bob Stone: ⁓ you did. yeah. No, I can imagine. Yeah, having been on a nuclear submarine, you haven't lived unless you smell the inside of a nuclear submarine. But no, but the response from people was incredible in terms of and I wish I wish we had ⁓ AI based NPCs for that. I we've got people walking around and we've got background sounds. Gene Feldman: Hahaha Mike Vann: Ha Damon Shackelford: Mm-hmm. Bob Stone: but they don't interact. They're there as you say, as NPCs, they're trying to set the scene for the 1620s and the filth and the horrific living conditions of the 1620s. But when people had that experience and they walked along the side of the harbour and they got on the boat, they got out to the Mayflower and they seen the harbour from the perspective of the Mayflower, they left. But they came back and when they came back, remember they said they were about half a dozen of them said, I've never been to Plymouth, I've never been to the Barbican, but I walked along that Barbican with eyes afresh because it wasn't just them walking along the Barbican and seeing the tatty gift shops or the fish and chips shops or the stuff that's there now. They could actually pinpoint the buildings and the locations. and link that back to the historical, even though our historical thing may not have been 100 % correct, it wasn't by any stretch of imagination. But they went out and they had a learning experience. just for them to go away and stay in touch afterwards, show how if you get it right, you get the storyboard right, you can engage incredibly well with people of all ages. I that's the important thing. Damon Shackelford: Mm. Hmm. Hmm. Gene Feldman: I know, I completely agree. was a history teacher a long, many, moons ago. And the whole idea of being able to recreate different experiences that we went through, like to be at the trial Joan of Arc in France in the 1400s. I still remember being a young teacher asking if I could take students out into the woods and have smoke bombs and recreate World War I. That was not very well received. ⁓ Bob Stone: Yeah. Gene Feldman: But this type of tech, think, you as we talk about can help recreate it. And like for me, where I've seen it, and I know Damon and I've had these conversations too about, you know, with getting in with Alzheimer's and you've even mentioned with hospice, you know, cause for me, one of the things in the Midwest, so I'm from the Midwest States, we have a unique culture among the motorcycle enthusiasts that live in this area that when one is on hospice or in a retirement or in a Bob Stone: Yeah. Gene Feldman: nursing facility or long-term care, if they ask, we will all bring our motorcycles up so they can experience it one last time. Very depressing to say, but that's really what's going on. And for me, it's what if I've always, and I've been working on this for a couple of years, ⁓ is a project of what if we could give people one last ride? Bob Stone: Yeah. Yes. Mm. Yes. Gene Feldman: where they can be on a headset, in the middle of the mountains of South Dakota, or, I mean, for ⁓ the people across the pond, for our non-colonists, they can have ⁓ the UK Isles, ⁓ parts of Ireland. Damon Shackelford: Hmm. Gene Feldman: Sorry, I don't know if that's allowed to say, but yeah. Yeah. Exactly. But then you can tie it into pain management. You can tie it into dialysis services. Because we've seen, and this is where I kind of want to bring it four circles, because as we're talking about the inspiration, we're talking about the scarring. One of the things that I think we've seen XRC Mark G.: Swiss Alps, the Swiss Alps, Grunwald is a popular thing. Bob Stone: Mm. Mm. Damon Shackelford: whatever their last, you know, memory, lingering memory is. Bob Stone: Yeah. Gene Feldman: seen and this kind of gets back into the human context is it taps into our emotional ⁓ aspects of our intelligence more than any other device because it's able to rewire our senses and by doing that it creates this kind of empathy builder but also is able to create these very unique experiences that AR or other things cannot create because it does tap into that emotional. Bob Stone: Yeah. Gene Feldman: And I think that's what makes XR special compared to other things. So that I'm just kind of throwing my two cents out there, but. Bob Stone: I agree and I think that's one of the reasons why I'm so frustrated that the smell side of things has not been developed as fast. Although as Eon Tech I think I've recently announced a new portable, almost ear type smell system and a smell system for games. We were using their little headset attachment which had nine individual smells in a little box the size of a printer cartridge. Absolutely fantastic. It's the number of people who commented that had it just been vision, they would... Okay, it's another game. It's another visual experience. Vision and sound, particularly with things like the fish being chopped, the sound of the water, the sound of people chucking their pots full of you-know-what outside of their windows, that added another dimension. But then you had the smell. And all of a sudden, the emotional engagement goes through the roof. And we all know it, if you can think about smell in some of the coastal and rural scenes that we've developed for things like pain management or distraction therapy, adding smell ⁓ would just be an absolute... I mean, hate, as Mark knows, I hate the phrase game changer, but I do think that is the next level. Damon Shackelford: Mm. Mike Vann: you Bob Stone: of technology that I would like to see before I pass away to that metaverse in the sky, I would like to see smell. Forget haptics. Seriously, forget haptics because you can handle haptics with mixed reality. Smell. That's on my bucket list. Damon Shackelford: Mm. Interesting. That's the ticket. That's the ticket to high memory. Ironic that you would like to see smell. Bob Stone: I go to the experience smell but in a proper context. Damon Shackelford: Yeah. Yeah. Gene Feldman: But it's true because you have to think about that. Your sight, vision, and smell are your three senses that are instinctively connected together. If you can't taste something but you can see it, your mind will fill in the gaps and tell you what you're tasting. And so there are three huge senses. It's the same thing like I always used to do with my high school students. Hold your nose and eat a piece of candy. I you can't tell me what flavor it is. So the more senses that we can engage and what I have told people if you want to experience it in a different way, go to the Alcatraz tour over in San Francisco. I experienced the Midnight Tour once. I went and did the Haunted Tour and what they do is they give you headphones. You already have your four senses. You you can see everything. All the smells are still existed. So don't worry. That's still all there. You know, you're walking through, but when you have the sound and when you walk through the cafeteria and all of a sudden you hear all the voices crackling in the, in the headset, I'm telling you the hairs on the back of my neck rose because now it engaged that last sense to make everything real. And that's where we have to tap into. think people forget that the human mind is programmed to actually defend itself from false inputs. Bob Stone: Yeah. Yeah. Gene Feldman: You know, and here we are trying to give it XR. Mike Vann: Yeah. Mark G.: Yeah, just to add to that, right, in the training space as well, students all learn differently based on their primary sensory code, right? Some people are auditory, some people are sensory in the sense of smell, right? And unfortunately, you know, audio and smell are the redheaded stepchildren of VR right now, you know, we need to add those things in to really make them truly immersive and memorable. So, but yeah. Damon Shackelford: fascinating. Yeah, fascinating. Everything old is new again. Aristotle in his book, The Confessions, has a whole section on the senses, on the five senses, and how we even confound them when we speak because they're so well intertwined. Phrases such as, you see what I'm saying? Still hit today. We still use those in every language. And it's adding smell would just bring it up a hundredfold in XR. Bob Stone: Yes, he's from the. Gene Feldman: Yeah. Bob Stone: I think Mark's right with... Yeah, Mark's right with training too. As we found with our Battlefield Advanced Trauma Life Support Training ⁓ Mixed Reality. You probably remember this on LinkedIn, Mark, but I've been screaming out for somebody to provide us with a really good, believable sense of aviation fuel after. Because when these young guys and girls go out on the Chinook and they do the body retrieval, the casualty retrieval, and they're trying to keep these poor Gene Feldman: ⁓ absolutely. Bob Stone: guys alive on the way back to the main hospital. It's not the smell of the blood or the human fluids. It's not the smell of the cordite from the minigun going off in the forward cabin. It's the aviation fuel. It sticks to them. They smell of it when they get off. They smell of it when they go on the next... And that... Talking to these people and flying with the RAF, you can tell, yeah, I stank of aviation fuel for days. It's that one smell, if sadly that project didn't go any further, sadly. But if there was one thing we had done to add, I believe something to that project that the young trainers in the Royal Centre for Defence Medicine would have said, now you've got it, it was that, that one single smell. Damon Shackelford: you Mike Vann: Well, there's a good challenge for the young people getting into the industry, right? Solve this problem. But just listening to all of these use cases and the kind of passion about solving some of these things, I don't know. I really feel that ⁓ the people that are coming into the industry, leveraging AI to build XR experiences, that's the future. The future is they're going to use tools that we couldn't have imagined in the 90s or the 80s. ⁓ to be able to solve these things and create experiences that are still human. Humans are creative and they're going to use, these kids are going to use their creativity in writing prompts and molding the tools to do what they want to create stories. And they're already starting to do that. But ⁓ we just have to have some that keep pushing, just like everybody here has. And they will because they're humans and they're creative. And I think, it kind of came all the way back around, right? Bob Stone: Yeah. Mike Vann: How is it going to survive? Because humans are creative and they're going to come up with creative ways to solve education problems and training problems and just human life challenges. Damon Shackelford: Yeah. Good job. to bring it back around, Mike. Gene Feldman: Absolutely. Very, very nice. So we only have a couple minutes left. So first off, Bob, seriously, thank you for joining us. This is actually going to be the first episode that we're going to release out of our new podcast. So we want to kind of launch it with you. So we'll be celebrating your lifetime achievement award ⁓ as well as I know you make a joke about it, but we really do stick. Bob Stone: Yeah Damon Shackelford: Yes. So. Bob Stone: Mark gets it. Mark gets it. Gene Feldman: yeah, but no, ⁓ trying to give you, trying to, I'm trying to, I'm trying to actually be complimentary. Come on. It's not often. ⁓ not often you gotta take it when you can get it. But seriously, one of the big things, this is one of the first things I told you when I met you. So, ⁓ is that we stand on your shoulders. You know, ⁓ we really do. ⁓ You have been an inspiration to us. Bob Stone: It's something. I know, I know. Damon Shackelford: We know it's hard for you, Gene. I know. Bob Stone: I'm right. Gene Feldman: and the opportunity not only to be inspired, but to get to work with you now and to have these conversations with you, very open candid, as well as talking this way. I think it's just been fantastic. ⁓ One of the things that we like to do on the podcast that we're trying to do is kind of the final protocol. What is a final thought that you would like to, anybody listening, what is a final thought that you would like to leave them with ⁓ as far as this conversation or on XR? If you could share one piece of advice with somebody getting into this, what would it be? Bob Stone: It would be never forget your imagination. That sounds pretty simple, from those early days of drawing control panels on the inside of a box, to doing the kind of things that I do with my grandkids over the weekend, and it's not all tablet-based, it's not all computer-based. We do things with Lego. ⁓ sometimes that goes wrong as you've seen with the DeLorean. But it's the imagination that I think is... I don't think it's dying, but I think it needs resurrection. think if people have a healthy imagination and can sit and lose themselves or imagine themselves in different situations, then this will not only help mental health, it'll help XR as well. But I think it's imagination. sometimes an overactive imagination, sometimes a psychotic imagination. But that's what's kept me going over these last 40 years or so. Gene Feldman: No, that is absolutely awesome. That's why, honestly, throughout this conversation, that's why I wanted to pick that thought. ⁓ So as far as listeners, if you want to learn more, there will be links to Bob's YouTube channel ⁓ in within this podcast, so please feel free. ⁓ Mark, Damon, Mike, thank you guys for joining as our panel. And Bob, thank you for being our guest. It was absolutely phenomenal. ⁓ Damon Shackelford: good. Gene Feldman: So we'll go ahead and say good night. Mark G.: Thanks, Bob. Bob Stone: Good night and it's nice to see more. Damon Shackelford: Good night.