Latest / Human Capital Business / Personalized Adaptive Workplace Learning and Assessment With Luis Garcia
Transcript
- 0:00Speaker 1: And so that's really what we're going to try to
- 0:02Speaker 1: unpack today and explore together and how we can do
- 0:05Speaker 1: that effectively or more effectively within our organizations. As we
- 0:08Speaker 1: get started, I wanted to share Luis's bio with everybody.
- 0:11Speaker 1: Luis Garcia is a seasoned international executive with over 25
- 0:15Speaker 1: years of experience in technology, digital media, and education. He
- 0:19Speaker 1: specializes in driving new ventures and products to rapid growth
- 0:22Speaker 1: by building effective teams that harness innovation, technology, and creativity
- 0:27Speaker 1: to solve complex problems. He is the president of PEAT,
- 0:30Speaker 1: an Orlando-based tech startup that offers a suite of cost-effective
- 0:34Speaker 1: and customizable solutions that enable organizations to deliver personalized workforce
- 0:39Speaker 1: learning at scale. The PEAT team is dedicated to harnessing
- 0:42Speaker 1: the power of AI to help organizations of all sizes
- 0:45Speaker 1: optimize their training initiatives, spanning from onboarding to regulatory compliance,
- 0:51Speaker 1: product knowledge, technical skills, and more without hiring additional training resources.
- 0:56Speaker 1: I love it. So Pete is all about what we're
- 0:58Speaker 1: going to be talking about today. Before we dive on in,
- 1:01Speaker 1: is there anything else you want to share with the
- 1:04Speaker 1: audience by way of your background, personal context, or about
- 1:06Speaker 1: your company? And then we'll get started.
- 1:09Speaker 2: Yeah, absolutely.
- 1:10Speaker 3: So as you read, I've been in digital education for
- 1:13Speaker 3: over 20 years. And there's just two problems that I
- 1:16Speaker 3: have constantly experienced as I manage organizations and grow organizations,
- 1:21Speaker 3: not only professionally, Because they weren't in education, but will
- 1:24Speaker 3: happen in any setting. And it is, number one, it's
- 1:28Speaker 3: really hard to create learning content that is effective. But
- 1:35Speaker 3: number two, and it's the hardest one, and it happens
- 1:38Speaker 3: at all levels of education and learning, it is really
- 1:40Speaker 3: hard to evaluate learning, to really know whether.
- 1:45Speaker 1: A person learned.
- 1:47Speaker 3: So, we have been living with these two problems for
- 1:49Speaker 3: a very long time, and we use them as the
- 1:51Speaker 3: foundation to create PEAT. Now, PEAT stands for Personalized Education
- 1:57Speaker 3: Training and Enrichment, and it's really the power of AI
- 2:00Speaker 3: which has given us the opportunity to create something like this.
- 2:05Speaker 3: because we can, for the first time, are able to
- 2:09Speaker 3: solve both of those problems. And solve both of those
- 2:12Speaker 3: problems at a price that can be brought into smaller organizations. See,
- 2:18Speaker 3: large companies usually solve their training problems by creating L
- 2:25Speaker 3: & D departments, learning and development or training.
- 2:28Speaker 2: Departments, and they have the training. learning experts in there
- 2:31Speaker 2: and the learning managers.
- 2:33Speaker 1: And so on.
- 2:34Speaker 2: So it is expensive to do that.
- 2:36Speaker 3: Like my content department at university to deliver content to,
- 2:40Speaker 3: you know, thousands of students around the world cost me
- 2:43Speaker 3: a million dollars a year to run.
- 2:44Speaker 2: So that is the cost of it. But if you're
- 2:47Speaker 2: a smaller.
- 2:47Speaker 3: Company, let's say 100 employees, 50 to 500 employees, you
- 2:51Speaker 3: don't have that kind of money for that.
- 2:53Speaker 2: But you do have the training problems. And so you
- 2:57Speaker 2: use other methods.
- 2:58Speaker 3: You use shadowing or you create a PowerPoint or use
- 3:04Speaker 3: even chat GPT nowadays to create courses. But that only
- 3:07Speaker 3: solves half of the problem. You can only deploy the content.
- 3:10Speaker 3: You don't know if they actually learn.
- 3:12Speaker 2: So what we wanted to build is a tool that
- 3:13Speaker 2: could solve both of.
- 3:14Speaker 3: Those problems at a price that we could bring into
- 3:17Speaker 3: a small and medium-sized organization, which in the past had
- 3:20Speaker 3: never been able to afford it.
- 3:22Speaker 1: Yeah, well, that's really cool. And you highlight a bunch
- 3:26Speaker 1: of major problems in the learning and development space that's
- 3:30Speaker 1: been really hard to grapple with for decades. And really,
- 3:38Speaker 1: for decades, the bread and butter of learning and development
- 3:41Speaker 1: and training and development has been classroom based learning. Like
- 3:44Speaker 1: you sit down, you have an instructor, they have a
- 3:46Speaker 1: learning manual. Uh, people may have like a packet. Uh,
- 3:50Speaker 1: maybe they do a little pre-work, they show up, they learn,
- 3:54Speaker 1: maybe they have an assignment, they have some sort of takeaway.
- 3:56Speaker 1: Maybe there's some sort of an assessment or an exam
- 3:58Speaker 1: or something. Maybe there's some sort of followup. If it's
- 4:02Speaker 1: a decent pro training program, there'll be some sort of followup,
- 4:05Speaker 1: you know, a week later, 30 days out, whatever. Um,
- 4:09Speaker 1: And that's if it's a good training. You know, a
- 4:11Speaker 1: lot of trainings don't even have that. Right. And and
- 4:14Speaker 1: but it's just not effective. It's just not very effective.
- 4:17Speaker 1: And and most of it, you know, learning science tells
- 4:20Speaker 1: us an educational theory and educational research tells us that
- 4:26Speaker 1: most of that is forgotten almost immediately. Most of it,
- 4:29Speaker 1: if it's not applied directly, you know, it goes in
- 4:32Speaker 1: one ear out the other. And it's just not personalized.
- 4:35Speaker 1: So so that personalization piece has always been a real challenge.
- 4:41Speaker 1: The assessment piece has always been a real challenge. The
- 4:45Speaker 1: direct application piece has always been a real challenge. What's
- 4:50Speaker 1: really cool about modern technology is it allows us an
- 4:54Speaker 1: opportunity to address all of those challenges. Right. Yes. So
- 4:59Speaker 1: so let's talk through that and tell us maybe a
- 5:00Speaker 1: little bit more about how you do that with Pete.
- 5:03Speaker 2: Absolutely. Thank you.
- 5:04Speaker 3: You're describing exactly correct. And it doesn't matter the setting.
- 5:08Speaker 3: You know, corporate training is one of them. But what
- 5:10Speaker 3: you're describing happened in the classroom for traditional education everywhere, too.
- 5:14Speaker 1: Right.
- 5:15Speaker 3: And the best way that we have for evaluating learning
- 5:18Speaker 3: was through tests.
- 5:19Speaker 2: And tests at.
- 5:20Speaker 3: Best are poor and at evaluating learning, the best way
- 5:24Speaker 3: to evaluate learning would probably be interviewing individuals about what
- 5:31Speaker 3: they learn and have them practice with you in front
- 5:34Speaker 3: of you to see whether or not they grasp the
- 5:37Speaker 3: knowledge and be able to fill up the gaps as
- 5:39Speaker 3: they go along. But that's not scalable. It's not even
- 5:42Speaker 3: scalable in a normal classroom and format. That's why tests
- 5:46Speaker 3: were invented. So how can I have a conversation with
- 5:50Speaker 3: an expert at scale without the expert?
- 5:54Speaker 2: So that's what AI allows.
- 5:55Speaker 3: Us to do now, because when we create courses and
- 5:59Speaker 3: we ingest all this knowledge, we're able to create this
- 6:03Speaker 3: skills engine in which a person can be evaluated. Now,
- 6:10Speaker 3: the first problem we wanted to solve is like, how
- 6:12Speaker 3: do I can have a conversation with the expert and
- 6:15Speaker 3: the expert can evaluate my knowledge based on the learning
- 6:17Speaker 3: outcomes that the system defined, because by the way, most
- 6:23Speaker 3: people don't know that the point of a course is
- 6:26Speaker 3: to deliver learning outcomes. And so our system is rooted
- 6:31Speaker 3: on learning outcomes, but because our system is not created
- 6:35Speaker 3: for learning experts, we do the work, the algorithm does
- 6:40Speaker 3: the work of creating the learning outcomes transparently for the user.
- 6:43Speaker 2: But it uses that as a foundation to do evaluation.
- 6:46Speaker 3: So we first wrote an engine to have this conversation
- 6:49Speaker 3: to be able to evaluate.
- 6:52Speaker 2: The learning outcome. And that worked really well. But what
- 6:56Speaker 2: we realized is like all we're doing is playing a role.
- 7:00Speaker 3: So now the AI could be the expert that is
- 7:05Speaker 3: asking you questions, evaluating your learning, but we could flip
- 7:08Speaker 3: the role also and say, well, the AI can be
- 7:12Speaker 3: the customer and you can be the expert. And that's
- 7:14Speaker 3: another way to prove that you learn, right? And if
- 7:18Speaker 3: we do that, then really the AI can be any role.
- 7:20Speaker 3: So we started experimenting with it. It could be a
- 7:23Speaker 3: customer calling to your support line being very upset. And
- 7:27Speaker 3: now you have to deescalate that.
- 7:30Speaker 2: Or it could be a cold call that you're trying
- 7:33Speaker 2: to convince somebody to buy your product and you could
- 7:35Speaker 2: be practicing that. Or it could be a number of scenarios.
- 7:39Speaker 3: So what we end up building was a skills assessment
- 7:41Speaker 3: engine that allows you to practice and allows you to
- 7:47Speaker 3: evaluate the learning. And all our courses include that by default. Now,
- 7:52Speaker 3: you can do that in text. You can do that
- 7:54Speaker 3: in spoken. You can even do it with a video.
- 7:57Speaker 3: We have the ability for you to have a live
- 7:59Speaker 3: conversation with a video avatar to make it as real
- 8:03Speaker 3: as possible. So I work in sales a long time.
- 8:06Speaker 3: You have to do a lot of role playing with
- 8:09Speaker 3: people to train them to take that first call. And
- 8:12Speaker 3: so that takes time from the supervisor or whoever is
- 8:14Speaker 3: doing that part. Here, they have a safe environment to
- 8:17Speaker 3: practice all these conversations and be ready for that first call.
- 8:22Speaker 1: Yeah, I love it. We've come so far. So the
- 8:28Speaker 1: fact that you can do it with an interactive video
- 8:33Speaker 1: avatar in real time, get real time feedback, that simulated environment,
- 8:38Speaker 1: that role play environment. You know, I'm a university professor.
- 8:43Speaker 1: So in a classroom environment, that was always, you know,
- 8:46Speaker 1: like actual application, classroom-based activities, role plays, you know, case,
- 8:53Speaker 1: applied case studies where students are like doing real projects
- 8:56Speaker 1: with real organizations. Like those were always the bread and butter.
- 8:59Speaker 1: Like that's the real stuff, right? If you could do
- 9:02Speaker 1: that with your students, that's where they gain the real skills.
- 9:05Speaker 1: That's where you can assess real competency. but it's hard
- 9:09Speaker 1: because it's hard to scale. Uh, and it's, it's, you know,
- 9:11Speaker 1: and so, so what you'd end up doing is you
- 9:14Speaker 1: would like pair off students. So they're like role play
- 9:16Speaker 1: playing with each other. Um, or, you know, there's a
- 9:19Speaker 1: variety of ways you try to do it, but that's
- 9:22Speaker 1: limited because now you, instead of having an expert with
- 9:24Speaker 1: the student, you have a student with the student, right.
- 9:26Speaker 1: And there's only so much, you know, a novice can
- 9:28Speaker 1: teach a novice and, You know, there's always, you know,
- 9:32Speaker 1: one of the best ways to learn is through teaching.
- 9:33Speaker 1: And so, you know, having a student working with a
- 9:36Speaker 1: student is still valuable. But having that expert, you know,
- 9:41Speaker 1: on the other side via the simulated role play with
- 9:45Speaker 1: the AI video avatar, that is valuable. really, really cool.
- 9:50Speaker 1: And that's something that we didn't have before. Like that's
- 9:53Speaker 1: a new emerging capability that we have with these technologies.
- 9:58Speaker 1: Now it takes a lot of computing power It takes
- 10:00Speaker 1: a lot of, you know, tokens. It takes a lot
- 10:02Speaker 1: of those sorts of things. But it's getting better. better
- 10:05Speaker 1: and better. It's getting cheaper and cheaper to be able
- 10:09Speaker 1: to do that and to be able to do it
- 10:11Speaker 1: at scale. So it's becoming more and more accessible for organizations,
- 10:15Speaker 1: not just big corporations, but even small businesses. Yes. Yes.
- 10:18Speaker 2: We are able to deliver a very affordable price so
- 10:25Speaker 2: that small companies can have it.
- 10:27Speaker 3: Now, what is also interesting that we found in this
- 10:29Speaker 3: work is that 80% of the workforce doesn't have a desk.
- 10:35Speaker 2: Is frontline deskless workers.
- 10:38Speaker 3: Yet only 1% of the software investment goes to software
- 10:41Speaker 3: for them. So the first people that are representing your brand,
- 10:46Speaker 3: yet the least trained people out there. And so, because
- 10:50Speaker 3: we're starting getting these customers for frontline distributed workforces that
- 10:55Speaker 3: needed to hire a lot of people, deploy them really quickly.
- 10:57Speaker 3: And I think concert, right? You know, Bandits in town,
- 11:03Speaker 3: you see all these people around protecting, helping people. They
- 11:07Speaker 3: get really no training to do that. And those were
- 11:11Speaker 3: our first customers. They wanted to be able to train
- 11:15Speaker 3: those folks. They are not trained on how to de-escalate
- 11:17Speaker 3: a difficult customer in life. So now they can practice that.
- 11:22Speaker 3: So we started getting more and more those kind of customers. Today,
- 11:25Speaker 3: a lot of our customers are frontline distributor workforces. That before,
- 11:30Speaker 3: we're getting no training whatsoever. And now they're not only
- 11:34Speaker 3: getting good instructionally sound content, they also have the ability
- 11:38Speaker 3: to practice and get their position certified before they are
- 11:42Speaker 3: out in the field.
- 11:44Speaker 1: Yeah, well, either no training or really generic, you know,
- 11:49Speaker 1: not personalized training, right? Right. So that's what I've seen
- 11:52Speaker 1: in small business is, you know, there's so many free
- 11:57Speaker 1: resources out there. There's MOOCs, there's, you know, there's YouTube, there's,
- 12:01Speaker 1: there's not a, there's not a, you know, a limitation
- 12:07Speaker 1: around content. There's so much content out there. And so,
- 12:12Speaker 1: you know, and a lot of scrappy small business owners, CEOs, solopreneurs, whatever, like,
- 12:18Speaker 1: They can go out and find content. The problem is,
- 12:20Speaker 1: is it personalized to your business, to your strategy? Is
- 12:24Speaker 1: it personalized to your team? Is it personalized to the
- 12:27Speaker 1: individual learning needs of your people and where they're at,
- 12:31Speaker 1: to your products and your services, right? And that's the
- 12:35Speaker 1: sticking point because there may be If you're lucky with
- 12:38Speaker 1: those generic resources that you find on YouTube or, you know,
- 12:42Speaker 1: on whatever, you know, you may find 50%, 60%, maybe
- 12:46Speaker 1: even 80% alignment with what you're trying to accomplish and
- 12:50Speaker 1: what that resource provides. But there's still probably a pretty
- 12:54Speaker 1: big gap. And it's static, right? It's because it's a
- 12:58Speaker 1: resource that someone else created. There's no interactivity with it.
- 13:02Speaker 2: That's actually right. So at best, you're consuming good content.
- 13:06Speaker 1: Yeah.
- 13:08Speaker 2: But you don't know if they learned it. You don't
- 13:11Speaker 2: know they're able to apply it. So absolutely.
- 13:15Speaker 3: Again, what I call a contact artifact is at best
- 13:20Speaker 3: half of the learning equation.
- 13:22Speaker 2: And so we have really focused on the evaluation.
- 13:27Speaker 1: Yeah, and talk about that. So one of the things
- 13:30Speaker 1: that I love about the new capabilities of the current
- 13:34Speaker 1: technology is not only does it provide you know, real-time
- 13:38Speaker 1: access to role plays and application, you know, simulated environments,
- 13:46Speaker 1: you know, personalized learning. But behind all of that then
- 13:51Speaker 1: is assessment capability, right? So talk more about that and
- 13:55Speaker 1: what you can do with your tools and like why
- 13:57Speaker 1: that's so important.
- 13:59Speaker 3: Well, the first thing is that you don't have to
- 14:02Speaker 3: be a learning expert to use our tool. You don't
- 14:05Speaker 3: need to know words like assessment or evaluation of learning
- 14:08Speaker 3: or learning outcomes. We're doing all that heavy lifting behind
- 14:11Speaker 3: the scenes to make sure that you can deliver training
- 14:15Speaker 3: programs that are effective.
- 14:16Speaker 2: So that's first. It's rooted in instructionally sound rules that.
- 14:22Speaker 3: You don't need to know anything about because our customers
- 14:25Speaker 3: are business leaders. The second part is, having an engine
- 14:30Speaker 3: that will allow you to role play at any level,
- 14:34Speaker 3: even if it's asking you questions to see what your
- 14:36Speaker 3: knowledge is, or you being the one that answers questions,
- 14:39Speaker 3: or having very specific operational knowledge that needs to be
- 14:43Speaker 3: practiced before you are deployed or to take you.
- 14:47Speaker 2: To the next level.
- 14:48Speaker 3: The other part is that we have found that in learning,
- 14:51Speaker 3: and you will know this, there's interactive activities.
- 14:54Speaker 2: And those are really hard in digital education to deploy
- 14:56Speaker 2: at scale.
- 14:57Speaker 3: If you want to do a simple drag and drop
- 14:59Speaker 3: or something, you know, how to teach my piece of
- 15:02Speaker 3: software or a complicated form. the best you can do
- 15:07Speaker 3: is record a video and then again, hope that they
- 15:10Speaker 3: consume it and understand how to use your software. So
- 15:13Speaker 3: one of the most sophisticated things that we do is
- 15:15Speaker 3: we have an app maker. So you can take, let's
- 15:19Speaker 3: say it's a piece of software, you can take screenshots
- 15:21Speaker 3: of the software, feed it to our app maker, and
- 15:24Speaker 3: the application itself will create an app in which you
- 15:28Speaker 3: walk through all of all of the points of the
- 15:30Speaker 3: UI and tells you exactly what to use and why
- 15:33Speaker 3: you're using it, and then evaluates your learning over that.
- 15:37Speaker 3: So it's not only conversational, it could also be systems-driven.
- 15:40Speaker 3: So we really focus on all those areas that are
- 15:43Speaker 3: important for the small business, for the people to know,
- 15:46Speaker 3: so they can do the job better.
- 15:48Speaker 1: Yeah. And I mean, that's so powerful because that's one
- 15:52Speaker 1: of the biggest gaps that's pretty much always been there
- 15:56Speaker 1: with with learning and development in the space is how
- 15:59Speaker 1: do you assess impact? I mean, frankly, that's that's one
- 16:03Speaker 1: of the biggest gaps in a lot of business areas
- 16:06Speaker 1: is like, how do you really, truly assess impact of
- 16:09Speaker 1: whatever initiative, whatever project, whatever thing you're trying to accomplish?
- 16:14Speaker 1: What's the ROI of it? What's the actual learning objective outcome?
- 16:19Speaker 1: Are you actually moving the needle? But. It's like the
- 16:24Speaker 1: assessment gets embedded into like the actual product itself and
- 16:31Speaker 1: how you can actually measure. the actual like learning taxonomy
- 16:37Speaker 1: and the actual skills and the competencies that you're having this, the,
- 16:40Speaker 1: the learners, you know, develop as they're going through, you know,
- 16:44Speaker 1: whatever role player, whatever simulation or whatever, you know, thing
- 16:47Speaker 1: that they need to learn, develop, whatever. And that's, it's,
- 16:51Speaker 1: it's incredibly powerful because then you actually have, you can create,
- 16:55Speaker 1: create a baseline. You can actually then see, you know,
- 16:59Speaker 1: movement and you can see you measure Delta over time
- 17:03Speaker 1: and you can translate that into ROI, which is, you know,
- 17:06Speaker 1: for any small business owner, of course, that's going to
- 17:08Speaker 1: be super powerful for you to be able to continue
- 17:11Speaker 1: to make the case on any L & D spend.
- 17:14Speaker 1: If you're in a bigger, you know, medium-sized to large business,
- 17:17Speaker 1: it's going to be critical as you're making the case
- 17:20Speaker 1: up through the C-suite, you know, to get dollars towards
- 17:24Speaker 1: your L & D budget. And there's a reason why
- 17:28Speaker 1: in any kind of economic hard times, why training L
- 17:34Speaker 1: & D budgets often tend to be some of the
- 17:36Speaker 1: first things that get cut. It's because they usually don't
- 17:40Speaker 1: have a whole lot of strong data to show how
- 17:46Speaker 1: their budget is producing outcomes. There's kind of the assumption
- 17:49Speaker 1: that what they're doing matters and like what they're doing helps,
- 17:53Speaker 1: you know, improve how the business is run and, you know, how,
- 17:57Speaker 1: you know, the employees do their work and how salespeople
- 18:00Speaker 1: sell and whatever, blah, blah, blah. But there's often no
- 18:04Speaker 1: real evidence of it because measuring the the outcomes is
- 18:09Speaker 1: challenging and a lot of organizations just don't do it
- 18:12Speaker 1: or they don't do it well. And so having something
- 18:16Speaker 1: that's embedded into what you do, you know, is a
- 18:19Speaker 1: really powerful feature. Well, Luis, I know at the time
- 18:22Speaker 1: I need to let you go here in a minute,
- 18:23Speaker 1: but before we wrap things up for today, I just
- 18:25Speaker 1: wanted to give you a chance to share with the
- 18:26Speaker 1: audience how they can connect with you, find out more
- 18:28Speaker 1: about your work, your team, and then give us a
- 18:30Speaker 1: final word for today.
- 18:31Speaker 2: Well, thank you so much for having me.
- 18:34Speaker 3: If what you heard today resonates with you, and please
- 18:39Speaker 3: go visit our website. We have the best, easiest website
- 18:43Speaker 3: to remember is pet.com, P-E-T-E.com.
- 18:47Speaker 2: You go right there and you can read about what
- 18:49Speaker 2: we do.