Latest / EDGE AI POD / Edge AI That Cuts Chemical Waste

Transcript

Edge AI That Cuts Chemical Waste · EDGE AI POD

• 0:06
  SPEAKER_00: Hello everybody.
• 0:07
  SPEAKER_00: Okay, so it has been a long day, right?
• 0:10
  SPEAKER_00: So today's gonna be a little more like a story on a real use case that we did like three years ago, even with before the HAI existed as such, right?
• 0:22
  SPEAKER_00: So it started with uh yeah, here it is, with a company.
• 0:28
  SPEAKER_00: But before get into our is that who is Barbara?
• 0:32
  SPEAKER_00: Now probably you will be all wondering what is this company with this funny name, so it's not somebody's not the founder.
• 0:40
  SPEAKER_00: It's uh long story short, is because we started a company based on the cybersecurity.
• 0:47
  SPEAKER_00: And there's an old saying on in Spain that you only remember St.
• 0:51
  SPEAKER_00: Barbara when it's an issue, right?
• 0:53
  SPEAKER_00: So you only remember cybersecurity when there's uh when there's a problem.
• 0:59
  SPEAKER_00: And and after that, so we've been evolving the company because of the customer request, and we have evolved it into what is HAI.
• 1:07
  SPEAKER_00: And what we do now is that we are able to deploy the uh we are engaged management platform that allows to deploy AI models across many different uh thousand or hundreds of different devices in a very cyber secure way, and and also includes a lot of uh infrastructure around it for the industrial environment.
• 1:32
  SPEAKER_00: So you have an ecosystem of applications that allow to create these use cases that are important.
• 1:37
  SPEAKER_00: So as I was saying, it all started with uh uh this use case about HAI and journey into that with a customer, it's a big customer in Spain called uh Actiona.
• 1:47
  SPEAKER_00: You may not know it's uh it's a company that covers energy, construction, and other things, and also water.
• 1:54
  SPEAKER_00: So they created in 2019 uh uh digitalization uh department whose idea was to bring innovation into the water, right?
• 2:06
  SPEAKER_00: So they cover the whole water cycle, but in this case, uh and uh but they have an issue in a particular use case because the desalination plants.
• 2:17
  SPEAKER_00: So the salination plant is a funny thing.
• 2:20
  SPEAKER_00: It looks like uh, okay, the water is everywhere, so it should be quite easy.
• 2:24
  SPEAKER_00: You just remove the salt, and that's it.
• 2:26
  SPEAKER_00: And basically that's what we do.
• 2:28
  SPEAKER_00: So they get the water, first they pre-treat it, they bring, they take all the organics out.
• 2:35
  SPEAKER_00: They go through a process which is called reverse osmosis, and they take the all the salt out, but there's still other products in the other chemical products into the uh desalination process.
• 2:47
  SPEAKER_00: And what they do is they treat it afterwards with some chemicals, right?
• 2:52
  SPEAKER_00: Uh one is difficult to get rid of is boron.
• 2:56
  SPEAKER_00: Okay.
• 2:56
  SPEAKER_00: So the boron, okay, say you there's a way of treating it, you just put uh caustic soda on it and then you treat it.
• 3:04
  SPEAKER_00: But you know you need to know how much uh boron is on the water, otherwise you may have issues.
• 3:11
  SPEAKER_00: It may be bad for the health, or even you can get penalties.
• 3:15
  SPEAKER_00: So they say, okay, let's let's analyze it.
• 3:18
  SPEAKER_00: But when they analyze it on the lab, it takes normally 12 hours, 24 hours in order to know exactly what is the amount.
• 3:25
  SPEAKER_00: And when that happens, they cannot treat it because that's the water is already gone.
• 3:29
  SPEAKER_00: So they have to find a way of uh of improving it, right?
• 3:34
  SPEAKER_00: So they say, okay, how can we estimate the amount of boron that's in the water so we can treat it more precisely?
• 3:40
  SPEAKER_00: And even better, can we predict how much boron are we gonna use?
• 3:43
  SPEAKER_00: And then there's another thing that they also thought about doing is energy optimization because there's a huge amount of energy they need to put into getting that.
• 3:51
  SPEAKER_00: But that's gonna be the second stage.
• 3:53
  SPEAKER_00: So originally say, okay, they had this idea, no, they had this vision.
• 4:01
  SPEAKER_00: Say we're gonna create a virtual sensor for boron.
• 4:06
  SPEAKER_00: That's quite simple, right?
• 4:07
  SPEAKER_00: It doesn't look like a very complex model anyway.
• 4:11
  SPEAKER_00: And but still, they have to do it, and they say, okay, they get all the things that are already, you know, the pH, uh turbidity, or temperature, all that.
• 4:20
  SPEAKER_00: That's how they get all the data, they got the results from the lab.
• 4:25
  SPEAKER_00: And say we should be quite straightforward.
• 4:27
  SPEAKER_00: But they also thought, okay, we're gonna do it, we're gonna deploy to all the 1989 plants that we have in the world.
• 4:34
  SPEAKER_00: But there's an issue here because the the plants need to be, you know, it's a critical infrastructure, so the data cannot live there.
• 4:43
  SPEAKER_00: And they cannot leave the premises, they cannot leave the plan.
• 4:46
  SPEAKER_00: Okay, so well, let's see how we're gonna do it.
• 4:49
  SPEAKER_00: So they they say, okay, we'll figure that out later, but that's our vision, that's what we want to achieve.
• 4:54
  SPEAKER_00: So they started and they found other challenges as well.
• 4:58
  SPEAKER_00: That even that they had the data, it's difficult to get.
• 5:03
  SPEAKER_00: Because in the lab, one of the main issues is that, okay, they have the they they maybe do uh one measure per day or twice.
• 5:13
  SPEAKER_00: So, in order to have enough data, you imagine how much years you need to gather the data out of that.
• 5:18
  SPEAKER_00: Also, the quality of the data, no, because there goes the guy to the lab, get the sample, they put it in the lab, they write in an Excel sheet the time.
• 5:29
  SPEAKER_00: So that was it was done until so it was also an issue.
• 5:32
  SPEAKER_00: They have to clean a lot of data before that.
• 5:34
  SPEAKER_00: Also, a problem with cybersecurity.
• 5:36
  SPEAKER_00: There are plants where you cannot connect, you cannot get the data outside of the plant.
• 5:41
  SPEAKER_00: You actually to get all the data, they have to ship the data in a hard disk in a special place to the laboratory to do everything.
• 5:50
  SPEAKER_00: Another issue is that there's a lot of variability because of the business.
• 5:54
  SPEAKER_00: They don't have the same plant everywhere.
• 5:57
  SPEAKER_00: It's difficult.
• 5:58
  SPEAKER_00: It is different in each one of them because they have concessions, one have been built by somebody else, not from them.
• 6:04
  SPEAKER_00: One has some system, others have other ones.
• 6:07
  SPEAKER_00: So that's difficult.
• 6:08
  SPEAKER_00: So they were all the challenges that they say, but they say, okay, we'll figure that later.
• 6:12
  SPEAKER_00: First of all, let's try to build the model.
• 6:15
  SPEAKER_00: So that's what they did.
• 6:16
  SPEAKER_00: Okay, that's gonna be quite straightforward.
• 6:18
  SPEAKER_00: So they went to the lab and they just installed a computer and they put a mod, they create the model, they had to clean up the data and all that.
• 6:28
  SPEAKER_00: It took them some quite a long time, but they managed to do it.
• 6:31
  SPEAKER_00: They clean it, they they create the model, they say, okay, now I need to connect to the SCADA system.
• 6:37
  SPEAKER_00: So, okay, I need to find a way of connecting it.
• 6:40
  SPEAKER_00: So uh it was a pain to say.
• 6:43
  SPEAKER_00: Well, but they finished, they did it, okay.
• 6:45
  SPEAKER_00: Now let's deploy.
• 6:46
  SPEAKER_00: We have this model, it's working here.
• 6:48
  SPEAKER_00: Actually, we tested, it works very well the model.
• 6:51
  SPEAKER_00: Let's deploy it somewhere else.
• 6:53
  SPEAKER_00: And and that was impossible.
• 6:55
  SPEAKER_00: They said we need to find to find a way to do that.
• 6:58
  SPEAKER_00: So they called us.
• 6:59
  SPEAKER_00: No, they called Barbara.
• 7:02
  SPEAKER_00: And uh the advantage is that we they knew us for some reasons, so we managed to sort out different types of problems that they had to deploy these models.
• 7:13
  SPEAKER_00: These were not the problems or um creating the model itself originally or having the model.
• 7:20
  SPEAKER_00: It were other types of issues, no?
• 7:22
  SPEAKER_00: And here what we sort for them is that we have a central platform that allows them to allow you to get to manage all the different equipment that they have across the different plants.
• 7:33
  SPEAKER_00: So they sort already something, it's gonna be easy to deploy.
• 7:37
  SPEAKER_00: We are based on Dockers, so that's all another advantage because they say, okay, it's gonna be quite standard to deploy everywhere, so I don't need to take care of everything.
• 7:46
  SPEAKER_00: We can uh it's a secure orchestration.
• 7:48
  SPEAKER_00: We take care of the operating system, we take care of the cybersecurity.
• 7:52
  SPEAKER_00: So we also take care of uh upgrading of the model and all that.
• 7:56
  SPEAKER_00: We have all the connectors to connect to the different systems, and for them already also sort that part out because it's getting the real data is complicated.
• 8:05
  SPEAKER_00: And then we at the time we didn't have it, but now we do.
• 8:09
  SPEAKER_00: But basically, it was uh we were able to deploy the mall ops there.
• 8:13
  SPEAKER_00: So, more or less, this is our platform here.
• 8:15
  SPEAKER_00: You see, for a central panel, you see all the different devices that are installed across the wall.
• 8:22
  SPEAKER_00: You can go inside of them and you can deploy the application in a single click.
• 8:26
  SPEAKER_00: Okay, you can deploy a model in a single click.
• 8:29
  SPEAKER_00: And also we have a marketplace full of applications that allows you to do that.
• 8:35
  SPEAKER_00: All the all the uh necessity connections, everything that is around, getting the data, exploited it, and in an industrial environment.
• 8:44
  SPEAKER_00: Because the industrial environments are quite specific.
• 8:48
  SPEAKER_00: So they they have their complications.
• 8:50
  SPEAKER_00: So we have that part, so then we sort it.
• 8:53
  SPEAKER_00: And what we do?
• 8:55
  SPEAKER_00: So the way we propose the solution, it's something like something like this.
• 9:02
  SPEAKER_00: Okay.
• 9:02
  SPEAKER_00: We as I said before, we are just an orchestration platform.
• 9:06
  SPEAKER_00: So we don't actually see the data.
• 9:08
  SPEAKER_00: That's important for cybersecurity.
• 9:11
  SPEAKER_00: All the data stays on the plans.
• 9:13
  SPEAKER_00: The only thing that is on the cloud is the orchestration.
• 9:16
  SPEAKER_00: So we only see that there are things and there are applications that are installed.
• 9:19
  SPEAKER_00: So you hear everything here is installed in an edge device.
• 9:24
  SPEAKER_00: These are bigger edge devices than all these microcontrollers you're talking about.
• 9:29
  SPEAKER_00: So uh some of them were from AdvanTech, another from from Westnater.
• 9:33
  SPEAKER_00: So we we create that part.
• 9:35
  SPEAKER_00: So they put this device here, and then you then can deploy the models, or your own Docker applications, you can deploy the straight away the models, and a lot of other applications that you can deploy, even someone from uh also IE, like YOLO, YAMA, all that, you can deploy stata weight and single click to all the devices.
• 9:53
  SPEAKER_00: And thanks to this type of architecture, and because of the flexibility of the platform, allows them to create different types of use cases.
• 10:00
  SPEAKER_00: So they say, okay, how we're gonna do it?
• 10:02
  SPEAKER_00: They have three different types of models to deploy.
• 10:06
  SPEAKER_00: Originally it was thought to do like uh uh you know a centralized training, so because they already have the model centralized, say we're gonna deploy all the plants.
• 10:17
  SPEAKER_00: That was the first idea.
• 10:19
  SPEAKER_00: But then they realized that they have an issue.
• 10:21
  SPEAKER_00: Every single plan was different.
• 10:24
  SPEAKER_00: So the membrane is different, the sensors are different.
• 10:27
  SPEAKER_00: So the model that they have in the cloud doesn't work.
• 10:30
  SPEAKER_00: They need to have a different model on every plant and a different model for every rack.
• 10:35
  SPEAKER_00: Kind of different work.
• 10:37
  SPEAKER_00: Okay, so one idea was okay, let's do it centralized, a different model, then they have to create 180 times 10, so 900 different models in the cloud.
• 10:50
  SPEAKER_00: That was a pain.
• 10:51
  SPEAKER_00: So, okay, we can do something different.
• 10:53
  SPEAKER_00: Why couldn't we do it local?
• 10:54
  SPEAKER_00: And that's what we propose.
• 10:56
  SPEAKER_00: So we propose a solution that allows them to deploy locally the and to train the models locally.
• 11:04
  SPEAKER_00: I get there.
• 11:05
  SPEAKER_00: And also uh there's another option of being federated, but although we haven't done it, but basically it's similar, no?
• 11:11
  SPEAKER_00: You train the uh centralized, you send it uh to the on-premises, do the inference, then you send the data back to the to the cloud, and you retrain the model that you send over there.
• 11:22
  SPEAKER_00: But it was not the case for them, it was more a local training.
• 11:25
  SPEAKER_00: So, in order to do that, um we do this type of architecture that is quite standard.
• 11:34
  SPEAKER_00: This is not only for them, I will go to them later.
• 11:36
  SPEAKER_00: But basically, it's here.
• 11:37
  SPEAKER_00: Normally we have always this type of architectures that make it very flexible to deploy the models on there.
• 11:44
  SPEAKER_00: So we put a local MQTD broker, this is an H node, right?
• 11:48
  SPEAKER_00: Everything is in the plan, one of one of the racks.
• 11:50
  SPEAKER_00: You put the MQTT broker there, from there you create the connectors.
• 11:54
  SPEAKER_00: Here is one, but you can have any type of connectors.
• 11:56
  SPEAKER_00: So all the data is standard there.
• 12:00
  SPEAKER_00: And then from there you connect the model.
• 12:02
  SPEAKER_00: So the advantage is you have a single place where all the data is concentrated, and from here you can send it also then to another database, you can send it to the cloud.
• 12:11
  SPEAKER_00: This is not for them, but this is more like a generic.
• 12:14
  SPEAKER_00: You have an ML monitoring tool that we also see, so you can see whether you are discontinuing.
• 12:19
  SPEAKER_00: So this is applications that normally at Barvara, the way we deploy normally these models or how we um make them available for everybody, is this type of architecture.
• 12:30
  SPEAKER_00: And that's very flexible because they allow to deploy different models in the same device.
• 12:35
  SPEAKER_00: So um let me go.
• 12:39
  SPEAKER_00: So, what did we do for them?
• 12:40
  SPEAKER_00: There was a little swap here.
• 12:42
  SPEAKER_00: So uh finally, what they started is that the sensor, the debroker, tensor flow, we have uh an influx database for time series locally, and a grafana, it's also to see everything that's happening on the model.
• 12:56
  SPEAKER_00: And then for the local training, that's the one that we're talking before.
• 12:59
  SPEAKER_00: We put also a Jupyter Lab here uh notepad with a Python model that they had it, an ML flow that allows them to have different versions of the model, then they can compare it with the real data at the end of the day, with the and then they can switch and select the best one.
• 13:16
  SPEAKER_00: So we are doing for them a local train uh training uh locally for every one of the racks on every one of the plants, and that allows them to create a specific model for them.
• 13:28
  SPEAKER_00: So that's another interesting use case is for HAI.
• 13:32
  SPEAKER_00: It's not only reducing data um to the cloud, it's not only uh uh lowering costs, it's because you can do it specifically at a different model per each device because the environment is different everywhere.
• 13:53
  SPEAKER_00: So what they manage is that what I mentioned.
• 13:56
  SPEAKER_00: They put the model, they have uh now they are able to do automation uh automated estimation of boron.
• 14:03
  SPEAKER_00: Now, thanks to that, they are reducing the amount of chemicals they need to use.
• 14:07
  SPEAKER_00: And also another advantage is that they can manage all these devices in all the plants locally.
• 14:13
  SPEAKER_00: And now they have like um this is a little bit old now, but they they see more or less all everything here, the different things that are um uh reading, and then they can compare with the real one, what is predicted, what is real, so they they can be sure.
• 14:29
  SPEAKER_00: And also it gives the all the people in the lab, in the lab in the plant the confidence that this AA thing that for them is quite science fiction is real because okay, actually it's actually it's happening, it's it's doing what it was supposed to do.
• 14:49
  SPEAKER_00: So that's uh really helps.
• 14:51
  SPEAKER_00: So how was it the end?
• 14:53
  SPEAKER_00: The impact.
• 14:54
  SPEAKER_00: So yes, super planning one year, they saved more than$200,000 in reducing of chemicals and fines.
• 15:05
  SPEAKER_00: That's important.
• 15:06
  SPEAKER_00: And also the health improves.
• 15:07
  SPEAKER_00: So in three years, it's more than if you put it everywhere, it's like more than 70 million dollars of savings that you may have.
• 15:14
  SPEAKER_00: And also help them to go much, much faster to deploy everywhere.
• 15:19
  SPEAKER_00: So, well, basically that was the idea.
• 15:22
  SPEAKER_00: So now because I'm uh SAT and the VP of sales, so I need to do some sales selling here.
• 15:27
  SPEAKER_00: So why Barbara?
• 15:29
  SPEAKER_00: Actually, we are a great solution because allows every uh the industrial companies to have security that the they're gonna we're gonna we're gonna have distributed equipment that is secure and we can manage from a central platform, and we are very uh focused in the cybersecurity.
• 15:49
  SPEAKER_00: That's this thing I6 ASC62443 uh recommendation of cybersecurity that makes that uh uh the the equipment has everything is encrypted, encrypted boot, no open ports, all that.
• 16:04
  SPEAKER_00: So we comply with that part.
• 16:05
  SPEAKER_00: That's the part with Barbara that we mentioned before.
• 16:08
  SPEAKER_00: We are edge native solutions, so we are cloud agnostics, you can integrate with any type of cloud.
• 16:14
  SPEAKER_00: We are hardware agnostic, we can deploy any type of hardware, normally any type of micro uh microprocessor hardware, no microcontrollers yet.
• 16:22
  SPEAKER_00: We are tailored for the OT environment, so we have more than 100 OT applications ready.
• 16:28
  SPEAKER_00: So we can be very flexible, we can integrate with different systems, we can deploy other tools.
• 16:34
  SPEAKER_00: I didn't mention, but that was the first use case, but now they were putting tools on top of that.
• 16:39
  SPEAKER_00: They are using our infrastructure also to deploy the traditional OT tools that they do, and for them it was a pain to do that everywhere.
• 16:47
  SPEAKER_00: So now from a central point, they can put it everywhere.
• 16:50
  SPEAKER_00: We are AA focused, actually.
• 16:52
  SPEAKER_00: We we were doing this like three years ago.
• 16:55
  SPEAKER_00: We were HAI before anybody was like, it was a buzzword at the moment.
• 17:00
  SPEAKER_00: We'll say, okay, we are doing already AI at the edge.
• 17:03
  SPEAKER_00: And it was interesting because it's it was driven by the customer needs.
• 17:07
  SPEAKER_00: It was not something that we thought it was a good idea.
• 17:10
  SPEAKER_00: And also UX orientation.
• 17:13
  SPEAKER_00: Um it's a pity I haven't been able to do a demo because well, the computer is over there and they don't allow me to do it.
• 17:20
  SPEAKER_00: But it will be great if you guys talk to me and we go and do a demo.
• 17:24
  SPEAKER_00: Even if it's an OT tool, it's very easy to deploy.
• 17:27
  SPEAKER_00: Deploy an application, deploy A models, all that.
• 17:30
  SPEAKER_00: It's a single clip and it's already embedded.
• 17:32
  SPEAKER_00: So, well, still we have a free trial here.
• 17:35
  SPEAKER_00: So if anybody wants to access that and connect, we will be gladly um do uh a demo for you, create a trial account so you will be able to access it.
• 17:47
  SPEAKER_00: So that's it.
• 17:48
  SPEAKER_00: Thank you.