Latest / EDGE AI POD / Simple Cost Effective Vision AI Solutions at the edge

Transcript

Simple Cost Effective Vision AI Solutions at the edge · EDGE AI POD

• 0:07
  Speaker 1: So my presentation is going to focus on the sensor.
• 0:10
  Speaker 1: As you may know, sony is leader in image sensor, but this new image sensor that we have is even different than what we had before.
• 0:18
  Speaker 1: So the sensors that we had before it was just an image sensor.
• 0:22
  Speaker 1: The new one that we have not only is an image sensor, it has AI integrated with it, so it makes it what Edge device, so you can do inferencing right on the device.
• 0:34
  Speaker 1: I don't think anybody talk about silicon sensor having AI.
• 0:39
  Speaker 1: So this is what Sony is bringing to Edge and is trying to bring some solution for smart applications.
• 0:50
  Speaker 1: So let's talk about what is this sensor, this sensor called IMXY500.
• 0:56
  Speaker 1: Imxy500, we work with different OEM companies to package this camera, so we are open.
• 1:03
  Speaker 1: If you are an OEM company, you want to partner with us, please come, come talk to us.
• 1:07
  Speaker 1: And then we have a platform called iTrios.
• 1:10
  Speaker 1: Itrios is a platform that you can build your vision solution end-to-end.
• 1:15
  Speaker 1: What does it mean?
• 1:16
  Speaker 1: It means you have your camera, you take pictures, you build your data set, you have your data set, you need to train it.
• 1:23
  Speaker 1: You train your data set and if you are happy with it, if the performance is good, you deploy it on the device After you deploy it on the device.
• 1:32
  Speaker 1: That's not the end of the story, because we want to deploy like 10,000, 100,000 of devices.
• 1:39
  Speaker 1: Then what do you need?
• 1:40
  Speaker 1: Device managers, then you need to connect to the cloud.
• 1:43
  Speaker 1: So the full path from the pictures all the way to deployment, scaling the solution.
• 1:51
  Speaker 1: You can use our ITRIOS platform, but this is not just a platform, this is not just a sensor like any other edge devices.
• 2:02
  Speaker 1: The significant features that you have for IMX 500 and this platform is what you see on this side.
• 2:09
  Speaker 1: First of all is high speed, because it's at the edge, of course, right, we are all here because of the edge, right?
• 2:14
  Speaker 1: So this is at the edge.
• 2:16
  Speaker 1: And also is low bandwidth and low power.
• 2:19
  Speaker 1: This is very interesting because I've heard a lot of people talking about low power.
• 2:23
  Speaker 1: I want to have it like low bandwidth because it's expensive.
• 2:27
  Speaker 1: How we achieve that?
• 2:28
  Speaker 1: Because we don't send the image, we send the metadata.
• 2:32
  Speaker 1: So look at the size that's shrinking to just, you know, a few kilobytes.
• 2:37
  Speaker 1: So this is what is good about IMX 500.
• 2:41
  Speaker 1: And the last thing is, when you send metadata, you don't send the full pictures.
• 2:46
  Speaker 1: I have an application, I have people.
• 2:48
  Speaker 1: They don't want the identity to be out there.
• 2:51
  Speaker 1: So with the metadata that you send out there, you also protect their privacy.
• 2:56
  Speaker 1: So this is the overview of IMX 500.
• 3:00
  Speaker 1: Now you know the sensor, you know the platform.
• 3:03
  Speaker 1: Let's talk about some of the applications that you can.
• 3:07
  Speaker 1: Oh, my God, if I can figure this thing out Now.
• 3:11
  Speaker 1: It's going fast, okay.
• 3:14
  Speaker 1: Okay, sorry about that, I'm not Okay.
• 3:24
  Speaker 1: So these are some applications that I put out there Today.
• 3:29
  Speaker 1: I'm going to focus only on smart city.
• 3:32
  Speaker 1: Okay, but this is a smart eye.
• 3:35
  Speaker 1: You want to do an application for retail?
• 3:38
  Speaker 1: Go for it.
• 3:39
  Speaker 1: You want to do some application for logistic?
• 3:43
  Speaker 1: Go for it.
• 3:43
  Speaker 1: So this is like anywhere that you need to have a smart eye application, you can use IMX 500.
• 3:50
  Speaker 1: But today we are going to talk about smart city, and smart city is kind of like now we see a lot of attention.
• 4:02
  Speaker 1: We wanted to make our city more smarter and we are looking at some applications that we can deploy and, as you may know, this smart city application is not only one or two, it's the whole city.
• 4:13
  Speaker 1: So then you need to be wise.
• 4:17
  Speaker 1: How you install this, what is the cost of your solution?
• 4:21
  Speaker 1: Let's talk about what is available today.
• 4:24
  Speaker 1: If you look at the conventional system that is available today, you see the IP camera and it's bundled with a GPU, right.
• 4:34
  Speaker 1: And then, right there, gpu is very expensive, right?
• 4:37
  Speaker 1: So GPU, and then, when you have this, it has to go outside.
• 4:41
  Speaker 1: When it goes outside, you need to protect it from rain, from sun, from snow and all of those things.
• 4:50
  Speaker 1: So, as you see in the bottom, you have to put it in a box.
• 4:53
  Speaker 1: You have to do some kind of structure to protect it.
• 4:57
  Speaker 1: Look at that.
• 4:58
  Speaker 1: That's cost, cost, cost, right.
• 5:00
  Speaker 1: But now Sony is just giving a solution all in one.
• 5:05
  Speaker 1: What does it mean?
• 5:06
  Speaker 1: So, as you see here, we partner with Leopard and we built this camera.
• 5:12
  Speaker 1: So this camera has two sensors and these two sensors you can adjust the angles when you install it.
• 5:19
  Speaker 1: It's not a remote controller, but you can adjust the angle mood controller, but you can adjust the angle.
• 5:28
  Speaker 1: And also, it's very easy to deploy, because in the city it's not easy to just go on top of a light and just install this.
• 5:31
  Speaker 1: But this has brackets.
• 5:33
  Speaker 1: You can just put it on the post, it can go vertical, it can go horizontal, so it's very easy to deploy.
• 5:40
  Speaker 1: I told you it's low power, because this is metadata when it's low power, it means that I can get the power.
• 5:46
  Speaker 1: It's not power hungry like a GPU, so that's another good thing.
• 5:51
  Speaker 1: And also metadata, so we have privacy for protecting your identification.
• 5:58
  Speaker 1: It's most of the city application you see people walking around right and also is very low cost.
• 6:05
  Speaker 1: So, god, help me going to the next slide.
• 6:08
  Speaker 1: Oh, perfect, I'm learning.
• 6:09
  Speaker 1: Okay, so now the good news is that's not just a solution that I told you.
• 6:14
  Speaker 1: Now, this solution has been released by Leopard, so okay, so this has been deployed, and this has been deployed in the city of San Jose.
• 6:26
  Speaker 1: And also, this is easy to install.
• 6:28
  Speaker 1: It has all of these good, significant features that I mentioned earlier.
• 6:33
  Speaker 1: So Leopard is releasing this.
• 6:35
  Speaker 1: This is available.
• 6:36
  Speaker 1: But you are not only limited to applications that we have right now for a smart city.
• 6:47
  Speaker 1: Okay, so you can.
• 6:55
  Speaker 1: Now we have, like, traffic accounting or we have pedestrian or we have road safety, but this is a very open platform.
• 7:03
  Speaker 1: You can deploy any model.
• 7:05
  Speaker 1: I told you you can take pictures with model.
• 7:07
  Speaker 1: If you have your own model, that's okay, bring it in, you can deploy it.
• 7:11
  Speaker 1: You can build your solution.
• 7:13
  Speaker 1: So any application can be deployed on that Leopard device that I told you, and now I have a very good example.
• 7:23
  Speaker 1: This is actually concerning the safety.
• 7:25
  Speaker 1: So in the city of Lakewood in Colorado, they were concerned because in the stretch of one mile of the road they had a lot of fatality, a lot of accidents.
• 7:36
  Speaker 1: And then the city was concerned and they wanted to find a solution.
• 7:40
  Speaker 1: They didn't care if the solutions are from Sony, it's from NVIDIA, it's from who.
• 7:44
  Speaker 1: They didn't care, they just wanted to find a solution and avoid this fatality in that area.
• 7:49
  Speaker 1: What they did?
• 7:50
  Speaker 1: They compared four solutions.
• 7:52
  Speaker 1: If you look at here, the first solution was LDAR and Edge application.
• 7:57
  Speaker 1: Two companies participated in this and then this.
• 8:01
  Speaker 1: So the third solution was camera and Edge application, and so this is another solution that they have, and the last one was Sony.
• 8:11
  Speaker 1: Among all this, sony performed 100%, and you think, okay, 100%, how much do I have to pay for it?
• 8:18
  Speaker 1: It was less expensive than all other solutions.
• 8:23
  Speaker 1: So you see that it's not just a smart city, it's not me offering technology, I'm saving people's lives.
• 8:30
  Speaker 1: So this is a very good story I wanted to share with you.
• 8:33
  Speaker 1: I want to go to my last slide.
• 8:35
  Speaker 1: Then I turn it over to my best friend here, vijay.
• 8:37
  Speaker 1: So now, so far you learn about the camera, about all this great team's performance, but what I told you, remember?
• 8:45
  Speaker 1: I said this is a very low power device.
• 8:47
  Speaker 1: What does it mean?
• 8:48
  Speaker 1: All the lights that you have outside, it has power If you can connect to the power and network from the light.
• 8:55
  Speaker 1: What do you do?
• 8:56
  Speaker 1: You make it less expensive.
• 8:58
  Speaker 1: Deployment is going to be easier, installation is going to be easier and the magic of that is coming from iTron.
• 9:05
  Speaker 1: So iTron has this possibility.
• 9:08
  Speaker 1: They have an adapter that they can basically give us this possibility to deploy our cameras, connect them to the power and the network, and then we can build like mesh type of group of this network of these devices and deploy it.
• 9:23
  Speaker 1: Please come.
• 9:24
  Speaker 1: Thank you so much.
• 9:26
  Speaker 1: Oh, let me mention this.
• 9:27
  Speaker 1: So tomorrow we have another talk about Sony, but we are talking, we are focusing on manufacturing.
• 9:33
  Speaker 1: If you are interested, it as 2015.
• 9:35
  Speaker 1: Also, for the smart city, we have a full webinar happening with HAI Foundation on April 29.
• 9:41
  Speaker 1: It's going to be announced on their page, so please join us If you have questions at all.
• 9:46
  Speaker 1: We are in the corner, so I'm going to pass.
• 9:48
  Speaker 1: Sorry if I took so much of your time.
• 9:50
  Speaker 1: Okay, thank you so much, vijay.
• 9:53
  Speaker 1: Do you think, testing, testing?
• 10:00
  Speaker 2: Testing.
• 10:00
  Speaker 2: Yeah, it's working.
• 10:01
  Speaker 2: Good Good morning.
• 10:03
  Speaker 2: And as we started to work with Sony a couple years ago on this solution and this basically will provide you how this can be deployed in real life here I see a sign connecting AI to real world, and so here's one of the examples we'll give you that how this gets connected, and we've been in this business from connecting devices, whether it's lighting controls or other kind of sensors and all that.
• 10:33
  Speaker 2: But joining that with Sony on the AI side actually opens up a lot more opportunities than originally when we started this whole thing together.
• 10:43
  Speaker 2: So my name is Vijay and I'm a product manager at.
• 10:51
  Speaker 2: My name is Vijay and I'm a product manager at ITRON.
• 10:55
  Speaker 2: I've been working on smart city smart lighting projects for many, many years, so adding this thing actually became much more interesting for me as well on the project side.
• 11:07
  Speaker 2: So first is, what is the challenges that cities are seeing?
• 11:10
  Speaker 2: Why do cities want any kind of sensors?
• 11:14
  Speaker 2: What challenges they have?
• 11:15
  Speaker 2: So, as you can know, the climate continues to change and I just have a list about four or five items that cities sees these as a challenges.
• 11:27
  Speaker 2: I don't wanna read through the slides, every word, but you can.
• 11:30
  Speaker 2: You'll get the presentation later.
• 11:32
  Speaker 2: But the idea behind is that cities are seeing real problems, that they need to have sensors deployed in the cities.
• 11:40
  Speaker 2: How, basically, can the smart city come through?
• 11:46
  Speaker 2: So here's the challenges.
• 11:50
  Speaker 2: And then what are the opportunities?
• 11:52
  Speaker 2: How do we, as a technologist technology companies, how can we solve that?
• 11:58
  Speaker 2: So?
• 11:59
  Speaker 2: So, introducing the solution that we provide to the cities First is obviously there has to be devices and sensors.
• 12:15
  Speaker 2: You start with that.
• 12:16
  Speaker 2: That's where the data collection starts.
• 12:17
  Speaker 2: Then intelligent connectivity Even if you have a sensor in one location, you gotta get the data somewhere.
• 12:26
  Speaker 2: So intelligent connectivity is the next important feature Business intelligence why would customer pay for all these things?
• 12:37
  Speaker 2: So they have to have understanding of, okay, what data I'm getting, how it's going to help me in overall solving the problem.
• 12:44
  Speaker 2: And now, no one company can build all the products.
• 12:51
  Speaker 2: We.
• 12:51
  Speaker 2: We know that and that's been our motto from day one.
• 12:54
  Speaker 2: We always bring the whole ecosystem of companies together and then go approach the customer to solve the challenges that earlier I talked about.
• 13:06
  Speaker 2: So that's where our overall when we say ITRON, cityed, city edge is what that is taking all the solution and combining that.
• 13:20
  Speaker 2: So we, we have been focusing on smart city applications for the last five, seven years and we basically have defined five major domains smart, smart lighting we've been doing that for almost 15 years now and a lot of cities have already deployed that.
• 13:40
  Speaker 2: And then customers come back and say we want to add more beyond the lighting only, and that's where, basically, we start to add more and more sensors in the field with existing networks.
• 13:53
  Speaker 2: So the next one is traffic and highways.
• 13:55
  Speaker 2: This is where one of the partnerships with Sony has come together to make it much more AI-based solution available in the market.
• 14:06
  Speaker 2: Public safety is also it will be part of the AI solution that's working with Sony, and then a few other ones I have.
• 14:15
  Speaker 2: We have environmental sustainability, where the floods and air quality things come together, and a lot of our customers are utility customers, so they worry about the water metering and electricity and all the utility kind of applications.
• 14:32
  Speaker 2: So this all comes into one platform and I can show you the architecture-wise how different devices in the field gets deployed.
• 14:44
  Speaker 2: And then there's an ITRAN, intelligent Edge operating system where it takes the data and then go to the actual applications.
• 14:53
  Speaker 2: That customer will be seeing what what customers need to try to solve, solve the challenges.
• 15:00
  Speaker 2: It looks like a little messy picture, but you can see what.
• 15:04
  Speaker 2: How the mesh networks work is that on the on the street light, you have the controller on the top and then you can add different sensors depending on what the needs of the customers are.
• 15:18
  Speaker 2: It could be eye camera, it could be sensors, it could be flood sensors, weather stations a number of different applications can be put on and then, once it's connected, the data comes to the controller.
• 15:30
  Speaker 2: Then it's a mesh network.
• 15:32
  Speaker 2: Intelligently, it takes the data and sends that to the back office.
• 15:37
  Speaker 2: Once the data is in the back office, then the intelligent applications can be built to provide the right outcome to the customers.
• 15:44
  Speaker 2: So how does it get connected?
• 15:51
  Speaker 2: You can see we have a little demo outside, and showing Simply is that Luminaire has the socket, what we call a seven pin, and then we're basically adding the adapter.
• 16:05
  Speaker 2: The controller is already there.
• 16:06
  Speaker 2: A lot of cities have already deployed that.
• 16:09
  Speaker 2: You just add the adapter, which basically connects to the different sensors.
• 16:13
  Speaker 2: Let's say this case is the AI camera.
• 16:15
  Speaker 2: It provides the power to the camera as well as picks up the data.
• 16:20
  Speaker 2: Once the data is picked up from there then goes to the mesh network and to come to the back software application where all this data can be metadata, as she talked about.
• 16:30
  Speaker 2: Metadata is available and then can be used for the challenges that customers are seeing on whether there's a flooding, whether it's a traffic, whatever the problem is.
• 16:42
  Speaker 2: So, in summary, adding the AI devices on the edge becomes on the smart city applications.
• 16:54
  Speaker 2: It becomes much easier.
• 16:55
  Speaker 2: Simplified installation you don't have to bring.
• 16:59
  Speaker 2: One of the major problem customers see is that how do you provide the power to these sensors?
• 17:05
  Speaker 2: So now we basically we're providing this network already on the street lights so we can take the power from there make the installation much, much simpler.
• 17:14
  Speaker 2: Powering the device IoT devices some cases could be, you know, few watts of power, could be, you know, some milli watts of power, doesn't matter, all the powers you know makes it much, much simpler.
• 17:26
  Speaker 2: You use the existing network from a communication point of view, so you don't really have to set up a new communication setup.
• 17:33
  Speaker 2: Communications setup was already there and it's a scalable expand I was showing on the mesh network.
• 17:41
  Speaker 2: This number of different devices can go on exactly the same network and the data can decipher at the back end which application, what problem is being solved and at the end is really the thing is low cost of ownership Is at the end.
• 17:55
  Speaker 2: To deploy tens of thousands of these sensors in the field has to be low enough cost, because the budget for every city is very tight and providing the total lower cost of ownership makes it much more useful for the customer as well as for all of our citizens.
• 18:14
  Speaker 2: And, like I said, we have a little demo area.
• 18:18
  Speaker 2: You can come and see what applications we're working on and that's basically what my if there's any questions, you can come up also and we can answer.
• 18:27
  Speaker 2: Thank you,