Latest / EDGE AI POD / Synthetic Data For Smarter Vision

Transcript

Synthetic Data For Smarter Vision · EDGE AI POD

• 0:07
  SPEAKER_01: Hi everyone, my name is Sherry List, and I'm co-founder and CEO of a startup called Synthetic AI Data.
• 0:20
  SPEAKER_01: So judging by the name, we are actually a synthetic data provider for training computer vision model.
• 0:30
  SPEAKER_01: So we know the pain, and then we decided to come up with some cure for that.
• 0:36
  SPEAKER_01: We are based in Copenhagen, Denmark, and we actually that we are we have a platform, we have an engine that we are working on it for about uh three years.
• 0:48
  SPEAKER_01: And um our startup is um kind of backed by Microsoft Ware startups and VIDIA inception program, and also we got a grant from Innovation Fund Denmark, which is uh like a um uh governmental grant from uh from a country.
• 1:08
  SPEAKER_01: So uh we also um last year we won a Microsoft uh partner award in a category of um startups uh because of our innovative way to solve uh this problem.
• 1:24
  SPEAKER_01: So um about our actually um our solution, uh as I mentioned that we actually that we have um we have a platform, we have an engine that uh with our engine, our customers, they are they can they can create the scene that they want in our platform, and then um they can easily without uh any hassle train uh actually generate the annotated data.
• 1:54
  SPEAKER_01: So uh we chose the approach to the approach to make sure that our platform is a no-code solution, so anyone can actually use that uh to generate the data.
• 2:06
  SPEAKER_01: Because we believe that um in fe in future, actually not even in future, but currently all of our teams they are fusion teams.
• 2:15
  SPEAKER_01: So it consists of people with a with a technical background, with a developer background, and also business background.
• 2:21
  SPEAKER_01: So we should make sure that everyone is able to uh is able and empowered to actually that to uh to generate this data.
• 2:32
  SPEAKER_01: And of course, we all agree that uh AI needs a lot of data.
• 2:40
  SPEAKER_01: And currently, the way that people and all of us we are generating the um data for training AI is that we need to spend so much of a time to collecting the data.
• 2:54
  SPEAKER_01: Once we collect the data, we need to annotate it, and then that annotation and collection is time consuming, and it's a very most of the time it's a very manual process.
• 3:04
  SPEAKER_01: And we all know that as human we make mistakes, and in this case, this mistake costs us uh the accuracy of uh our model.
• 3:15
  SPEAKER_01: And uh that's why that we believe that the solution for that is synthetic data.
• 3:22
  SPEAKER_01: So synthetic data is the data that is generated by simulation, by computer algorithm.
• 3:29
  SPEAKER_01: They are very much like real-world data, uh, but they are uh in reality is they've been synthesized.
• 3:38
  SPEAKER_01: And the good thing about it is that since it is generated by computer, it's all it's out of the box comes with all the annotation data.
• 3:47
  SPEAKER_01: So you can have the segmentation, you can have the all the uh points for the uh for the object detections and so on without doing any extra work.
• 3:58
  SPEAKER_01: And um also, as you can see, that for example in this picture, uh since this scene is generated by um actually that is a is a synthetic scene, so you can have even more than one object in each picture.
• 4:15
  SPEAKER_01: So you can fine-tune it because it's your uh because it is this is what you actually that you have all the control over it, so you can have all of this annotation out of the box.
• 4:26
  SPEAKER_01: And um one thing is that we are not the one that we say that, hey, synthetic data is the future.
• 4:33
  SPEAKER_01: So Gartner is also saying that by the 2030, almost all the data that is being fueled for for AI model is being uh is actually all of this data that we use for training the model is fueled by synthetic data.
• 4:50
  SPEAKER_01: And uh so in reality, you cannot have accurate data and develop perform data without using synthetic data.
• 5:00
  SPEAKER_01: And in our actually, in our company, we have um our focus is on uh mostly defect detection, because we know that that's an area that uh most of the uh actually that the the industry is uh lacking the data.
• 5:19
  SPEAKER_01: So just imagine um that, for example, if you want to make sure that you want to train a model for uh finding the defect in this clicker, how much of a different types of defect this clicker could have.
• 5:33
  SPEAKER_01: And then how much of a time you need to spend in order to create this defect to and take a picture and then annotate the picture to be able to have a welfare-performed model.
• 5:47
  SPEAKER_01: And that is why that we chose to actually that to have this as the focus of our um our company.
• 5:56
  SPEAKER_01: And I'm going to hand it over to Goran to actually show us uh some of the recent uh project that we did.
• 6:06
  SPEAKER_00: Hello, my name is Goran, and um I'm co-founder and city of uh Synthetic AI Data.
• 6:13
  SPEAKER_00: And uh recently we became uh strategic partner of HAI Foundation.
• 6:19
  SPEAKER_00: That's why we are here today.
• 6:21
  SPEAKER_00: And um together with their uh data working group, we discussed some use cases like what problem in industry we could tackle, and uh we decided to go after this um problem of metal and aluminium cans.
• 6:40
  SPEAKER_00: We all know how they look like they are for beverages and food, and um they are used nowadays uh in industry a lot because they are easily transportable, uh they are durable and uh highly recyclable, like uh 90 to 95 percent of these cans is recycled.
• 7:03
  SPEAKER_00: The thing with with the cans uh that you maybe don't know, it's a huge industry.
• 7:11
  SPEAKER_00: Uh there is 627 billion units produced each year, and uh that approximates into 1.72 billion cans per day being produced out there.
• 7:26
  SPEAKER_00: So it's a pretty huge industry.
• 7:28
  SPEAKER_00: And um just in uh US uh in 2020, it was produced 120 billion of cans.
• 7:38
  SPEAKER_00: Um in Europe there is something around 100, China is 75, and so on.
• 7:45
  SPEAKER_00: So uh huge global industry, and projections are also that this will grow from 120 to 173 by 2030.
• 7:56
  SPEAKER_00: This industry is um yeah, steadily growing over the years.
• 8:02
  SPEAKER_00: Um challenges with metal and aluminum cans in the in the production is um that those cans could have the broken tabs, could have missing tabs and lifted tabs, and this is basic functionality that we actually need to be able to open the can, right?
• 8:22
  SPEAKER_00: So we want to be able to detect is this can correct or it's not.
• 8:29
  SPEAKER_00: For this purpose we decided to develop a dataset, and I will show you through slides some of the pictures from from this dataset.
• 8:41
  SPEAKER_00: Um here what you can see is um standard beverage can.
• 8:47
  SPEAKER_00: Imagine cola or beer, that those are the cans.
• 8:52
  SPEAKER_00: But if you look a bit closer, like those cans are a bit different, depends on the on the top cover, right?
• 9:00
  SPEAKER_00: And they also have the different opener tab on top for all of them.
• 9:08
  SPEAKER_00: They come, this is as I said, standard one for the drinks.
• 9:13
  SPEAKER_00: Then there is a slick version, which is used for energy drinks mostly.
• 9:18
  SPEAKER_00: You'll probably also see those a lot.
• 9:21
  SPEAKER_00: Then there are slim versions, then there are stubby versions.
• 9:25
  SPEAKER_00: All those scans come in many different materials, and tabs come in many different colors.
• 9:32
  SPEAKER_00: So here showing you some of the variations.
• 9:37
  SPEAKER_00: And what you are looking over here are synthetic images generated by simulation on our platform.
• 9:44
  SPEAKER_00: This was for standard, then uh also some preview of variations for the for the slick version of cans, slim, stubby, a lot of a lot of those variations.
• 9:59
  SPEAKER_00: Uh in this data set, as we were saying, we are focusing a lot on the defect detection and simulating actually the defects.
• 10:09
  SPEAKER_00: And here you can see one example of a defect, like this is correct picture, and on the right, there is a defect, right?
• 10:16
  SPEAKER_00: This tab is bent.
• 10:18
  SPEAKER_00: This could happen in in uh production, and this is something that we want to detect.
• 10:24
  SPEAKER_00: Um it might sound easy if you haven't worked with the computer vision, like how to test the defects and such, but I can give you one example of one enterprise company that had a model in production not for this purpose, but for their product being uh able to detect the defects.
• 10:42
  SPEAKER_00: And the way they trained their their model, they took they took a lot of um a lot of their products, their data scientists took screwdrivers, damaged those products, took pictures, and then trained the model, right?
• 10:55
  SPEAKER_00: We don't want data scientists to run around with screwdrivers, and we don't want them to break down our products, that's not sustainable, so it's much better to run simulations and create the defects.
• 11:07
  SPEAKER_00: Uh few more examples of defects.
• 11:12
  SPEAKER_00: Also, example of a bent tab, another variation of a bent tab.
• 11:21
  SPEAKER_00: A few more previews here from the from the different versions.
• 11:29
  SPEAKER_00: Um this is uh preview of a broken tabs that can also happen.
• 11:37
  SPEAKER_00: So in the dataset, there is simulation of the broken and bent tabs, as you can probably see.
• 11:45
  SPEAKER_00: I hope that you can like tab is half broken over here.
• 11:51
  SPEAKER_00: In the dataset, there are beverages, there are food cans also.
• 11:54
  SPEAKER_00: Food cans come in many different shapes, they also come with different uh tabs on top, they come with uh in uh different materials, tabs can be in different materials and so on.
• 12:10
  SPEAKER_00: During the generation of data set, I was showing you now just uh top view and one orientation of the can.
• 12:21
  SPEAKER_00: During the generation, we generated uh images from many different angles, rotating those cans.
• 12:29
  SPEAKER_00: And uh maybe pictures are too small over here to be visible, but you'll have access to that data set.
• 12:36
  SPEAKER_00: Feel free to check it out.
• 12:38
  SPEAKER_00: There are different lightnings and shadings on those images, so light reflects uh differently on those pictures from the can since we have the metal surface, and also the the shadows are falling differently.
• 12:54
  SPEAKER_00: In um production, we could inspect the cans in two ways, with camera from the top looking down, 90 degrees, right?
• 13:04
  SPEAKER_00: But we could also inspect it on the side because from the side it's easier to catch some defects such as can being bent.
• 13:12
  SPEAKER_00: So uh all those synthetic images are generated with uh also in a different view with uh camera angle, and here you can see that those tubs are tubs are bent.
• 13:27
  SPEAKER_00: Maybe this one would be easy to detect from top, but this one probably wouldn't because it's not bent so much.
• 13:36
  SPEAKER_00: Where we ended up is uh generating the world's largest CAN synthetic data uh synthetic images dataset, uh resulting in 3 million images, 2.985600 images, uh 267 gigabytes.
• 13:59
  SPEAKER_00: Uh this dataset will soon be available at the HAI Foundation uh AI labs, so you can go over there and download the dataset and inspect it.
• 14:10
  SPEAKER_00: We look forward to see what people will build on top of it.
• 14:15
  SPEAKER_00: Um all images are available in high and low resolution.
• 14:21
  SPEAKER_00: Uh they are fully annotated in uh Coco, IOLO, TensorFlow, and uh some other formats, so being uh ready to be used for training the model, and they will be available under the Creative Commons Zero license so you can build applications on top of it.
• 14:44
  SPEAKER_00: Um yeah, so um I would wrap up here and would be happy to hear your questions.