![Image by Leo Moko](https://static.wixstatic.com/media/nsplsh_685f5555465a473276486f~mv2_d_5184_2310_s_2.jpg/v1/crop/x_0,y_50,w_2128,h_2209/fill/w_470,h_488,al_c,q_80,usm_0.66_1.00_0.01,enc_auto/Image%20by%20Leo%20Moko.jpg)
IndyCar
Real-time anomaly detection from edge to HPC-cloud in collaboration with Indycar and Intel.
Introduction
With the growth of the Internet of Things, we see an increase in importance of the analysis of data from the edge with often the results needed in real time. Indy Car series is one of the top racing series in North America. All cars are equipped with multiple cameras. The video streams captured by these cameras can be used for detection and predictive tasks to increase race safety, develop better strategies for the teams to win the race. Furthermore, sensor's data can be used as the telemetry data to provide better analysis and predictions for the drivers and the teams.
In video image analytics, anomaly detection and prediction tasks start with object detection. We create new datasets and compare three different Single Shot Multibox Detector models from TensorFlow Detection Model Zoo. We run experiments on CPU and GPU, and test mobile detection models on an Edge TPU, which is Google Coral Dev Board. Our initial results show that the Edge TPU gives the best inference time, and it is more suitable for a real-time machine learning task.
Objectives
![1gF7k0PvNIjn0ETNbzOzQt5zG7mcF6SNTxiQSrq1](https://static.wixstatic.com/media/078a65_831d6726d86440cd9f172e3f538e2c9e~mv2.jpeg/v1/fill/w_978,h_387,al_c,q_85,usm_0.66_1.00_0.01,enc_auto/1gF7k0PvNIjn0ETNbzOzQt5zG7mcF6SNTxiQSrq1.jpeg)
Equipment Malfunction Prediction and Alerts
Anomaly prediction can help engineers identify issues in the hardware before they become serious. Especially at the speed at which these cars travel, small issue can quickly snowball to become catastrophic.
![wire.jpg](https://static.wixstatic.com/media/078a65_97110942e95842649a94790c7dda42ef~mv2.jpg/v1/crop/x_0,y_2,w_612,h_404/fill/w_354,h_234,al_c,q_80,usm_0.66_1.00_0.01,enc_auto/wire.jpg)
![WhatIsIndyCar2018.jpg_la=en&vs=1&d=20180](https://static.wixstatic.com/media/078a65_48379c2f4d6d4e238c4e532efcb398c8~mv2.jpg/v1/fill/w_396,h_243,al_c,q_80,usm_0.66_1.00_0.01,enc_auto/WhatIsIndyCar2018_jpg_la%3Den%26vs%3D1%26d%3D20180.jpg)
Recommendations with Evolving Driving Conditions
Track conditions are ever evolving, from humidity, ambient temperature and track temperature. All of these factors affect the way on-board systems perform in different ways. It can be hard for a human to take appropriate action at the appropriate time with such gradual change.
Prototype
Performance Tuning During Practice
Performance of hardware can be tuned to minute degrees based on insights provided by AI systems which can go beyond the level of pattern recognition capable by humans.
![dsc07930-e1571347891121.jpg_w=610&h=343&](https://static.wixstatic.com/media/078a65_0b73d13942d5489185c9602530a86e3b~mv2.jpg/v1/fill/w_402,h_226,al_c,q_80,usm_0.66_1.00_0.01,enc_auto/dsc07930-e1571347891121_jpg_w%3D610%26h%3D343%26.jpg)
Blogs
![Peek 2020-01-26 21-40.gif](https://static.wixstatic.com/media/078a65_15eccf64b08b47119864f1effd185588~mv2.gif)
![Peek 2020-01-26 21-35.gif](https://static.wixstatic.com/media/078a65_a23dc3063800474cb831e827b2b017ca~mv2.gif)
![demo_ano.gif](https://static.wixstatic.com/media/078a65_6f76da83593b4369959637f5a7edec5b~mv2.gif)