Training the Right ML Model and Training the ML Model Right
摘要
Future intelligence, surveillance, reconnaissance, and targeting capabilities will rely on Artificial Intelligence/Machine Learning (AI/ML) to support time critical missions including indications and warning intelligence preparation of the battlespace, and real-time targeting. Historically, exploitation and analysis of imagery have relied entirely on the expertise of trained analysts. Today, however, the volume of sensor data and the shortened timelines for decisions are driving us towards greater automation. At the same time advances in AI/ML capabilities are providing tools to assist analysts in meeting these missions. For many basic image analysis tasks, such as object detection or object classification, multiple models might be available to process imagery for a given mission. Which model is the best choice for the mission? Our research demonstrates that seemingly similar deep learning methods can yield different performance results. Furthermore, our investigations demonstrate differences due to the choice of training data. The team propose methods for evaluating the training data and the model framework relative to the mission imagery, which leads to a natural strategy for model selection. Using several popular object detection methods applied to multiple data sets, we will present: