Business

August 31, 2018
 

Raytheon developing system that lets artificial intelligence explain itself

Under the Defense Research Project Agency’s Explainable Artificial Intelligence program, Raytheon BBN Technologies is developing a first of its kind neural network that explains itself.

The XAI program aims to create a suite of machine learning techniques that produce more explainable models while maintaining a high level of performance. It also aims to help human users understand, appropriately trust and effectively manage the emerging generation of artificially intelligent partners.

Raytheon BBN’s Explainable Question Answering System will allow AI programs to ‘show their work,’ increasing the human user’s confidence in the machine’s suggestions. “Our goal is to give the user enough information about how the machine’s answer was derived and show that the system considered relevant information so users feel comfortable acting on the system’s recommendation,” said Bill Ferguson, lead scientist and EQUAS principal investigator at Raytheon BBN.

EQUAS will show users which data mattered most in the AI decision-making process. Using a graphical interface, users can explore the system’s recommendations and see why it chose one answer over another. The technology is still in its early phases of development but could potentially be used for a wide-range of applications.

“A fully developed system like EQUAS could help with decision-making not only in DOD operations, but in a range of other applications like campus security, industrial operations and the medical field,” said Ferguson. “Say a doctor has an x-ray image of a lung and her AI system says that its cancer. She asks why and the system highlights what it thinks are suspicious shadows, which she had previously disregarded as artifacts of the X-ray process. Now the doctor can make the call — to diagnose, investigate further, or, if she still thinks the system is in error, to let it go.”

As the system is enhanced, EQUAS will be able to monitor itself and share factors that limit its ability to make reliable recommendations. This self-monitoring capability will help developers refine AI systems, allowing them to inject additional data or change how data is processed. 




All of this week's top headlines to your email every Friday.


 
 

 

U.S. Air Force awards E-8C Joint STARS fleet total systems support responsibility contract to Northrop Grumman

Air National Guard photograph by Senior Master Sgt. Roger Parson E-8C Joint STARS aircrew members monitor moving target indication data at their operator work stations during a mission supporting BALTOPS 2018 and Saber Strike 18 exercises at Fighter Wing Skrydstrup, Denmark, June 12, 2018. The JSTARS team consists of the Georgia Air National Guard’s 116th...
 
 

Northrop Grumman providing training, sustainment services to ROK fleet of Global Hawks

Northrop Grumman has signed a contract with the Defense Acquisition Program Administration to provide contractor logistics support to the Republic of Korea’s high-altitude unmanned aerial vehicle fleet. The support for DAPA and the Republic of Korea Air Force include: timely site activation in South Korea; complete training packages for pilots, operators and maintainers of the...
 
 

GA-ASI to provide RPAs to Australian Defence Force

General Atomics Aeronautical Systems, Inc. has been advised that, following consideration by the Australian Government, it has been selected to provide the Armed Remotely Piloted Aircraft System under Project Air 7003 for the Australian Defence Force. “We look forward to providing our world-leading RPAS to meet the Air 7003 requirements,” said Linden Blue, CEO of...