Defense

August 23, 2012

Solution to weapon development problem: HALO, Mass Effect

Tags:
Jason Kaneshiro
Picatinny Arsenal, N.J.
army-development1
Picatinny manager David Musgrave seeks more data on how the M109 Paladin is used in the field, information that would help engineers improve the system.

Picatinny manager David Musgrave seeks more data on how the M109 Paladin is used in the field, information that would help engineers improve the system.

David Musgrave is a man with a problem.

His latest project is undergoing field testing and he’s just not getting the data he wants on how the weapon system he helped to develop is being used.

The solution to his problem just might come from the video game industry.

“We were encountering some problems with firing tests,” Musgrave said. Musgrave serves as the project lead for fire control software development on the M109 Paladin Integrated Management, the U.S. Army’s latest iteration of its self-propelled 155 mm howitzer.

“I started asking questions looking for objective use data. How often does subsystem X fail? When it does fail, what was the user trying to do at the time? How often does a user perform Y task? The truth was I couldn’t get any decent answers,” said Musgrave who works at the Armament Research, Development and Engineering Center’s Weapons Software Engineering Center.

“I was frustrated that there was a very limited information channel from our system back to us while it was being used,” he said. “I felt like I had helped create a system and then threw it over a brick wall for someone else to use, and my only visibility was to try to peer through cracks in the mortar.”

But something about video games planted an idea in his mind that promised to smash through that brick wall like Super Mario.

Press start to begin

“My background is in software development and I’ve always looked to the video game industry for potential cutting edge ideas; sort of like how an automotive engineer at Ford may follow Formula 1 racing,” he said.

“I do really enjoy playing video games and I’ve been active since the days of Jumpman on my dad’s Commodore 64,” said Musgrave. “I don’t have as much time to play as I once did but I try to get in a few hours a week as a way to relax once the wife and kids go to sleep.”

It was that enduring enjoyment which started as a child that led to his latest idea.

At the same time as the testing was going on, Musgrave was watching a weekly web series called ExtraCredits that focuses on video game development technologies.

“One of their episodes discussed how user telemetry and the resulting metrics were changing the way games were developed,” said Musgrave.
According to Musgrave, user telemetry is the concept of recording data about the use of a deployed system and then transmitting that data back to a central point where it can be analyzed.

This data could consist of fault data, system usage data (how the system is used), performance data (how well the system is used) or anything else needed.

“For example let’s say you had a racing game where the user telemetry was collected and tracked. From a general perspective, the developer would know which tracks are the most popular, which cars are most used and if there are any parts of a track that are more difficult than others,” he explained.

“They could also drill down to see individual users and monitor your favorite track, your favorite car, and how often you crash or leave the pavement. They can then decide how they want to improve for the next game,” he continued.

“Let’s say the Ferrari’s are the most popular car and Honda’s are largely ignored. For the next game they may decide to expand the selection of available Ferrari’s or maybe take a second look at their Honda’s to see why nobody drives them,” said Musgrav.

“Or maybe one hairpin turn is too tough and 95 percent of the players can’t make it without smacking into a wall. That data could lead to a subsequent patch that would widen the turn and make it easier but still challenging.”

“My current favorite is the Mass Effect series from BioWare. Despite the recent controversy with the ending cinematics, the game is a prime example of how user data feeds back into the development cycle,” he said. “BioWare took great pains to listen to their user community and keep the parts of the game that worked and fix what was annoying from one game to the next.

“I dug more into the video game industry and I found a wonderful presentation by Georg Zoller who was a lead technical designer at BioWare,” Musgrave said. “He worked on BioWare’s user telemetry system used on games such as Mass Effect 2 and Dragon Age. I saw the amazing insight that system gave the developers and became excited about what a similar system could mean for the military.”

Musgrave said he believes that many different people in the Army could benefit from the collection and analysis of user telemetry.
“The program manager of a system would benefit from seeing objective fault information including types of faults along with frequency and associated data that would help them re-create the fault and come up with a solution,” he said. “The program manager would also be able to see which functions of the system are being used and how often. This would provide objective data to help them decide where to focus product improvement to get ‘the best bang for the buck.'”

“For instance let’s say we had a weapon system that provides direct and indirect fire modes; and through user telemetry data we determine that 87.5 percent of all engagements are direct fire,” he explained.

“The program manager can then determine if improvements to the indirect fire capability are a worthwhile investment since it is rarely used.”
Another potential beneficiary of a user telemetry program Musgrave identified would be schoolhouses or other training groups.

“If performance data is collected and tracked, they can see which units are performing well and which units may need some help,” said Musgrave. “They can also track training effectiveness by comparing performance data before and after an exercise or introduction of a new teaching tool.”

The final, and somewhat indirect, beneficiary Musgrave identified is the soldier.

“It will relieve the burden of reporting problems up the chain of command when they are encountered,” Musgrave said.

“A soldier in the field is not an IT guy and he has better things to do than try to fill out a trouble ticket.”

The Mass Effect series from the software company BioWare is a prime example of how user data feeds back into the product development cycle.

Pitfalls

Even small ideas can sometimes impose enormous challenges.

“I think there are three big pitfalls that we need to avoid if we want to successfully implement this into fielded weapon systems,” Musgrave said.

“First, we have to make sure that whatever telemetry system we can implement, and that has to be specifically tailored to each weapon, does not impact the existing functionality of that system. The worst thing we could do would be to take a reliable, working system and gum it up with something like this that’s non-critical.”

“The next challenge would be to keep the system small and simple,” Musgrave cautioned. “Far too often concepts like this get expanded quickly to be a leviathan that tries to do everything, for everybody, all the time. The system becomes huge, expensive and ultimately cancelled. We need to start any system small, see what works and build in increments from that point.”

“The truth is that while it may be ideal to collect and monitor 300 variables about a system, it’s probably far too cumbersome to implement properly,” explained Musgrave.

“Pulling only five variables instead may sound limiting, but considering we’re collecting nothing now, it’s an infinite improvement.”

“The final challenge, and the most technical, is developing a method to get the data from the weapon system onto a network so it can eventually make it back to a central server,” he concluded.

“There are some technologies out there that can do this but any solution will have to be heavily tailored to the target platform. For instance pulling data from a rifle scope would be far more difficult than a semi-fixed missile system,” he said.

Despite the challenges that may come with putting together such a system of user telemetry on current and future Army weapons systems, Musgrave says he believes that potential long-term benefits could outweigh the initial costs in time and effort and improve the bottom line for both the troops who use the weapon and the taxpayers who fund it.

“The data collected will eventually lead to a higher quality, more affordable system,” Musgrave added.




All of this week's top headlines to your email every Friday.


 
 

 

Headlines November 21, 2014

News: Dempsey lays groundwork for larger 2016 defense budget - The top U.S. military official on Wednesday made the case for growing the base defense budget significantly over the $535 billion spending cap imposed by Congress for fiscal 2015.   Business: Boeing can bill $61 million that Pentagon withheld for months - The Pentagon withheld $60.5 million...
 
 

News Briefs November 21, 2014

Obama aide: U.S. should look at Ukraine military aid A senior aide of President Barack Obama says he believes the U.S. should consider giving Ukraine lethal, defensive military assistance to get Russia to think twice about its destabilizing behavior. Tony Blinken, the deputy national security adviser, cites serious violations by Russia of agreements not to...
 
 
Air Force photograph by SrA. Divine Cox

Kunsan AB hosts Exercise Max Thunder 14-2

Air Force photograph by SrA. Divine Cox A South Korean air force F-15 Strike Eagle lands Nov. 17, 2014, during Max Thunder 14-2 at Kunsan Air Base, South Korea. U.S. Air Force, Army, Marine Corps and Navy personnel and aircraft...
 

 
LM-facility

Lockheed Martin opens Surface Navy Innovation Center

Lockheed Martin has opened the Surface Navy Innovation Center in Moorestown, N.J., to support the development of new technologies for the U.S. Navy. The SNIC is a research, development and demonstration facility that brings tog...
 
 
raytheon-test

Raytheon successfully demonstrates integrated electronic warfare capabilities

EL SEGUNDO, Calif. – Raytheon, in collaboration with the U.S. Navy, successfully demonstrated an end to end, first of its kind, integrated electronic attack system during flight tests at the Naval Air Weapons Station Chi...
 
 

Three bases identified as F-16 aggressor candidate bases

U.S. Air Force photo by Tech. Sgt. Joseph Swafford Jr. A U.S. Air Force F-16 Fighting Falcon fighter aircraft assigned to the 18th Aggressor Squadron lands at Eielson Air Force Base, Alaska, Oct. 6 during RED FLAG-Alaska 15-1. RF-A is a series of Pacific Air Forces commander-directed field training exercises for U.S. and partner nation...
 




0 Comments


Be the first to comment!


Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>