Open AccessThis article is
- freely available
A Characterization of the Utility of Using Artificial Intelligence to Test Two Artificial Intelligence Systems
Department of Computer Science, University of North Dakota, 3950 Campus Road, Stop 9015, Grand Forks, ND 58202-9015, USA
* Author to whom correspondence should be addressed.
Received: 28 December 2012; in revised form: 4 February 2013 / Accepted: 22 May 2013 / Published: 31 May 2013
Abstract: An artificial intelligence system, designed for operations in a real-world environment faces a nearly infinite set of possible performance scenarios. Designers and developers, thus, face the challenge of validating proper performance across both foreseen and unforeseen conditions, particularly when the artificial intelligence is controlling a robot that will be operating in close proximity, or may represent a danger, to humans. While the manual creation of test cases allows limited testing (perhaps ensuring that a set of foreseeable conditions trigger an appropriate response), this may be insufficient to fully characterize and validate safe system performance. An approach to validating the performance of an artificial intelligence system using a simple artificial intelligence test case producer (AITCP) is presented. The AITCP allows the creation and simulation of prospective operating scenarios at a rate far exceeding that possible by human testers. Four scenarios for testing an autonomous navigation control system are presented: single actor in two-dimensional space, multiple actors in two-dimensional space, single actor in three-dimensional space, and multiple actors in three-dimensional space. The utility of using the AITCP is compared to that of human testers in each of these scenarios.
Keywords: artificial intelligence; testing artificial intelligence systems; using artificial intelligence for testing; artificial intelligence test case generation
Citations to this Article
Cite This Article
MDPI and ACS Style
Straub, J.; Huber, J. A Characterization of the Utility of Using Artificial Intelligence to Test Two Artificial Intelligence Systems. Computers 2013, 2, 67-87.
Straub J, Huber J. A Characterization of the Utility of Using Artificial Intelligence to Test Two Artificial Intelligence Systems. Computers. 2013; 2(2):67-87.
Straub, Jeremy; Huber, Justin. 2013. "A Characterization of the Utility of Using Artificial Intelligence to Test Two Artificial Intelligence Systems." Computers 2, no. 2: 67-87.