Next Article in Journal
Previous Article in Journal
Computers 2013, 2(2), 67-87; doi:10.3390/computers2020067
Article

A Characterization of the Utility of Using Artificial Intelligence to Test Two Artificial Intelligence Systems

*  and
Received: 28 December 2012; in revised form: 4 February 2013 / Accepted: 22 May 2013 / Published: 31 May 2013
View Full-Text   |   Download PDF [729 KB, uploaded 31 May 2013]
Abstract: An artificial intelligence system, designed for operations in a real-world environment faces a nearly infinite set of possible performance scenarios. Designers and developers, thus, face the challenge of validating proper performance across both foreseen and unforeseen conditions, particularly when the artificial intelligence is controlling a robot that will be operating in close proximity, or may represent a danger, to humans. While the manual creation of test cases allows limited testing (perhaps ensuring that a set of foreseeable conditions trigger an appropriate response), this may be insufficient to fully characterize and validate safe system performance. An approach to validating the performance of an artificial intelligence system using a simple artificial intelligence test case producer (AITCP) is presented. The AITCP allows the creation and simulation of prospective operating scenarios at a rate far exceeding that possible by human testers. Four scenarios for testing an autonomous navigation control system are presented: single actor in two-dimensional space, multiple actors in two-dimensional space, single actor in three-dimensional space, and multiple actors in three-dimensional space. The utility of using the AITCP is compared to that of human testers in each of these scenarios.
Keywords: artificial intelligence; testing artificial intelligence systems; using artificial intelligence for testing; artificial intelligence test case generation artificial intelligence; testing artificial intelligence systems; using artificial intelligence for testing; artificial intelligence test case generation
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Export to BibTeX |
EndNote


MDPI and ACS Style

Straub, J.; Huber, J. A Characterization of the Utility of Using Artificial Intelligence to Test Two Artificial Intelligence Systems. Computers 2013, 2, 67-87.

AMA Style

Straub J, Huber J. A Characterization of the Utility of Using Artificial Intelligence to Test Two Artificial Intelligence Systems. Computers. 2013; 2(2):67-87.

Chicago/Turabian Style

Straub, Jeremy; Huber, Justin. 2013. "A Characterization of the Utility of Using Artificial Intelligence to Test Two Artificial Intelligence Systems." Computers 2, no. 2: 67-87.

Computers EISSN 2073-431X Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert