Kruse P.M.,Berner and Mattner Systemtechnik GmbH |
Schieferdecker I.,Fraunhofer Institute for Open Communication Systems
2012 Federated Conference on Computer Science and Information Systems, FedCSIS 2012 | Year: 2012
Due to limited test resources, it is often necessary to prioritize and select test cases for a given system under test. Although test case prioritization is well studied and understood, its combination with test data generation is difficult and not completely solved yet. For example, the Classification Tree Method is a well established method for test data generation, however the application of prioritization techniques to it is a current research topic. We present an extension of the classification tree method that allows the generation of optimized test suites, containing test cases ordered according to their importance with respect to test goals. The presented algorithms are incorporated into the Classification Tree Editor and empirically evaluated on a set of benchmarks. © 2012 Polish Info Processing Socit.
Lindlar F.,TU Berlin |
Windisch A.,TU Berlin |
Wegener J.,Berner and Mattner Systemtechnik GmbH
ICSTW 2010 - 3rd International Conference on Software Testing, Verification, and Validation Workshops | Year: 2010
Evolutionary Functional Testing (EFT) is a relatively recent approach to automating the testing process. The research presented in this paper aims at increasing the acceptability of EFT in industrial settings. An approach suitable for efficiently and effectively testing complex continuous control systems is introduced. The main focus is on generating realistic test stimuli, enabling interactivity between test driver and test object, and facilitating the process of designing a suitable fitness function. This is accomplished by integrating EFT with modelbased testing methodologies resulting in an intuitive testing approach that enables even testers not familiar with searchbased testing to achieve good results with limited effort. A test environment optimized for deployment in the industrial domain is introduced. Features of the test environment include the capability of automatically generating realistic continuous test data sets, interacting with the system under test during test execution, and automatically executing and evaluating large numbers of tests. A thorough case study using an adaptive cruise control system from the automotive domain is performed to assess the approach. Results of this work indicate high usability, efficiency, and effectiveness of the proposed method for testing complex embedded systems. © 2010 IEEE.
Hulin B.,Berner and Mattner Systemtechnik GmbH
ZEVrail | Year: 2013
This article shows an overview of the new chapter "deployment" of EN 50128. A definition of deployment and its goals are given. Important aspects of deployment as well as its steps are discussed. Especially focus is set to the actors in the deployment phase.
Lakhotia K.,University College London |
Harman M.,University College London |
Gross H.,Berner and Mattner Systemtechnik GmbH
Information and Software Technology | Year: 2013
Context: Despite the large number of publications on Search-Based Software Testing (SBST), there remain few publicly available tools. This paper introduces AUSTIN, a publicly available open source SBST tool for the C language. 1 The paper is an extension of previous work . It includes a new hill climb algorithm implemented in AUSTIN and an investigation into the effectiveness and efficiency of different pointer handling techniques implemented by AUSTIN's test data generation algorithms. Objective: To evaluate the different search algorithms implemented within AUSTIN on open source systems with respect to effectiveness and efficiency in achieving branch coverage. Further, to compare AUSTIN against a non-publicly available, state-of-the-art Evolutionary Testing Framework (ETF). Method: First, we use example functions from open source benchmarks as well as common data structure implementations to check if the decision procedure for pointer inputs, introduced in this paper, differs in terms of effectiveness and efficiency compared to a simpler alternative that generates random memory graphs. A second empirical study formulates two alternate hypotheses regarding the effectiveness and efficiency of AUSTIN compared to the ETF. These hypotheses are tested using a paired Wilcoxon test. Results and Conclusion: The first study highlights some practical problems with the decision procedure for pointer inputs described in this paper. In particular, if the code under test contains insufficient guard statements to enforce constraints over pointers, then using a constraint solver for pointer inputs may be suboptimal compared to a method that generates random memory graphs. The programs used in the second study do not require any constraint solving for pointer inputs and consist of eight non-trivial, real-world C functions drawn from three embedded automotive software modules. For these functions, AUSTIN is competitive compared to the ETF, achieving an equal or higher branch coverage for six of the functions. In addition, for functions where AUSTIN's branch coverage is equal or higher, AUSTIN is more efficient than the ETF. © 2012 Elsevier B.V. All rights reserved.
Robinson-Mallett C.L.,Berner and Mattner Systemtechnik GmbH
2012 2nd IEEE International Workshop on Model-Driven Requirements Engineering, MoDRE 2012 - Proceedings | Year: 2012
The time-to-market pressure and the introduction of new development standards into automotive industry have created interest in systematic approaches across the whole product lifecycle. Model-based design and testing methods and tools have been successfully introduced into development processes of car manufacturers and suppliers. Surprisingly, in practice the elicitation and specification of requirements remained largely unaffected by the introduction of model-based methods, while much effort has been spent on the introduction of functional specifications. As a consequence, where functional specifications exist, these are often created unsystematically and are of poor quality, leading to further problems during design, implementation and testing. In this paper we present an approach to improve specification quality through systemization of specification structures based on architectural block diagrams, behavioural statecharts and propositional logic structures. The approach has been implemented in a tool. Experiences from the application of approach and tool in industrial projects are reported. © 2012 IEEE.