A Sample Verification and Validation Framework for Open Source Simulation Software

Abstract

Verification and Validation (V&V) activities performed in the life cycle of a software project are necessary to meet technical specifications and requirements. Likewise, V&V activities in a simulation project's life cycle have a critical role in ensuring the validity of the relevant model. Accordingly, these activities must be carried out successfully in order to determine the consistency of the simulation model that is being developed with its real or hypothetical system. To achieve this, it is expected that the most suitable V&V methods are to be evaluated, selected and then applied within the scope of the simulation project. Until recently, various V&V methods have been produced and made available for using at certain stages of the software cycle. Unfortunately, it is not possible to apply so many methods at the same time, considering such project constraints as time and resources. Therefore, in the field of Modeling and Simulation, selection and application of V&V methods in a proper and efficient way for the project in question poses a big problem. In the present study, upon reviewing the existing literature on the subject, the missing aspects crucial for the selection of the suitable V&V techniques were examined first. Afterwards, a sample framework that can guide the selection of the most appropriate methods for the V&V processes of simulations has been offered. The current study made use of score-based method selection processes rather than the traditional method selection techniques, by taking requirements and metrics of the relevant simulation project into account. The proposed framework was applied using open source simulation software project data. And the practical results show that the framework developed in this study significantly optimizes the V&V method selection process compared to general-purpose method selection techniques.