Model verification and validation (V&V) is one of the most important activities in simulation mod... more Model verification and validation (V&V) is one of the most important activities in simulation modelling. Model validation is especially challenging for Agent-Based Simulation (ABS). Techniques that can help to improve V&V in simulation modelling are needed. This paper proposes a V&V technique called Test-Driven Simulation Modelling (TDSM) which applies techniques from Test-Driven Development in software engineering to simulation modelling. The main principle in TDSM is that a unit test for a simulation model has to be specified before the simulation model is implemented. Hence, TDSM explicitly embeds V&V in simulation modelling. We use a case study in maritime search operations to demonstrate how TDSM can be used in practice. Maritime search operations (and search operations in general) are one of the classic applications of Operational Research (OR). Hence, we can use analytical models from the vast search theory literature for unit tests in TDSM. The results show that TDSM is a useful technique in the verification and validation of simulation models, especially ABS models. This paper also shows that ABS can offer an alternative modelling approach in the analysis of maritime search operations.
Two of the crucial parts in the process of performing a simulation study are validation and verif... more Two of the crucial parts in the process of performing a simulation study are validation and verification. The reason is these techniques help on increasing the confidence in the model, since it is not possible to demonstrate its absolute validity in all contexts. This paper presents the results of a white-box validation performed in an agent-based simulator for population dynamics. The tool provides a way to simulate the demographic evolution of large populations in a parallel environment. The purpose is to obtain population projections that can be used afterwards for policy analysis. Although the tool has been studied in terms of performance and scalability, its validation hasn’t been addressed. With a white-box validation we expect to increase the confidence of policy analysers and social scientists in our simulation model.
SIMULATION: Transactions of The Society for Modeling and Simulation International
This paper advocates the use of a formal framework for analyzing simulation performance. Simulati... more This paper advocates the use of a formal framework for analyzing simulation performance. Simulation performance is characterized based on the three simulation development process boundaries: physical system, simulation model, and simulator implementation. Firstly, we formalize simulation event ordering using partially ordered set theory. A simulator implements a simulation event ordering, and incurs implementation overheads when enforcing event ordering at runtime. Secondly, we apply our formalism to extract and formalize the simulation event orderings of both sequential and parallel simulations. Thirdly, we propose the relation stricter and a measure called strictness for comparing and quantifying the degree of event dependency of simulation event orderings respectively. In contrast to the event parallelism measure, strictness is independent of time.
Simulation modeling is one of the analytic techniques commonly used for transportation management... more Simulation modeling is one of the analytic techniques commonly used for transportation management; it includes such activities as route planning and post-operation analysis. One of the simulation methods, agent-based simulation, has become increasingly popular due to the availability of good micro-level data collected through technologies such as GPS-enabled devices and road sensors. This paper presents the design and implementation of an agent-based simulation tool that can be used to analyse vehicle routing algorithms. We demonstrate how the tool can be used in practice by implementing two vehicle routing algorithms: shortest-path and LANTIME. LANTIME is an algorithm that can be used to minimize CO 2 emissions.
The computer power required in the simulation of mutually cooperating systems in the physical sci... more The computer power required in the simulation of mutually cooperating systems in the physical sciences is huge. Therefore, it is common to simulate one system and treat others as parameters or environmental conditions to the simulated system. Macro-micro interlocked (MMI) simulation framework has been proposed to simulate such cooperating systems. In this paper, we study the feasibility of applying this framework on the simulation of macro-micro economic model. This simulation allows us to observe the system's behaviour at the macro and micro levels concurrently. Policy changes at the macroeconomic level may affect the behaviour of the entities at the microeconomic level. Similarly, the behaviour changes at the microeconomic level may affect the macroeconomic system. We implement an MMI simulation library suitable for execution on a cluster of PCs. At this early stage, the experiment shows a promising result which provides us with a foundation to experiment with a larger model.
Research in parallel simulation has been around for more than two decades. However, the number of... more Research in parallel simulation has been around for more than two decades. However, the number of papers reporting on its application to real world problems is limited. At the 2002 PADS conference, researchers discussed the need to go beyond synchronization and performance issues and, in particular, to demonstrate that parallel simulation could be used in real world applications outside military and network simulations. Since then, we have seen an increase in the number of papers on parallel simulation applications in areas such as operations management and the physical sciences. This paper presents a parallel discrete-event demographic simulation tool which has been developed using sik parallel simulation library. A number of experiments have been conducted to evaluate the simulation performance. The result shows that good event parallelism can be achieved.
Changes in demographic and regulations in social care in England are expected to alter the social... more Changes in demographic and regulations in social care in England are expected to alter the social care landscape and increase pressure on people working in the adult social care sector, especially those who deliver direct care services. While significant work has been done to understand the demand side of the adult social care system, work on the supply side is considerably limited and analysis has been dominated by methods such as macro- and micro-simulation. This paper demonstrates that system dynamics modelling can be used to understand the dynamics of the social care workforce who deliver direct care services in the formal sector, specifically, to identify the main feedback loops that govern the dynamics of the system, to identify sensitive and influential factors, and to show non-linearity in the system. Therefore, system dynamics should play a more important role in the analysis of adult social care system.
High Level Architecture provides a standard for abstraction, design, construction, development an... more High Level Architecture provides a standard for abstraction, design, construction, development and operation of distributed computer simulation systems. This paper focuses on the latest version of the standard, i.e. IEEE1516:2010. Users who are not familiar with distributed computer programming may find it difficult to create HLA-compliant models using a tool that assumes some familiarities with distributed computer programming. Hence, a tool that can help such users is useful, especially in encouraging more people to develop HLA-compliant models. We have developed HLAVA Framework that encapsulates the detailed steps of main HLA interfaces such as the methods for creating logical processes, and management thereof, synchronization methods, and communication protocols -in fact, the framework is a simulation kernel for the distributed simulation logical process, which is compliant with (among others) the HLA standard, but due to a simple interface has only about 10 methods, which have ...
The verification and validation of a simulation model is one of the most important steps in simul... more The verification and validation of a simulation model is one of the most important steps in simulation modelling. This paper proposes an approach to the verification and validation of a simulation model called the Test-Driven Simulation Modelling (TDSM) that is based on the concept of Test-Driven Development in software engineering. TDSM makes use of two unit test suites, verification suite and validation suite. This paper demonstrates how a unit test can be used to verify and validate a simulation model. This is followed by a discussion on how to carry out TDSM using the two unit test suites. We use tools called SharpSim simulation library and NUnit in this paper but the concept of TDSM can be implemented using similar tools.
Whilst trust is an increasingly popular subject amongst management scholars, very few scholars ha... more Whilst trust is an increasingly popular subject amongst management scholars, very few scholars have attempted to address the public-business trust relationship. However, it is the loss of public trust in business (and the need to restore it) which appears to be of the most concern in practice. This paper discusses the perspective of a group of experienced business consultants on factors that drive public trust in a business organisation and examines the causal structure of these drivers in order to determine public trust. The focus group design was influenced by group model building practices. The key insights include how they perceive the importance of competence over characters, how they identify trust drivers, and how they perceive the interplays between trust drivers, trustworthiness dimensions and the moderating factors. A causal loop diagram is used to map the key insights into a conceptual model.
Model verification and validation (V&V) is one of the most important activities in simulation mod... more Model verification and validation (V&V) is one of the most important activities in simulation modelling. Model validation is especially challenging for Agent-Based Simulation (ABS). Techniques that can help to improve V&V in simulation modelling are needed. This paper proposes a V&V technique called Test-Driven Simulation Modelling (TDSM) which applies techniques from Test-Driven Development in software engineering to simulation modelling. The main principle in TDSM is that a unit test for a simulation model has to be specified before the simulation model is implemented. Hence, TDSM explicitly embeds V&V in simulation modelling. We use a case study in maritime search operations to demonstrate how TDSM can be used in practice. Maritime search operations (and search operations in general) are one of the classic applications of Operational Research (OR). Hence, we can use analytical models from the vast search theory literature for unit tests in TDSM. The results show that TDSM is a useful technique in the verification and validation of simulation models, especially ABS models. This paper also shows that ABS can offer an alternative modelling approach in the analysis of maritime search operations.
Two of the crucial parts in the process of performing a simulation study are validation and verif... more Two of the crucial parts in the process of performing a simulation study are validation and verification. The reason is these techniques help on increasing the confidence in the model, since it is not possible to demonstrate its absolute validity in all contexts. This paper presents the results of a white-box validation performed in an agent-based simulator for population dynamics. The tool provides a way to simulate the demographic evolution of large populations in a parallel environment. The purpose is to obtain population projections that can be used afterwards for policy analysis. Although the tool has been studied in terms of performance and scalability, its validation hasn’t been addressed. With a white-box validation we expect to increase the confidence of policy analysers and social scientists in our simulation model.
SIMULATION: Transactions of The Society for Modeling and Simulation International
This paper advocates the use of a formal framework for analyzing simulation performance. Simulati... more This paper advocates the use of a formal framework for analyzing simulation performance. Simulation performance is characterized based on the three simulation development process boundaries: physical system, simulation model, and simulator implementation. Firstly, we formalize simulation event ordering using partially ordered set theory. A simulator implements a simulation event ordering, and incurs implementation overheads when enforcing event ordering at runtime. Secondly, we apply our formalism to extract and formalize the simulation event orderings of both sequential and parallel simulations. Thirdly, we propose the relation stricter and a measure called strictness for comparing and quantifying the degree of event dependency of simulation event orderings respectively. In contrast to the event parallelism measure, strictness is independent of time.
Simulation modeling is one of the analytic techniques commonly used for transportation management... more Simulation modeling is one of the analytic techniques commonly used for transportation management; it includes such activities as route planning and post-operation analysis. One of the simulation methods, agent-based simulation, has become increasingly popular due to the availability of good micro-level data collected through technologies such as GPS-enabled devices and road sensors. This paper presents the design and implementation of an agent-based simulation tool that can be used to analyse vehicle routing algorithms. We demonstrate how the tool can be used in practice by implementing two vehicle routing algorithms: shortest-path and LANTIME. LANTIME is an algorithm that can be used to minimize CO 2 emissions.
The computer power required in the simulation of mutually cooperating systems in the physical sci... more The computer power required in the simulation of mutually cooperating systems in the physical sciences is huge. Therefore, it is common to simulate one system and treat others as parameters or environmental conditions to the simulated system. Macro-micro interlocked (MMI) simulation framework has been proposed to simulate such cooperating systems. In this paper, we study the feasibility of applying this framework on the simulation of macro-micro economic model. This simulation allows us to observe the system's behaviour at the macro and micro levels concurrently. Policy changes at the macroeconomic level may affect the behaviour of the entities at the microeconomic level. Similarly, the behaviour changes at the microeconomic level may affect the macroeconomic system. We implement an MMI simulation library suitable for execution on a cluster of PCs. At this early stage, the experiment shows a promising result which provides us with a foundation to experiment with a larger model.
Research in parallel simulation has been around for more than two decades. However, the number of... more Research in parallel simulation has been around for more than two decades. However, the number of papers reporting on its application to real world problems is limited. At the 2002 PADS conference, researchers discussed the need to go beyond synchronization and performance issues and, in particular, to demonstrate that parallel simulation could be used in real world applications outside military and network simulations. Since then, we have seen an increase in the number of papers on parallel simulation applications in areas such as operations management and the physical sciences. This paper presents a parallel discrete-event demographic simulation tool which has been developed using sik parallel simulation library. A number of experiments have been conducted to evaluate the simulation performance. The result shows that good event parallelism can be achieved.
Changes in demographic and regulations in social care in England are expected to alter the social... more Changes in demographic and regulations in social care in England are expected to alter the social care landscape and increase pressure on people working in the adult social care sector, especially those who deliver direct care services. While significant work has been done to understand the demand side of the adult social care system, work on the supply side is considerably limited and analysis has been dominated by methods such as macro- and micro-simulation. This paper demonstrates that system dynamics modelling can be used to understand the dynamics of the social care workforce who deliver direct care services in the formal sector, specifically, to identify the main feedback loops that govern the dynamics of the system, to identify sensitive and influential factors, and to show non-linearity in the system. Therefore, system dynamics should play a more important role in the analysis of adult social care system.
High Level Architecture provides a standard for abstraction, design, construction, development an... more High Level Architecture provides a standard for abstraction, design, construction, development and operation of distributed computer simulation systems. This paper focuses on the latest version of the standard, i.e. IEEE1516:2010. Users who are not familiar with distributed computer programming may find it difficult to create HLA-compliant models using a tool that assumes some familiarities with distributed computer programming. Hence, a tool that can help such users is useful, especially in encouraging more people to develop HLA-compliant models. We have developed HLAVA Framework that encapsulates the detailed steps of main HLA interfaces such as the methods for creating logical processes, and management thereof, synchronization methods, and communication protocols -in fact, the framework is a simulation kernel for the distributed simulation logical process, which is compliant with (among others) the HLA standard, but due to a simple interface has only about 10 methods, which have ...
The verification and validation of a simulation model is one of the most important steps in simul... more The verification and validation of a simulation model is one of the most important steps in simulation modelling. This paper proposes an approach to the verification and validation of a simulation model called the Test-Driven Simulation Modelling (TDSM) that is based on the concept of Test-Driven Development in software engineering. TDSM makes use of two unit test suites, verification suite and validation suite. This paper demonstrates how a unit test can be used to verify and validate a simulation model. This is followed by a discussion on how to carry out TDSM using the two unit test suites. We use tools called SharpSim simulation library and NUnit in this paper but the concept of TDSM can be implemented using similar tools.
Whilst trust is an increasingly popular subject amongst management scholars, very few scholars ha... more Whilst trust is an increasingly popular subject amongst management scholars, very few scholars have attempted to address the public-business trust relationship. However, it is the loss of public trust in business (and the need to restore it) which appears to be of the most concern in practice. This paper discusses the perspective of a group of experienced business consultants on factors that drive public trust in a business organisation and examines the causal structure of these drivers in order to determine public trust. The focus group design was influenced by group model building practices. The key insights include how they perceive the importance of competence over characters, how they identify trust drivers, and how they perceive the interplays between trust drivers, trustworthiness dimensions and the moderating factors. A causal loop diagram is used to map the key insights into a conceptual model.
Uploads
Papers
the model, since it is not possible to demonstrate its absolute validity in all contexts. This paper presents the results of a white-box validation performed in an agent-based simulator for population dynamics. The tool provides a way to simulate the demographic evolution of large populations in a parallel environment. The purpose is to obtain population projections that can be used afterwards for policy analysis. Although the
tool has been studied in terms of performance and scalability, its validation hasn’t been addressed. With a white-box validation we expect to increase the confidence of policy analysers and social scientists in our simulation model.
the model, since it is not possible to demonstrate its absolute validity in all contexts. This paper presents the results of a white-box validation performed in an agent-based simulator for population dynamics. The tool provides a way to simulate the demographic evolution of large populations in a parallel environment. The purpose is to obtain population projections that can be used afterwards for policy analysis. Although the
tool has been studied in terms of performance and scalability, its validation hasn’t been addressed. With a white-box validation we expect to increase the confidence of policy analysers and social scientists in our simulation model.