Computer Simulation Validation: Fundamental Concepts, Methodological Frameworks, and Philosophical P

Introduction

Part I:  Foundations - Basic Conceptions in Simulation Model Validation

What Is Validation of Computer Simulations? Towards a Clarification of the Concept of Validation and Related Notions
Claus Beisbart

Simulation Accuracy, Uncertainty, and Predictive Capability: A Physical Sciences Perspective
William Oberkampf

Verification and Validation Principles from a Systems Perspective
David J. Murray-Smith

Errors and Uncertainties: Their Sources and Treatment
Christopher J. Roy

Part II: Foundations - Validation as a Scientific Method: Philosophical Frameworks for Thinking about Validation

Invalidation of Models and Fitness-for-purpose: A Rejectionist Approach
Keith Beven & Stuart Lane

Simulation Validation from a Bayesian Perspective
Claus Beisbart

Validation of Computer Simulations from a Kuhnian Perspective
Eckhart Arnold

Understanding Simulation Validation - The Hermeneutic Perspective
Nicole J. Saam

Part III: Methodology - Preparatory Steps

Assessing the Credibility of Conceptual Models
Axel Gelfert

The Method of Manufactured Solutions for Code Verification
Patrick J. Roache

Validation Metrics: A Case for Pattern-based Methods
Robert E. Marks

Analyzing Output from Stochastic Computer Simulations: An Overview
Christine Currie

Part IV: Methodology - Points of Reference and Related Techniques

The Use of Experimental Data in Simulation Model Validation
David J. Murray-Smith

How to Use and Derive Stylized Facts for Validating Simulation Models
Matthias Meyer

The Users' Judgements - The Stakeholder Approach to Simulation Validation
Nicole J. Saam

Validation Benchmarks and Related Metrics
Nicole J. Saam

Part V: Methodology - Mathematical Frameworks and Related Techniques

Testing Simulation Models Using Frequentist Statistics
Andrew P. Robinson

Validation Using Bayesian Methods
Xiaomo Jiang, Xueyu Cheng & Yong Yuan

Imprecise Probabilities
Seamus Bradley

Objective Uncertainty Quantification
Ed Dougherty, Lori Dalton & Roozbeh Dehghannasiri

Part VI: Methodology - The Organization and Management of Simulation Validation 

Standards for Evaluation of Atmospheric Models in Environmental Meteorology
K. Heinke Schluenzen

The Management of Simulation Validation
Fei Liu &Ming Yang

Valid and Reproducible Simulation Studies - Making It Explicit
Oliver Reinhardt, Tom Warnke, Andreas Ruscheinski & Adelinde M. Uhrmacher

Part VII: Validation at Work - Best Practice-Examples

Validation of Particle Physics Simulation
Peter Mättig

Astrophysical Validation
Alan C. Calder & Dean M. Townsley

Validation in Weather Forecasting
Susanne Theis & Michael Baldauf

Validation of Climate Models: An Essential Practice
Richard B. Rood

Validation of Agent-based Models in Economics and Finance
Giorgio Fagiolo, Mattia Guerini, Francesco Lamperti, Alessio Moneta & Andrea Roventini

Part VIII: Challenges in Simulation Model Validation

Validation and Equifinality
Keith Beven

Validation and Overparameterization - Experiences from Hydrological Modeling
Jan Seibert, Maria Staudinger & Ilja van Meerveld

Uncertainty Quantification Using Multiple Models - Prospects and Challenges
Reto Knutti, Christoph Baumberger & Gertrude Hirsch Hadorn

Challenges to Simulation Validation in the Social Sciences - A critical-rationalist perspective
Michael Mäs

Validation and the Uniqueness of Historical Events
Josef Köstlbauer

Part IX: Reflecting on Simulation Validation: Philosophical Perspectives and Discussion Points

How Do the Validations of Simulations and Experiments Compare?
Anouk Barberousse & Julie Jebeile

How Does Holism Challenge the Validation of Computer Simulation?
Johannes Lenhard

What Types of Values Enter Simulation Validation and What are Their Roles?
Gertrude Hirsch Hadorn & Christoph Baumberger

Calibration, Validation, and Confirmation
Mathias Frisch

Should Validation and Verification Be Separated Strictly?
Claus Beisbart