Validating agent based social systems models

Authors:
Gnana K. Bharathy;Barry Silverman
Affiliations:
University of Pennsylvania, Philadelphia, PA;University of Pennsylvania, Philadelphia, PA
Venue:
Proceedings of the Winter Simulation Conference
Year:
2010

Citing 8
Cited 4

Note on free lunches and cross-validation

Neural Computation
Verification & validation in military simulations

Proceedings of the 29th conference on Winter simulation
Computational organization theory

Multiagent systems
Modeling factions for "effects based operations": part I--leaders and followers

Computational & Mathematical Organization Theory
Modeling factions for `effects based operations', part II: behavioral game theory

Computational & Mathematical Organization Theory
Systems social seience: a design inquiry approach for stabilization and reconstruction of social systems

Intelligent Decision Technologies - Engineering and management of IDTs for knowledge management systems
From KISS to KIDS: an 'anti-simplistic' modelling approach

MABS'04 Proceedings of the 2004 international conference on Multi-Agent and Multi-Agent-Based Simulation
Sociocultural Games for Training and Analysis

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans

Agent-Based modelling for risk assessment of routine clinical processes

PRIMA'10 Proceedings of the 13th international conference on Principles and Practice of Multi-Agent Systems
Simulation-Based training of ill-defined social domains: the complex environment assessment and tutoring system (CEATS)

ITS'12 Proceedings of the 11th international conference on Intelligent Tutoring Systems
Agent-based simulation for large-scale emergency response: A survey of usage and implementation

ACM Computing Surveys (CSUR)
A robust evolutionary strategy for generative validation of agent-based models using adaptive simulation ensembles

Proceedings of the Winter Simulation Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

Validating social systems is not a trivial task. The paper outlines some of our past efforts in validating models of social systems with cognitively detailed agents. It also presents some of the challenges faced by us. A social system built primarily of cognitively detailed agents can provide multiple levels of correspondence, both at observable and abstract aggregated levels. Such a system can also pose several challenges including large feature spaces, issues in information elicitation with database, experts and news feeds, counterfactuals, fragmented theoretical base, and limited funding for validation. Our own approach to validity assessment is to consider the entire life cycle and assess the validity under four broad dimensions of methodological validity, internal validity, external validity and qualitative, causal and narrative validity. In the past, we have employed a triangulation of multiple validation techniques, including face validation as well as formal validation tests including correspondence testing.