A Surprise-based Agent Architecture



We describe the architecture of an artificial agent whose task is to explore unknown environments. It is assumed that the behavior of the agent is partly (and in a simplified version of the agent, even wholly) controlled by surprise. We describe the computational model of surprise incorporated in the architecture, briefly report on related empirical research on surprise intensity in humans, and summarize the results of simulation studies that compared a purely surprise-motivated agent to agents with additional motives.


18th European Meeting on Cybernetics and Systems Research, April 2006

PDF File

Cited by

Year 2015 : 1 citations

 Demey, Lorenz. "The dynamics of surprise." Logique et Analyse 58.230 (2015): 251-277.

Year 2014 : 1 citations

 Demey, Lorenz. "Surprise in Probabilistic Dynamic Epistemic Logic." Logic and Interactive Rationality Yearbook 2012. Vol. 1. Institute for Logic, Language and Computation, 2014.

Year 2013 : 2 citations

 Qiao, Rui, et al. "Surprise simulation using fuzzy logic." Intelligent Computing Theories and Technology. Springer Berlin Heidelberg, 2013. 110-119.

 Rui Qiao, Xiuqin Zhong, Shihan Yang, Heng He (2013). Surprise Simulation Using Fuzzy Logic. In Intelligent Computing Theories and Technology, Lecture Notes in Computer Science Volume 7996, 2013, pp 110-119

Year 2011 : 2 citations

 Merk, R. J. (2011). A surprise model for use in agents in simulated environments. National Aerospace Laboratory NLR. NLR-TP-2011-036.

 Spitz, D. (2011). A Computational Model of Surprise. MSc Thesis, WORCERSTER POLYTECHNIC INSTITUTE, USA.

Year 2010 : 1 citations

 Robbert-Jan Merk (2010) A Computational Model on Surprise and Its Effects on Agent Behaviour in Simulated Environments. In Advances in Practical Applications of Agents and Multiagent Systems Advances in Soft Computing, Volume 70, 47-57

Year 2009 : 2 citations

 Prassler, E., Kahl, B., Henne, T., & Reggiani, M. Autonomous Design of Experiments for Learning by Experimentation. In FORSCHUNGSSPITZEN UND SPITZENFORSCHUNG
2009, II, 125-135

 Juarez, Alex, et al. "Automatic stimulation of experiments and learning based on prediction failure recognition." Robotics and Automation, 2009. ICRA'09. IEEE International Conference on. IEEE, 2009.

Year 2008 : 1 citations

 Henne, T., Juarez, A., Reggiani, M. & Prassler, E. Towards Autonomous Design of Experiments for Robots. In Proceedings of the 6th. International Workshop on Cognitive Robotics (CogRob), held at the 18th. European Conference on Artificial Intelligence (ECAI), July, 2008.