Volume 16 · Number 1 · Pages 060–062
Maximization of Future Internal States?

Robert Lowe

Log in download the full text in PDF

> Citation > Similar > References > Add Comment

Abstract

Open peer commentary on the article “Foresight Rather than Hindsight? Future State Maximization As a Computational Interpretation of Heinz von Foerster’s Ethical Imperative” by Hannes Hornischer, Simon Plakolb, Georg Jäger & Manfred Füllsack. Abstract: The target article outlines a Future-State-Maximization (FSX) approach whose focus on “rewarding” actions that lead to increased action possibilities serves as an alternative to standard value-based learning approaches. In my commentary, I discuss how internal states might shape future action possibilities. Specifically, the notion of allostasis is discussed in relation to how physiological (internal variable) regulation may enable or constrain future action spaces.

Handling Editor: Alexander Riegler

Citation

Lowe R. (2020) Maximization of future internal states? Constructivist Foundations 16(1): 060–062. https://constructivist.info/16/1/060

Export article citation data: Plain Text · BibTex · EndNote · Reference Manager (RIS)

References

Cannon W. B. (1915) Bodily changes in pain, hunger, fear and rage. Appleton, New York. ▸︎ Google︎ Scholar
Cerezo S. H., Ballester G. D. & Baxevanakis S. (2018) Solving Atari Games using fractals and entropy. ArXiv:1807.01081 (Cs) July. http://arxiv.org/abs/1807.01081.
Chin G. J. (2007) Cognitive homeostasis. Science 318(5851): 717. ▸︎ Google︎ Scholar
Corcoran A. W. & Hohwy J. (2019) Allostasis, interoception, and the free energy principle: Feeling our way forward. In: Tsarkiris M. & De Preester H. (eds.) The interoceptive mind: From homeostasis to awareness. Oxford University Press, Oxford: 272–292. ▸︎ Google︎ Scholar
Gu X. & FitzGerald T. H. (2014) Interoceptive inference: Homeostasis and decision-making. Trends in Cognitive Sciences 18(6): 269–70. ▸︎ Google︎ Scholar
Kiryazov K., Lowe R., Becker-Asano C. & Randazzo M. (2013) The role of arousal in two-resource problem tasks for humanoid service robots. In: Proceedings of IEEE RO-MAN 201. IEEE, Piscataway NJ: 62–69. ▸︎ Google︎ Scholar
Lowe R. & Ziemke T. (2013) Exploring the relationship of reward and punishment in reinforcement learning. In: Proceedings of the 2013 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL). IEEE, Piscataway NJ: 140–147. ▸︎ Google︎ Scholar
Lowe R., Montebelli A., Ieropoulos I., Greenman J., Melhuish C. & Ziemke T. (2010) Grounding motivation in energy autonomy: A study of artificial metabolism constrained robot dynamics. In: Fellermann H., Dörr M., Hanczyc M., Laursen L., Maurer S., Merkle D., Monnard P.-A., Sty K. & & Rasmussen S. (eds.) Artificial life XII. MIT Press, Cambridge MA: 725–732. https://cepa.info/2408
McEwen B. S. (1998) Stress, adaptation, and disease: Allostasis and allostatic load. Annals of the New York Academy of Sciences 840: 33–44. ▸︎ Google︎ Scholar
Montebelli A., Lowe R. & Ziemke T. (2008) The cognitive body: From dynamic modulation to anticipation. In: Pezzulo G., Butz M. V., Sigaud O. & Baldassarre G. (eds.) Anticipatory behavior in adaptive learning systems: From psychological theories to artificial cognitive systems. Springer, Berlin: 132–151. ▸︎ Google︎ Scholar
Montebelli A., Lowe R. & Ziemke T. (2013) Toward metabolic robotics: Insights from modeling embodied cognition in a biomechatronic symbiont. Artificial Life 19(3_4): 299–315. ▸︎ Google︎ Scholar
Montebelli A., Lowe R., Ieropoulos I., Melhuish C. R., Greenman J. & Ziemke T. (2010) Microbial fuel cell driven behavioral dynamics in robot simulations. In: Fellermann H., Dörr M., Hanczyc M., Laursen L., Maurer S., Merkle D., Monnard P.-A., Sty K. & Rasmussen S. (eds.) Artificial life XII. MIT Press: Cambridge MA: 749–756. ▸︎ Google︎ Scholar
Navarro-Guerrero N., Lowe R. J. & Wermter S. (2017) Improving robot motor learning with negatively valenced reinforcement signals. Frontiers in Neurorobotics 11: 10. https://www.frontiersin.org/articles/10.3389/fnbot.2017.00010
Schulkin J. (2011) Social allostasis: Anticipatory regulation of the internal milieu. Frontiers in Evolutionary Neuroscience 2: 111. https://www.frontiersin.org/articles/10.3389/fnevo.2010.00111
Seth A. K. (2015) The cybernetic Bayesian brain: From interoceptive inference to sensorimotor contingencies. In: Metzinger T. & Windt J. M. (eds.) Open mind. MIND Group, Frankfurt am Main: 35(T). https://open-mind.net/papers/the-cybernetic-bayesian-brain
Sterling P. (2004) Principles of allostasis: Optimal design, predictive regulation, pathophysiology, and rational therapeutics. In: Schulkin J. (ed.) Allostasis, homeostasis, and the costs of physiological adaptation. Cambridge University Press, Cambridge: 17–63. ▸︎ Google︎ Scholar
Sterling P. (2012) Allostasis: A model of predictive regulation. Physiology & Behavior 106(1): 5–15. https://cepa.info/5330

Comments: 0

To stay informed about comments to this publication and post comments yourself, please log in first.