16th International Conference on Cognitive Modeling
Managing the exploration vs exploitation trade-off is an important part of our everyday lives. It occurs in minor decisions such as choosing what music to listen to as well as major decisions, such as picking a research direction to pursue. The dilemma is the same despite the context: does one exploit the environment, using current knowledge to acquire a satisfactory solution, or explore other options and potentially find a better answer. An accurate cognitive model must be able to handle this trade-off because of the importance it plays in our lives. We are developing physio-cognitive models to better understand how physiological and cognitive processes interact to mediate decisions to explore or exploit. To accomplish this, we utilize the ACT-R/Φ hybrid architecture (Dancy, 2013; Dancy et al., 2015) and the Project Malmo AI platform (Johnson et al., 2016).
Schwartz, D. M., & Dancy, C. L. (2018). Towards a physio-cognitive model of the exploration exploitation trade-off. In proceedings of the 16th International Conference on Cognitive Modeling, Madison, WI: University of Wisconsin, 134-135.