- EIEIO
Jokes aside, this algorithm was inspired by the Fog-of-War (FoW) functional proposed in my first paper, which sought to bias exploration to the areas proportionally to the time since they had last been visited. In formulating a data-driven analog to the FoW functional, we extended the FoW with EIEIO so that heterogeneity in the nonstationary environment is taken into account. Since the first paper on EIEIO has been published, we have published a chapter (Chapter 2) in Springer's Handling Uncertainty and Networked Structure in Robot Control in collaboration with Lucian Busoniu and Levente Tamas, which becomes available in 2016.
