Abstract
This work introduces two new neuro-fuzzy systems for intelligent agents called Reinforcement Learning – Hierarchical Neuro-Fuzzy Systems BSP (RL-HNFB) and Reinforcement Learning – Hierarchical Neuro-Fuzzy Systems Politree (RL-HNFP). By using hierarchical partitioning methods, together with the Reinforcement Learning (RL) methodology, a new class of Neuro-Fuzzy Systems (SNF) was obtained, which executes, in addition to automatically learning its structure, the autonomous learning of the actions to be taken by an agent. These characteristics have been developed in order to bypass the traditional drawbacks of neuro-fuzzy systems. The paper details the two novel RL_HNF systems and evaluates their performance in a benchmark application – the cart-centering problem. The results obtained demonstrate the capacity of the proposed models in extracting knowledge from the agent’s direct interaction with large and/or continuous environments.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Vellasco, M., Pacheco, M., Figueiredo, K.: Hierarchical Neuro-Fuzzy Systems. In: Mira, J., Álvarez, J.R. (eds.) IWANN 2003. LNCS, vol. 2686, pp. 126–135. Springer, Heidelberg (2003)
Jouffe, L.: Fuzzy Inference System Learning by Reinforcement Methods. IEEE Trans. on SMCs-C 28/3, 338–355 (1998)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Jang, J.S.R.: ANFIS: Adaptive-network-based fuzzy inference system. IEEE Trans. on SMC 23(3), 665–685 (1993)
Kruse, R., Nauck, D.: NEFCLASS-A neuro-fuzzy approach for the classification of data. In: Proc. of the 1995 ACM Symposium on Applied Computing, pp. 26–28 (1995)
Vuorimaa, P.: Fuzzy self-organing map. Fuzzy Sets and Systems (66), 223–231 (1994)
Vellasco, M., Pacheco, M., Ribeiro Neto, L.S., Souza, F.J.: Electric load forecasting: evaluating the novel hierarchical neuro-fuzzy BSP model. Electrical Power and Energy Systems Elsevier Ltd 26, 131–142 (2004)
Souza, F., Vellasco, M., Pacheco, M.: Hierarchical Neuro-Fuzzy QuadTree Models. Fuzzy Sets & Systems 130/2, 189–205 (2002)
Koza, J.R.: Genetic Programming: On the programming of computers by means of natural selection. MIT Press, Cambridge (1992)
Figueiredo, K., Vellasco, M., Pacheco, M., Souza, F.: Reinforcement Learning Hierarchical Neuro-Fuzzy Politree Model for Control of Autonomous Agents. In: Fourth Int. Conf. on Hybrid Intelligent Systems, Japan (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Figueiredo, K., Vellasco, M., Pacheco, M.A. (2005). Hierarchical Neuro-fuzzy Models Based on Reinforcement Learning for Intelligent Agents. In: Cabestany, J., Prieto, A., Sandoval, F. (eds) Computational Intelligence and Bioinspired Systems. IWANN 2005. Lecture Notes in Computer Science, vol 3512. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11494669_52
Download citation
DOI: https://doi.org/10.1007/11494669_52
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26208-4
Online ISBN: 978-3-540-32106-4
eBook Packages: Computer ScienceComputer Science (R0)