Learning the Filling Policy of a Biodegradation Process by Fuzzy Actor---Critic Learning Methodology

  • Authors:
  • Efraín Franco Flores;Julio Waissman Vilanova;Jair García Lamont

  • Affiliations:
  • Centro de Investigación en Tecnologías de la Información y Sistemas, Unversidad Autónoma del Estado de Hidalgo, Pachuca Hgo, México 42084;Centro de Investigación en Tecnologías de la Información y Sistemas, Unversidad Autónoma del Estado de Hidalgo, Pachuca Hgo, México 42084 and Departamento de Matemáti ...;Centro de Investigación en Tecnologías de la Información y Sistemas, Unversidad Autónoma del Estado de Hidalgo, Pachuca Hgo, México 42084

  • Venue:
  • MICAI '08 Proceedings of the 7th Mexican International Conference on Artificial Intelligence: Advances in Artificial Intelligence
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Reinforcement Learning is a learning methodology through an agent interacting with the environment. Actor-Critic methods have a separated memory structure to present the independence between the policy and the value function. In systems where the states are defined as continuous, there is a problem with dimensionality, and an approximation method has to be used. The classic Reinforcement Learning algorithms can be combined with Fuzzy Logic techniques to store all value functions, since Fuzzy Logic has been proved to be an effective universal approximator. This work propose a Fuzzy Actor-Critic method to compute and store the state values using fuzzy logic to get a state approximation. Phenol is one of the most important water pollutants on chemistry industries. A phenol biodegradation process consist on a Sequence Batch Reactor (SBR), that need an near optimal filling policy for its correct operation. Fuzzy Actor Critic learning strategy offers a operation policy and it can be linguistically interpreted by the process experts, this approach can be useful to propose a comprehensive filling policy of a biodegradation SBR process.