Stochastic point location in non-stationary environments and its applications

  • Authors:
  • B. John Oommen;Sang-Woon Kim;Mathew Samuel;Ole-Christoffer Granmo

  • Affiliations:
  • School of Computer Science, Carleton University, Ottawa, Canada;Dept. of Computer Science and Engineering, Myongji University, Yongin, Korea;School of Computer Science, Carleton University, Ottawa, Canada;Dept. of ICT, Agder University College, Grimstad, Norway

  • Venue:
  • IEA/AIE'07 Proceedings of the 20th international conference on Industrial, engineering, and other applications of applied intelligent systems
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper reports the first known solution to the Stochastic Point Location (SPL) problem when the Environment is non-stationary. The SPL problem [12,13,14] involves a general learning problem in which the learning mechanism attempts to learn a "parameter", say λ*, within a closed interval. However, unlike the earlier reported results, we consider the scenario when the learning is to be done in a non-stationary setting. The Environment communicates with an intermediate entity (referred to as the Teacher) about the point itself, advising it where it should go. The mechanism searching for the point, in turn, receives responses from the Teacher, directing it how it should move. Therefore, the point itself, in the overall setting, is moving, delivering possibly incorrect information about its location to the Teacher. This, in turn, means that the "Environment" is itself non-stationary, implying that the advice of the Teacher is both uncertain and changing with time - rendering the problem extremely fascinating. The heart of the strategy we propose involves discretizing the space and performing a controlled random walk on this space. Apart from deriving some analytic results about our solution, we also report simulation results which demonstrate the power of the scheme.