Fast communication: The exponentiated convex variable step-size (ECVSS) algorithm

  • Authors:
  • Corneliu Rusu;Colin F. N. Cowan

  • Affiliations:
  • Faculty of Electronics, Telecommunications and Information Technology, Technical University of Cluj-Napoca, Cluj-Napoca, Str. Baritiu 26-28, RO-400027, Romania;Department of Electrical and Electronic Engineering, The Queen's University of Belfast, UK

  • Venue:
  • Signal Processing
  • Year:
  • 2010

Quantified Score

Hi-index 0.08

Visualization

Abstract

For some time there is a large interest in variable step-size methods for adaptive filtering. Recently, a few stochastic gradient algorithms have been proposed, which are based on cost functions that have exponential dependence on the chosen error. However, we have experienced that the cost function based on exponential of the squared error does not always satisfactorily converge. In this paper we modify this cost function in order to improve the convergence of exponentiated cost function and the novel ECVSS (exponentiated convex variable step-size) stochastic gradient algorithm is obtained. The proposed technique has attractive properties in both stationary and abrupt-change situations.