A Multi-agent Q-learning Framework for Optimizing Stock Trading Systems
DEXA '02 Proceedings of the 13th International Conference on Database and Expert Systems Applications
To buy or not to buy: mining airfare data to minimize ticket purchase price
Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
System for foreign exchange trading using genetic algorithms and reinforcement learning
International Journal of Systems Science
Designing safe, profitable automated stock trading agents using evolutionary algorithms
Proceedings of the 8th annual conference on Genetic and evolutionary computation
Reinforcement Learning in Autonomic Computing: A Manifesto and Case Studies
IEEE Internet Computing
Learning to trade with insider information
Proceedings of the ninth international conference on Electronic commerce
Applied Intelligence
State-Dependent Exploration for Policy Gradient Methods
ECML PKDD '08 Proceedings of the European conference on Machine Learning and Knowledge Discovery in Databases - Part II
Learning bidding strategies with autonomous agents in environments with unstable equilibrium
Decision Support Systems
Policy Iteration for Learning an Exercise Policy for American Options
Recent Advances in Reinforcement Learning
Making Financial Trading by Recurrent Reinforcement Learning
KES '07 Knowledge-Based Intelligent Information and Engineering Systems and the XVII Italian Workshop on Neural Networks on Proceedings of the 11th International Conference
Reordering Sparsification of Kernel Machines in Approximate Policy Iteration
ISNN 2009 Proceedings of the 6th International Symposium on Neural Networks: Advances in Neural Networks - Part II
Financial market trading system with a hierarchical coevolutionary fuzzy predictive model
IEEE Transactions on Evolutionary Computation - Special issue on computational finance and economics
A Q-learning approach to derive optimal consumption and investment strategies
IEEE Transactions on Neural Networks
An automated FX trading system using adaptive reinforcement learning
Expert Systems with Applications: An International Journal
Solving deep memory POMDPs with recurrent policy gradients
ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
Expert Systems with Applications: An International Journal
Stock trading with cycles: A financial application of ANFIS and reinforcement learning
Expert Systems with Applications: An International Journal
Prediction in financial markets: The case for small disjuncts
ACM Transactions on Intelligent Systems and Technology (TIST)
Neuro-genetic system for stock index prediction
Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology - Evolutionary neural networks for practical applications
ICCOMP'06 Proceedings of the 10th WSEAS international conference on Computers
NN-OPT: neural network for option pricing using multinomial tree
ICONIP'06 Proceedings of the 13th international conference on Neural information processing - Volume Part III
Adaptive stock trading with dynamic asset allocation using reinforcement learning
Information Sciences: an International Journal
AI'06 Proceedings of the 19th international conference on Advances in Artificial Intelligence: Canadian Society for Computational Studies of Intelligence
Threshold recurrent reinforcement learning model for automated trading
EvoCOMNET'10 Proceedings of the 2010 international conference on Applications of Evolutionary Computation - Volume Part II
Three automated stock-trading agents: a comparative study
AAMAS'04 Proceedings of the 6th AAMAS international conference on Agent-Mediated Electronic Commerce: theories for and Engineering of Distributed Mechanisms and Systems
A rapid sparsification method for kernel machines in approximate policy iteration
ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
Trading team composition for the intraday multistock market
Decision Support Systems
A Novel Fuzzy Associative Memory Architecture for Stock Market Prediction and Trading
International Journal of Fuzzy System Applications
Online portfolio selection: A survey
ACM Computing Surveys (CSUR)
Hi-index | 0.01 |
We present methods for optimizing portfolios, asset allocations, and trading systems based on direct reinforcement (DR). In this approach, investment decision-making is viewed as a stochastic control problem, and strategies are discovered directly. We present an adaptive algorithm called recurrent reinforcement learning (RRL) for discovering investment policies. The need to build forecasting models is eliminated, and better trading performance is obtained. The direct reinforcement approach differs from dynamic programming and reinforcement algorithms such as TD-learning and Q-learning, which attempt to estimate a value function for the control problem. We find that the RRL direct reinforcement framework enables a simpler problem representation, avoids Bellman's curse of dimensionality and offers compelling advantages in efficiency. We demonstrate how direct reinforcement can be used to optimize risk-adjusted investment returns (including the differential Sharpe ratio), while accounting for the effects of transaction costs. In extensive simulation work using real financial data, we find that our approach based on RRL produces better trading strategies than systems utilizing Q-learning (a value function method). Real-world applications include an intra-daily currency trader and a monthly asset allocation system for the S&P 500 Stock Index and T-Bills