A reinforcement agent for object segmentation in ultrasound images

Authors:
Farhang Sahba;Hamid R. Tizhoosh;Magdy M. M. A. Salama
Affiliations:
Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada and Pattern Analysis and Machine Intelligence Laboratory (PAMI), University of Waterloo, Waterloo, Canada;Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada and Pattern Analysis and Machine Intelligence Laboratory (PAMI), University of Waterloo, Waterloo, Canada;Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, Canada
Venue:
Expert Systems with Applications: An International Journal
Year:
2008

Citing 2
Cited 6

Artificial intelligence: a modern approach

Artificial intelligence: a modern approach
Maximum entropy-based optimal threshold selection using deterministic reinforcement learning with controlled randomization

Signal Processing

An inclusive ontology based on the categories of intelligent software agents: an exploratory research

International Journal of Intelligent Engineering Informatics
Software agent with reinforcement learning approach for medical image segmentation

Journal of Computer Science and Technology
Improved watershed transform for tumor segmentation: Application to mammogram image compression

Expert Systems with Applications: An International Journal
A hybrid neural network model based reinforcement learning agent

ISNN'10 Proceedings of the 7th international conference on Advances in Neural Networks - Volume Part I
Image segmentation using Atanassov's intuitionistic fuzzy sets

Expert Systems with Applications: An International Journal
Neural network Reinforcement Learning for visual control of robot manipulators

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	12.06

Visualization

Abstract

The principal contribution of this work is to design a general framework for an intelligent system to extract one object of interest from ultrasound images. This system is based on reinforcement learning. The input image is divided into several sub-images, and the proposed system finds the appropriate local values for each of them so that it can extract the object of interest. The agent uses some images and their ground-truth (manually segmented) version to learn from. A reward function is employed to measure the similarities between the output and the manually segmented images, and to provide feedback to the agent. The information obtained can be used as valuable knowledge stored in the Q-matrix. The agent can then use this knowledge for new input images. The experimental results for prostate segmentation in trans-rectal ultrasound images show high potential of this approach in the field of ultrasound image segmentation.