An optimal online algorithm for metrical task systems
STOC '87 Proceedings of the nineteenth annual ACM symposium on Theory of computing
The design and implementation of a log-structured file system
ACM Transactions on Computer Systems (TOCS)
Database Systems Concepts
ELF: an efficient log-structured flash file system for micro sensor nodes
SenSys '04 Proceedings of the 2nd international conference on Embedded networked sensor systems
Hardware design experiences in ZebraNet
SenSys '04 Proceedings of the 2nd international conference on Embedded networked sensor systems
TSAR: a two tier sensor storage architecture using interval skip graphs
Proceedings of the 3rd international conference on Embedded networked sensor systems
Networked infomechanical systems: a mobile embedded networked sensor platform
IPSN '05 Proceedings of the 4th international symposium on Information processing in sensor networks
XYZ: a motion-enabled, power aware sensor node platform for distributed sensor network applications
IPSN '05 Proceedings of the 4th international symposium on Information processing in sensor networks
The design and implementation of a self-calibrating distributed acoustic sensing platform
Proceedings of the 4th international conference on Embedded networked sensor systems
CarTel: a distributed mobile sensor computing system
Proceedings of the 4th international conference on Embedded networked sensor systems
Capsule: an energy-optimized object storage system for memory-constrained sensor devices
Proceedings of the 4th international conference on Embedded networked sensor systems
Microhash: an efficient index structure for fash-based sensor devices
FAST'05 Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4
μ-tree: an ordered index structure for NAND flash memory
EMSOFT '07 Proceedings of the 7th ACM & IEEE international conference on Embedded software
Cooperative caching in wireless multimedia sensor networks
Proceedings of the 3rd international conference on Mobile multimedia communications
Design tradeoffs for SSD performance
ATC'08 USENIX 2008 Annual Technical Conference on Annual Technical Conference
Cooperative caching in wireless multimedia sensor networks
Mobile Networks and Applications
Proceedings of the VLDB Endowment
Online maintenance of very large random samples on flash storage
Proceedings of the VLDB Endowment
Proceedings of the VLDB Endowment
Modeling the performance of algorithms on flash memory devices
Proceedings of the 4th international workshop on Data management on new hardware
PBFilter: indexing flash-resident data through partitioned summaries
Proceedings of the 17th ACM conference on Information and knowledge management
Distributed image search in camera sensor networks
Proceedings of the 6th ACM conference on Embedded network sensor systems
A sequential indexing scheme for flash-based embedded systems
Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
Migrating server storage to SSDs: analysis of tradeoffs
Proceedings of the 4th ACM European conference on Computer systems
Survey of indexing schemes for information retrieval on flash memory based wireless sensor networks
Proceedings of the 2009 conference on Information Science, Technology and Applications
FlashLogging: exploiting flash devices for synchronous logging performance
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
A B-Tree index extension to enhance response time and the life cycle of flash memory
Information Sciences: an International Journal
Energy efficient sensor data logging with amnesic flash storage
IPSN '09 Proceedings of the 2009 International Conference on Information Processing in Sensor Networks
Enabling large-scale storage in sensor networks with the Coffee file system
IPSN '09 Proceedings of the 2009 International Conference on Information Processing in Sensor Networks
Evaluating Non-In-Place Update Techniques for Flash-Based Transaction Processing Systems
DEXA '09 Proceedings of the 20th International Conference on Database and Expert Systems Applications
FAST: Flash-aware external sorting for mobile database systems
Journal of Systems and Software
NANDFS: a flexible flash file system for RAM-constrained systems
EMSOFT '09 Proceedings of the seventh ACM international conference on Embedded software
FAWN: a fast array of wimpy nodes
Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles
Cache consistency in Wireless Multimedia Sensor Networks
Ad Hoc Networks
An object placement advisor for DB2 using solid state storage
Proceedings of the VLDB Endowment
Lazy-Adaptive Tree: an optimized index structure for flash devices
Proceedings of the VLDB Endowment
Online maintenance of very large random samples on flash storage
The VLDB Journal — The International Journal on Very Large Data Bases
Programming storage-centric sensor networks with Squirrel
Proceedings of the 9th ACM/IEEE International Conference on Information Processing in Sensor Networks
PR-join: a non-blocking join achieving higher early result rate with statistical guarantees
Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
Cheap and large CAMs for high performance data-intensive networked systems
NSDI'10 Proceedings of the 7th USENIX conference on Networked systems design and implementation
ChunkStash: speeding up inline storage deduplication using flash memory
USENIXATC'10 Proceedings of the 2010 USENIX conference on USENIX annual technical conference
Vertical partitioning for flash and HDD database systems
Journal of Systems and Software
On the impact of flash SSDs on spatial indexing
Proceedings of the Sixth International Workshop on Data Management on New Hardware
Flashing databases: expectations and limitations
Proceedings of the Sixth International Workshop on Data Management on New Hardware
Enix: a lightweight dynamic operating system for tightly constrained wireless sensor platforms
Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems
Tree indexing on solid state drives
Proceedings of the VLDB Endowment
FlashStore: high throughput persistent key-value store
Proceedings of the VLDB Endowment
Adaptive logging for mobile device
Proceedings of the VLDB Endowment
Journal of Computer Science and Technology
FAWN: a fast array of wimpy nodes
Communications of the ACM
LazyFTL: a page-level flash translation layer optimized for NAND flash memory
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
SkimpyStash: RAM space skimpy key-value store on flash-based storage
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
Data management over flash memory
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
A novel method to extend flash memory lifetime in flash-based DBMS
DASFAA'11 Proceedings of the 16th international conference on Database systems for advanced applications
Log-compact R-tree: an efficient spatial index for SSD
DASFAA'11 Proceedings of the 16th international conference on Database systems for advanced applications
FAST: a generic framework for flash-aware spatial trees
SSTD'11 Proceedings of the 12th international conference on Advances in spatial and temporal databases
SILT: a memory-efficient, high-performance key-value store
SOSP '11 Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles
Column-oriented query processing for row stores
Proceedings of the ACM 14th international workshop on Data Warehousing and OLAP
Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems
FlashB-tree: a novel B-tree index scheme for solid state drives
Proceedings of the 2011 ACM Symposium on Research in Applied Computation
bLSM: a general purpose log structured merge tree
SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
PBFilter: A flash-based indexing scheme for embedded systems
Information Systems
TL-Tree: flash-optimized storage for time-series sensing data on sensor platforms
Proceedings of the 27th Annual ACM Symposium on Applied Computing
HotDataTrap: a sampling-based hot data identification scheme for flash memory
Proceedings of the 27th Annual ACM Symposium on Applied Computing
Improving database performance using a flash-based write cache
DASFAA'12 Proceedings of the 17th international conference on Database Systems for Advanced Applications
Implementation of the aggregated r-tree over flash memory
DASFAA'12 Proceedings of the 17th international conference on Database Systems for Advanced Applications
Power- and time-aware buffer cache management for real-time embedded databases
Journal of Systems Architecture: the EUROMICRO Journal
A practical concurrent index for solid-state drives
Proceedings of the 21st ACM international conference on Information and knowledge management
Adapting the b+-tree for asymmetric i/o
ADBIS'12 Proceedings of the 16th East European conference on Advances in Databases and Information Systems
HybridStore: an efficient data management system for hybrid flash-based sensor devices
EWSN'13 Proceedings of the 10th European conference on Wireless Sensor Networks
An on-line hot data identification for flash-based storage using sampling mechanism
ACM SIGAPP Applied Computing Review
Sensor streams middleware for easy configuration and processing in hybrid sensor network
Proceedings of the 28th Annual ACM Symposium on Applied Computing
Investigating hybrid SSD FTL schemes for Hadoop workloads
Proceedings of the ACM International Conference on Computing Frontiers
ACM Transactions on Embedded Computing Systems (TECS)
Scalable multi-access flash store for big data analytics
Proceedings of the 2014 ACM/SIGDA international symposium on Field-programmable gate arrays
A group round robin based b-tree index storage scheme for flash memory devices
Proceedings of the 8th International Conference on Ubiquitous Information Management and Communication
Supporting historic queries in sensor networks with flash storage
Information Systems
Hi-index | 0.02 |
FlashDB is a self-tuning database optimized for sensor networks using NAND flash storage. In practical systems flash is used in different packages such as on-board flash chips, compact flash cards, secure digital cards and related formats. Our experiments reveal non-trivial differences in their access costs. Furthermore, databases may be subject to different types of workloads. We show that existing databases for flash are not optimized for all types of flash devices or for all workloads and their performance is thus suboptimal in many practical systems. FlashDB uses a novel self-tuning index that dynamically adapts its storage structure to workload and underlying storage device. We formalize the self-tuning nature of an index as a two-state task system and propose a 3-competitive online algorithm that achieves the theoretical optimum. We also provide a framework to determine the optimal size of an index node that minimizes energy and latency for a given device. Finally, we propose optimizations to further improve the performance of our index. We prototype and compare different indexing schemes on multiple flash devices and workloads, and show that our indexing scheme outperforms existing schemes under all workloads and flash devices we consider.