ACM Transactions on Computer Systems (TOCS)
File access performance of diskless workstations
ACM Transactions on Computer Systems (TOCS)
A Crash Recovery Scheme for a Memory-Resident Database System
IEEE Transactions on Computers
Log files: an extended file service exploiting write-once storage
SOSP '87 Proceedings of the eleventh ACM Symposium on Operating systems principles
Reimplementing the Cedar file system using logging and group commit
SOSP '87 Proceedings of the eleventh ACM Symposium on Operating systems principles
The Sprite Network Operating System
Computer
A case for redundant arrays of inexpensive disks (RAID)
SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
Evolution of storage facilities in AIX Version 3 for RISC System/6000 processors
IBM Journal of Research and Development
Measurements of a distributed file system
SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
A trace-driven analysis of the UNIX 4.2 BSD file system
Proceedings of the tenth ACM symposium on Operating systems principles
Reliable object storage to support atomic actions
Proceedings of the tenth ACM symposium on Operating systems principles
A real-time garbage collector based on the lifetimes of objects
Communications of the ACM
Implementation techniques for main memory database systems
SIGMOD '84 Proceedings of the 1984 ACM SIGMOD international conference on Management of data
Notes on Data Base Operating Systems
Operating Systems, An Advanced Course
A study of file sizes and functional lifetimes
SOSP '81 Proceedings of the eighth ACM symposium on Operating systems principles
Measurements of a distributed file system
SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
Replication in the harp file system
SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
On-line data compression in a log-structured file system
ASPLOS V Proceedings of the fifth international conference on Architectural support for programming languages and operating systems
Parity declustering for continuous operation in redundant disk arrays
ASPLOS V Proceedings of the fifth international conference on Architectural support for programming languages and operating systems
A status report on research in transparent informed prefetching
ACM SIGOPS Operating Systems Review
Texas: good, fast, cheap persistence for C++
OOPSLA '92 Addendum to the proceedings on Object-oriented programming systems, languages, and applications (Addendum)
Pegasus—operating system support for distributed multimedia systems
ACM SIGOPS Operating Systems Review
Parity logging overcoming the small write problem in redundant disk arrays
ISCA '93 Proceedings of the 20th annual international symposium on computer architecture
A new approach to I/O performance evaluation: self-scaling I/O benchmarks, predicted I/O performance
SIGMETRICS '93 Proceedings of the 1993 ACM SIGMETRICS conference on Measurement and modeling of computer systems
Trace driven analysis of write caching policies for disks
SIGMETRICS '93 Proceedings of the 1993 ACM SIGMETRICS conference on Measurement and modeling of computer systems
The Zebra striped network file system
SOSP '93 Proceedings of the fourteenth ACM symposium on Operating systems principles
RAID: high-performance, reliable secondary storage
ACM Computing Surveys (CSUR)
ACM Transactions on Computer Systems (TOCS)
RAID-II: a high-bandwidth network file server
ISCA '94 Proceedings of the 21st annual international symposium on Computer architecture
A new approach to I/O performance evaluation: self-scaling I/O benchmarks, predicted I/O performance
ACM Transactions on Computer Systems (TOCS) - Special issue on computer architecture
The Zebra striped network file system
ACM Transactions on Computer Systems (TOCS)
Informed prefetching and caching
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
Hot mirroring: a method of hiding parity update penalty and degradation during rebuilds for RAID5
SIGMOD '96 Proceedings of the 1996 ACM SIGMOD international conference on Management of data
ACM Transactions on Computer Systems (TOCS)
Extended ephemeral logging: log storage management for applications with long lived transactions
ACM Transactions on Database Systems (TODS)
Security and log structured file systems
ACM SIGOPS Operating Systems Review
HFS: a performance-oriented flexible file system based on building-block compositions
ACM Transactions on Computer Systems (TOCS)
Self-similarity in file systems
SIGMETRICS '98/PERFORMANCE '98 Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
A memory-efficient real-time non-copying garbage collector
Proceedings of the 1st international symposium on Memory management
Virtual log based file systems for a programmable disk
OSDI '99 Proceedings of the third symposium on Operating systems design and implementation
Teaching real time OSs with DORITOS
SIGCSE '99 The proceedings of the thirtieth SIGCSE technical symposium on Computer science education
Separating key management from file system security
Proceedings of the seventeenth ACM symposium on Operating systems principles
Proceedings of the 8th ACM SIGOPS European workshop on Support for composing distributed applications
A comparative study of log-only and in-place update based temporal object database systems
Proceedings of the ninth international conference on Information and knowledge management
ACM Transactions on Database Systems (TODS)
Information and control in gray-box systems
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Fast and secure distributed read-only file system
ACM Transactions on Computer Systems (TOCS)
Analysis of methods for scheduling low priority disk drive tasks
SIGMETRICS '02 Proceedings of the 2002 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Web-conscious storage management for web proxies
IEEE/ACM Transactions on Networking (TON)
Implementing Atomicity in Two Systems: Techniques, Tradeoffs, and Experience
IEEE Transactions on Software Engineering
TDB: A Database System for Digital Rights Management
EDBT '02 Proceedings of the 8th International Conference on Extending Database Technology: Advances in Database Technology
Exploiting A History Database for Backup
VLDB '93 Proceedings of the 19th International Conference on Very Large Data Bases
Hot Block Clustering for Disk Arrays with Dynamic Striping
VLDB '95 Proceedings of the 21th International Conference on Very Large Data Bases
Design Issues in Transaction-Time Temporal Object Database Systems
ADBIS-DASFAA '00 Proceedings of the East-European Conference on Advances in Databases and Information Systems Held Jointly with International Conference on Database Systems for Advanced Applications: Current Issues in Databases and Information Systems
Implementing a Reliable Digital Object Archive
ECDL '00 Proceedings of the 4th European Conference on Research and Advanced Technology for Digital Libraries
Conquest: Better Performance Through a Disk/Persistent-RAM Hybrid File System
ATEC '02 Proceedings of the General Track of the annual conference on USENIX Annual Technical Conference
How to Manage Persistent State in DRM Systems
DRM '01 Revised Papers from the ACM CCS-8 Workshop on Security and Privacy in Digital Rights Management
Object and Log Management in Temporal Log-Only Object Database Systems
ADBIS '01 Proceedings of the 5th East European Conference on Advances in Databases and Information Systems
Design and evaluation of fault-tolerant shared file system for cluster systems
FTCS '96 Proceedings of the The Twenty-Sixth Annual International Symposium on Fault-Tolerant Computing (FTCS '96)
Issues in Reliable Network Memory Paging
MASCOTS '96 Proceedings of the 4th International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems
Dynamic Access Load Balancing on the Parallel Secondary Storage
PAS '97 Proceedings of the 2nd AIZU International Symposium on Parallel Algorithms / Architecture Synthesis
SRDS '99 Proceedings of the 18th IEEE Symposium on Reliable Distributed Systems
A Performance Evaluation of Log-Only Temporal Object Database Systems
SSDBM '00 Proceedings of the 12th International Conference on Scientific and Statistical Database Management
PFS: a distributed and customizable file system
IWOOOS '96 Proceedings of the 5th International Workshop on Object Orientation in Operating Systems (IWOOOS '96)
A Flexible I/O Framework for Parallel and Distributed Systems
IWOOOS '95 Proceedings of the 4th International Workshop on Object-Orientation in Operating Systems
Log Compaction and Garbage Collection: What could they Bring to Each Other?
IWOOOS '95 Proceedings of the 4th International Workshop on Object-Orientation in Operating Systems
Decentralized user authentication in a global file system
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Improving availability with recursive microreboots: a soft-state system case study
Performance Evaluation - Dependable systems and networks-performance and dependability symposium (DSN-PDS) 2002: Selected papers
A unified theory of garbage collection
OOPSLA '04 Proceedings of the 19th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications
ELF: an efficient log-structured flash file system for micro sensor nodes
SenSys '04 Proceedings of the 2nd international conference on Embedded networked sensor systems
SNAP: Efficient Snapshots for Back-in-Time Execution
ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Data structure repair using goal-directed reasoning
Proceedings of the 27th international conference on Software engineering
Bridging the digital divide: storage media + postal network = generic high-bandwidth communication
ACM Transactions on Storage (TOS)
A high-performance, transactional filestore for application servers
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Configuring and Scheduling an Eager-Writing Disk Array for a Transaction Processing Workload
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
Metadata Efficiency in Versioning File Systems
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
Improved proxy re-encryption schemes with applications to secure distributed storage
ACM Transactions on Information and System Security (TISSEC)
Using time travel to diagnose computer problems
Proceedings of the 11th workshop on ACM SIGOPS European workshop
Inference and enforcement of data structure consistency specifications
Proceedings of the 2006 international symposium on Software testing and analysis
LGeDBMS: a small DBMS for embedded system with flash memory
VLDB '06 Proceedings of the 32nd international conference on Very large data bases
An energy-efficient virtual memory system with flash memory as the secondary storage
Proceedings of the 2006 international symposium on Low power electronics and design
The Conquest file system: Better performance through a disk/persistent-RAM hybrid design
ACM Transactions on Storage (TOS)
Implementation of a Linux log-structured file system with a garbage collector
ACM SIGOPS Operating Systems Review
Extending ACID semantics to the file system
ACM Transactions on Storage (TOS)
Design of flash-based DBMS: an in-page logging approach
Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Glacier: highly durable, decentralized storage despite massive correlated failures
NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
How to build a trusted database system on untrusted storage
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
Fast and secure distributed read-only file system
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
Scalable, distributed data structures for internet service construction
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
Configuration debugging as search: finding the needle in the haystack
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Secure untrusted data repository (SUNDR)
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Secondary storage management for web proxies
USITS'99 Proceedings of the 2nd conference on USENIX Symposium on Internet Technologies and Systems - Volume 2
Operating-system support for distributed multimedia
USTC'94 Proceedings of the USENIX Summer 1994 Technical Conference on USENIX Summer 1994 Technical Conference - Volume 1
Metadata logging in an NFS server
TCON'95 Proceedings of the USENIX 1995 Technical Conference Proceedings
Opportunistic log: efficient installation reads in a reliable storage server
OSDI '94 Proceedings of the 1st USENIX conference on Operating Systems Design and Implementation
MSYM'93 Proceedings of the 3rd conference on USENIX MACH III Symposium - Volume 1
Fast consistency checking for the Solaris file system
ATEC '98 Proceedings of the annual conference on USENIX Annual Technical Conference
A comparison of OS extension technologies
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Implementation of a reliable remote memory pager
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Cut-and-paste file-systems: integrating simulators and file-systems
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Observing the effects of multi-zone disks
ATEC '97 Proceedings of the annual conference on USENIX Annual Technical Conference
Soft updates: a technique for eliminating most synchronous writes in the fast filesystem
ATEC '99 Proceedings of the annual conference on USENIX Annual Technical Conference
GnatDb: a small-footprint, secure database system
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Strong accountability for network storage
ACM Transactions on Storage (TOS)
Proceedings of the 9th workshop on Multimedia & security
Stasis: flexible transactional storage
OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
Operating system profiling via latency analysis
OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
Making information flow explicit in HiStar
OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
Lachesis: robust database storage management based on device-specific performance characteristics
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
A web based covert file system
HOTOS'07 Proceedings of the 11th USENIX workshop on Hot topics in operating systems
Write off-loading: practical power management for enterprise storage
FAST'08 Proceedings of the 6th USENIX Conference on File and Storage Technologies
Write off-loading: Practical power management for enterprise storage
ACM Transactions on Storage (TOS)
The case for active block layer extensions
ACM SIGOPS Operating Systems Review
When cryptography meets storage
Proceedings of the 4th ACM international workshop on Storage security and survivability
Adaptive disk scheduling with workload-dependent anticipation intervals
Journal of Systems and Software
Sensornet Checkpointing: Enabling Repeatability in Testbeds and Realism in Simulations
EWSN '09 Proceedings of the 6th European Conference on Wireless Sensor Networks
Energy-aware flash memory management in virtual memory system
IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Migrating server storage to SSDs: analysis of tradeoffs
Proceedings of the 4th ACM European conference on Computer systems
BORG: block-reORGanization for self-optimizing storage systems
FAST '09 Proccedings of the 7th conference on File and storage technologies
WorkOut: I/O workload outsourcing for boosting RAID reconstruction performance
FAST '09 Proccedings of the 7th conference on File and storage technologies
Enabling large-scale storage in sensor networks with the Coffee file system
IPSN '09 Proceedings of the 2009 International Conference on Information Processing in Sensor Networks
Dynamic in-page logging for flash-aware B-tree index
Proceedings of the 18th ACM conference on Information and knowledge management
A survey of confidential data storage and deletion methods
ACM Computing Surveys (CSUR)
Versioning for workflow evolution
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Cheap and large CAMs for high performance data-intensive networked systems
NSDI'10 Proceedings of the 7th USENIX conference on Networked systems design and implementation
Everest: scaling down peak loads through I/O off-loading
OSDI'08 Proceedings of the 8th USENIX conference on Operating systems design and implementation
Intelligent methods for file system optimization
AAAI'97/IAAI'97 Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence
Configuring and scheduling an eager-writing disk array for a transaction processing workload
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Chunkfs: using divide-and-conquer to improve file system reliability and repair
HotDep'06 Proceedings of the Second conference on Hot topics in system dependability
Design of embedded database based on hybrid storage of PRAM and NAND flash memory
DASFAA'11 Proceedings of the 16th international conference on Database systems for advanced applications
jVPFS: adding robustness to a secure stacked file system with untrusted local storage components
USENIXATC'11 Proceedings of the 2011 USENIX conference on USENIX annual technical conference
An efficient multi-tier tablet server storage architecture
Proceedings of the 2nd ACM Symposium on Cloud Computing
Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems
File system support for adjustable resolution applications in sensor networks
ADHOC-NOW'06 Proceedings of the 5th international conference on Ad-Hoc, Mobile, and Wireless Networks
Block storage virtualization with commodity secure digital cards
VEE '12 Proceedings of the 8th ACM SIGPLAN/SIGOPS conference on Virtual Execution Environments
bLSM: a general purpose log structured merge tree
SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
VM aware journaling: improving journaling file system performance in virtualization environments
Software—Practice & Experience
RAMCube: exploiting network proximity for ram-based key-value store
HotCloud'12 Proceedings of the 4th USENIX conference on Hot Topics in Cloud Ccomputing
The TokuFS streaming file system
HotStorage'12 Proceedings of the 4th USENIX conference on Hot Topics in Storage and File Systems
USENIX ATC'12 Proceedings of the 2012 USENIX conference on Annual Technical Conference
Analytic modeling of SSD write performance
Proceedings of the 5th Annual International Systems and Storage Conference
NAND flash memory-based hybrid file system for high I/O performance
Journal of Parallel and Distributed Computing
An empirical study of hot/cold data separation policies in solid state drives (SSDs)
Proceedings of the 6th International Systems and Storage Conference
Insights for exascale IO APIs from building a petascale IO API
SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
TABLEFS: enhancing metadata efficiency in the local file system
USENIX ATC'13 Proceedings of the 2013 USENIX conference on Annual Technical Conference
CORFU: A distributed shared log
ACM Transactions on Computer Systems (TOCS)
Improving flash write performance by using update frequency
Proceedings of the VLDB Endowment
Analytic Models of SSD Write Performance
ACM Transactions on Storage (TOS)
Memory efficient sanitization of a deduplicated storage system
FAST'13 Proceedings of the 11th USENIX conference on File and Storage Technologies
Hi-index | 0.00 |
This paper presents a new technique for disk storage management called a log-structured file system. A log-structured file system writes all modifications to disk sequentially in a log-like structure, thereby speeding up both file writing and crash recovery. The log is the only structure on disk; it contains indexing information so that files can be read back from the log efficiently. In order to maintain large free areas on disk for fast writing, we divide the log into segments and use a segment cleaner to compress the live information from heavily fragmented segments. We present a series of simulations that demonstrate the efficiency of a simple cleaning policy based on cost and benefit. We have implemented a prototype log-structured file system called Sprite LFS; it outperforms current Unix file systems by an order of magnitude for small-file writes while matching or exceeding Unix performance for reads and large writes. Even when the overhead for cleaning is included, Sprite LFS can use 70% of the disk bandwidth for writing, whereas Unix file systems typically can use only 5--10%.