Coda: A Highly Available File System for a Distributed Workstation Environment
IEEE Transactions on Computers
Managing update conflicts in Bayou, a weakly connected replicated storage system
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs
SIAM Journal on Scientific Computing
Computers and Intractability: A Guide to the Theory of NP-Completeness
Computers and Intractability: A Guide to the Theory of NP-Completeness
Farsite: federated, available, and reliable storage for an incompletely trusted environment
OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
Graph evolution: Densification and shrinking diameters
ACM Transactions on Knowledge Discovery from Data (TKDD)
Dynamo: amazon's highly available key-value store
Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles
Measurement and analysis of online social networks
Proceedings of the 7th ACM SIGCOMM conference on Internet measurement
Expander flows, geometric embeddings and graph partitioning
Journal of the ACM (JACM)
On the evolution of user interaction in Facebook
Proceedings of the 2nd ACM workshop on Online social networks
Understanding online social network usage from a network perspective
Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference
Characterizing user behavior in online social networks
Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference
Mining communities in networks: a solution for consistency and its evaluation
Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference
Exploiting locality of interest in online social networks
Proceedings of the 6th International COnference
Load-balanced migration of social media to content clouds
Proceedings of the 21st international workshop on Network and operating systems support for digital audio and video
Partitioning social networks for time-dependent queries
Proceedings of the 4th Workshop on Social Network Systems
Feed following: the big data challenge in social applications
Databases and Social Networks
Optimal network locality in distributed virtualized data-centers
Computer Communications
ParallelGDB: a parallel graph database based on cache specialization
Proceedings of the 15th Symposium on International Database Engineering & Applications
Latency-aware data partitioning for geo-replicated online social networks
Proceedings of the Workshop on Posters and Demos Track
Characterizing user navigation and interactions in online social networks
Information Sciences: an International Journal
Diverging towards the common good: heterogeneous self-organisation in decentralised recommenders
Proceedings of the Fifth Workshop on Social Network Systems
On the impact of users availability in OSNs
Proceedings of the Fifth Workshop on Social Network Systems
Shepherding social feed generation with Sheep
Proceedings of the Fifth Workshop on Social Network Systems
Social piggybacking: leveraging common friends to generate event streams
Proceedings of the Fifth Workshop on Social Network Systems
S-CLONE: Socially-aware data replication for social networks
Computer Networks: The International Journal of Computer and Telecommunications Networking
TailGate: handling long-tail content with a little help from friends
Proceedings of the 21st international conference on World Wide Web
YouTube around the world: geographic popularity of videos
Proceedings of the 21st international conference on World Wide Web
Confidant: protecting OSN data without locking it up
Middleware'11 Proceedings of the 12th ACM/IFIP/USENIX international conference on Middleware
Managing large dynamic graphs efficiently
SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
Towards effective partition management for large graphs
SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
Content and geographical locality in user-generated content sharing systems
Proceedings of the 22nd international workshop on Network and Operating System Support for Digital Audio and Video
Clustered embedding of massive social networks
Proceedings of the 12th ACM SIGMETRICS/PERFORMANCE joint international conference on Measurement and Modeling of Computer Systems
Graph data partition models for online social networks
Proceedings of the 23rd ACM conference on Hypertext and social media
Far from the eyes, close on the web: impact of geographic distance on online social interactions
Proceedings of the 2012 ACM workshop on Workshop on online social networks
Managing large graphs on multi-cores with graph awareness
USENIX ATC'12 Proceedings of the 2012 USENIX conference on Annual Technical Conference
Executing web application queries on a partitioned database
WebApps'12 Proceedings of the 3rd USENIX conference on Web Application Development
PowerGraph: distributed graph-parallel computation on natural graphs
OSDI'12 Proceedings of the 10th USENIX conference on Operating Systems Design and Implementation
Facilitating real-time graph mining
Proceedings of the fourth international workshop on Cloud data management
Improving large graph processing on partitioned graphs in the cloud
Proceedings of the Third ACM Symposium on Cloud Computing
Using vector interfaces to deliver millions of IOPS from a networked key-value storage server
Proceedings of the Third ACM Symposium on Cloud Computing
Propagation-based social-aware replication for social video contents
Proceedings of the 20th ACM international conference on Multimedia
Evolution of a location-based online social network: analysis and models
Proceedings of the 2012 ACM conference on Internet measurement conference
Cloud-based social application deployment using local processing and global distribution
Proceedings of the 8th international conference on Emerging networking experiments and technologies
Confidant: protecting OSN data without locking it up
Proceedings of the 12th International Middleware Conference
Proceedings of the sixth ACM international conference on Web search and data mining
Analyzing the scalability of a social network of agents
Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining
Pushing CDN-ISP collaboration to the limit
ACM SIGCOMM Computer Communication Review
Two decades of internet video streaming: A retrospective view
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special Sections on the 20th Anniversary of ACM International Conference on Multimedia, Best Papers of ACM Multimedia 2012
Crowd crawling: towards collaborative data collection for large-scale online social networks
Proceedings of the first ACM conference on Online social networks
Propagation-based social-aware multimedia content distribution
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special Sections on the 20th Anniversary of ACM International Conference on Multimedia, Best Papers of ACM Multimedia 2012
FENNEL: streaming graph partitioning for massive scale graphs
Proceedings of the 7th ACM international conference on Web search and data mining
Understanding the locality effect in Twitter: measurement and analysis
Personal and Ubiquitous Computing
Hi-index | 0.00 |
The difficulty of scaling Online Social Networks (OSNs) has introduced new system design challenges that has often caused costly re-architecting for services like Twitter and Facebook. The complexity of interconnection of users in social networks has introduced new scalability challenges. Conventional vertical scaling by resorting to full replication can be a costly proposition. Horizontal scaling by partitioning and distributing data among multiples servers - e.g. using DHTs - can lead to costly inter-server communication. We design, implement, and evaluate SPAR, a social partitioning and replication middle-ware that transparently leverages the social graph structure to achieve data locality while minimizing replication. SPAR guarantees that for all users in an OSN, their direct neighbor's data is co-located in the same server. The gains from this approach are multi-fold: application developers can assume local semantics, i.e., develop as they would for a single server; scalability is achieved by adding commodity servers with low memory and network I/O requirements; and redundancy is achieved at a fraction of the cost. We detail our system design and an evaluation based on datasets from Twitter, Orkut, and Facebook, with a working implementation. We show that SPAR incurs minimum overhead, and can help a well-known open-source Twitter clone reach Twitter's scale without changing a line of its application logic and achieves higher throughput than Cassandra, Facebook's DHT based key-value store database.