Matchmaking: Distributed Resource Management for High Throughput Computing
HPDC '98 Proceedings of the 7th IEEE International Symposium on High Performance Distributed Computing
High-Speed Distributed Video Transcoding for Multiple Rates and Formats
IEICE - Transactions on Information and Systems
Dryad: distributed data-parallel programs from sequential building blocks
Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
MapReduce: simplified data processing on large clusters
Communications of the ACM - 50th anniversary issue: 1958 - 2008
Centralized versus Distributed Schedulers for Bag-of-Tasks Applications
IEEE Transactions on Parallel and Distributed Systems
Quincy: fair scheduling for distributed computing clusters
Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles
Distributed media transcoding using a P2P network of set top boxes
CCNC'09 Proceedings of the 6th IEEE Conference on Consumer Communications and Networking Conference
The Research on a P2P Transcoding System Based on Distributed Farming Computing Architecture
KESE '09 Proceedings of the 2009 Pacific-Asia Conference on Knowledge Engineering and Software Engineering
Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling
Proceedings of the 5th European conference on Computer systems
| Hi-index | 0.00 |
We present a highly scalable distributed media transcoding system that reduces the time required for batch transcoding of multimedia files into several output formats. To implement this system we propose a fully distributed architecture that leverages proven technologies to create a highly scalable and fault-tolerant platform. Also a new task-oriented parallel processing framework that improves on MapReduce is developed in order to express transcoding tasks as distributed processes and execute them on top of the distributed platform. Preliminary results show a significant reduction in time resources required to transcode large batches of media files with little effects on the quality of the output transcoded files.