Paper Infomation
An Efficient File Assignment Strategy for Hybrid Parallel Storage System with Energy & Reliability Constraints
Full Text(PDF, 977KB)
Author: Xupeng Wang, Wei Jiang, Hang Lei, Xia Zhang
Abstract: In this work, we are interested in the file assignment problem in a distributed file system. We adopt a hybrid parallel storage system consisting of hard and flash disks, and then address the problem of minimizing the system’s mean response time by determining the distribution of the files in the system. In addition, energy efficiency and system reliability are all taken into consideration and regarded as the system constraints. Due to the complexity of the problem, we propose our Two Stage File Assignment algorithm (TSFA) to find an optimized solution with predefined constraints. The efficiency of our algorithm is verified by extensive experiments.
Keywords: Parallel I/O System; Flash Disk; Energy Conservation; System Reliability; FAP
References:
[1] Chen P M, Lee E K, Gibson G A, et al. RAID: High-performance, reliable secondary storage[J]. ACM Computing Surveys (CSUR), 1994, 26(2): 145-185.Choi, Mihwa. “Contesting Imaginaires in Death Rituals during the Northern Song Dynasty.” PhD diss., University of Chicago, 2008
[2] Kim Y J, Kwon K T, Kim J. Energy-efficient file placement techniques for heterogeneous mobile storage systems[C]//Proceedings of the 6th ACM & IEEE International conference on Embedded software. ACM, 2006: 171-177.García Márquez, Gabriel. Love in the Time of Cholera. Translated by Edith Grossman. London: Cape, 1988
[3] Nijim M, Manzanares A, Ruan X, et al. HYBUD: an energy-efficient architecture for hybrid parallel disk systems[C]//Computer Communications and Networks, 2009. ICCCN 2009. Proceedings of 18th Internatonal Conference on. IEEE, 2009: 1-6.Kossinets, Gueorgi, and Duncan J. Watts. “Origins of Homophily in an Evolving Social Network.” American Journal of Sociology 115 (2009): 405-50. Accessed February 28, 2010. doi:10.1086/599247
[4] Xie T, Madathil D. SAIL: self-adaptive file reallocation on hybrid disk arrays[M]//High Performance Computing-HiPC 2008. Springer Berlin Heidelberg, 2008: 529-540.Pollan, Michael et al., The Omnivore’s Dilemma: A Natural History of Four Meals. New York: Penguin, 2006
[5] Dowdy L W, Foster D V. Comparative models of the file assignment problem[J]. ACM Computing Surveys (CSUR), 1982, 14(2): 287-313.Stolberg, Sheryl Gay, and Robert Pear. “Wary Centrists Posing Challenge in Health Care Vote.” New York Times, February 27, 2012. Accessed February 28, 2012. http://www.nytimes.com/2010/02/28/us/politics/28health.html
[6] Copeland G, Alexander W, Boughter E, et al. Data placement in Bubba[M]. ACM, 1988.Weinstein, Joshua I. “The Market in Plato’s Republic.” Classical Philology. 104 (2009): 439-58
[7] Wolf J. The placement optimization program: a practical solution to the disk file assignment problem[M]. ACM, 1989
[8] Wah B W. File placement on distributed computer systems[J]. IEEE Computer, 1984, 17(1): 23-32
[9] Madathil D K, Thota R B, Paul P, et al. A static data placement strategy towards perfect load-balancing for distributed storage clusters[C]//Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on. IEEE, 2008: 1-8
[10] Lee L W, Scheuermann P, Vingralek R. File assignment in parallel I/O systems with minimal variance of service time[J]. Computers, IEEE Transactions on, 2000, 49(2): 127-140
[11] Xie T, Sun Y. A file assignment strategy independent of workload characteristic assumptions[J]. ACM Transactions on Storage (TOS), 2009, 5(3): 10
[12] Zhu Q, David F M, Devaraj C F, et al. Reducing energy consumption of disk storage using power-aware cache management[C]//Software, IEE Proceedings-. IEEE, 2004: 118-118
[13] Carrera E V, Pinheiro E, Bianchini R. Conserving disk energy in network servers[C]//Proceedings of the 17th annual international conference on Supercomputing. ACM, 2003: 86-97