Education, Science, Technology, Innovation and Life
Open Access
Sign In

A Distributed Block Storage Optimization Mechanism Based on Ceph

Download as PDF

DOI: 10.23977/amce.2019.006

Author(s)

Yang Pi, Zhanglong Wang

Corresponding Author

Yang Pi

ABSTRACT

RADOS block device (RBD) is the storage service component in Ceph, which provides an important block storage service for OpenStack and other cloud computing platforms. In response to the challenges faced by enterprises in terms of higher resource utilization and read/write rates on block storage services, Ceph provides Cache Tiering to improve cluster performance in heterogeneous storage environments. However, the least recently used (LRU) algorithm in Cache Tiering would evict more valuable data due to cache pollution which causes higher latency for some requests; Meanwhile, when the data is allocated on the storage node, the Controlled Replication Under Scalable Hashing (CRUSH) algorithm only considers the storage node capacity, which makes Ceph unable to dynamically balance the node's I/O load. To solve these problems, a storage selection strategy based on the prediction model is proposed to increase the hit ratio of object access in the cache pool and improve the overall I/O performance of the cluster; Besides, the cache pool I/O load balancing strategy is also proposed. Compared with the native mechanism, the proposed block storage optimization mechanism can achieve higher I/O throughput and more balanced I/O load.

KEYWORDS

Ceph, Block storage, Cache Tiering, Storage selection, Load balancing

All published work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2016 - 2031 Clausius Scientific Press Inc. All Rights Reserved.