호스팅 TIP > 리눅스

호스팅 TIP

보안

시스템

프로그래밍

리눅스

월간 인기 게시물

	게시물 1,376건

RBD QOS

글쓴이 : 최고관리자 날짜 : 2019-08-09 (금) 14:10 조회 : 873

글주소 :

Ciner Backend 는 스토리지 제공자가 설정한 qos 를 나타낸다.

백엔드 QoS에는 스토리지 제공자의 지원이 필요합니다. 일반적인 스토리지 장치는 EMC와 같은 QoS를 지원하지만 최신 버전의 Ceph Mimic RBD도 IOPS QoS를 지원하지만 그 기능은 여전히 완벽하지는 않습니다. 따라서 Ceph 스토리지 솔루션에 연결하는 사용자는 프런트 엔드 Qos를 사용하여 가상 시스템의 QoS를 데이터 디스크로 제한합니다.

※ Ceph 에서는 Mimic 에서부터...QOS를 지원하며 어느정도의 테스트는 필요

image-meta list (image-meta ls) Image metadata list keys with values.

image-meta remove (image-meta rm) Image metadata remove the key and value associated.

image-meta set Image metadata set key with value.

image-meta 설정

# rbd image-meta list queens_volumes/volume-7b4797af-527b-4ddb-9352-b003dd5662e1

There are 0 metadata on this image.

# rbd image-meta set queens_volumes/volume-7b4797af-527b-4ddb-9352-b003dd5662e1 conf_rbd_qos_iops_limit 1000

# rbd image-meta list queens_volumes/volume-7b4797af-527b-4ddb-9352-b003dd5662e1

There is 1 metadatum on this image:

Key Value

conf_rbd_qos_iops_limit 1000

image-meta 삭제

# rbd image-meta remove queens_volumes/volume-7b4797af-527b-4ddb-9352-b003dd5662e1 conf_rbd_qos_iops_limit

# rbd image-meta list queens_volumes/volume-7b4797af-527b-4ddb-9352-b003dd5662e1

There are 0 metadata on this image.

Pool 별로 설정

# rbd config pool list test_volumes_cephfs |grep qos

rbd_qos_bps_burst 0 config

rbd_qos_bps_limit 0 config

rbd_qos_iops_burst 0 config

rbd_qos_iops_limit 0 pool

rbd_qos_read_bps_burst 0 config

rbd_qos_read_bps_limit 0 config

rbd_qos_read_iops_burst 0 config

rbd_qos_read_iops_limit 10 config

rbd_qos_schedule_tick_min 50 config

rbd_qos_write_bps_burst 0 config

rbd_qos_write_bps_limit 0 config

rbd_qos_write_iops_burst 0 config

rbd_qos_write_iops_limit 0 config

# rbd config pool set test_volumes_cephfs rbd_qos_iops_limit 50

# rbd config pool list test_volumes_cephfs |grep qos

rbd_qos_bps_burst 0 config

rbd_qos_bps_limit 0 config

rbd_qos_iops_burst 0 config

rbd_qos_iops_limit 50 pool

rbd_qos_read_bps_burst 0 config

rbd_qos_read_bps_limit 0 config

rbd_qos_read_iops_burst 0 config

rbd_qos_read_iops_limit 10 config

rbd_qos_schedule_tick_min 50 config

rbd_qos_write_bps_burst 0 config

rbd_qos_write_bps_limit 0 config

rbd_qos_write_iops_burst 0 config

rbd_qos_write_iops_limit 0 config

==>> rbd bench 툴로 체크했을때 적용 OK

:: Dashboard 에서 확인

※ mimic 에서는 conf_rbd_qos_iops_limit 옵션만 지원하며....이후 버전(Nautilus)에서는 아래 옵션까지 지원가능

v 14.2.0 Nautilus released 2019. 03.19.
https://ceph.io/releases/v14-2-0-nautilus-released/

https://blog.csdn.net/Jmilk/article/details/89494746

https://blog.csdn.net/jmilk/article/details/86493844

Benchmark

https://edenmal.moe/post/2017/Ceph-rbd-bench-Commands/

# rbd bench --io-type read --io-size 4096 --io-threads 1 <Pool>/<images>

# rbd bench --io-type write --io-size 4096 --io-threads 1 <Pool>/<images>

기본값
mon 서버에서만.... ceph.conf 파일에 삽입하면 적용
:: rbd qos iops limit = 100

# service ceph-mon@ceph-mon restart

~~# ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config show |grep qos~~

~~"rbd_qos_bps_burst": "0",~~

~~"rbd_qos_bps_limit": "0",~~

~~"rbd_qos_iops_burst": "0",~~

~~"rbd_qos_iops_limit": "0",~~

~~"rbd_qos_read_bps_burst": "0",~~

~~"rbd_qos_read_bps_limit": "0",~~

~~"rbd_qos_read_iops_burst": "0",~~

~~"rbd_qos_read_iops_limit": "0",~~

~~"rbd_qos_schedule_tick_min": "50",~~

~~"rbd_qos_write_bps_burst": "0",~~

~~"rbd_qos_write_bps_limit": "0",~~

~~"rbd_qos_write_iops_burst": "0",~~

~~"rbd_qos_write_iops_limit": "0",~~

ceph.conf 파일에 삽입하면...
:: rbd qos iops limit = 100

~~# ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config show |grep qos~~

~~"rbd_qos_bps_burst": "0",~~

~~"rbd_qos_bps_limit": "0",~~

~~"rbd_qos_iops_burst": "0",~~

~~"rbd_qos_iops_limit": "100",~~

~~"rbd_qos_read_bps_burst": "0",~~

~~"rbd_qos_read_bps_limit": "0",~~

~~"rbd_qos_read_iops_burst": "0",~~

~~"rbd_qos_read_iops_limit": "0",~~

~~"rbd_qos_schedule_tick_min": "50",~~

~~"rbd_qos_write_bps_burst": "0",~~

~~"rbd_qos_write_bps_limit": "0",~~

~~"rbd_qos_write_iops_burst": "0",~~

~~"rbd_qos_write_iops_limit": "0",~~

https://docs.ceph.com/docs/master/rbd/rbd-config-ref/

QOS SETTINGS

librbd supports limiting per image IO, controlled by the following settings.

rbd qos iops limit

Description:	The desired limit of IO operations per second.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos bps limit

Description:	The desired limit of IO bytes per second.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos read iops limit

Description:	The desired limit of read operations per second.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos write iops limit

Description:	The desired limit of write operations per second.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos read bps limit

Description:	The desired limit of read bytes per second.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos write bps limit

Description:	The desired limit of write bytes per second.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos iops burst

Description:	The desired burst limit of IO operations.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos bps burst

Description:	The desired burst limit of IO bytes.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos read iops burst

Description:	The desired burst limit of read operations.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos write iops burst

Description:	The desired burst limit of write operations.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos read bps burst

Description:	The desired burst limit of read bytes.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos write bps burst

Description:	The desired burst limit of write bytes.
Type:	Unsigned Integer
Required:	No
Default:	`0`

rbd qos schedule tick min

Description:	The minimum schedule tick (in milliseconds) for QoS.
Type:	Unsigned Integer
Required:	No
Default:	`50`

여행스케치

웹소식

자유게시판

인기검색어

	for	1
	mon	2
	AND
	ceph	1
	mysql
	--	1
	http	2
	volume	3
	sq	1
	all	2