如何利用wrap测试oss性能?

前言

我们利用mino与ceph rgw搭建好的oss经过多层网络转发,传输速度必定有所折损,这个时候我们使用wrap来测试oss对象存储的真实性能

利用wrap测试oss性能

wrap是minio项目下的一个开源测试工具,wrap会上传一定随机数据到oss对象存储服务器上,统计过程消耗时间得出整个oss性能分析。

使用docker 执行测试

docker pull minio/warp:v0.5.5docker run –net host minio/warp:v0.5.5 mixed –host=172.16.1.54:7480 –access-key=123456 –secret-key=123456 –autoterm

上述命令使用warpv0.5.5对地址为172.16.1.54:7480的oss服务器进行测试。

相关命令

FLAGS:–no-color disable color theme–debug enable debug output–insecure disable TLS certificate verification–autocompletion install auto-completion for your shell–host value host. Multiple hosts can be specified as a comma separated list. (default: “127.0.0.1:9000”) [$WARP_HOST]–access-key value Specify access key [$WARP_ACCESS_KEY]–secret-key value Specify secret key [$WARP_SECRET_KEY]–tls Use TLS (HTTPS) for transport [$WARP_TLS]–region value Specify a custom region [$WARP_REGION]–encrypt encrypt/decrypt objects (using server-side encryption with random keys)–bucket value Bucket to use for benchmark data. ALL DATA WILL BE DELETED IN BUCKET! (default: “warp-benchmark-bucket”)–host-select value Host selection algorithm. Can be “weighed” or “roundrobin” (default: “weighed”)–concurrent value Run this many concurrent operations (default: 20)–noprefix Do not use separate prefix for each thread–prefix value Use a custom prefix for each thread–disable-multipart disable multipart uploads–md5 Add MD5 sum to uploads–storage-class value Specify custom storage class, for instance ‘STANDARD’ or ‘REDUCED_REDUNDANCY’.–objects value Number of objects to upload. (default: 2500)–obj.size value Size of each generated object. Can be a number or 10KiB/MiB/GiB. All sizes are base 2 binary. (default: “10MiB”)–get-distrib value The amount of GET operations. (default: 45)–stat-distrib value The amount of STAT operations. (default: 30)–put-distrib value The amount of PUT operations. (default: 15)–delete-distrib value The amount of DELETE operations. Must be at least the same as PUT. (default: 10)–obj.generator value Use specific data generator (default: “random”)–obj.randsize Randomize size of objects so they will be up to the specified size–benchdata value Output benchmark+profile data to this file. By default unique filename is generated.–serverprof value Run MinIO server profiling during benchmark; possible values are ‘cpu’, ‘mem’, ‘block’, ‘mutex’ and ‘trace’.–duration value Duration to run the benchmark. Use ‘s’ and ‘m’ to specify seconds and minutes. (default: 5m0s)–autoterm Auto terminate when benchmark is considered stable.–autoterm.dur value Minimum duration where output must have been stable to allow automatic termination. (default: 10s)–autoterm.pct value The percentage the last 6/25 time blocks must be within current speed to auto terminate. (default: 7.5)–noclear Do not clear bucket before or after running benchmarks. Use when running multiple clients.–syncstart value Specify a benchmark start time. Time format is ‘hh:mm’ where hours are specified in 24h format, server TZ.–warp-client value Connect to warp clients and run benchmarks there.–analyze.dur value Split analysis into durations of this length. Can be ‘1s’, ‘5s’, ‘1m’, etc.–analyze.out value Output aggregated data as to file–analyze.op value Only output for this op. Can be GET/PUT/DELETE, etc.–analyze.host value Only output for this host.–analyze.skip value Additional duration to skip when analyzing data. (default: 0s)–analyze.v Display additional analysis data.–serve value When running benchmarks open a webserver to fetch results remotely, eg: localhost:7762–help, -h show help

结果

Uploading 2500 objects of Random data; 4194304 bytes totalwarp: Starting benchmark in 3s…warp: Benchmark starting…Throughput 101.0 objects/s within 7.500000% for 10.262s. Assuming stability. Terminating benchmark.warp: Saving benchmark data…warp: Benchmark data written to “warp-mixed-2022-04-18[030853]-nm3V.csv.zst”Mixed operations.Operation: DELETE, 10%, Concurrency: 20, Ran 36s.* Throughput: 33.90 obj/sOperation: GET, 45%, Concurrency: 20, Ran 36s.* Throughput: 610.60 MiB/s, 152.65 obj/sOperation: PUT, 15%, Concurrency: 20, Ran 36s.* Throughput: 203.71 MiB/s, 50.93 obj/sOperation: STAT, 30%, Concurrency: 20, Ran 36s.* Throughput: 101.58 obj/sCluster Total: 813.56 MiB/s, 338.78 obj/s over 37s.

结语

以上就是使用wrap测试oss的其中一种办法,你学会了吗?希望读者朋友看完这篇文章后有所启发

郑重声明:本文内容及图片均整理自互联网,不代表本站立场,版权归原作者所有,如有侵权请联系管理员(admin#wlmqw.com)删除。
(0)
用户投稿
上一篇 2022年6月18日
下一篇 2022年6月18日

相关推荐

联系我们

联系邮箱:admin#wlmqw.com
工作时间:周一至周五,10:30-18:30,节假日休息