MetaData performance evaluation

The results of metadata performance testing through mdtestopen in new window are as follows:

tool settings

#!/bin/bash
TEST_PATH=/mnt/cfs/mdtest # mount point of CubeFS volume
for CLIENTS in 1 2 4 8 # number of clients
do
mpirun --allow-run-as-root -np $CLIENTS --hostfile hfile01 mdtest -n 5000 -u -z 2 -i 3 -d $TEST_PATH;
done

Directory Creation

Dir Creation

1 Process4 Processes16 Processes64 Processes
1 Client769.9083630.33712777.61920629.592
2 Clients1713.0387259.28224064.05236769.599
4 Clients3723.99314002.36642976.83761513.648
8 Clients6681.78323946.14364191.3893729.222

Directory Removal

Dir Removal

1 Process4 Processes16 Processes64 Processes
1 Client853.9954012.40415238.64742028.845
2 Clients1906.2617967.68828410.30862338.506
4 Clients3942.59015601.79946741.94587411.655
8 Clients7072.08025183.09269054.92379459.091

Directory Status Check

Dir Stat

1 Process4 Processes16 Processes64 Processes
1 Client462527.4451736760.3326194206.76815509755.836
2 Clients885454.3353414538.35212263175.10424951003.498
4 Clients1727030.7826874284.76524371306.25010412238.894
8 Clients1897588.2147499219.74425927923.6464264896.279

File Creation

File Creation

1 Process4 Processes16 Processes64 Processes
1 Client706.4533306.2709647.17610879.290
2 Clients1601.8916601.52219181.96520756.693
4 Clients3369.91113165.05636158.06141817.753
8 Clients6312.91122560.68755801.06276157.675

File Removal

File Removal

1 Process4 Processes16 Processes64 Processes
1 Client1220.3224606.34011715.45723653.043
2 Clients2360.1338971.36122097.20641579.985
4 Clients4547.02117242.90034965.47161726.902
8 Clients8809.38120379.83955363.38971101.736

Tree Creation

Tree Creation

1 Process4 Processes16 Processes64 Processes
1 Client734.383379.403146.07037.811
2 Clients648.938432.150148.92130.699
4 Clients756.639394.733123.72223.998
8 Clients607.547263.439124.9117.510

Tree Removal

Tree Removal

1 Process4 Processes16 Processes64 Processes
1 Client552.70683.19723.8235.747
2 Clients448.55784.63324.0375.137
4 Clients453.52085.63623.4905.233
8 Clients429.92083.44923.7771.667
Edit on GitHub