Small file performance evaluation
The results of the small file performance test by mdtest are as follows:
Configuration
#!/bin/bash
set -e
TARGET_PATH="/home/service/chubaofs/adls/mnt-perform-test" # mount point of CubeFS volume
for FILE_SIZE in 1024 2048 4096 8192 16384 32768 65536 131072 # file size
do
CMD="/usr/lib64/openmpi/bin/mpirun --allow-run-as-root -mca plm_rsh_args '-p 18822' -np 512 --hostfile hfile64 mdtest -n 1000 -w $FILE_SIZE -e $FILE_SIZE -y -u -i 3 -N 1 -F -R -d $TARGET_PATH"
#CMD="/usr/lib64/openmpi/bin/mpirun --allow-run-as-root -mca plm_rsh_args '-p 18822' -np 512 --hostfile hfile64 mdtest -n 1000 -w $FILE_SIZE -e $FILE_SIZE -y -u -i 3 -N 1 -F -R -d $TARGET_PATH"
echo
echo $CMD
eval $CMD | tee -a ${LOGPREFIX}.txt
echo "start to sleep 5s"
sleep 5
done
Test Results
| File Size (KB) | 1 | 2 | 4 | 8 | 16 | 32 | 64 | 128 |
|---|---|---|---|---|---|---|---|---|
| Creation (TPS) | 49808 | 37726 | 42296 | 44826 | 41481 | 35699 | 31609 | 35622 |
| Read (TPS) | 76743 | 81085 | 84831 | 75397 | 73165 | 69665 | 62135 | 53658 |
| Deletion (TPS) | 72522 | 67749 | 70919 | 68689 | 69819 | 71671 | 71568 | 71647 |
| Stat (TPS) | 188609 | 185945 | 188542 | 180602 | 188274 | 174771 | 171100 | 183334 |
Edit on GitHub