I have backend on cephfs cluster, mounted on gateway. Mount path is shared with samba 4.7.4. But my speed is low, about 1,5MB/s with small files (1k - 100k). I copy ot with win server 2008 client. Locally i copy the same files 5-6 times faster. So i tried to use 5-6 clients to copy this files and got the same speed as locally.
I tried different socket options, but not get required speed
aio read size = 1 aio write size = 1
P.S. tried vfs_ceph, but did not get any profits. And with acl_xattr it working 4 times worse than mounted cephfs.