Design is good, but it looks like we are rate limited on the PCIe gen 2.
128GB read from a single name space. 8 simultaneous threads.
Run status group 0 (all jobs):
READ: io=126984MB, aggrb=5285.8MB/s, minb=5412.6MB/s, maxb=5412.6MB/s, mint=24024msec, maxt=24024msec
Yes, that is 5.3 GB/s. Still far south of what we can be doing, but I’ve verified that we are rate limited to ~2GB/s per RAID with other tests. This looks like a card issue. This is closer to PCIe-x4 gen2 performance, not the x8 performance we are supposed to be getting. Working on this.
Getting something like 115k IOPs. Again, should be much higher. Starting to think I am hitting some stack driver latencies.