turning siFlash past 10 (GB/s that is) ...

Yeah, that title is a Spinal Tap homage. We are bringing a new siFlash unit to the HPC on Wall Street conference. This uses our new chassis, an updated kernel, and lots of tuning. Still have much more work to do … but its probably good enough to ship now. I ran a few quick speed drills on it. 4.2 GB/s streaming write , and 10.7 GB/s streaming read with 96 simultaneous processes. No, I am not kidding.

Run status group 0 (all jobs):
   READ: io=381312MB, aggrb=10680MB/s, minb=10680MB/s, maxb=10680MB/s, mint=35703msec, maxt=35703msec

Thats reading 1/3 of a Terabyte in about 36 seconds. So 1TB ought to take about 100 seconds or so. Writing 1TB takes about 287s

Run status group 0 (all jobs):
  WRITE: io=1140.4GB, aggrb=4067.9MB/s, minb=4067.9MB/s, maxb=4067.9MB/s, mint=287067msec, maxt=287067msec

Reading is a little faster.

Run status group 0 (all jobs):
   READ: io=1140.4GB, aggrb=11074MB/s, minb=11074MB/s, maxb=11074MB/s, mint=105449msec, maxt=105449msec

Thats 1TB (really 1.14TB) read in 106 seconds. 11.1 GB/s. This is one of the fastest self contained storage boxes on the market. We’ve got to rebuild some of the raids and do a better job on interrupt management. This isn’t the last word on performance for this. Not by a long shot. And to drop a hint. A fairly massive hint … this is not, by any stretch of the imagination, our fastest box. We’ll save turning things up to 11 for a later date. I did say something about coming roaring across the 10 year mark … didn’t I. Just getting started though … just getting started :D [update] I guess I should point out that (in response to an inquiry)

• Yes, they are shipping now
• Yes, we can get pretty good densities per machine

And for those looking to build really insanely fast storage systems, as these are about 1% of 1TB/s, 100 units or so ought to be able to handle that sort of data read rate. Thats about 13 racks of these. 30 racks if you want to write 1TB/s. Assuming 10 machines per rack BTW. And yes, they will happily be OSSes/OSTes for Lustre, FhGFS, GlusterFS, … or even a plain old NFS server.