This is a 5U 108TB (0.1 PB) usable high performance tightly coupled storage unit we are shipping to a customer this week.
This is a spinning rust machine. We’ve been busy little beavers. Tuning, tweaking. And tuning. And tweaking.
Did I mention the tuning and tweaking?
Run status group 0 (all jobs): WRITE: io=196236MB, aggrb=4155.7MB/s, minb=4255.4MB/s, maxb=4255.4MB/s, mint=47222msec, maxt=47222msec
But … it gets … better.
Run status group 0 (all jobs): READ: io=196236MB, aggrb=5128.8MB/s, minb=5251.9MB/s, maxb=5251.9MB/s, mint=38262msec, maxt=38262msec
This is spinning rust. This is not SSD/Flash.
I think this just might be the fastest single spinning rust unit on the market. We are more than 2.5x faster at writes, and more than 3.5x faster on reads than the “worlds fastest” storage.
Now imagine building large storage clusters out of units like this. What sort of storage bandwidth wall should you expect? For a single box, 108TB/5.1GB/s = 2.2 x 104 seconds. About 1/4 of a day. Scale up to 10 machines for 1080TB and an aggregate 51 GB/s read speed. Which gives you a constant storage bandwidth wall height.
These units are going to a financial services customer. We are building many more of them.