On crushing older tests

About 6 years ago, I wrote this, about a benchmark test that did a 2TB write in 73s or so, on pure spinning disk. That result was just so far out there, compared to pretty much anything else available, in terms of performance density (single rack of storage units). The hardware was Scalable Informatics Unison … Read more

On using legacy tooling in modern HPC systems

Or as House MD may have put it So there you are, working on a system with a group, when you realize that something is out of kilter. And you think to yourself … It’s not DNSThere is a no way it’s DNSIt was DNS So your team works on resolving the issue. And the … Read more

On risk and how to mitigate it

On 1-March-2020, I wrote this article. In it I argued that the risk benefit/reward equations have been thrown out of kilter by the pandemic. Or maybe, rather than thrown out of kilter, maybe they are reverting to a more natural state, where risks that have been previously discounted, are now showing their true (or more … Read more

On zeros

Not a math post, I promise. Really about teams. You have a team of people. You have a mission. You have a (short) timeline. You need them to focus on the problem, and find the minimum temporal path length process to achieve a resolution. You have a process, albeit informal, to address issues, which is … Read more

R.I.P. Rich

The link to his obituary. A wonderful person, deeply insightful, excellent communicator. Gone too soon. I will miss him. I think everyone in #HPC will.

Updating compressors for NyBLE

Compressing tools like gzip and bzip2 have been around quite a long time. They are, well, mature. Almost boring. You depend upon them for many things. You don’t really pay attention to them until you use them for significant work. Like with NyBLE, compression and decompression are important, and time sensitive steps … well … … Read more

My urgent #HPC computational project, COVID-19 related

This is the project that I alluded to. We tuned the system, the code, the environment. We wrote tooling to massively simplify job creation and submission. Moreover, we worked around numerous issues that arise in each technological layer. Multiple simultaneous tools are being deployed to work on this, and I am hopeful that the net … Read more

Time to replace some hardware

I built an updated raid pair of drives with a brand new OS for the system that underlies this blog and other services. Basically, the previous system load had been updated from debian 7 through debian 9 and had accumulated lots of cruft. So I rebuilt this using my wonderful nyble system on a lab … Read more