Ok. Lets call this an absolutely wild ride so far. I mean, its freaking insane. I cannot remember working so hard and so fast.
First off Tiburon, our cluster software package (designed mostly for HPC Storage, and cluster like things) has been an insanely awesome trouper. It just works. And I mean that in a jaw dropping manner. It just freaking works.
Part of it may be due to the simplicity of the thing. I dunno.
New machines. Never set them up in the database. Turned them on. PXE booted. And they were up. I mean, our DeltaV’s, our compute nodes. Just up. Fully loaded. Insanely easy to manage.
And of course, a compute node is not a storage node, so a wee little script executed in the boot process figures out if its a storage node and directs storage nodes to assemble their volumes and export them, while directing compute nodes to do their stuff. Real simple. Works perfectly on pretty much all our units so far.
Yes, it makes setting up storage (and compute) clusters as simple as putting in a new unit, turning it on, and (for the most part) walking away.