Quick accounting tool for Torque

A long while ago, I had developed a usage summary tool for gridengine. For our small internal cluster, we are using Torque (we set it up just as the dejecta was hitting the high rotational rate elements w.r.t. gridengine at Oracle, link URL may not be safe for work, and you might be offended by it … if so, I apologize.).

This summary tool was a quick way to parse the accounting records. We developed even more tools, including converting the accounting records into databases, excel spreadsheets (yeah, you can say “oooh” now), and a number of other things. usage.pl was something of a hit for our customers. Many used it for chargeback summaries.

Fast forward to today, and we are missing this in torque.

Well, no longer.

landman@lightning:~/pbsaccting$ ./usage.pl  --files=2011* --jobs --user=landman
 jobid      owner      queue        jobname       submitted   NCPUs        wallclock
    14    landman      batch          STDIN       1294073040      1               34
    15    landman      batch          STDIN       1294073093      1               19
    16    landman      batch          STDIN       1294073149      1               30
    41    landman      batch     ExampleJob       1294417598      1               10
    42    landman      batch          STDIN       1294421252      1               84
    47    landman      batch          STDIN       1295991784      1                2
    48    landman      batch          STDIN       1295991786      1                1
    49    landman      batch          STDIN       1295991788      1                2
    53    landman      batch          STDIN       1296055210      1                1
    54    landman      batch          STDIN       1296055213      1                1
    57    landman      batch        bt.bash       1296061273     68                1
    58    landman      batch        bt.bash       1296061326     68                1
    59    landman      batch        bt.bash       1296061485     64                1
    60    landman      batch        bt.bash       1296061564     67                0
    61    landman      batch        bt.bash       1296061721     67                1
    62    landman      batch          STDIN       1296061876     64               15
    65    landman      batch          STDIN       1296061985     64               78
    96    landman      batch          STDIN       1296265537      1               19
   108    landman      batch          STDIN       1296838316      1                7
   109    landman      batch          STDIN       1296838736      1                8
   125    landman      batch          STDIN       1297042442      1                2
   126    landman      batch          STDIN       1297042449     48                7
   127    landman      batch          STDIN       1297042549     48                1
   133    landman      batch          STDIN       1297044348     48                3
   195    landman      batch          STDIN       1297377710      1                4
   196    landman      batch     ExampleJob       1297377732      1               10
   200    landman      batch          STDIN       1297876725      1                0
   201    landman      batch          STDIN       1297876742      1                0
   202    landman      batch          STDIN       1297876745      1                0
   203    landman      batch          STDIN       1297876817      1                5
   204    landman      batch          STDIN       1297876823      1                2
   205    landman      batch          STDIN       1297876825      1                4
   206    landman      batch          STDIN       1297876832      1               19
   207    landman      batch          STDIN       1298063839      1               66
total CPU seconds = 7077
total CPU hours = 1.966

Still have a bit of work to do to get them to a really nice state (e.g. pretty reports and all that). But we will clean them up over the next few weeks, and they will be released as GPL.

Viewed 8633 times by 2110 viewers

Facebooktwittergoogle_plusredditpinterestlinkedinmail