Quick accounting tool for Torque
By joe
- 3 minutes read - 427 wordsA long while ago, I had developed a usage summary tool for gridengine. For our small internal cluster, we are using Torque (we set it up just as the dejecta was hitting the high rotational rate elements w.r.t. gridengine at Oracle, link URL may not be safe for work, and you might be offended by it … if so, I apologize.). This summary tool was a quick way to parse the accounting records. We developed even more tools, including converting the accounting records into databases, excel spreadsheets (yeah, you can say “oooh” now), and a number of other things. usage.pl was something of a hit for our customers. Many used it for chargeback summaries. Fast forward to today, and we are missing this in torque. Well, no longer.
landman@lightning:~/pbsaccting$ ./usage.pl --files=2011* --jobs --user=landman
jobid owner queue jobname submitted NCPUs wallclock
14 landman batch STDIN 1294073040 1 34
15 landman batch STDIN 1294073093 1 19
16 landman batch STDIN 1294073149 1 30
41 landman batch ExampleJob 1294417598 1 10
42 landman batch STDIN 1294421252 1 84
47 landman batch STDIN 1295991784 1 2
48 landman batch STDIN 1295991786 1 1
49 landman batch STDIN 1295991788 1 2
53 landman batch STDIN 1296055210 1 1
54 landman batch STDIN 1296055213 1 1
57 landman batch bt.bash 1296061273 68 1
58 landman batch bt.bash 1296061326 68 1
59 landman batch bt.bash 1296061485 64 1
60 landman batch bt.bash 1296061564 67 0
61 landman batch bt.bash 1296061721 67 1
62 landman batch STDIN 1296061876 64 15
65 landman batch STDIN 1296061985 64 78
96 landman batch STDIN 1296265537 1 19
108 landman batch STDIN 1296838316 1 7
109 landman batch STDIN 1296838736 1 8
125 landman batch STDIN 1297042442 1 2
126 landman batch STDIN 1297042449 48 7
127 landman batch STDIN 1297042549 48 1
133 landman batch STDIN 1297044348 48 3
195 landman batch STDIN 1297377710 1 4
196 landman batch ExampleJob 1297377732 1 10
200 landman batch STDIN 1297876725 1 0
201 landman batch STDIN 1297876742 1 0
202 landman batch STDIN 1297876745 1 0
203 landman batch STDIN 1297876817 1 5
204 landman batch STDIN 1297876823 1 2
205 landman batch STDIN 1297876825 1 4
206 landman batch STDIN 1297876832 1 19
207 landman batch STDIN 1298063839 1 66
total CPU seconds = 7077
total CPU hours = 1.966
Still have a bit of work to do to get them to a really nice state (e.g. pretty reports and all that). But we will clean them up over the next few weeks, and they will be released as GPL.