The cntlmon API on gateway at Caltech-Test

Legend:
green ball Normal status or debugging message
yellow ball Notable condition which may be a non-fatal error
orange ball Error condition not fatal to job
red ball Error condition fatal to job
blue ball Notable condition which is not an error
purple ball Currently undefined
email Condition requires email notification of the responsible administrator of this API
telephone Condition requires phone notification of the responsible administrator of this API

Link: API Status Page for Caltech-Test

09/07/08-02:16:16 PDT 09/07/08-09:16:16 GMT 904814190 IDLE archiveLog /ldas_outgoing/logs/LDAScntlmon.log.html (file13) closed (archived as /ldas_outgoing/logs/archive/cntlmonAPI/LDAScntlmon.904813988)
09/07/08-02:43:46 PDT 09/07/08-09:43:46 GMT 904815840 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-02:43:46 PDT 09/07/08-09:43:46 GMT 904815840 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-02:43:46 PDT 09/07/08-09:43:46 GMT 904815840 LDAS-TEST31585890 operator_callback begin processing LDAS-TEST31585890
09/07/08-02:43:50 PDT 09/07/08-09:43:50 GMT 904815844 LDAS-TEST31585808 mgr::rmJobFiles response has 8397 bytes
09/07/08-02:43:50 PDT 09/07/08-09:43:50 GMT 904815844 LDAS-TEST31585890 reattach done processing LDAS-TEST31585890, closing sock5
09/07/08-03:06:39 PDT 09/07/08-10:06:39 GMT 904817213 IDLE ::getPid appending pids 784 obtained from ps
09/07/08-03:06:39 PDT 09/07/08-10:06:39 GMT 904817213 IDLE ::getPid appending pids 810 obtained from ps
09/07/08-03:06:39 PDT 09/07/08-10:06:39 GMT 904817213 IDLE ::getPid appending pids 848 obtained from ps
09/07/08-03:06:39 PDT 09/07/08-10:06:39 GMT 904817213 IDLE cntlmon::cleanupLDASoutput next cleanup at 1220785599 secs
09/07/08-03:09:14 PDT 09/07/08-10:09:14 GMT 904817368 IDLE ::getPid appending pids 23569 obtained from ps
09/07/08-03:13:43 PDT 09/07/08-10:13:43 GMT 904817637 LDAS-TEST31586099 operator_callback begin processing LDAS-TEST31586099
09/07/08-03:13:45 PDT 09/07/08-10:13:45 GMT 904817639 LDAS-TEST31586095 mgr::rmJobFiles response has 6282 bytes
09/07/08-03:13:45 PDT 09/07/08-10:13:45 GMT 904817639 LDAS-TEST31586099 reattach done processing LDAS-TEST31586099, closing sock5
09/07/08-03:30:16 PDT 09/07/08-10:30:16 GMT 904818630 LDAS-TEST31586157 operator_callback begin processing LDAS-TEST31586157
09/07/08-03:30:20 PDT 09/07/08-10:30:20 GMT 904818634 LDAS-TEST31586113 mgr::rmJobFiles response has 11433 bytes
09/07/08-03:30:20 PDT 09/07/08-10:30:20 GMT 904818634 LDAS-TEST31586157 reattach done processing LDAS-TEST31586157, closing sock5
09/07/08-03:43:46 PDT 09/07/08-10:43:46 GMT 904819440 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-03:43:46 PDT 09/07/08-10:43:46 GMT 904819440 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-04:00:36 PDT 09/07/08-11:00:36 GMT 904820450 LDAS-TEST31586374 operator_callback begin processing LDAS-TEST31586374
09/07/08-04:00:38 PDT 09/07/08-11:00:38 GMT 904820452 LDAS-TEST31586363 mgr::rmJobFiles response has 55873 bytes
09/07/08-04:00:39 PDT 09/07/08-11:00:39 GMT 904820453 LDAS-TEST31586374 reattach done processing LDAS-TEST31586374, closing sock5
09/07/08-04:01:29 PDT 09/07/08-11:01:29 GMT 904820503 LDAS-TEST31586385 operator_callback begin processing LDAS-TEST31586385
09/07/08-04:01:30 PDT 09/07/08-11:01:30 GMT 904820504 LDAS-TEST31586380 mgr::rmJobFiles response has 6080 bytes
09/07/08-04:01:30 PDT 09/07/08-11:01:30 GMT 904820504 LDAS-TEST31586385 reattach done processing LDAS-TEST31586385, closing sock5
09/07/08-04:04:13 PDT 09/07/08-11:04:13 GMT 904820667 LDAS-TEST31586426 operator_callback begin processing LDAS-TEST31586426
09/07/08-04:04:14 PDT 09/07/08-11:04:14 GMT 904820668 LDAS-TEST31586425 mgr::rmJobFiles response has 6282 bytes
09/07/08-04:04:14 PDT 09/07/08-11:04:14 GMT 904820668 LDAS-TEST31586426 reattach done processing LDAS-TEST31586426, closing sock5
09/07/08-04:06:39 PDT 09/07/08-11:06:39 GMT 904820813 IDLE ::getPid appending pids 784 obtained from ps
09/07/08-04:06:39 PDT 09/07/08-11:06:39 GMT 904820813 IDLE ::getPid appending pids 810 obtained from ps
09/07/08-04:06:39 PDT 09/07/08-11:06:39 GMT 904820813 IDLE ::getPid appending pids 848 obtained from ps
09/07/08-04:06:39 PDT 09/07/08-11:06:39 GMT 904820813 IDLE cntlmon::cleanupLDASoutput next cleanup at 1220789199 secs
09/07/08-04:09:15 PDT 09/07/08-11:09:15 GMT 904820969 IDLE ::getPid appending pids 23569 obtained from ps
09/07/08-04:17:18 PDT 09/07/08-11:17:18 GMT 904821452 LDAS-TEST31586491 operator_callback begin processing LDAS-TEST31586491
09/07/08-04:17:20 PDT 09/07/08-11:17:20 GMT 904821454 LDAS-TEST31586476 mgr::rmJobFiles response has 5272 bytes
09/07/08-04:17:20 PDT 09/07/08-11:17:20 GMT 904821454 LDAS-TEST31586491 reattach done processing LDAS-TEST31586491, closing sock5
09/07/08-04:37:12 PDT 09/07/08-11:37:12 GMT 904822646 LDAS-TEST31586654 operator_callback begin processing LDAS-TEST31586654
09/07/08-04:37:15 PDT 09/07/08-11:37:15 GMT 904822649 LDAS-TEST31586649 mgr::rmJobFiles response has 7696 bytes
09/07/08-04:37:15 PDT 09/07/08-11:37:15 GMT 904822649 LDAS-TEST31586654 reattach done processing LDAS-TEST31586654, closing sock5
09/07/08-04:43:46 PDT 09/07/08-11:43:46 GMT 904823040 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-04:43:46 PDT 09/07/08-11:43:46 GMT 904823040 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-05:06:39 PDT 09/07/08-12:06:39 GMT 904824413 IDLE ::getPid appending pids 784 obtained from ps
09/07/08-05:06:39 PDT 09/07/08-12:06:39 GMT 904824413 IDLE ::getPid appending pids 810 obtained from ps
09/07/08-05:06:39 PDT 09/07/08-12:06:39 GMT 904824413 IDLE ::getPid appending pids 848 obtained from ps
09/07/08-05:06:39 PDT 09/07/08-12:06:39 GMT 904824413 IDLE cntlmon::cleanupLDASoutput next cleanup at 1220792799 secs
09/07/08-05:09:16 PDT 09/07/08-12:09:16 GMT 904824570 IDLE ::getPid appending pids 23569 obtained from ps
09/07/08-05:24:16 PDT 09/07/08-12:24:16 GMT 904825470 LDAS-TEST31586954 operator_callback begin processing LDAS-TEST31586954
09/07/08-05:24:20 PDT 09/07/08-12:24:20 GMT 904825474 LDAS-TEST31586903 mgr::rmJobFiles response has 8403 bytes
09/07/08-05:24:20 PDT 09/07/08-12:24:20 GMT 904825474 LDAS-TEST31586954 reattach done processing LDAS-TEST31586954, closing sock5
09/07/08-05:43:46 PDT 09/07/08-12:43:46 GMT 904826640 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-05:43:46 PDT 09/07/08-12:43:46 GMT 904826640 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-06:06:39 PDT 09/07/08-13:06:39 GMT 904828013 IDLE ::getPid appending pids 784 obtained from ps
09/07/08-06:06:39 PDT 09/07/08-13:06:39 GMT 904828013 IDLE ::getPid appending pids 810 obtained from ps
09/07/08-06:06:39 PDT 09/07/08-13:06:39 GMT 904828013 IDLE ::getPid appending pids 848 obtained from ps
09/07/08-06:06:39 PDT 09/07/08-13:06:39 GMT 904828013 IDLE cntlmon::cleanupLDASoutput next cleanup at 1220796399 secs
09/07/08-06:09:17 PDT 09/07/08-13:09:17 GMT 904828171 IDLE ::getPid appending pids 23569 obtained from ps
09/07/08-06:13:16 PDT 09/07/08-13:13:16 GMT 904828410 LDAS-TEST31587301 operator_callback begin processing LDAS-TEST31587301
09/07/08-06:13:18 PDT 09/07/08-13:13:18 GMT 904828412 LDAS-TEST31587299 mgr::rmJobFiles response has 6080 bytes
09/07/08-06:13:18 PDT 09/07/08-13:13:18 GMT 904828412 LDAS-TEST31587301 reattach done processing LDAS-TEST31587301, closing sock5
09/07/08-06:33:23 PDT 09/07/08-13:33:23 GMT 904829617 LDAS-TEST31587456 operator_callback begin processing LDAS-TEST31587456
09/07/08-06:33:26 PDT 09/07/08-13:33:26 GMT 904829620 LDAS-TEST31587451 mgr::rmJobFiles response has 5272 bytes
09/07/08-06:33:26 PDT 09/07/08-13:33:26 GMT 904829620 LDAS-TEST31587456 reattach done processing LDAS-TEST31587456, closing sock5
09/07/08-06:43:46 PDT 09/07/08-13:43:46 GMT 904830240 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-06:43:46 PDT 09/07/08-13:43:46 GMT 904830240 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-07:06:39 PDT 09/07/08-14:06:39 GMT 904831613 IDLE ::getPid appending pids 784 obtained from ps
09/07/08-07:06:39 PDT 09/07/08-14:06:39 GMT 904831613 IDLE ::getPid appending pids 810 obtained from ps
09/07/08-07:06:40 PDT 09/07/08-14:06:40 GMT 904831614 IDLE ::getPid appending pids 848 obtained from ps
09/07/08-07:06:40 PDT 09/07/08-14:06:40 GMT 904831614 IDLE cntlmon::cleanupLDASoutput next cleanup at 1220800000 secs
09/07/08-07:09:18 PDT 09/07/08-14:09:18 GMT 904831772 IDLE ::getPid appending pids 23569 obtained from ps
09/07/08-07:10:15 PDT 09/07/08-14:10:15 GMT 904831829 LDAS-TEST31587727 operator_callback begin processing LDAS-TEST31587727
09/07/08-07:10:19 PDT 09/07/08-14:10:19 GMT 904831833 LDAS-TEST31587724 mgr::rmJobFiles response has 11231 bytes
09/07/08-07:10:19 PDT 09/07/08-14:10:19 GMT 904831833 LDAS-TEST31587727 reattach done processing LDAS-TEST31587727, closing sock5
09/07/08-07:43:46 PDT 09/07/08-14:43:46 GMT 904833840 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-07:43:46 PDT 09/07/08-14:43:46 GMT 904833840 IDLE emergency_callback In the last hour, 0 emails were sent out, 0 emails blocked; so far 26393 emails were sent, 1090 unsent (throttle exceeded), 0 emails were blocked, 271 emails generated by ldas since 09/02/08-04:10:16 PDT
09/07/08-07:55:44 PDT 09/07/08-14:55:44 GMT 904834558 LDAS-TEST31588017 operator_callback begin processing LDAS-TEST31588017
09/07/08-07:55:50 PDT 09/07/08-14:55:50 GMT 904834564 LDAS-TEST31588013 mgr::rmJobFiles response has 7393 bytes
09/07/08-07:55:50 PDT 09/07/08-14:55:50 GMT 904834564 LDAS-TEST31588017 reattach done processing LDAS-TEST31588017, closing sock5
09/07/08-08:06:39 PDT 09/07/08-15:06:39 GMT 904835213 IDLE ::getPid appending pids 784 obtained from ps
09/07/08-08:06:40 PDT 09/07/08-15:06:40 GMT 904835214 IDLE ::getPid appending pids 810 obtained from ps
09/07/08-08:06:40 PDT 09/07/08-15:06:40 GMT 904835214 IDLE ::getPid appending pids 848 obtained from ps
09/07/08-08:06:40 PDT 09/07/08-15:06:40 GMT 904835214 IDLE cntlmon::cleanupLDASoutput next cleanup at 1220803600 secs
09/07/08-08:09:19 PDT 09/07/08-15:09:19 GMT 904835373 IDLE ::getPid appending pids 23569 obtained from ps
09/07/08-08:18:21 PDT 09/07/08-15:18:21 GMT 904835915 LDAS-TEST31588194 operator_callback begin processing LDAS-TEST31588194
09/07/08-08:18:23 PDT 09/07/08-15:18:23 GMT 904835917 LDAS-TEST31588192 mgr::rmJobFiles response has 6080 bytes
09/07/08-08:18:23 PDT 09/07/08-15:18:23 GMT 904835917 LDAS-TEST31588194 reattach done processing LDAS-TEST31588194, closing sock5