The mpi API on metaserver at Caltech-Test

Legend:
green ball Normal status or debugging message
yellow ball Notable condition which may be a non-fatal error
orange ball Error condition not fatal to job
red ball Error condition fatal to job
blue ball Notable condition which is not an error
purple ball Currently undefined
email Condition requires email notification of the responsible administrator of this API
telephone Condition requires phone notification of the responsible administrator of this API

Link: API Status Page for Caltech-Test

08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP archiveLog file "/ldas_outgoing/logs/LDASmpi.log.html" already closed. (archived as /ldas_outgoing/logs/archive/mpiAPI/LDASmpi.903133313)
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP execOverload overloaded exec
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP closeListenSock no cid registered for service 'data'
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP mpi::init unused data port 10024 closed
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP mpi::initNodes *** no slave nodes configured on this system ***
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP mpi::init port 10024 (jobstate) opened on metaserver as sock5
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP bgLoop Looping process watchlogs started
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP openListenSock port 10022 (operator) opened on metaserver as sock6
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP openListenSock port 10023 (emergency) opened on metaserver as sock7
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP setResourceLimit vmemoryuse=unlimited; datasize=unlimited; core=unlimited; maxproc=32767; descriptors=1024; memorylocked=32768; filesize=unlimited; cputime=unlimited
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP leakLogger inital size of mpi API: 12804 kB
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP bgLoop Looping process etchosts started
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP mpi Trying API
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP mpi API yes
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP mpi Trying LDAS_SYSTEM
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 STARTUP mpi LDAS_SYSTEM yes
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 IDLE bgLoop Looping process statpagefile started
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 IDLE bgLoop Looping process killedjobreaper started
08/20/2008-04:43:27 PM PDT 08/20/2008-11:43:27 PM GMT 903311021 IDLE bgLoop Looping process logrotate started
08/20/2008-04:43:32 PM PDT 08/20/2008-11:43:32 PM GMT 903311026 IDLE setFTPandHTTPinfo (::FTPURL 'ftp://131.215.115.235') (::FTPDIR '') (::HTTPURL 'http://131.215.115.235/ldas_outgoing/jobs') (::HTTPDIR '/ldas_outgoing/jobs') (::GRIDFTPURL 'gridftp:/export/grid/ldas') (::GRIDFTPDIR '/export/grid/ldas') (::LDAS_GATEWAY 'ldas-test 131.215.115.235') (::LDAS_SYSTEM 'ldas-test') (::RUNCODE 'LDAS-TEST')
08/20/2008-04:43:32 PM PDT 08/20/2008-11:43:32 PM GMT 903311026 STARTUP mpi::killAllMpirun cleaning up for user ldas
08/20/2008-04:43:34 PM PDT 08/20/2008-11:43:34 PM GMT 903311028 STARTUP mpi::killAllMpirun ran kill 2 times in 1.391 seconds
08/20/2008-04:43:34 PM PDT 08/20/2008-11:43:34 PM GMT 903311028 STARTUP mpi::prestartLamds running lamboot for user search01
08/20/2008-04:43:35 PM PDT 08/20/2008-11:43:35 PM GMT 903311029 STARTUP mpi::prestartLamds running lamboot for user search02
08/20/2008-04:43:36 PM PDT 08/20/2008-11:43:36 PM GMT 903311030 STARTUP mpi::prestartLamds running lamboot for user search03
08/20/2008-04:43:36 PM PDT 08/20/2008-11:43:36 PM GMT 903311030 STARTUP mpi::prestartLamds running lamboot for user search04
08/20/2008-04:43:37 PM PDT 08/20/2008-11:43:37 PM GMT 903311031 STARTUP mpi::prestartLamds running lamboot for user search05
08/20/2008-04:43:38 PM PDT 08/20/2008-11:43:38 PM GMT 903311032 STARTUP mpi::prestartLamds running lamboot for user search06
08/20/2008-04:43:39 PM PDT 08/20/2008-11:43:39 PM GMT 903311033 STARTUP mpi::prestartLamds running lamboot for user search07
08/20/2008-04:43:40 PM PDT 08/20/2008-11:43:40 PM GMT 903311034 STARTUP mpi::prestartLamds running lamboot for user search08
08/20/2008-04:43:41 PM PDT 08/20/2008-11:43:41 PM GMT 903311035 STARTUP mpi::prestartLamds running lamboot for user search09
08/20/2008-04:43:42 PM PDT 08/20/2008-11:43:42 PM GMT 903311036 STARTUP mpi::prestartLamds running lamboot for user search10
08/20/2008-04:43:43 PM PDT 08/20/2008-11:43:43 PM GMT 903311037 STARTUP mpi::prestartLamds running lamboot for user search11
08/20/2008-04:43:44 PM PDT 08/20/2008-11:43:44 PM GMT 903311038 STARTUP mpi::prestartLamds running lamboot for user search12
08/20/2008-04:43:45 PM PDT 08/20/2008-11:43:45 PM GMT 903311039 STARTUP mpi::prestartLamds running lamboot for user search13
08/20/2008-04:43:46 PM PDT 08/20/2008-11:43:46 PM GMT 903311040 STARTUP mpi::prestartLamds running lamboot for user search14
08/20/2008-04:43:47 PM PDT 08/20/2008-11:43:47 PM GMT 903311041 STARTUP mpi::prestartLamds running lamboot for user search15
08/20/2008-04:43:48 PM PDT 08/20/2008-11:43:48 PM GMT 903311042 STARTUP mpi::prestartLamds running lamboot for user search16
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 IDLE mpi::updateCmonNodelist updated ::beowulfNodes in cntlmonAPI to 'metaserver'
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search01 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search02 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search03 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search04 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search05 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search06 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search07 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search08 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search09 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search10 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search11 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search12 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search13 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search14 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 STARTUP mpi::prestartLamds STARTUP search15 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 IDLE setFTPandHTTPinfo (::FTPURL 'ftp://131.215.115.235') (::FTPDIR '') (::HTTPURL 'http://131.215.115.235/ldas_outgoing/jobs') (::HTTPDIR '/ldas_outgoing/jobs') (::GRIDFTPURL 'gridftp:/export/grid/ldas') (::GRIDFTPDIR '/export/grid/ldas') (::LDAS_GATEWAY 'ldas-test 131.215.115.235') (::LDAS_SYSTEM 'ldas-test') (::RUNCODE 'LDAS-TEST')
08/20/2008-04:43:49 PM PDT 08/20/2008-11:43:49 PM GMT 903311043 IDLE mpi::updateCmonNodelist updated ::beowulfNodes in cntlmonAPI to 'metaserver'
08/20/2008-04:43:50 PM PDT 08/20/2008-11:43:50 PM GMT 903311044 STARTUP mpi::prestartLamds STARTUP search16 metaserver {lamboot errors: couldn't execute "recon": no such file or directory}
08/20/2008-04:43:50 PM PDT 08/20/2008-11:43:50 PM GMT 903311044 STARTUP mpi::killAllMpirun {ldas@metaserver:mpirun: sudo: sorry, you must have a tty to run sudo} {ldas@metaserver:wrapperAPI: sudo: sorry, you must have a tty to run sudo} {ldas@metaserver:lamd: sudo: sorry, you must have a tty to run sudo}