Replay configuration for MWGR5 #4550

germanfgv · 2020-11-16T14:19:10Z

Replay configuration for MWGR5.

Release: CMSSW_11_1_5
Runs: 337808, 337973, 336436

GTs:

111X_dataRun3_HLT_v3
111X_dataRun3_Express_v4
111X_dataRun3_Prompt_v4

germanfgv · 2020-11-16T14:33:08Z

run replay please

cmsdmwmbot · 2020-11-16T14:33:52Z

Container Tests
Unit tests finished

germanfgv · 2020-11-16T14:37:33Z

run replay please

cmsdmwmbot · 2020-11-16T14:40:37Z

Host name : vocms047.cern.ch
Container ID : 1
Pull request url : #4550
Current build at jenkins : https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-T0-PR-test-job/228/.
Jira Issue : https://its.cern.ch/jira/browse/CMSTZDEV-627

cmsdmwmbot · 2020-11-16T14:40:41Z

Container Tests
JIRA URL : https://its.cern.ch/jira/browse/CMSTZDEV-627
Tier0_REPLAY v228 DMWM-T0-PR-test-job on vocms047.cern.ch. Replay configuration for MWGR5
There is NO fileset and job.
Replay might be empty.
All filesets were closed.
There was NO paused job in the replay.
End.
Replay was empty..

cmsdmwmbot · 2020-11-16T14:44:39Z

Host name : vocms047.cern.ch
Container ID : 1
Pull request url : #4550
Current build at jenkins : https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-T0-PR-test-job/229/.
Jira Issue : https://its.cern.ch/jira/browse/CMSTZDEV-628

cmsdmwmbot · 2020-11-16T14:44:43Z

Container Tests
JIRA URL : https://its.cern.ch/jira/browse/CMSTZDEV-628
Tier0_REPLAY v229 DMWM-T0-PR-test-job on vocms047.cern.ch. Replay configuration for MWGR5
There is NO fileset and job.
Replay might be empty.
All filesets were closed.
There was NO paused job in the replay.
End.
Replay was empty..

cmsdmwmbot · 2020-11-16T14:52:20Z

Container Tests
Unit tests finished

cmsdmwmbot · 2020-11-16T15:45:25Z

Host name : vocms047.cern.ch
Container ID : 1
Pull request url : #4550
Current build at jenkins : https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-T0-PR-test-job/230/.
Jira Issue : https://its.cern.ch/jira/browse/CMSTZDEV-629

cmsdmwmbot · 2020-11-16T15:54:28Z

There are 1 paused jobs in the replay.

cmsdmwmbot · 2020-11-16T21:47:51Z

Container Tests
JIRA URL : https://its.cern.ch/jira/browse/CMSTZDEV-629
Tier0_REPLAY v230 DMWM-T0-PR-test-job on vocms047.cern.ch. Replay configuration for MWGR5
There are 1 paused jobs in the replay. List of Paused job below.
Cache directory : Exit code
/data/tier0/docker/container1/srv/wmagent/current/install/tier0/JobCreator/JobCache/Repack_Run337973_StreamNanoDST_Tier0_REPLAY_2020_v2011161641_201116_1642/Repack/JobCollection_9_0/job_2352 : None

There are only 1 memory errors, Will check again after 5 hours.
Workflow failed
name 'idatetime' is not defined

cmsdmwmbot · 2020-11-17T09:11:12Z

Host name : vocms047.cern.ch
Container ID : 2
Pull request url : #4550
Current build at jenkins : https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-T0-PR-test-job/231/.
Jira Issue : https://its.cern.ch/jira/browse/CMSTZDEV-630

cmsdmwmbot · 2020-11-17T09:20:15Z

There are 1 paused jobs in the replay.

cmsdmwmbot · 2020-11-17T11:37:35Z

Container Tests
Unit tests finished

germanfgv · 2020-11-17T12:28:37Z

run replay please

cmsdmwmbot · 2020-11-17T12:34:34Z

Host name : vocms047.cern.ch
Container ID : 3
Pull request url : #4550
Current build at jenkins : https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-T0-PR-test-job/232/.
Jira Issue : https://its.cern.ch/jira/browse/CMSTZDEV-631

cmsdmwmbot · 2020-11-17T12:34:39Z

Container Tests
JIRA URL : https://its.cern.ch/jira/browse/CMSTZDEV-631
Tier0_REPLAY v232 DMWM-T0-PR-test-job on vocms047.cern.ch. Replay configuration for MWGR5
There is NO fileset and job.
Replay might be empty.
All filesets were closed.
There was NO paused job in the replay.
End.
Replay was empty..

cmsdmwmbot · 2020-11-17T14:32:53Z

Host name : vocms047.cern.ch
Container ID : 2
Pull request url : #4550
Current build at jenkins : https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-T0-PR-test-job/233/.
Jira Issue : https://its.cern.ch/jira/browse/CMSTZDEV-632

cmsdmwmbot · 2020-11-17T15:18:05Z

There are 1 paused jobs in the replay.

cmsdmwmbot · 2020-11-17T15:18:09Z

Container Tests
JIRA URL : https://its.cern.ch/jira/browse/CMSTZDEV-632
Tier0_REPLAY v233 DMWM-T0-PR-test-job on vocms047.cern.ch. Replay configuration for MWGR5
There are 1 paused jobs in the replay. List of Paused job below.
Cache directory : Exit code
/data/tier0/docker/container2/srv/wmagent/current/install/tier0/JobCreator/JobCache/Repack_Run337808_StreamNanoDST_Tier0_REPLAY_2020_v2011171528_201117_1529/Repack/JobCollection_13_0/job_2403 : 8022

Return 8022 : 1 job(s)
#Error message ==========
INFO:root:Subprocess stderr was:
None
INFO:root:Executing CMSSW. args: ['/bin/bash', '/srv/job/WMTaskSpace/cmsRun1/cmsRun1-main.sh', '', 'slc7_amd64_gcc820', 'scramv1', 'CMSSW', 'CMSSW_11_1_5', 'FrameworkJobReport.xml', 'cmsRun', 'PSet.py', '', '', '']
INFO:root:addOutputFile method called with outputModule: write_L1Accept_RAW, aFile: None
INFO:root:addOutputFile method fileRef: , whole tree: {}
ERROR:root:Tried to divide by zero doing storage statistics report parsing.
ERROR:root:Either you aren't reading and writing data, or you aren't reporting it.
ERROR:root:Not adding any storage performance info to report.
CRITICAL:root:Error running cmsRun
{'arguments': ['/bin/bash', '/srv/job/WMTaskSpace/cmsRun1/cmsRun1-main.sh', '', 'slc7_amd64_gcc820', 'scramv1', 'CMSSW', 'CMSSW_11_1_5', 'FrameworkJobReport.xml', 'cmsRun', 'PSet.py', '', '', '']}
CMSSW Return code: 8022

CRITICAL:root:Error message: An exception of category 'FatalRootError' occurred while
[0] Calling InputSource::getNextItemType
Additional Info:
[a] Fatal Root Error: @sub=TBufferFile::CheckByteCount
object of class vectorl1t::Muon read too many bytes: 366 instead of 334
CRITICAL:root:CMSDefaultHandler Diagnostic Handler invoked
WARNING:root:Exit code: 8022 has been already added to the job report

#====================

Replay was closed by puased job

germanfgv · 2021-02-12T12:06:10Z

run replay please

cmsdmwmbot · 2021-02-12T12:08:08Z