Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@gkfthddk
Copy link
Contributor

@gkfthddk gkfthddk commented Oct 4, 2022

Add specifyStreams(config, streamNames) at Tier0Config.py

Add speicifyStreams at end of ReplayOfflineConfiguration.py to ignore every stream except specified streams.
for example,
specifyStreams(tier0Config, ["Calibration","LookArea"])

Replay at vocms0500
Describe the configuration

  • Run: 356005,359060
  • DeploymentID: 221012133000
  • Additional changes: specifyStreams(tier0Config, ["Calibration"]) at the end of ReplayOfflineConfiguration.py

Ignore every streams except specified one.
@germanfgv germanfgv changed the title Specifiedstreams Add specifyStreams function Oct 5, 2022
import specifyStreams function
@germanfgv
Copy link
Contributor

This wont work as athe streams are addit to the configuration after we pull the data from storage manager

@germanfgv
Copy link
Contributor

Here is were we get the data from storage manager. After this, the tier0Config object is populated.

try:
if tier0Config.Global.InjectRuns == None:
StorageManagerAPI.injectNewData(self.dbInterfaceStorageManager,
self.dbInterfaceHltConf,
self.dbInterfaceSMNotify,
streamerPNN = tier0Config.Global.StreamerPNN,
minRun = tier0Config.Global.InjectMinRun,
maxRun = tier0Config.Global.InjectMaxRun)
else:
injectRuns = set()
for injectRun in tier0Config.Global.InjectRuns:
if injectRun not in self.injectedRuns:
injectRuns.add(injectRun)
for injectRun in injectRuns:
StorageManagerAPI.injectNewData(self.dbInterfaceStorageManager,
self.dbInterfaceHltConf,
self.dbInterfaceSMNotify,
streamerPNN = tier0Config.Global.StreamerPNN,
injectRun = injectRun)
self.injectedRuns.add(injectRun)
except:
# shouldn't happen, just a catch all insurance
logging.exception("Something went wrong with data retrieval from StorageManager")

You need to set the Processing type as ignore after this.

@germanfgv
Copy link
Contributor

That means that the list of streams to process needs to be stored in the tier0Config object, so it can be used by Tier0Feeder after reading the configuration file.

@gkfthddk
Copy link
Contributor Author

You mean even I set ignore to streams of tier0Config at the end of ReplayOfflineConfiguration.py, more streams will be loaded after?
Then, streams added after are also needed to be ignored?

@germanfgv germanfgv merged commit e405b3f into dmwm:master Oct 26, 2022
@gkfthddk gkfthddk deleted the specifiedstreams branch November 1, 2022 02:20
germanfgv pushed a commit to germanfgv/T0 that referenced this pull request Nov 16, 2022
* Update Tier0Config.py

Ignore every streams except specified one.

* Update ReplayOfflineConfiguration.py

import specifyStreams function

Co-authored-by: Yunjae Lee <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants