-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Labels
backlog/starterGood issue for newcomersGood issue for newcomers
Description
This PR https://github.com/SneaksAndData/arcane-framework-scala/pull/149/files fixed an issue with listing increasing number of prefixes for slow changing tables, but made logging confusing, as we'll see listing from... and staying at... desyncing eventually:
staying at x
listing from x
staying at x
listing from x
< past 2h (lookback)
staying at x + 1
listing from x + 1
staying at x + 1
listing from x + 2
staying at x + 2
listing from x + 3
We should add another log message indicating a shift to x+3 due to us moving past lookback interval w/o any data emitted. I'd also suggest a refactor to move date eval outside of yield
f-thiele
Metadata
Metadata
Assignees
Labels
backlog/starterGood issue for newcomersGood issue for newcomers
Type
Projects
Status
No status