Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Inconcise logging for Synapse list offset #151

@george-zubrienko

Description

@george-zubrienko

This PR https://github.com/SneaksAndData/arcane-framework-scala/pull/149/files fixed an issue with listing increasing number of prefixes for slow changing tables, but made logging confusing, as we'll see listing from... and staying at... desyncing eventually:

staying at x
listing from x
staying at x
listing from x
< past 2h (lookback)
staying at x + 1
listing from x + 1
staying at x + 1
listing from x + 2
staying at x + 2
listing from x + 3

We should add another log message indicating a shift to x+3 due to us moving past lookback interval w/o any data emitted. I'd also suggest a refactor to move date eval outside of yield

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions