Thanks to visit codestin.com
Credit goes to github.com

Skip to content

v0.4.2 dev #47

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 121 commits into from
Jul 1, 2025
Merged

v0.4.2 dev #47

merged 121 commits into from
Jul 1, 2025

Conversation

@iam047801
Copy link
Collaborator

@iam047801 iam047801 commented Jun 26, 2025 •
edited
Loading

  • Added new fields in LatestAccountState for faster filtering: types, owner_address, minter_address, fake, and created_lt
  • API handlers now accept a count query parameter (default false) so endpoints can skip row counting to speed up responses
  • Block fetching and saving work concurrently and accumulate batches before insertion for better catch‑up performance
  • The fetcher caches account states to avoid repeated requests, while the parser keeps a large cache mapping items to their minters for fake-item checks
  • Updated dependencies to Go 1.23 and tonutils-go v1.13.0

iam047801 added 30 commits May 18, 2024 07:07
@iam047801
[fetcher] getLastSeenAccountState: do not count states
72990ba
@iam047801
[indexer] getMessageSource: fix panic message
8a3685c
@iam047801
[parser] fix error wrappings on failed GetMethodDescription
1e3ab2d
@iam047801
docker-compose.yml: restart services on failure
ba3690a
@iam047801
[parser] add semaphore to limit maximum number of account parsing wor…
6b3c215 
…kers
@iam047801
[repo] contract: do not remove standard minter get-method descriptions
7353f92
@iam047801
[fetcher] getOtherAccount: add time track
800906b
@iam047801
[parser] add lru cache for minter addresses
a05ec13
@iam047801
[fetcher] getOtherAccount: fetch minter state exactly once
f55791b
@iam047801
[repo] account filter: always limit number of rows
7fce15c
@iam047801
[fetcher] getAccount: fetch account state on a block exactly once
d468ad7
@iam047801
[parser] add some time tracking
8cd2e2b
@iam047801
[repo] contract: add mutex for GetInterfaces
ee35e25
@iam047801
[repo] add time track for interfaceMatched
81109e5
@iam047801
[repo] contract: fill and cache contract code hash
ef83dd3
@iam047801
[parser] emulateGetMethod: add time track
ca8d59c
@iam047801
[repo] account: add timer for getCodeData
abbe03f
@iam047801
[indexer] getMessageSource: fix check for masterchain messages
fa19cfc
@iam047801
[indexer] fetch and save blocks simultaneously
497785e
@iam047801
[indexer] publishProcessedBlocks: fix typo
605033a
@iam047801
[fetcher] getAccount: rewrite account cache in case of error
ea6c3ac
@iam047801
[indexer] fetchMastersConcurrent: catch up with maximum number of wor…
b1dedec 
…kers, continue with just one
@iam047801
[fetcher] getAccount: start timer after cache get
c452f5b
@iam047801
[fetcher] getAccountLibraries: add timer
a189a17
@iam047801
[repo] tx: do not ch count rows on filter by hash
69969b5
@iam047801
SkipAddress: add quackquack account states
18fb161
@iam047801
[fetcher] fix tests
d47585b
@iam047801
[cmd] add fillMissedClickHouseData command
2806da5
@iam047801
[cmd] fillMissedClickHouseData: check data length on insert
4e8b3e3
@iam047801
[cmd] fillMissedClickHouseData: check incoming message is not nil
b61cc48
iam047801 and others added 29 commits June 23, 2025 16:02
@iam047801
.golangci.yaml: remove depguard
d75ca38
@iam047801
go.mod: go version 1.23.0
9633147
@iam047801
[migrations] fix comments
88bca32
@iam047801
[migrations] latest_account_states created_lt as not null
4af29b6
@iam047801
[fetcher] getAccountLibraries: skip nil libraries
956cc51
@iam047801
[query] FilterAccounts: validate contract types
fa0a123
@iam047801
[query] AggregateAccountsHistory: validate contract types
ab5bcd9
@iam047801
[query] FilterMessages/AggregateMessagesHistory: validate contract ty…
f496a0b 
…pes and operation name
@iam047801
[abi] move emulator to a separate package
b28ec85
@iam047801
README.md: provide emulator library path to run tests
ec148bc
@iam047801
[filter] cache: cleanup old entries on Get
4d6db49
@iam047801
[statistics] getTransactionStatistics: do not panic if there are no m…
203c890 
…essages
@iam047801
[indexer] getMessagesSource: fail on unknown message source after 16 …
f34d06e 
…blocks
@iam047801
[fetcher] mapMessage: calculate message hash as in old versions of to…
7970fa5 
…nutils-go
@iam047801
[repo] message filter hash: lag for rounded max_lt
89d8d3b
@iam047801
.golangci.yaml: do not check msg_hash folder
8e6a81f
@iam047801
[rndm] unify lt counter for tests
625bc80
@iam047801
[repo] message filter counting: fix tests and since_start_count in pa…
4b59dd8 
…rtial scan
@iam047801
[repo] countAccountStates: use rounded counting
9cbc6df
@iam047801
[repo] account filter counting: remove countLatestAccountStatesFullSc…
c451cf2 
…anFiltered
@iam047801
[repo] countAccountStatesFullScan: remove filter check
7c4bc66
@iam047801
[repo] countAccountStates: full scan postgresql instead of clickhouse
caa6129
@iam047801
[repo] tx filter count: round max lt
7f74263
@iam047801
[repo] countAccountStates: nolint nestif
5a2bce5
@iam047801
Merge pull request #46 from tonindexer/optimize-count
9f770f9 
Optimize counting on messages, account_states and transactions filters
@iam047801
[core] latest account states: add fake flag
b498510
@iam047801
[repo] AggregateAccounts: move queries to postgresql
d649719
@iam047801
README.md: prettify cgo lib export example
bd505af
@iam047801
[migrations] latest_account_states: drop fake column in down migration
d7db10e
@iam047801 iam047801 merged commit eab7f71 into main Jul 1, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@iam047801