feat(database): add optimized batch saving and automatic save method #2
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
saveToFileBatchedfor efficient batch saving of large databases using buffered I/O.saveToFileOptimizedto automatically choose between regular and batched saving based on record count.handleInitto use the new optimized save method.feat(manifest): switch to adaptive hashing for file checksums
crypto.blake3HashFileAdaptivefor improved performance.feat(scanner): implement parallel scanning with work queue
WorkQueuefor managing scan jobs in parallel.scanPathParallelto utilize multiple threads for scanning directories.scanPathAdaptiveto choose between sequential and parallel scanning based on estimated workload.scanPathWithStringPoolfor memory-optimized scanning using string pooling.feat(string_pool): add string interning for memory efficiency
StringPoolandPathPoolto reduce memory allocations for repeated strings, particularly filesystem paths.test: add comprehensive tests for new features
saveToFileBatched,saveToFileOptimized, and string pooling functionality.