Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@davidmorgan
Copy link
Contributor

@davidmorgan davidmorgan commented Nov 3, 2025

Fix #2170
Fix #1728

Use a Directory.list replacement that handles symlinks better to avoid severe performance issues with symlink loops on Linux and MacOS.

dart-lang/sdk#61407

Use the find -L algorithm, which skips entering a path that's already being traversed. Test using the actual find -L.

Add a simple check for the original performance issue that creates a watcher on a directory with a lot of symlink loops and expects it to start up quickly.

@github-actions
Copy link

github-actions bot commented Nov 3, 2025

Package publishing

Package Version Status Publish tag (post-merge)
package:bazel_worker 1.1.4 already published at pub.dev
package:benchmark_harness 2.4.0-wip WIP (no publish necessary)
package:boolean_selector 2.1.2 already published at pub.dev
package:browser_launcher 1.1.3 already published at pub.dev
package:cli_config 0.2.1-wip WIP (no publish necessary)
package:cli_util 0.5.0-wip WIP (no publish necessary)
package:clock 1.1.3-wip WIP (no publish necessary)
package:code_builder 4.11.0 already published at pub.dev
package:coverage 1.15.0 already published at pub.dev
package:csslib 1.0.2 already published at pub.dev
package:extension_discovery 2.1.0 already published at pub.dev
package:file 7.0.2-wip WIP (no publish necessary)
package:file_testing 3.1.0-wip WIP (no publish necessary)
package:glob 2.1.3 already published at pub.dev
package:graphs 2.3.3-wip WIP (no publish necessary)
package:html 0.15.7-wip WIP (no publish necessary)
package:io 1.1.0-wip WIP (no publish necessary)
package:json_rpc_2 4.0.0 already published at pub.dev
package:markdown 7.3.1-wip WIP (no publish necessary)
package:mime 2.1.0-wip WIP (no publish necessary)
package:oauth2 2.0.5 already published at pub.dev
package:package_config 2.3.0-wip WIP (no publish necessary)
package:pool 1.5.2 already published at pub.dev
package:process 5.0.5 already published at pub.dev
package:pub_semver 2.2.0 already published at pub.dev
package:pubspec_parse 1.5.1-wip WIP (no publish necessary)
package:source_map_stack_trace 2.1.3-wip WIP (no publish necessary)
package:source_maps 0.10.14-wip WIP (no publish necessary)
package:source_span 1.10.1 already published at pub.dev
package:sse 4.1.8 already published at pub.dev
package:stack_trace 1.12.2-wip (error) pubspec version (1.12.2-wip) and changelog (1.12.2-dev) don't agree
package:stream_channel 2.1.4 already published at pub.dev
package:stream_transform 2.1.2-wip WIP (no publish necessary)
package:string_scanner 1.4.1 already published at pub.dev
package:term_glyph 1.2.3-wip WIP (no publish necessary)
package:test_reflective_loader 0.5.0 ready to publish test_reflective_loader-v0.5.0
package:timing 1.0.2 already published at pub.dev
package:unified_analytics 8.0.8 ready to publish unified_analytics-v8.0.8
package:watcher 1.1.5-wip WIP (no publish necessary)
package:yaml 3.1.3 already published at pub.dev
package:yaml_edit 2.2.2 already published at pub.dev

Documentation at https://github.com/dart-lang/ecosystem/wiki/Publishing-automation.

@github-actions
Copy link

github-actions bot commented Nov 3, 2025

PR Health

Breaking changes ✔️
Package Change Current Version New Version Needed Version Looking good?
watcher None 1.1.4 1.1.5-wip 1.1.4 ✔️

This check can be disabled by tagging the PR with skip-breaking-check.

Changelog Entry ✔️
Package Changed Files

Changes to files need to be accounted for in their respective changelogs.

This check can be disabled by tagging the PR with skip-changelog-check.

Coverage ⚠️
File Coverage
pkgs/watcher/lib/src/directory_watcher/directory_list.dart 💚 100 %
pkgs/watcher/lib/src/directory_watcher/linux.dart 💔 90 % ⬇️ 2 %
pkgs/watcher/lib/src/directory_watcher/mac_os.dart 💔 0 % ⬇️ NaN %
pkgs/watcher/lib/src/directory_watcher/polling.dart 💚 83 %
pkgs/watcher/lib/src/directory_watcher/windows.dart 💔 0 % ⬇️ NaN %
pkgs/watcher/lib/src/utils.dart 💔 81 % ⬇️ 3 %

This check for test coverage is informational (issues shown here will not fail the PR).

This check can be disabled by tagging the PR with skip-coverage-check.

API leaks ✔️

The following packages contain symbols visible in the public API, but not exported by the library. Export these symbols or remove them from your publicly visible API.

Package Leaked API symbol Leaking sources

This check can be disabled by tagging the PR with skip-leaking-check.

License Headers ✔️
// Copyright (c) 2025, the Dart project authors. Please see the AUTHORS file
// for details. All rights reserved. Use of this source code is governed by a
// BSD-style license that can be found in the LICENSE file.
Files
no missing headers

All source files should start with a license header.

Unrelated files missing license headers
Files
pkgs/bazel_worker/benchmark/benchmark.dart
pkgs/benchmark_harness/integration_test/perf_benchmark_test.dart
pkgs/boolean_selector/example/example.dart
pkgs/clock/lib/clock.dart
pkgs/clock/lib/src/clock.dart
pkgs/clock/lib/src/default.dart
pkgs/clock/lib/src/stopwatch.dart
pkgs/clock/lib/src/utils.dart
pkgs/clock/test/clock_test.dart
pkgs/clock/test/default_test.dart
pkgs/clock/test/stopwatch_test.dart
pkgs/clock/test/utils.dart
pkgs/coverage/lib/src/coverage_options.dart
pkgs/html/example/main.dart
pkgs/html/lib/dom.dart
pkgs/html/lib/dom_parsing.dart
pkgs/html/lib/html_escape.dart
pkgs/html/lib/parser.dart
pkgs/html/lib/src/constants.dart
pkgs/html/lib/src/encoding_parser.dart
pkgs/html/lib/src/html_input_stream.dart
pkgs/html/lib/src/list_proxy.dart
pkgs/html/lib/src/query_selector.dart
pkgs/html/lib/src/token.dart
pkgs/html/lib/src/tokenizer.dart
pkgs/html/lib/src/treebuilder.dart
pkgs/html/lib/src/utils.dart
pkgs/html/test/dom_test.dart
pkgs/html/test/parser_feature_test.dart
pkgs/html/test/parser_test.dart
pkgs/html/test/query_selector_test.dart
pkgs/html/test/selectors/level1_baseline_test.dart
pkgs/html/test/selectors/level1_lib.dart
pkgs/html/test/selectors/selectors.dart
pkgs/html/test/support.dart
pkgs/html/test/tokenizer_test.dart
pkgs/html/test/trie_test.dart
pkgs/html/tool/generate_trie.dart
pkgs/pubspec_parse/test/git_uri_test.dart
pkgs/stack_trace/example/example.dart
pkgs/watcher/test/custom_watcher_factory_test.dart
pkgs/yaml_edit/example/example.dart

This check can be disabled by tagging the PR with skip-license-check.

@davidmorgan davidmorgan force-pushed the symlink-loops-second-algorithm branch 6 times, most recently from 5d0ad34 to cd0a497 Compare November 3, 2025 15:14
Recursively list directories handling symlinks like `find -L`.
@davidmorgan davidmorgan force-pushed the symlink-loops-second-algorithm branch from cd0a497 to 5a2c806 Compare November 3, 2025 15:14
@davidmorgan davidmorgan marked this pull request as ready for review November 3, 2025 15:20
@davidmorgan davidmorgan requested a review from a team as a code owner November 3, 2025 15:21
@davidmorgan davidmorgan requested a review from mraleph November 3, 2025 15:21
@davidmorgan davidmorgan mentioned this pull request Nov 4, 2025

if (targetType == FileSystemEntityType.directory) {
// Add links to directories with their target to [subdirectories].
subdirectories.add(_ResolvedDirectory(
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this not end up ignoring link altogether if it is already visited? e.g. if I do:

mkdir tmp/a/b/c
ln -s $PWD/tmp tmp/a/b/c/root
find -L tmp

I get:

tmp
tmp/a
tmp/a/b
tmp/a/b/c
tmp/a/b/c/root

But the current algorithm will just ignore root altogether.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm which find are you using? For me that triggers loop detection and does not print root.

mkdir -p tmp/a/b/c
ln -s $PWD/tmp tmp/a/b/c/root
tmp
tmp/a
tmp/a/b
tmp/a/b/c
find: File system loop detected; ‘tmp/a/b/c/root’ is part of the same file system loop as ‘tmp’.

find --version
find (GNU findutils) 4.10.0

Possibly with your find the loop link is being reported as a link? You could check with -type l. That would be the same way a broken link is reported.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I use Mac OS X find. FWIW tree seems to behave similar, it prints:

tmp
└── a
    └── b
        └── c
            └── root -> /Users/vegorov/tmp

Anyway it's a minor detail.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks.

It's easy to change; but if they're reported here as links then the other code in the package will report them like they're files. Doesn't seem particularly useful.

Kept as-is and added to the listRecursively doc comment instead

/// Skipped links to directories are not mentioned in the directory listing.

@davidmorgan davidmorgan merged commit a97dc2c into dart-lang:main Nov 4, 2025
17 checks passed
@davidmorgan davidmorgan deleted the symlink-loops-second-algorithm branch November 4, 2025 13:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix package:watcher performance when there are multiple symlink cycles Cyclic symlinks are followed indefinitely until crashing

2 participants