Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[mono] MiniJIT System.Formats.Nrbf.Tests getting killed #108515

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
matouskozak opened this issue Oct 3, 2024 · 4 comments
Open

[mono] MiniJIT System.Formats.Nrbf.Tests getting killed #108515

matouskozak opened this issue Oct 3, 2024 · 4 comments
Labels
arch-x64 area-Codegen-JIT-mono Known Build Error Use this to report build issues in the .NET Helix tab
Milestone
10.0.0

Comments

@matouskozak
Copy link
Member

matouskozak commented Oct 3, 2024 •
edited by build-analysis bot
Loading

The System.Formats.Nrbf.Tests are getting ocassinally killed on CI. Affecting mostly MonoJIT linux_x64_release_mono_minijit_librariestests job and occasionally MonoInterpreterlinux_x64_release_mono_interpreter_librariestests.

7 failures in the last 30 days as per
image

Log:

Starting:    System.Formats.Nrbf.Tests (parallel test collections = on [2 threads], stop on fail = off)
./RunTests.sh: line 176:    21 Killed                  "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Formats.Nrbf.Tests.runtimeconfig.json --depsfile System.Formats.Nrbf.Tests.deps.json xunit.console.dll System.Formats.Nrbf.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing $RSP_FILE
cat: /proc/sys/kernel/coredump_filter: No such file or directory
dmesg: read kernel buffer failed: Operation not permitted
+ export _commandExitCode=137
+ python /root/helix/work/correlation/reporter/run.py https://dev.azure.com/dnceng-public/ public 21132138 eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsIng1dCI6IjdSd2F5dmlYRHFoZnN6MTZSNmxPbXNXWWxTQSJ9.eyJuYW1laWQiOiJjNzczZjJjMi01MTIwLTQyMDctYWZlMi1hZmFmMzVhOGJjMGEiLCJzY3AiOiJhcHBfdG9rZW4iLCJhdWkiOiJiMWU0ZDg3Ni0yZjIwLTQ1NjctODgyMi05OWQ0YTNhZGYxNGEiLCJzaWQiOiI4ODdhMTkyYy0yNTQ3LTQ4YTUtYTEwMS0yOTc4ZmJiNzI0ZWIiLCJCdWlsZElkIjoiY2JiMTgyNjEtYzQ4Zi00YWJiLTg2NTEtOGNkY2I1NDc0NjQ5OzgxNTI0OSIsIkRlZklkIjoiMTI5Iiwiam9icmVmIjoiNDgyZjk0ZWQtYjFjZi00Mjk4LWJmMmMtMDY3NGIyNTRjNzgxOjFkMTA2YTY1LTI2OWItNTI4Mi1lZjMxLWUzMzc4YTVhMTNmMiIsInBwaWQiOiJ2c3RmczovLy9CdWlsZC9CdWlsZC84MTUyNDkiLCJvcmNoaWQiOiI0ODJmOTRlZC1iMWNmLTQyOTgtYmYyYy0wNjc0YjI1NGM3ODEuYnVpbGQuYnVpbGRfbGludXhfeDY0X3JlbGVhc2VfbW9ub19pbnRlcnByZXRlcl9saWJyYXJpZXN0ZXN0cy5fX2RlZmF1bHQiLCJyZXBvSWRzIjoiIiwiaXNzIjoiYXBwLnZzdG9rZW4udmlzdWFsc3R1ZGlvLmNvbSIsImF1ZCI6ImFwcC52c3Rva2VuLnZpc3VhbHN0dWRpby5jb218dnNvOjZmY2M5MmU1LTczYTctNGY4OC04ZDEzLWQ5MDQ1YjQ1ZmIyNyIsIm5iZiI6MTcyNzAzNDk0MSwiZXhwIjoxNzI3MDY0OTQxfQ.om2rr6irEACnRYKhRuUB2ECACuJKmQKGl3wctZ4IVZo8LtGCigyhva_yyKjvZRX5n3xl6SQgNlv01Cl2uKRaVGws1zizT9WsUwKKkLm390V5dSHg3eb1VyDHMM2LTO9mM5Ve4dfn4XhgeUid4xkpH-V6vXrIMu6E3hW-B30oH7xH1kdj8Ftw1sYuL5rsNJRAXjnd3hZgODSSXgK3_dij7BqeH-AZZBqv3ErGWdUYuVd0BRv4M8P51EJPjp8u4CC1jP_rjKRMw8nZm4VvCEL7CyR4X4SbVNqp5KP2F8Kpjnpus_0rMPNyLnyE2KOI1totQRV_WmguZZq7w9V8KMb5FQ
/root/helix/work/workitem/e
----- end Sun 22 Sep 2024 08:43:19 PM UTC ----- exit code 137 ----------------------------------------------------------
exit code 137 means SIGKILL Killed either due to out of memory/resources (see /var/log/messages) or by explicit kill.

Known Issue Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": ["System.Formats.Nrbf.Tests", "exit code 137 means SIGKILL Killed either due to out of memory/resources (see /var/log/messages) or by explicit kill"],
  "BuildRetry": true,
  "ExcludeConsoleLog": false
}

Report

Build Definition Test Pull Request
1034987 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1035037 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1034984 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1034452 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution #114148
1034516 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1034482 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1034026 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1032998 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1032888 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1032547 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1032176 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1032150 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1031761 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1031712 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1031412 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1031074 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1030527 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1030072 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1029552 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution #114148
1029856 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution #114862
1028887 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1028766 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1028257 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution #114148
1027840 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1027817 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1027701 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1027526 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1027336 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1027223 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1026951 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1026884 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1026417 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1025865 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1025934 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1025809 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1025611 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1025187 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1024727 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1024588 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1024239 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1023958 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1023896 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1023855 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1023328 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1023266 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1023185 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution #114148
1022607 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1022138 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1022078 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1021425 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1021410 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1021239 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1021233 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1021153 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1021145 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1021008 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1020987 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1019836 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1019283 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1019248 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1018596 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1018008 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1017429 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1017233 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1016839 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1016780 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1016432 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1016189 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1016183 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1016090 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1016066 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1015941 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1015355 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1015324 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1014931 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1014775 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1014765 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1014621 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1014599 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1014414 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1013976 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1013909 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1013967 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1013908 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1013705 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1013697 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1013198 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1012535 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1011921 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1011871 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1011329 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1011276 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1011252 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution #113313
1010491 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1010424 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1009767 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1009046 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1008185 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1007520 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1007448 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
6 17 100

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=825800
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 10/3/2024 4:08:45 PM UTC
@matouskozak matouskozak added arch-x64 untriaged New issue has not been triaged by the area owner area-Codegen-JIT-mono labels Oct 3, 2024
@dotnet-policy-service Dotnet Policy Service
Copy link
Contributor

Tagging subscribers to this area: @lambdageek, @steveisok
See info in area-owners.md if you want to be subscribed.

@matouskozak matouskozak mentioned this issue Oct 3, 2024
Open
@lambdageek
Copy link
Member

There are some interesting "attack tests" that do things with cyclic graphs and potentially large memory usage that might be behaving pathologically on Mono. (for example due to conservative stack scanning)

https://github.com/dotnet/runtime/blob/main/src/libraries/System.Formats.Nrbf/tests/AttackTests.cs

@matouskozak matouskozak added the Known Build Error Use this to report build issues in the .NET Helix tab label Oct 3, 2024
@steveisok steveisok removed the untriaged New issue has not been triaged by the area owner label Oct 7, 2024
@steveisok steveisok added this to the Future milestone Oct 7, 2024
@matouskozak
Copy link
Member Author

No longer failing. Unclear what fix it as the test was a bit flaky.

@matouskozak
Copy link
Member Author

Failed again, reopening https://dev.azure.com/dnceng-public/public/_build/results?buildId=914493&view=results

@matouskozak matouskozak reopened this Jan 12, 2025
@matouskozak matouskozak modified the milestones: Future, 10.0.0 Jan 12, 2025
@matouskozak matouskozak mentioned this issue Apr 24, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
arch-x64 area-Codegen-JIT-mono Known Build Error Use this to report build issues in the .NET Helix tab
Projects
None yet
Milestone
10.0.0
Development

No branches or pull requests
3 participants
@steveisok @lambdageek @matouskozak