Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Test failure profiler/eventpipe/eventpipe/eventpipe.sh #66174

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
VincentBu opened this issue Mar 4, 2022 · 11 comments
Open

Test failure profiler/eventpipe/eventpipe/eventpipe.sh #66174

VincentBu opened this issue Mar 4, 2022 · 11 comments
Assignees
@davmason
Labels
area-Tracing-coreclr disabled-test The test is disabled in source code against the issue os-mac-os-x macOS aka OSX
Milestone
Future

Comments

@VincentBu
Copy link
Contributor

Run: runtime-coreclr outerloop 20220303.2

Failed test:

CoreCLR OSX x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open

- profiler/eventpipe/eventpipe/eventpipe.sh

Error message:

cmdLine:/private/tmp/helix/working/C5030A0F/w/B5FB0987/e/profiler/eventpipe/eventpipe/eventpipe.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 3/3/2022 12:33:40 PM, end: 3/3/2022 12:43:41 PM)

Return code:      -100
Raw output file:      /tmp/helix/working/C5030A0F/w/B5FB0987/uploads/Reports/profiler.eventpipe/eventpipe/eventpipe.output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/C5030A0F/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false eventpipe.dll ''
Profiler path: /private/tmp/helix/working/C5030A0F/w/B5FB0987/e/profiler/eventpipe/eventpipe/libProfiler.dylib
Profiler.dll!DllGetClassObject
Profiler.dll!Profiler::Initialize
This method being jitted should trigger events firing...

cmdLine:/private/tmp/helix/working/C5030A0F/w/B5FB0987/e/profiler/eventpipe/eventpipe/eventpipe.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 3/3/2022 12:33:40 PM, end: 3/3/2022 12:43:41 PM)
Test Harness Exitcode is : -100
To run the test:

set CORE_ROOT=/tmp/helix/working/C5030A0F/p
/private/tmp/helix/working/C5030A0F/w/B5FB0987/e/profiler/eventpipe/eventpipe/eventpipe.sh
Expected: True
Actual:   False


Stack trace
   at profiler_eventpipe._eventpipe_eventpipe_._eventpipe_eventpipe_sh()
@ghost ghost added area-Tracing-coreclr untriaged New issue has not been triaged by the area owner labels Mar 4, 2022
@BruceForstall
Copy link
Member

This timeout is pervasive: Kusto data shows that it happens in many pipelines, but mostly on osx/x64.

@dotnet/area-system-diagnostics-tracing

@tommcdon tommcdon added this to the 7.0.0 milestone Mar 7, 2022
@tommcdon tommcdon removed the untriaged New issue has not been triaged by the area owner label Mar 7, 2022
@fanyang-mono
Copy link
Member

This happened again for rolling build #20220308.1 on CoreCLR Pri0 Runtime Tests Run OSX x64 checked. The link to the log is https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-main-a1a9de6e17b849f196/profiler.eventpipe/1/console.1158da49.log?sv=2019-07-07&se=2022-03-28T09%3A24%3A17Z&sr=c&sp=rl&sig=Xqtq4mBksJ5vn2SeQpc00q9oqntl2GhaHPQ5vDmaJAM%3D

@VincentBu VincentBu added the blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs label Mar 9, 2022
@runfoapp runfoapp bot mentioned this issue Mar 9, 2022
Closed
@agocke agocke added the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Mar 9, 2022
@agocke
Copy link
Member

agocke commented Mar 9, 2022

This is now blocking the runtime builds as well @tommcdon could someone take a look asap?

@tommcdon
Copy link
Member

tommcdon commented Mar 9, 2022

@agocke taking a look

@BruceForstall
Copy link
Member

Here's where it started failing for the nightly scheduled jitstress run:

https://dev.azure.com/dnceng/public/_build/results?buildId=1644509&view=ms.vss-test-web.build-test-results-tab

@hoyosjs
Copy link
Member

hoyosjs commented Mar 11, 2022

There's a few families of errors in here. Most of them were old and targeted to specific PR's

There's this:

Process terminated. Infinite recursion during resource lookup within System.Private.CoreLib.  This may be a bug in System.Private.CoreLib, or potentially in certain extensibility points such as assembly resolve events or CultureInfo names.  Resource name: Arg_NullReferenceException
   at System.Environment.FailFast(System.String)
   at System.SR.InternalGetResourceString(System.String)
   at System.SR.GetResourceString(System.String)
   at System.NullReferenceException..ctor()
   at System.Char.IsWhiteSpaceLatin1(Char)
   at System.Resources.ResourceManager.IsDefaultType(System.String, System.String)
   at System.Resources.ManifestBasedResourceGroveler.CanUseDefaultResourceClasses(System.String, System.String)
   at System.Resources.ManifestBasedResourceGroveler.CreateResourceSet(System.IO.Stream, System.Reflection.Assembly)
   at System.Resources.ManifestBasedResourceGroveler.GrovelForResourceSet(System.Globalization.CultureInfo, System.Collections.Generic.Dictionary`2<System.String,System.Resources.ResourceSet>, Boolean, Boolean)
   at System.Resources.ResourceManager.InternalGetResourceSet(System.Globalization.CultureInfo, Boolean, Boolean)
   at System.Resources.ResourceManager.GetString(System.String, System.Globalization.CultureInfo)
   at System.SR.InternalGetResourceString(System.String)
   at System.SR.GetResourceString(System.String)
   at System.NullReferenceException..ctor()
   at System.Char.IsWhiteSpaceLatin1(Char)
   at System.MemoryExtensions.Trim(System.ReadOnlySpan`1<Char>)
   at System.Guid.TryParseGuid(System.ReadOnlySpan`1<Char>, GuidResult ByRef)
   at System.Guid..ctor(System.String)
   at EventPipeTests.EventPipe..cctor()
   at EventPipeTests.EventPipe.Main(System.String[])

These type of simd asserts that have been reported elsewhere:

Assert failure(PID 12180 [0x00002f94], Thread: 12222 [0x2fbe]): Assertion failed 'IsBaselineSimdIsaSupportedDebugOnly()' in 'Microsoft.Diagnostics.Tracing.EventPipeEventSource:CheckForWellKnownEventFields(Microsoft.Diagnostics.Tracing.EventPipeEventMetaDataHeader):PayloadFetchClassInfo:this' during 'Morph - Inlining' (IL size 492; hash 0x78e35964; FullOpts)

All the ones that come from the profiler test itself are timeouts in OSX, regardless of jit modes.

@hoyosjs hoyosjs removed arch-x64 blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs labels Mar 11, 2022
@vitek-karas vitek-karas mentioned this issue Mar 11, 2022
Merged
@BruceForstall
Copy link
Member

@hoyosjs Why did you remove the "blocking-outerloop" label? Unless this test has been fixed or disabled, it is, indeed, blocking clean outerloop test runs.

@jakobbotsch jakobbotsch mentioned this issue Mar 13, 2022
Merged
@VincentBu
Copy link
Contributor Author

VincentBu commented Mar 14, 2022 •
edited
Loading

Failed again in: runtime-coreclr jitstress-isas-x86 20220312.1

Failed test:

CoreCLR OSX x64 Checked jitstress_isas_nohwintrinsic_nosimd @ OSX.1200.Amd64.Open

- profiler/eventpipe/eventpipe/eventpipe.sh

CoreCLR OSX x64 Checked jitstress_isas_x86_nosse @ OSX.1200.Amd64.Open

- profiler/eventpipe/eventpipe/eventpipe.sh

CoreCLR OSX x64 Checked jitstress_isas_nohwintrinsic @ OSX.1200.Amd64.Open

- profiler/eventpipe/eventpipe/eventpipe.sh

CoreCLR OSX x64 Checked jitstress_isas_x86_nolzcnt @ OSX.1200.Amd64.Open

- profiler/eventpipe/eventpipe/eventpipe.sh

CoreCLR OSX x64 Checked jitstress_isas_x86_nohwintrinsic @ OSX.1200.Amd64.Open

- profiler/eventpipe/eventpipe/eventpipe.sh

CoreCLR OSX x64 Checked jitstress_isas_x86_noaes @ OSX.1200.Amd64.Open

- profiler/eventpipe/eventpipe/eventpipe.sh

CoreCLR OSX x64 Checked jitstress_isas_x86_nofma @ OSX.1200.Amd64.Open

- profiler/eventpipe/eventpipe/eventpipe.sh

Error message:

cmdLine:/private/tmp/helix/working/B50109A6/w/B95809E4/e/profiler/eventpipe/eventpipe/eventpipe.sh Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 3/12/2022 1:34:43 PM, end: 3/12/2022 2:04:43 PM)

Return code:      -100
Raw output file:      /tmp/helix/working/B50109A6/w/B95809E4/uploads/Reports/profiler.eventpipe/eventpipe/eventpipe.output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/B50109A6/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false eventpipe.dll ''
Profiler path: /private/tmp/helix/working/B50109A6/w/B95809E4/e/profiler/eventpipe/eventpipe/libProfiler.dylib
Profiler.dll!DllGetClassObject
Profiler.dll!Profiler::Initialize
This method being jitted should trigger events firing...

cmdLine:/private/tmp/helix/working/B50109A6/w/B95809E4/e/profiler/eventpipe/eventpipe/eventpipe.sh Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 3/12/2022 1:34:43 PM, end: 3/12/2022 2:04:43 PM)
Test Harness Exitcode is : -100
To run the test:

set CORE_ROOT=/tmp/helix/working/B50109A6/p
/private/tmp/helix/working/B50109A6/w/B95809E4/e/profiler/eventpipe/eventpipe/eventpipe.sh
Expected: True
Actual:   False


Stack trace
   at profiler_eventpipe._eventpipe_eventpipe_._eventpipe_eventpipe_sh()

@fanyang-mono
Copy link
Member

Should the test be disabled for now? I saw this being hit on rolling build quite often.

@BruceForstall BruceForstall mentioned this issue Mar 14, 2022
Merged
@kunalspathak kunalspathak mentioned this issue Mar 14, 2022
Merged
@BruceForstall BruceForstall removed the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Mar 14, 2022
@BruceForstall
Copy link
Member

Note: this test was disabled in #66606. Re-enable when fixing/closing this issue.

@hoyosjs hoyosjs mentioned this issue Mar 15, 2022
Closed
@fanyang-mono fanyang-mono added the disabled-test The test is disabled in source code against the issue label Mar 16, 2022
@tommcdon
Copy link
Member

@davmason PTAL

@davmason davmason self-assigned this Jul 13, 2022
@davmason davmason modified the milestones: 7.0.0, Future Jul 13, 2022
@mdh1418 mdh1418 mentioned this issue Apr 22, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@davmason davmason

Labels
area-Tracing-coreclr disabled-test The test is disabled in source code against the issue os-mac-os-x macOS aka OSX
Projects
None yet
Milestone
Future
Development

No branches or pull requests
7 participants
@agocke @BruceForstall @davmason @tommcdon @hoyosjs @VincentBu @fanyang-mono