Fix solution parsing in dotnet test for Microsoft.Testing.Platform #51411

Youssef1313 · 2025-10-22T15:55:02Z

Youssef1313 · 2025-10-31T17:41:09Z

src/Cli/dotnet/Commands/Test/MTP/MSBuildUtility.cs

-        var msbuildArgs = MSBuildArgs.AnalyzeMSBuildArguments(buildOptions.MSBuildArgs, CommonOptions.PropertiesOption, CommonOptions.RestorePropertiesOption, CommonOptions.MSBuildTargetOption(), CommonOptions.VerbosityOption());
+        if (string.IsNullOrEmpty(activeSolutionConfiguration))
+        {
+            activeSolutionConfiguration = solutionFile.GetDefaultConfigurationName();


@rainersigwald @baronfel Can this be null or empty under any scenario?

unsure, would need to reach out to the VS Solution team for clarification on specific behaviors.

Youssef1313 · 2025-10-31T17:41:46Z

src/Cli/dotnet/Commands/Test/MTP/MSBuildUtility.cs

+            activeSolutionPlatform = solutionFile.GetDefaultPlatformName();
+        }
+
+        var solutionConfiguration = solutionFile.SolutionConfigurations.FirstOrDefault(c => c.ConfigurationName == activeSolutionConfiguration && c.PlatformName == activeSolutionPlatform)


@rainersigwald @baronfel Is this the right way to get the solution configuration?

I think you may need to handle the case where the solution configuration accepts any platform? but am not certain, again a question for the VS Solution team about required solution behaviors.

Platform and configuration are case insensitive, so if they are coming from the user's command line, these checks should ignore case.

A valid solution file will always have at least one solution configuration and solution platform, it should be safe to not continue if this isn't true.

Youssef1313 · 2025-10-31T17:43:21Z

src/Cli/dotnet/Commands/Test/MTP/MSBuildUtility.cs

+        var solutionConfiguration = solutionFile.SolutionConfigurations.FirstOrDefault(c => c.ConfigurationName == activeSolutionConfiguration && c.PlatformName == activeSolutionPlatform)
+            ?? throw new InvalidOperationException($"The solution configuration '{activeSolutionConfiguration}|{activeSolutionPlatform}' is invalid.");
+
+        // TODO: What to do if the given key doesn't exist in the ProjectConfigurations?


@rainersigwald @baronfel Few lines below, I'm filtering projects only where the project configurations contains the requested solution configuration. Should that be an error instead if the solution configuration isn't found in the dictionary? or is it a valid scenario? And if valid scenario, is skipping the project the right behavior?

Youssef1313 · 2025-10-31T17:44:31Z

src/Cli/dotnet/Commands/Test/MTP/MSBuildUtility.cs

        using var collection = new ProjectCollection(globalProperties: CommonRunHelpers.GetGlobalPropertiesFromArgs(msbuildArgs), logger is null ? null : [logger], toolsetDefinitionLocations: ToolsetDefinitionLocations.Default);
        var evaluationContext = EvaluationContext.Create(EvaluationContext.SharingPolicy.Shared);
-        IEnumerable<ParallelizableTestModuleGroupWithSequentialInnerModules> projects = SolutionAndProjectUtility.GetProjectProperties(projectFilePath, collection, evaluationContext, buildOptions);
+        IEnumerable<ParallelizableTestModuleGroupWithSequentialInnerModules> projects = SolutionAndProjectUtility.GetProjectProperties(projectFilePath, collection, evaluationContext, buildOptions, configuration: null, platform: null);


In this code path we are dealing with a single project.

Youssef1313 · 2025-10-31T17:47:00Z

src/Cli/dotnet/Commands/Test/MTP/MSBuildUtility.cs

+        globalProperties.TryGetValue("Configuration", out var activeSolutionConfiguration);
+        globalProperties.TryGetValue("Platform", out var activeSolutionPlatform);


I think Configuration/Platform here are "solution configuration". This maps then to "project configuration" on the individual project files.

Should we clear out those values from the dictionary at this point?

This is a good line of thinking, I think you may be right. To do it right you'd use this to find the solutionconfiguration, and then use the solutionconfiguration to find per-project configuration/platform/etc arguments as we talked about today.

Youssef1313 · 2025-10-31T17:48:05Z

src/Cli/dotnet/Commands/Test/MTP/MSBuildUtility.cs

+            .Where(p => ProjectShouldBuild(solutionFile, p.RelativePath) && p.ProjectConfigurations.ContainsKey(solutionConfiguration.FullName))
+            .Select(p => (p.ProjectConfigurations[solutionConfiguration.FullName], p.AbsolutePath))
+            .Where(p => p.Item1.IncludeInBuild)
+            .Select(p => (p.AbsolutePath, p.Item1.ConfigurationName, p.Item1.PlatformName));


@rainersigwald @baronfel Can ConfigurationName or PlatformName here be null or empty?

unsure, to me these are all questions about solution behavior - and such the VS Solution team needs to eb brought in.

Valid projects require a configuration name, but platform is options. For example, reporting projects and setup projects don't have platforms. Also, there are many invalid solution files out there were configurations may be missing from the file. What to do in those cases is up to the tool, but it should probably be ignored, but not skip other valid projects.

Youssef1313 · 2025-11-03T13:14:59Z

@copilot Please add tests for #51481 and #51398. The tests should be in GivenDotnetTestBuildsAndRunsTestsWithDifferentOptions, and test assets go in test/TestAssets/TestProjects.

Copilot · 2025-11-03T13:15:09Z

@Youssef1313 I've opened a new pull request, #51526, to work on those changes. Once the pull request is ready, I'll request review from you.

…guration support (#51526) Co-authored-by: copilot-swe-agent[bot] <[email protected]> Co-authored-by: Youssef1313 <[email protected]>

Youssef1313 added 4 commits October 22, 2025 17:48

Fix solution parsing in dotnet test for Microsoft.Testing.Platform

e763d34

Add ProjectShouldBuild

7a3920a

Hack

6ef9d54

Add comment

304b212

Youssef1313 marked this pull request as ready for review October 23, 2025 12:53

Youssef1313 requested review from YuliiaKovalova, baronfel, mariam-abdulla, nohwnd and rainersigwald October 23, 2025 12:54

mariam-abdulla approved these changes Oct 23, 2025

View reviewed changes

Youssef1313 added 2 commits October 31, 2025 18:37

A bit of progress

b58730f

Fix

8b11323

Youssef1313 commented Oct 31, 2025

View reviewed changes

Copilot AI mentioned this pull request Nov 3, 2025

Add tests for solution filter with shared projects and platform configuration support #51526

Merged

richardstanton approved these changes Nov 3, 2025

View reviewed changes

Merge branch 'release/10.0.2xx' into dev/ygerges/parse-sln

cdb835d

build-analysis bot mentioned this pull request Nov 11, 2025

GenerateBundle Task fails writing to singlefilehost.exe #50784

Open

Copilot AI and others added 2 commits November 12, 2025 11:18

Add tests for solution filter with shared projects and platform confi…

8a749af

…guration support (#51526) Co-authored-by: copilot-swe-agent[bot] <[email protected]> Co-authored-by: Youssef1313 <[email protected]>

Ensure full path is passed to SolutionFile.Parse

c5f0cb1

This was referenced Nov 12, 2025

Tests Failing in Template Engine: Failed to update search cache. (The SSL connection could not be established, see inner exception.) #51147

Open

SSL Template Issue Causes Missing OSX Templates #51198

Open

Template Engine SSL Connection Issue #51574

Open

build-analysis bot mentioned this pull request Nov 12, 2025

Known Test Repository Issue Sometimes Misses Test Failures dotnet/dnceng#6411

Open

3 tasks

Non buildable

f4d2700

		globalProperties.TryGetValue("Configuration", out var activeSolutionConfiguration);
		globalProperties.TryGetValue("Platform", out var activeSolutionPlatform);

Fix solution parsing in dotnet test for Microsoft.Testing.Platform #51411

Are you sure you want to change the base?

Fix solution parsing in dotnet test for Microsoft.Testing.Platform #51411

Uh oh!

Conversation

Youssef1313 commented Oct 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Youssef1313 commented Nov 3, 2025

Uh oh!

Copilot AI commented Nov 3, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Youssef1313 commented Oct 22, 2025 •

edited

Loading