Stryker did not execute successfully (exit code 134)

[vbreuss]

Describe the bug
In my GitHub Actions pipeline Stryker suddenly returns exit code 134. It previously worked with Stryker v4.7.0 (see this build). I ran the same commit again today and it now fails (see this build).
Also an update to the latest Stryker v4.8.1 did not help (see this build).

I am not sure, if the problem relates to Stryker or the GitHub runner; please correct me, if I should raise it somewhere else.

Logs

  Error: Unhandled exception. System.AggregateException: One or more errors occurred. (Commandline could not be parsed.) (Commandline could not be parsed.)
  14:00:41 [ERR] Unhandled exception. System.AggregateException: One or more errors occurred. (Commandline could not be parsed.) (Commandline could not be parsed.)
  Error:  ---> System.FormatException: Commandline could not be parsed.
  14:00:41 [ERR]  ---> System.FormatException: Commandline could not be parsed.
  Error:    at Buildalyzer.Compiler.CommandLine.Parse(DirectoryInfo baseDir, String commandLine, CompilerLanguage language)
  14:00:41 [ERR]    at Buildalyzer.Compiler.CommandLine.Parse(DirectoryInfo baseDir, String commandLine, CompilerLanguage language)
  Error:    at Buildalyzer.AnalyzerResult.ProcessCscCommandLine(String commandLine, Boolean coreCompile)
  14:00:41 [ERR]    at Buildalyzer.AnalyzerResult.ProcessCscCommandLine(String commandLine, Boolean coreCompile)
  Error:    at Buildalyzer.Logging.EventProcessor.MessageRaised(Object sender, BuildMessageEventArgs e)
  14:00:41 [ERR]    at Buildalyzer.Logging.EventProcessor.MessageRaised(Object sender, BuildMessageEventArgs e)
  Error:    at Microsoft.Build.Logging.EventArgsDispatcher.Dispatch(BuildEventArgs buildEvent)
  14:00:41 [ERR]    at Microsoft.Build.Logging.EventArgsDispatcher.Dispatch(BuildEventArgs buildEvent)
  Error:    at MsBuildPipeLogger.PipeLoggerServer`1.Read()
  14:00:41 [ERR]    at MsBuildPipeLogger.PipeLoggerServer`1.Read()
  Error:    at MsBuildPipeLogger.PipeLoggerServer`1.ReadAll()
  14:00:41 [ERR]    at MsBuildPipeLogger.PipeLoggerServer`1.ReadAll()
  Error:    at Buildalyzer.ProjectAnalyzer.BuildTargets(BuildEnvironment buildEnvironment, String targetFramework, String[] targetsToBuild, AnalyzerResults results)
  14:00:41 [ERR]    at Buildalyzer.ProjectAnalyzer.BuildTargets(BuildEnvironment buildEnvironment, String targetFramework, String[] targetsToBuild, AnalyzerResults results)
  Error:    at Buildalyzer.ProjectAnalyzer.Build(String targetFramework, BuildEnvironment buildEnvironment)
  14:00:41 [ERR]    at Buildalyzer.ProjectAnalyzer.Build(String targetFramework, BuildEnvironment buildEnvironment)
  Error:    at Buildalyzer.ProjectAnalyzer.Build(String targetFramework, EnvironmentOptions environmentOptions)
  14:00:41 [ERR]    at Buildalyzer.ProjectAnalyzer.Build(String targetFramework, EnvironmentOptions environmentOptions)
  Error:    at Buildalyzer.ProjectAnalyzer.Build(EnvironmentOptions environmentOptions)
  14:00:41 [ERR]    at Buildalyzer.ProjectAnalyzer.Build(EnvironmentOptions environmentOptions)
  Error:    at Stryker.Core.Initialisation.InputFileResolver.AnalyzeSingleProject(IProjectAnalyzer project, IStrykerOptions options)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.InputFileResolver.AnalyzeSingleProject(IProjectAnalyzer project, IStrykerOptions options)
  Error:    at Stryker.Core.Initialisation.InputFileResolver.GetProjectAndAddIt(IStrykerOptions options, IAnalyzerManager manager, ValueTuple`2 entry, String normalizedProjectUnderTestNameFilter, ConcurrentBag`1 mutableProjectsAnalyzerResults)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.InputFileResolver.GetProjectAndAddIt(IStrykerOptions options, IAnalyzerManager manager, ValueTuple`2 entry, String normalizedProjectUnderTestNameFilter, ConcurrentBag`1 mutableProjectsAnalyzerResults)
  Error:    at Stryker.Core.Initialisation.InputFileResolver.<>c__DisplayClass15_1.<AnalyzeAllNeededProjects>b__1(ValueTuple`2 entry)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.InputFileResolver.<>c__DisplayClass15_1.<AnalyzeAllNeededProjects>b__1(ValueTuple`2 entry)
  Error:    at System.Threading.Tasks.Parallel.<>c__DisplayClass43_0`2.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int64 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
  14:00:41 [ERR]    at System.Threading.Tasks.Parallel.<>c__DisplayClass43_0`2.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int64 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
  Error: --- End of stack trace from previous location ---
  14:00:41 [ERR] --- End of stack trace from previous location ---
  Error:    at System.Threading.Tasks.Parallel.<>c__DisplayClass43_0`2.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int64 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
  14:00:41 [ERR]    at System.Threading.Tasks.Parallel.<>c__DisplayClass43_0`2.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int64 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
  Error:    at System.Threading.Tasks.TaskReplicator.Replica.Execute()
  14:00:41 [ERR]    at System.Threading.Tasks.TaskReplicator.Replica.Execute()
  Error:    --- End of inner exception stack trace ---
  14:00:41 [ERR]    --- End of inner exception stack trace ---
  Error:    at Stryker.Core.Initialisation.InputFileResolver.AnalyzeAllNeededProjects(List`1 projectList, IStrykerOptions options, IAnalyzerManager manager, ScanMode mode)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.InputFileResolver.AnalyzeAllNeededProjects(List`1 projectList, IStrykerOptions options, IAnalyzerManager manager, ScanMode mode)
  Error:    at Stryker.Core.Initialisation.InputFileResolver.AnalyzeAndIdentifyProjects(List`1 projectList, IStrykerOptions options, IAnalyzerManager manager, ScanMode mode)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.InputFileResolver.AnalyzeAndIdentifyProjects(List`1 projectList, IStrykerOptions options, IAnalyzerManager manager, ScanMode mode)
  Error:    at Stryker.Core.Initialisation.InputFileResolver.ResolveSourceProjectInfos(IStrykerOptions options)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.InputFileResolver.ResolveSourceProjectInfos(IStrykerOptions options)
  Error:    at Stryker.Core.Initialisation.InitialisationProcess.GetMutableProjectsInfo(IStrykerOptions options)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.InitialisationProcess.GetMutableProjectsInfo(IStrykerOptions options)
  Error:    at Stryker.Core.Initialisation.ProjectOrchestrator.MutateProjects(IStrykerOptions options, IReporter reporters, ITestRunner runner)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.ProjectOrchestrator.MutateProjects(IStrykerOptions options, IReporter reporters, ITestRunner runner)
  Error:    at Stryker.Core.StrykerRunner.RunMutationTest(IStrykerInputs inputs, ILoggerFactory loggerFactory, IProjectOrchestrator projectOrchestrator)
  14:00:41 [ERR]    at Stryker.Core.StrykerRunner.RunMutationTest(IStrykerInputs inputs, ILoggerFactory loggerFactory, IProjectOrchestrator projectOrchestrator)
  Error:    at Stryker.CLI.StrykerCli.RunStryker(IStrykerInputs inputs) in /_/src/Stryker.CLI/Stryker.CLI/StrykerCLI.cs:line 152
  14:00:41 [ERR]    at Stryker.CLI.StrykerCli.RunStryker(IStrykerInputs inputs) in /_/src/Stryker.CLI/Stryker.CLI/StrykerCLI.cs:line 152
  Error:    at Stryker.CLI.StrykerCli.<>c__DisplayClass11_0.<Run>b__0() in /_/src/Stryker.CLI/Stryker.CLI/StrykerCLI.cs:line 124
  14:00:41 [ERR]    at Stryker.CLI.StrykerCli.<>c__DisplayClass11_0.<Run>b__0() in /_/src/Stryker.CLI/Stryker.CLI/StrykerCLI.cs:line 124
  Error:    at McMaster.Extensions.CommandLineUtils.CommandLineApplication.<>c__DisplayClass143_0.<OnExecute>b__0(CancellationToken _)
  14:00:41 [ERR]    at McMaster.Extensions.CommandLineUtils.CommandLineApplication.<>c__DisplayClass143_0.<OnExecute>b__0(CancellationToken _)
  Error:    at McMaster.Extensions.CommandLineUtils.CommandLineApplication.ExecuteAsync(String[] args, CancellationToken cancellationToken)
  14:00:41 [ERR]    at McMaster.Extensions.CommandLineUtils.CommandLineApplication.ExecuteAsync(String[] args, CancellationToken cancellationToken)
  Error:    at McMaster.Extensions.CommandLineUtils.CommandLineApplication.Execute(String[] args)
  14:00:41 [ERR]    at McMaster.Extensions.CommandLineUtils.CommandLineApplication.Execute(String[] args)
  Error:    at Stryker.CLI.StrykerCli.Run(String[] args) in /_/src/Stryker.CLI/Stryker.CLI/StrykerCLI.cs:line 130
  14:00:41 [ERR]    at Stryker.CLI.StrykerCli.Run(String[] args) in /_/src/Stryker.CLI/Stryker.CLI/StrykerCLI.cs:line 130
  Error:    at Stryker.CLI.Program.Main(String[] args) in /_/src/Stryker.CLI/Stryker.CLI/Program.cs:line 14
  14:00:41 [ERR]    at Stryker.CLI.Program.Main(String[] args) in /_/src/Stryker.CLI/Stryker.CLI/Program.cs:line 14
  Error:  ---> (Inner Exception #1) System.FormatException: Commandline could not be parsed.
  14:00:41 [ERR]  ---> (Inner Exception #1) System.FormatException: Commandline could not be parsed.
  Error:    at Buildalyzer.Compiler.CommandLine.Parse(DirectoryInfo baseDir, String commandLine, CompilerLanguage language)
  14:00:41 [ERR]    at Buildalyzer.Compiler.CommandLine.Parse(DirectoryInfo baseDir, String commandLine, CompilerLanguage language)
  Error:    at Buildalyzer.AnalyzerResult.ProcessCscCommandLine(String commandLine, Boolean coreCompile)
  14:00:41 [ERR]    at Buildalyzer.AnalyzerResult.ProcessCscCommandLine(String commandLine, Boolean coreCompile)
  Error:    at Buildalyzer.Logging.EventProcessor.MessageRaised(Object sender, BuildMessageEventArgs e)
  14:00:41 [ERR]    at Buildalyzer.Logging.EventProcessor.MessageRaised(Object sender, BuildMessageEventArgs e)
  Error:    at Microsoft.Build.Logging.EventArgsDispatcher.Dispatch(BuildEventArgs buildEvent)
  14:00:41 [ERR]    at Microsoft.Build.Logging.EventArgsDispatcher.Dispatch(BuildEventArgs buildEvent)
  Error:    at MsBuildPipeLogger.PipeLoggerServer`1.Read()
  14:00:41 [ERR]    at MsBuildPipeLogger.PipeLoggerServer`1.Read()
  Error:    at MsBuildPipeLogger.PipeLoggerServer`1.ReadAll()
  14:00:41 [ERR]    at MsBuildPipeLogger.PipeLoggerServer`1.ReadAll()
  Error:    at Buildalyzer.ProjectAnalyzer.BuildTargets(BuildEnvironment buildEnvironment, String targetFramework, String[] targetsToBuild, AnalyzerResults results)
  14:00:41 [ERR]    at Buildalyzer.ProjectAnalyzer.BuildTargets(BuildEnvironment buildEnvironment, String targetFramework, String[] targetsToBuild, AnalyzerResults results)
  Error:    at Buildalyzer.ProjectAnalyzer.Build(String targetFramework, BuildEnvironment buildEnvironment)
  14:00:41 [ERR]    at Buildalyzer.ProjectAnalyzer.Build(String targetFramework, BuildEnvironment buildEnvironment)
  Error:    at Buildalyzer.ProjectAnalyzer.Build(String targetFramework, EnvironmentOptions environmentOptions)
  14:00:41 [ERR]    at Buildalyzer.ProjectAnalyzer.Build(String targetFramework, EnvironmentOptions environmentOptions)
  Error:    at Buildalyzer.ProjectAnalyzer.Build(EnvironmentOptions environmentOptions)
  14:00:41 [ERR]    at Buildalyzer.ProjectAnalyzer.Build(EnvironmentOptions environmentOptions)
  Error:    at Stryker.Core.Initialisation.InputFileResolver.AnalyzeSingleProject(IProjectAnalyzer project, IStrykerOptions options)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.InputFileResolver.AnalyzeSingleProject(IProjectAnalyzer project, IStrykerOptions options)
  Error:    at Stryker.Core.Initialisation.InputFileResolver.GetProjectAndAddIt(IStrykerOptions options, IAnalyzerManager manager, ValueTuple`2 entry, String normalizedProjectUnderTestNameFilter, ConcurrentBag`1 mutableProjectsAnalyzerResults)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.InputFileResolver.GetProjectAndAddIt(IStrykerOptions options, IAnalyzerManager manager, ValueTuple`2 entry, String normalizedProjectUnderTestNameFilter, ConcurrentBag`1 mutableProjectsAnalyzerResults)
  Error:    at Stryker.Core.Initialisation.InputFileResolver.<>c__DisplayClass15_1.<AnalyzeAllNeededProjects>b__1(ValueTuple`2 entry)
  14:00:41 [ERR]    at Stryker.Core.Initialisation.InputFileResolver.<>c__DisplayClass15_1.<AnalyzeAllNeededProjects>b__1(ValueTuple`2 entry)
  Error:    at System.Threading.Tasks.Parallel.<>c__DisplayClass43_0`2.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int64 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
  14:00:41 [ERR]    at System.Threading.Tasks.Parallel.<>c__DisplayClass43_0`2.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int64 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
  Error: --- End of stack trace from previous location ---
  14:00:41 [ERR] --- End of stack trace from previous location ---
  Error:    at System.Threading.Tasks.Parallel.<>c__DisplayClass43_0`2.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int64 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
  14:00:41 [ERR]    at System.Threading.Tasks.Parallel.<>c__DisplayClass43_0`2.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int64 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
  Error:    at System.Threading.Tasks.TaskReplicator.Replica.Execute()<---
  14:00:41 [ERR]    at System.Threading.Tasks.TaskReplicator.Replica.Execute()<---
  14:00:41 [ERR] 
  Error: Target "MutationTestExecution" has thrown an exception
  14:00:42 [ERR] Target MutationTestExecution has thrown an exception
  System.Exception: Stryker did not execute successfully for Mockolate: (exit code 134).

See linked GitHub pipeline runs for more details.

Expected behavior
The build pipeline should succeed.

Desktop (please complete the following information):

• OS: Ubuntu 24.04.3
• Type of project .NET
• Framework Version net8.0
• Stryker Version 4.7.0 and 4.8.1

Additional context

[dupdob]

thanks for raising this issue.
We can agree that whatever the cause, this should not happen.

This has been caused because Stryker failed to parse the command line send to the C# compiler. I suspect it has been triggered by some recent options you activated in the project that is not yet supported. It would be great if you could identify it.

The bad news is that it happens within Buildalyzer which is used by Stryker for project analysis, so we do not have control over their release cycle.

[vbreuss]

@dupdob Thanks for having a look.
I use some pre-release stuff from C# (extension properties), but as the exact same commit worked before, it should not be related to any change I made. The same logic applies to stryker, so I am really stuck as to what could have caused this regression.
At first I thought it might be the github runner, that something changed there, but they seem to be identical:

What is this Buildalyzer? Should I report this issue there?

[martincostello]

I've hit the same issue since updating Polly to use .NET 10 RC.2.

System.FormatException: Commandline could not be parsed.
   at Stryker.Core.Initialisation.InputFileResolver.AnalyzeAllNeededProjects(List`1 projectList, IStrykerOptions options, IAnalyzerManager manager, ScanMode mode)
   at Stryker.Core.Initialisation.InputFileResolver.AnalyzeAndIdentifyProjects(List`1 projectList, IStrykerOptions options, IAnalyzerManager manager, ScanMode mode)
   at Stryker.Core.Initialisation.InputFileResolver.ResolveSourceProjectInfos(IStrykerOptions options)
   at Stryker.Core.Initialisation.InitialisationProcess.GetMutableProjectsInfo(IStrykerOptions options)
   at Stryker.Core.Initialisation.ProjectOrchestrator.MutateProjects(IStrykerOptions options, IReporter reporters, ITestRunner runner)
   at Stryker.Core.StrykerRunner.RunMutationTest(IStrykerInputs inputs, ILoggerFactory loggerFactory, IProjectOrchestrator projectOrchestrator)
[11:42:14 INF] Time Elapsed 00:00:04.0091730
Unhandled exception. System.FormatException: Commandline could not be parsed.
   at Stryker.Core.Initialisation.InputFileResolver.AnalyzeAllNeededProjects(List`1 projectList, IStrykerOptions options, IAnalyzerManager manager, ScanMode mode)
   at Stryker.Core.Initialisation.InputFileResolver.AnalyzeAndIdentifyProjects(List`1 projectList, IStrykerOptions options, IAnalyzerManager manager, ScanMode mode)
   at Stryker.Core.Initialisation.InputFileResolver.ResolveSourceProjectInfos(IStrykerOptions options)
   at Stryker.Core.Initialisation.InitialisationProcess.GetMutableProjectsInfo(IStrykerOptions options)
   at Stryker.Core.Initialisation.ProjectOrchestrator.MutateProjects(IStrykerOptions options, IReporter reporters, ITestRunner runner)
   at Stryker.Core.StrykerRunner.RunMutationTest(IStrykerInputs inputs, ILoggerFactory loggerFactory, IProjectOrchestrator projectOrchestrator)
   at Stryker.CLI.StrykerCli.RunStryker(IStrykerInputs inputs) in /_/src/Stryker.CLI/Stryker.CLI/StrykerCLI.cs:line 152
   at Stryker.CLI.StrykerCli.<>c__DisplayClass11_0.<Run>b__0() in /_/src/Stryker.CLI/Stryker.CLI/StrykerCLI.cs:line 124
   at McMaster.Extensions.CommandLineUtils.CommandLineApplication.<>c__DisplayClass143_0.<OnExecute>b__0(CancellationToken _)
   at McMaster.Extensions.CommandLineUtils.CommandLineApplication.ExecuteAsync(String[] args, CancellationToken cancellationToken)
   at McMaster.Extensions.CommandLineUtils.CommandLineApplication.Execute(String[] args)
   at Stryker.CLI.StrykerCli.Run(String[] args) in /_/src/Stryker.CLI/Stryker.CLI/StrykerCLI.cs:line 130
   at Stryker.CLI.Program.Main(String[] args) in /_/src/Stryker.CLI/Stryker.CLI/Program.cs:line 14

[dupdob]

hi
I had a look into Buildalyzer source code, and my understanding is that Buildalyzer needs to update the roslyn package they use.
Basically, they rely on Roslyn to parse the command line provided by MSBuild to the C# compiler (csc). And when it fails, it returns an empty result, which then results in an exception. This makes sense since Buildalyzer needs this information to build an understanding of the project main properties.

In other words, they need to provide at least a Net 9.0 version, maybe a Net 10.0

[martincostello]

Have opened Buildalyzer/Buildalyzer#318.

[slang25]

It looks like RC2 changed to use an apphost for the compiler, so on linux the compiler entrypoint changes from csc.dll to just csc
dotnet/roslyn#80026

A potential fix is here: Buildalyzer/Buildalyzer#319

I'm really keen to get involved in the Buildalyzer maintenance, there are lots of edge cases people are hitting and we need to support things like slnx solution files etc...

[candoumbe]

It seems like the fix was merged on Buildalizer repo. Do you have any update to share ?

[martincostello]

The fix was merged, but there hasn't been a new release containing it yet: Buildalyzer/Buildalyzer#319 (comment)