Increasing the TestThreadCount causes TestExecution.json file generation to fail

I am attempting to write a tool that will automate the generation of a visual studio test playlist based on failed tests from the specflow report, we recently increased our testThreadCount to 4 and when using the LivingDocumentation plugin to generate the TestExecution.json file it is only generating a result for 1 in 4 tests and I think this is due to the threadCount so 4 tests are being seen as a single execution.

My aim is to generate a fully qualified test name for each of the failed tests using the TestExecution file but this will not work if I am only generating 25% of the results. Could I ask if anyone has an idea of a workaround for this. Please bear in mind that I am an apprentice so I may not fully understand everything.

<Execution stopAfterFailures="0" testThreadCount="4" testSchedulingMode="Sequential" retryFor="Failing" retryCount="0" />

This is our current execution settings in the .srprofile

Josh Herman

April 14, 2021 13:47

One of my colleagues suggested that there may be a way to generate a separate test execution file for each thread but we are not sure how to do this and I couldn't find anything referencing this in the documentation, separately I would like to avoid this if at all possible

Andreas Willich

April 16, 2021 11:53

You can do it like this in the specflow.json:

{
  "livingDocGenerator": {
    "enabled": true,
    "filePath": "TestExecution_{ProcessId}_{ThreadId}.json"
  }
}

From: https://docs.specflow.org/projects/specflow-livingdoc/en/latest/LivingDocGenerator/Setup-the-LivingDocPlugin.html

Increasing the TestThreadCount causes TestExecution.json file generation to fail

Comments

Didn't find what you were looking for?