Use specflow runner to run tests on multiple machines?
Answered
Hello,
I have recently upgraded to the latest specflow (from 2.2 and wow what a change!) and have moved from using mstest to execute tests to use specflow runner. I have also migrated from using the XAML builds with MS test controller/agents to the built in VSTS build/agent. My prior setup was I had a test controller distribute the tests to 8 other servers/ test agents to distribute the UI tests (1500+).
I have the builds/tests running as expected on one server, but I'm not finding anything in regards to distributing these tests across multiple servers. In my build I have a Visual Studio Test Task to run the tests, but I'm not finding any documentation on how to distribute tests. Does runner have the ability to do this? Or should I explore another tool for this?
-
The VSTest Task has the ability to distribute the tests to multiple agents. Documentation is here: https://docs.microsoft.com/en-us/azure/devops/pipelines/test/parallel-testing-vstest?view=azure-devops
I have not tried it yet.
1 -
Great thanks, I was able to get it up and running following that documentation as expected.
0 -
Follow up question, each server running tests generates it's own .html report for the tests they individually ran. Is there a built in way to create one master HTML report that combines them all together?
1 -
No, there isn't. The orchestration to split this to multiple machines is completely done in VSTest. The report HTML is generated by the SpecFlow+ Runner. They are completely separated in that case. We don't know in the SpecFlow+ Runner, that this test run is distributed over multiple machines.
0
Please sign in to leave a comment.
Comments
4 comments