SpecFlow+LivingDoc change test passing threshold

Buntis, Leons

December 16, 2020 08:57

By default LivingDoc displays scenario as failed if at least one test run has failed.

Add possibility to change the behavior to display test as passed if at least one test run was successful.

13

• Official comment

  

  Mario Steiner

  December 18, 2020 13:16

  Update: Under consideration

  thanks everyone for your interesting feedback regarding the test passing threshold option/configuration.
  
  We are currently evaluating how we can further improve SpecFlow+ LivingDoc and how to enable individual test passing thresholds. We'll keep you updated.
• 

  Brenere, Oksana

  December 16, 2020 09:10

  Very needed feature

  3
• 

  Rafael Pedretti

  August 04, 2021 10:25

  Also it should be good to be able to set a `warning` status so we know when to check for flaky tests.
  Something like
  All runs fail -> Error
  Success runs > 0 and < total runs -> Warning
  All runs pass -> Success

  0
• 

  Ivan Dolgov

  August 09, 2021 15:27

  Hey guys, absolutely agree with Rafael.

  Also, it could be very cool if we would have possibility to configure it (f.e. in specflow.json).

  0

Please sign in to leave a comment.