Specflow Livingdoc (Azure DevOps plugin).: Problems with uploading test results with Azure Devops Server (w/o internet access)
Answered
I am having problems using the new Azure DevOps plugin Version 0.6.669 . Outcome of tests are not displayed in LivingDoc. I followed the new updated documentation pages. In the same build definition I also created successfully the LivingDoc commandline reports, so I am pretty confident the setup is correctly regarding TestExecution.json , etc. Problem seems to be that when uploading test results, it seems to try internet resources, however our Azure Devops Server 2019 has no connectivity with internet (due to security considerations) Build step is shown as successful, but log entries are like this:
ApplicationInsights:CorrelationIdManager [ { Error: getaddrinfo ENOTFOUND dc.services.visualstudio.com dc.services.visualstudio.com:443
at errnoException (dns.js:28:10)
at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:76:26)
code: 'ENOTFOUND',
errno: 'ENOTFOUND',
syscall: 'getaddrinfo',
hostname: 'dc.services.visualstudio.com',
host: 'dc.services.visualstudio.com',
port: 443 } ]
Uploading: 379 bytes
Uploading: 118870 bytes
Upload was successful.
##[section]Finishing: SpecFlow+ build step.
-
The log entry you have posted is only a warning from Appinsights, it cannot access the endpoint for the logging of analytics events. That's ok when you can't access the internet from your build agents.
Are there any other log entries?
0 -
Hi Andreas,
Thanks for looking into it
Some more logs
##[debug]dotnet /home/tfsbuildsvc/agent/_work/_tasks/SpecFlowPlus_32f3fe66-8bfc-476e-8e2c-9b4b59432ffa/0.6.669/CLI/LivingDoc.CLI.dll feature-folder "/home/tfsbuildsvc/agent/_work/2/s/XXXX/Features" --project-language "en" --output "/home/tfsbuildsvc/agent/_work/2/s/285309/FeatureData.json" --output-type JSON --title " XXXX " --work-item-prefix "tfs:" --test-execution-json "/home/tfsbuildsvc/agent/_work/2/s/ XXXX/bin/Debug/netcoreapp3.1/TestExecution.json"
##[debug]/home/tfsbuildsvc/agent/_work/2/s/285309/FeatureData.json was successfully generated.##[debug]System.AccessToken=undefined
##[debug]SYSTEMVSSCONNECTION exists true
ApplicationInsights:CorrelationIdManager [ { Error: getaddrinfo ENOTFOUND dc.services.visualstudio.com dc.services.visualstudio.com:443
at errnoException (dns.js:28:10)
at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:76:26)
code: 'ENOTFOUND',
errno: 'ENOTFOUND',
syscall: 'getaddrinfo',
hostname: 'dc.services.visualstudio.com',
host: 'dc.services.visualstudio.com',
port: 443 } ]
Uploading: 379 bytes
Uploading: 123515 bytes
Upload was successful.
##[debug]Absolute path for pathSegments: /home/tfsbuildsvc/agent/_work/2/s/285309,LivingDoc.html = /home/tfsbuildsvc/agent/_work/2/s/285309/LivingDoc.html
##[debug]Processed: ##vso[task.addattachment type=Distributedtask.Core.Summary;name=SpecFlow LivingDoc generated;]/home/tfsbuildsvc/agent/_work/2/s/285309/LivingDoc.html
##[section]Finishing: SpecFlow+ build step.The FeatureData.json seems to be correct (including test execution status (e.g. Duration ,Status, etc.)
What I can see, when navigating to the TFS Livingdoc page ending with
_apps/hub/techtalk.techtalk-specflow-plus.techtalk.specflow.plus.hub#/document/GUID that the testexecution data is also included in the Ajax call with that GUID.Nevertheless, all steps are greyed out with Test Status “Others” and no additional information about the tests and not with Passed or failed Status when the tests are excecuted.
There are a few javascript errors
0 -
Issue solved by using approach described in comments of https://support.specflow.org/hc/en-us/community/posts/360014407618-Specflow-LivingDoc-Test-results-generating-as-other-instead-of-passing?page=1#community_comment_360003708297
Many thanks !!
0
Please sign in to leave a comment.
Comments
3 comments