Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
Dmitry Baev
@baev
Allure.getLifecycle().updateTestResult(tr -> tr.setParameters(...));
Kirill Bilchenko
@kirillbilchenko
thanks
byakoshiki
@byakoshiki_twitter
@baev what about the Jira Plugin? I created an issue that API in the plugin for Jira is not the same as in the commandliine
and its hard to create good pull request since the source code for that Plugin is not open source
DevOpsArt
@prabhurs123
HI Team, it my allure report it is coming as "Allure Report unknown
unknown - unknown (Unknown) " , could you please help me
Artur Mkrtychian
@arturmkr
Is it possible that all methods in the test would be marked as Step, without putting annotation @Step to each method?
byakoshiki
@byakoshiki_twitter
@arturmkr yes, it is. At least in java. If you are using Java you can do Allure.step() which uses lambda expression
and you just call methods inside this step
or multiple steps
Dmitry Baev
@baev
or you can create custom aspect that will catch all the method calls in classes you need
DevOpsArt
@prabhurs123

HI Team, it my allure report it is coming as "Allure Report unknown
unknown - unknown (Unknown) " , could you please help me

Anybody can help me for this issue?

fescobar
@fescobar
@prabhurs123 can you give more details, what adaptors/frameworks are you using?
Karol Perechowski
@KarolPerechowski_gitlab
Hi, i have question. On my jenkins i want to change labels that are on X and Y axis. What steps should i take? Is that like this modify allure plugin -> modify allure jenkins plugin -> add to jenkins. Am i right ?
DevOpsArt
@prabhurs123
@fescobar Below steps i have followed, 1. I have build maven project manually with surefire report plugin, then xml files are created in target/surefire-reports directory, 2. Ran allure serve on target/surefire-reports directory and i got the port to be access, 3. tried the port from browser to check the report, when access the report i can see "Allure Report unknown
unknown - unknown (Unknown)".
fescobar
@fescobar
@prabhurs123 I think you are not generating allure results correctly, you should obtained json files in your allure-results directory, not xmls(at least you use Allure1)
Here you have implemented, some examples in JAVA with Junit, TestNG and Cucumber https://github.com/fescobar/allure-docker-service#generate-allure-results
Amit Garg
@agar14
Hi, I am using Allure plugin with Jenkins to generate report, but not sure how to get Passed and Failed scenarios number in pipeline to ark deployment Pass\Fail. Suggestion please
DevOpsArt
@prabhurs123
@fescobar Thanks I will check it.
fescobar
@fescobar
@prabhurs123 let me know if you can fix it
Amit Garg
@agar14

Hi, I am using Allure plugin with Jenkins to generate report, but not sure how to get Passed and Failed scenarios number in pipeline to ark deployment Pass\Fail. Suggestion please

@prabhurs123 @fescobar Can you please suggest if allure plugin returns Job status with passed and fail number?

fescobar
@fescobar
@agar14 are you talking about jobs or about pipelines?
Riddhi K
@riddhik84
Hi I am using pytest and allure..I am not able to see history of the test execution. I do not find any helpful docs for the same.
When I open suits tab in the report and then select a specific test.. I can see overview and retries info.. but there is nothing in history tab
is there any configuration required for that?
Amit Garg
@agar14
@fescobar I am using Jenkins job to to deploy application code and after that with in same Jenkin job I am executing Automation scripts and generating allure report. On basis of allure results I want to pass or fail deployment status. (Pass% > 95% pass) otherwise fail and revert code.
byakoshiki
@byakoshiki_twitter
@agar14 but you want overall number of scenarios (that uses multiple frameworks like e.g. junit and karma) or some other number?
because if you dont use the behavior scenarios, you can easily get the raw number of scenarios from each framework
for example testng has listener that at end of suite can save the number of passed scenarios to the file
in Jenkins Pipeline job you can do a stage ("calculating results") which takes this file (or files) and do some basic math
then use conditional step
and you are done
Anton Aftakhov
@simple-elf
@riddhik84 retries is because you dont clean allure-results after each build
fescobar
@fescobar
@agar14 for that you should create a pipeline that will trigger a job with the tests and based on the results and status you will failed your pipeline and rollback. The pipeline allow you to add logic to do that. I will share you and example, but give me a few mins.
@riddhik84 if you want to keep history/trends you have to do this https://stackoverflow.com/questions/50376630/allure-reports-to-see-historic-trends
@riddhik84 or you can use allire
You can use allure docker container that include that feature https://github.com/fescobar/allure-docker-service/blob/master/README.md#keep-history-and-trends
fescobar
@fescobar
@agar14 the thing is you can rollback based on the status of the job, but you can't get the percentage of successful results.

                pipeline {
                    agent { label "linux" }
                    stages {
                        stage('TRIGGER JOBS') {
                                    build job: 'TEST-FRONTEND-JOB', wait: true
                       }

                    }

                    post {
                      always {
                        script {
                            switch (currentBuild.currentResult) {
                                case "SUCCESS":
                                    // DO SOMETHING
                                    break
                                case "FAILURE":
                                    // ROLLBACK
                                    break
                            }
                        }
                      }
                       }

                }
even if you pipeline run the tests, I think it's not possible to get the percentage
but the best approach to deploy/rollback is using a pipeline, not a job
fescobar
@fescobar

because if you dont use the behavior scenarios, you can easily get the raw number of scenarios from each framework

what @byakoshiki_twitter suggest it could work, you could calculate the results and determine when you want to rollback or not

in that case, I suggest to run the tests in the pipeline (a different stage) instead to run in different job
byakoshiki
@byakoshiki_twitter
@fescobar tests can still be done in different job if those files are transfered outside of tests workspace
and have one more stage that cleans up those files
fescobar
@fescobar
It could, but remember he could have different agents.
It depends what is the purpose
Riddhi K
@riddhik84
@fescobar I am confused again because I dont see a history folder generated anywhere
I use this and with pytest --alluredir=.\allureRepprts
Riddhi K
@riddhik84
I got it now
I would like to know when a test is considered flaky?
basically the bomb icon
fescobar
@fescobar