These are chat archives for Behat/Behat

29th
Jan 2015
Nikita
@nike-17
Jan 29 2015 01:13
We have some unstable tests in our CI, Is there any way to rerun failed tests and if they are fine return OK output?
Alex Panshin
@enl
Jan 29 2015 04:30
@nike-17, vendor/bin/behat --rerun
Nikita
@nike-17
Jan 29 2015 05:34
thank you @enl it's almost what i need, but it require kind of wrapper to produce clean junit formated output
Alex Panshin
@enl
Jan 29 2015 05:41
You can write shell script which will rerun failed tests and return ok status if second attempt is fine.
Nikita
@nike-17
Jan 29 2015 05:55
sounds good, thank you!
Eddie Jaoude
@eddiejaoude
Jan 29 2015 06:59

We have some unstable tests

It rare for tests to be unstable as they are relatively simple, it usually the Application that is unstable & should be resolved

Alex Panshin
@enl
Jan 29 2015 08:17
@eddiejaoude I have to test an application with only OAuth authentication so that I need to rely on third-party components (I mean logging in through Facebook). Sometimes tests can be unstable, but it is really rear case, of course.
Eddie Jaoude
@eddiejaoude
Jan 29 2015 08:18
fair enough :)
Nikita
@nike-17
Jan 29 2015 18:09
We have about ~1000 tests that wroten for different people. They runs in parallel and can fail randomly by different reason, including(but not limited) phantomjs falling, resource concurrency, timing problems etc.