Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    guilhotarras
    @guilhotarras
    Hello
    when can we have this fixed ? midniteio/multi-cuke#64
    Ian Fleming
    @midniteio
    Hey there
    Let me take a look now and see how difficult thatd be to add
    Actually, this already is implemented, I'm going to be closing out this issue if it's ok with you
    There is a --logdir flag that you can pass a path to, thats where json logs end up
    You can see the cucumber command that gets run here, we always export a json file actually, it's what we use to parse the results per-scenario and then aggregate for results https://github.com/midniteio/multi-cuke/blob/master/src/lib/worker.js#L35
    So each log will end up there
    Ian Fleming
    @midniteio
    Also, all the scenarios do get merged back into a single results json file here once all are finished https://github.com/midniteio/multi-cuke/blob/master/src/lib/test-handler.js#L76
    So this should provide the granularity of individual logs and a single overall log
    @guilhotarras if you'd like to reopen the issue please do and ping me here, but I believe this is what you're looking for.
    Ian Fleming
    @midniteio
    In regards to midniteio/multi-cuke#63, let me look to see how cucumber itself interprets feature-level tags
    Ian Fleming
    @midniteio
    Yeah we just aren't supporting feature tags at this point, I can get this worked out
    Ian Fleming
    @midniteio
    @guilhotarras I've tagged you in a PR to resolve this second issue, midniteio/multi-cuke#65
    Ian Fleming
    @midniteio
    This is resolved now in version 0.13.4, feel free to ping here again if that isnt working for you or if you have other questions
    guilhotarras
    @guilhotarras
    Thanks ! It really works. But there is also another bug. When I take a screenshot, the screenshot is not being shown on the html generated report. If you check the results.json file, you will see there that it isnt any reference to the taken screenshot.
    here is my code to take the screenshot:
    this.After({tags: ['@01_web_app_build_number']}, function(scenario) {
    this.browser.takeScreenshot()
    .then( buffer => scenario.attach(new Buffer(buffer, 'base64'), 'image/png') )
    });
    Ian Fleming
    @midniteio
    @guilhotarras good to hear. Re: screenshots, can you make an issue for this? I can try and take a look at it today. Functionally speaking, multicuke uses the json output that comes directly from cucumber, so should have anything that cucumber itself provides there, can you gist/link a snippet of the results you're getting output? If not for company/project reasons, that's fine- I can still try to repro
    Ian Fleming
    @midniteio
    I just attempted this by adding scenario.attach(new Buffer([100, 97, 116, 97]), 'image/png'); to the beforeHooks in one of our projects, I am seeing this in the logs multi-cuke produces:
    "embeddings": [
      {
        "data": "ZGF0YQ==",
        "mime_type": "image/png"
      }
    ],
    guilhotarras
    @guilhotarras
    It looks like that now its working :) Maybe I did something wrong on the last time I tried it. Thanks !
    guilhotarras
    @guilhotarras
    Do you have planned to have a re-run failed scenarios feature ?
    guilhotarras
    @guilhotarras
    Another question, when using multi-cuke, I write console.log(''some text") on my tests, but nothing is shown on the console
    that is a problem, when I want to make debugs
    Ian Fleming
    @midniteio
    Re: console.logs, that's mentioned here: midniteio/multi-cuke#56
    The problem here is that we are explicitly silencing stdout on test runs because we run X number of tests at once all trying to write to console and it becomes a jumbled mess of incoherent text. Our solution is to silence that output, and then output the results of the tests once the test has finished based on its results given by the cucumber json- but that means debug text gets stuck in a bad place
    Ian Fleming
    @midniteio
    I do have plans to refactor a bit so that we can have the best of both worlds. Ther'es an option we could take to pipe the output per-scenario rather than ignore it, but your console would be flooded with sumnmary output on every single scenario you run and would be unwieldy. And scraping that summary away from the text isn't a great solution because that could vary with a given version of cucumber and that'd be a bummer for compatability
    In the meantime, instead of console.log you could simply have a debug log file that you fs.appendFile to if that help? :/ Not the solution you probably were looking for, but I have this issue noted and planned to take care of soon
    This issue's also listed within the readme, and we have another solution you could try listed here if you like: https://github.com/midniteio/multi-cuke#differences-from-standard-cucumber-js
    but will be looking to support you're standard console.log/warn/error commands when I get to refactoring this
    Ian Fleming
    @midniteio
    Re: failure reruns, issue added here: midniteio/multi-cuke#67 will address this one asap
    Ian Fleming
    @midniteio
    So in regards to console logs, this is solvable on our end with stubs, in a way that you could then use console log/warn/error/etc as normal and we'd be able to output it at test time.
    However associating it with a step would be a little more difficult without explicitly changing the console calls, which I'd like to avoid so that step definitions work regardless of cucumber/multi-cuke/parallel/serial
    It will print them in order, but theyd display in order after all of the steps