I return Response.Ok or Response.Fail on all execution path:
7 replies
Hello @AntyaDev did you thought about aggregating metrics before writing them to InfluxDB? Correct me if I'm wrong but it seems that you simply store data points and batch write them, which is fine until higher rps values, like 50K rps or similar.
I extended locust (locust.io) with custom metric sink for influxdb, and would aggregate points with numpy every second, and write the aggregate. That way we could do 120K rps or more. Any thoughts?
I extended locust (locust.io) with custom metric sink for influxdb, and would aggregate points with numpy every second, and write the aggregate. That way we could do 120K rps or more. Any thoughts?
8 replies
Hello, I was hoping someone could help me with a problem I've encountered. I have a scenario with several steps. When one of those steps encounters an internal server error, I return Fail with the status code. The test runner runs the next step, even though I've returned Fail with status code 500. That next step generates a 500 error too. I should see two fails in the report. I do not. According to the documentation, "NBomber executes steps by iterations and if you return Response.fail from any step - NBomber will stop the current iteration and starts a new one from step one." That doesn't happen until two steps later. And no failure is reported in the results.
12 replies
@AntyaDev amazing work on NBomber.
What's the chance of adding a flag that allows steps (as part of a sequence) that are still running after the load sim is done to be calculated and accounted for in the stats and metrics?
When there's more than 1 step, the flow seems incomplete when the RPS count doesn't match in all steps.
What's the chance of adding a flag that allows steps (as part of a sequence) that are still running after the load sim is done to be calculated and accounted for in the stats and metrics?
When there's more than 1 step, the flow seems incomplete when the RPS count doesn't match in all steps.
4 replies
@AntyaDev: Thanks for the reply.
I understand that the overall stats will change, that's what I'm aiming for.
When I have a Step1 with 100RPS and Step2 with 80RPS, these stats seem incomplete because some sequences weren't calculated.
Again, great job on the framework.
I understand that the overall stats will change, that's what I'm aiming for.
When I have a Step1 with 100RPS and Step2 with 80RPS, these stats seem incomplete because some sequences weren't calculated.
Again, great job on the framework.
when you have duration 10 seconds and you got Step 1 = 100RPS and Step 2 = 80RPS
it's what your server is capable to handle in 10 seconds
also, if for example you at 9:59 seonds and nBomber is started request at 9:59 and received response at 10:05 then this response will be filtered fromoveral stats
because you server was not able to complete this request till 10:00
it's clear that you was able to start at 9:59 (you have 1 seconds to complete)
6 replies
Hello all! I've got a question about dynamically register scenarios with nbomber. My use case is this:
- Like setting configurations with using json file, I need to switch on/off some scenarios for testing according to environment or any other settings set in application config files. Is there any built-in solution or sample code-base to follow? If not, I need to implement it from scratch.
7 replies
@AntyaDev - Any chance I can help out with some of the C# documentation / examples? Copy + Paste didn't compile on one of them and I'd like to update it. And the multi step example delays for 1 second, but the default timeout for a step is 1 second so it seems like something is broken when you run it.
5 replies
@AntyaDev when working with NBomber and Kafka, I ran into an interesting issue when producing via the
void return type as the serialization for that method requires that the process NOT continue on the captured context in order to avoid deadlocks. I was able to quite easily and reliably create a deadlock when using NBomber... my fsharp experience is zero... but would having the execute function essentially ConfigureAwait(false) be problematic to the lib?
5 replies
HI @AntyaDev, hope you are well and safe! What if we need to make some calls in parallel during one step? For example to emulate client page openning with a couple of different services calling? In that case one step should contain several calls but it will affect statistics. We will see only combined calls. What is the best solution in this case?
For those who may come here and notice @Balfa 's message and others who have come to the same realization, let's show our support for the dev's here with our kind wishes and a pledge to help in whatever way we can. As for me, I have reworked my budget so that I can give to organizations helping Ukrainians out of each paycheck. Please consider doing the same if you have not already started.
@AntyaDev we are all praying, hoping, wishing, and doing what we can for you, your team, and your country. I know that it will probably be some time before you read these messages, but I hope when you do, that it will be a time of peace and that they will be words of hope and encouragement for your team.
3 replies
Hello, i have little problem with my scenario execution order. I know that is going "By default all steps within one scenario execute sequentially". My scenario is composed by login -> thinkTime(10s) -> createFolder -> thinkTime(10) -> uploadFile. Everything is going allright but last step uploadFile is not executed.
43 replies
Hello, i have noticed little problem in targetScenarios PragmaticFlow/NBomber#462 If i have the same names in enum and in the targetScenarios so the last one in targerScenarios array will disapear
Hi @AntyaDev , I've been trying NBomber but i got a lot of fail count with simple_http test.. It worked fine the first couple of times by the way. I couldn't figure out what's wrong. Maybe someone here had the same kind of problem?
1 reply
@AntyaDev I'm seeing errors in the 2.14 & 2.15 versions of nbomber today with an unfound method in Serilog. 3.x is working as expected, though. I haven't checked older versions of 2.x yet. I'll post the error as a reply to this msg so I don't soak up vertical space.
5 replies
I keep getting the hint "Step <StepName> in scenario <ScenarioName> didn't track data transfer. In order to track data transfer, you should use Response.Ok(sizeInBytes: value)" despite having passing a value to sizeInBytes. For a lot of my steps, there is no data transferred, so I would like the warning to not be shown when the data transferred is 0. Would I have to disable the hints entirely for this?
2 replies
I have a question about scenarios
I have 4 scenarios and each scenario has a load simulation for 10 minutes. When I am registering all of them in NBomberRunner.RegisterServices() method it doesn't complete in 10 mins and after 10 min it fails. what could be the problem?
4 replies
I believe there is somethin wrong with how the CSV reports are generated. In the last column (data_transfer_all_mb), the last step always has "nbomber_default_test_suite_name" attached to the number that would be the data transfer. It seems that the column name is being inserted at the wrong place. I am not sure exactly sure what the CSV report is supposed to look like, so I'll send a screenshot of it here.
4 replies
I'm using NBomber.Cluster and I am trying to pass Json configured settings to an Agent. I can do this using GlobalSettings->ScenariosSettings. But what if I want to pass settings that apply to ALL Scenarios (i.e. BaseUrl)? I am trying to avoid having to configure the same settings over and over for each Scenario. Is this possible?
12 replies
Hello, I'm having trouble configuring InfluxDB + Grafana. I am following this example:
Question #1: I use Docker Compose to set up InfluxDB + Grafana. I noticed that the JSON configuration specifies "nbomber" as the Database, but in the code configuration it uses "default". Are these contradicting each other, or is this the desired setup?
Question #2: when I follow instructions to add the datasource, I get an error saying "Cannot create property 'executedQueryString' on string '<!DOCTYPE html>", followed by a mixture of a bunch of HTML and JSON. The instructions say:
On the Data Source configuration page, enter a name for your InfluxDB data source. To run this example enter: nbomber
Is there anything else I need to configure here (i.e. credentials, db name), to get past this error?
5 replies
