Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • 17:11
    Ky7m synchronize #1077
  • 14:02
    phillijw commented #1249
  • 09:59
    wryczko opened #1249
  • Sep 17 09:49
    adamsitnik commented #1238
  • Sep 17 09:40
    adamsitnik assigned #1226
  • Sep 17 09:40
    adamsitnik labeled #1226
  • Sep 17 09:40
    adamsitnik edited #1226
  • Sep 17 09:40
    adamsitnik edited #1226
  • Sep 17 09:39
    adamsitnik closed #1226
  • Sep 17 09:39
    adamsitnik commented #1226
  • Sep 17 08:49
    adamsitnik review_requested #1248
  • Sep 17 08:49
    adamsitnik review_requested #1248
  • Sep 17 08:49
    adamsitnik opened #1248
  • Sep 17 08:48

    adamsitnik on longStringAsArguments

    implement test extend FullNameProvider with a … make EtwProfiler support benchm… and 1 more (compare)

  • Sep 17 08:38
    adamsitnik milestoned #1247
  • Sep 17 08:38
    adamsitnik labeled #1247
  • Sep 17 08:38
    adamsitnik assigned #1247
  • Sep 17 08:38
    adamsitnik opened #1247
  • Sep 17 05:01
    adamsitnik commented #1198
  • Sep 16 17:48
    wojtpl2 commented #1198
TeBeCo
@tebeco
https://github.com/dotnet/BenchmarkDotNet/milestones
this is how you can trackdown Work in progress to have a notion of "Achievement" in upcoming or past releases
for example there is one updated ~5h ago with 100% acheivement
v0.11.6 is 100% and there is no release yet, so you can expect it to be released if there's no bug or mandatory "patch"
Filip Navara
@filipnavara
I'm specifically looking for a fix that is supposed to be released with v0.11.6. Some release notes were committed few days ago and it's ~5 months since last release...
I have two options - wait for v0.11.6 and make it really trivial for me to pick up the fix, or do the build myself and inject it as custom NuGet on my build machine used in Azure Pipelines.
Obviously I would rather go the easy way and wait but if someone told me that it will take another week/month I may reconsider.
TeBeCo
@tebeco
as said, the milestone has been "changed" 5hours ago and is at 100%. So just wait until your impatient enought to build it yourelf ^^
(i am not a contributor at all to benchmarkdotnet, i'm just generally speaking about project on open source repo)
Filip Navara
@filipnavara
Thanks. I did not notice the milestone was 100% complete. That makes me more confident that the right decision is to wait.
TeBeCo
@tebeco
^^ no worries
i hope it's deliver soon enought for you
that's why i linked the page to the milestone :)
Adam Sitnik
@adamsitnik
hi @filipnavara
we have a CI feed, you can use it to get the latest version
https://benchmarkdotnet.org/articles/guides/nuget.html#nightly
@AndreyAkinshin should be able to tell more about when we are going to release to nuget.org
Filip Navara
@filipnavara
Cool. The CI feed should be good enough for me.
I only consume dotnet/performance directly so patching that one is easy enough. Getting one more dependency through git would be a bit of a chore asking to get broken builds every few weeks.
Filip Navara
@filipnavara
Even better, the CI feed is already used in dotnet/performance
Looks like just bumping version in performance/src/harness/BenchmarkDotNet.Extensions/BenchmarkDotNet.Extensions.csproj should be enough
Filip Navara
@filipnavara
The new version detection code triggered an incompatibility with Mono/netcore. Funnily enough, there is bug both in BDN and Mono and it only fails because both are hit at the same time. :)
John Zabroski
@jzabroski
@natiki I think you can do what you want to do, but the results likely won't be very educational. I've managed to write time series as-of joins two different ways, where the intuitively "slower" version actually out-performed due to fewer branch mispredictions.
John Zabroski
@jzabroski
And when I say intuitively slower, I mean the Big O notation for the slower version is strictly slower due to a constant factor k, yet it's faster because it avoided branch mispredictions. Was a weird day when I saw that.
Andrey Akinshin
@AndreyAkinshin
@tebeco @filipnavara I have some concerns about recent API changes (see dotnet/BenchmarkDotNet#1236). Once we resolve all of the list problems, I'm going to release the next BenchmarkDotNet version.
Filip Navara
@filipnavara
@AndreyAkinshin alright. makes sense. note that there's an unfinalized story about how Mono/netcore will be consumed in .NET 5. right now I run it with custom runtime/SDK and netcoreapp5.0 TFM but that is likely not a long term solution. if the way the runtimes are specified is changed this should probably be accounted for, somehow.
(just thinking aloud, may not be totally related to your concerns)
Filip Navara
@filipnavara
fwiw... the scenario where I run the same set of tests using different runtimes (CoreCLR, Mono, CoreRT) shift some of the burden of comparing the result to me because they all target the same TFM (netcoreapp5.0).
or maybe I am just missing some magic switches :)
TeBeCo
@tebeco
@AndreyAkinshin
TeBeCo
@tebeco
oups
i did not meant to ping you sorry
Andrey Akinshin
@AndreyAkinshin

the scenario where I run the same set of tests using different runtimes (CoreCLR, Mono, CoreRT) shift some of the burden of comparing the result to me because they all target the same TFM (netcoreapp5.0)

@adamsitnik what do you think about this problem?

TeBeCo
@tebeco
gitter is soooo full of bug ... and on mobile -_-
can't edit / delete previous msg :(
Filip Navara
@filipnavara
yeah, I got bored of complaining on it already. few weeks ago it stopped working completely on mobile. I had to logout and log back in...
...to get back to the normal flaky sort-of working state
TeBeCo
@tebeco
@AndreyAkinshin
thx for the PR
will see when i add a new one for the coverage
will see later for the Exporter precheck
TeBeCo
@tebeco
@AndreyAkinshin regarding the RExporter, do you happen to know if an archive exist to "install" it as i mainly found "MSI" ? like an Expand + EnvVar and that's all ?
Andrey Akinshin
@AndreyAkinshin
@tebeco sorry, I'm not sure that I understand your question. Could you please provide more details?
TeBeCo
@tebeco
@AndreyAkinshin i wondered how i could use RExporter on the CI
We manage to do "parametrized" run on the CI, but we did not Add RExporter so i kind of have 2 questions
  • do you know if there is a way to "install" R sdk or R prerequisite for the exporter from the CI, usually just a zip or tar/tar.gz
  • do you know if there's a way to make BenchmarkDotNet only generate RScript + Json sumary => so that i could story the Json data and aggregate them but also run RScript whenever i want (or in another triggered Job)
Free Job on AzDO is limited to 60min so splitting actual Bench from the actual data exploitation would be neat (Graph generation / Aggregation/ push to storage)
TeBeCo
@tebeco
not sure what i wrote is clear ^^
Filip Navara
@filipnavara
a bit off-topic: are you actually running benchmarks on the AzDO hosted machines? how reliably does that work for you?
I migrated that entirely to on-site setup due to concerns about consistency
TeBeCo
@tebeco
i'm pretty sure i can give any reliable anwser myself about that :D
as the host change / cpu usage / shared etc .... i do understand it is totally awkward
This message was deleted
TeBeCo
@tebeco
we mostly used it to compare between existing signalr implementation and a custom one so it's fine for our usage
Filip Navara
@filipnavara
I am not sure they guarantee consistent performance during single run.
TeBeCo
@tebeco
i'll keep that in mind but this is fine for what we are doing and what we expect from it