@dmetzger57 So ran the patched code with a VIM Broker as well, and I saw improvements on each provider size: Small - ~7%, Medium: ~26%, Large ~46%, XLarge 75%
On the X-Large the non-patched code took 3585s total on the best run (4 runs) and the best run with the patched code was 898s
want to see how many queries, how much data throughput, ... we do on the same test runs over time
disclaimer I say statsd but mean statsd / graphite / flavor of the month (which is influxdb for me right now)
but the idea is to make metric colletion so easy, that you start measuring everything. and then you can detect regressions, and when you performance tune, you can actually see things getting better