These are chat archives for ManageIQ/manageiq/performance

28th
Apr 2016
Oleg Barenboim
@chessbyte
Apr 28 2016 16:44
@dmetzger57 @kbrock on ManageIQ/manageiq#8303, I am ready to merge, but questioning the darga/yes label
Dennis Metzger
@dmetzger57
Apr 28 2016 16:57
@chessbyte @kbrock given we have enetered the (darga / cmfe 5.6) stabilization phase, not including this in darga is the right choice.
Keenan Brock
@kbrock
Apr 28 2016 17:05
+1
@chessbyte ok, lets exclude
Oleg Barenboim
@chessbyte
Apr 28 2016 17:47
merged
Keenan Brock
@kbrock
Apr 28 2016 20:58
vms = MiqPreload.preload_and_map(Ems.all, :vms)
hosts = MiqPreload.preload_and_map(vms, :hosts)
puts hosts.count # LINE 3

Quick quiz: How many rows total are coming back from the db?
a) number of ems + number of vms + humber of hosts
b) number of ems + number of vms
c) 1

Extra credit, what is the count if you remove LINE 3? :)

(this is my way to say I'm excited and found a way to turn this into 100% scope)
Oleg Barenboim
@chessbyte
Apr 28 2016 21:21
woo hoo?
Keenan Brock
@kbrock
Apr 28 2016 21:21
oh yea!
nailing down kinks
5.5, had 1+ queries per tag per query
5.6 = no extra queries per flag
this is belongs to. used to be ~2-3 extra queries per belongs to filter per query
think we got this to no extra queries
Oleg Barenboim
@chessbyte
Apr 28 2016 21:22
wow
Keenan Brock
@kbrock
Apr 28 2016 21:23
calc_filtered_ids: ~10+ queries w/ +100,000 ids going over the wire to 1 sub query (no extra ids)
PER RBAC call
lucy's screen had 15?
Oleg Barenboim
@chessbyte
Apr 28 2016 21:24
15 what?
Keenan Brock
@kbrock
Apr 28 2016 21:24
rbac calls
think she reduced it
Oleg Barenboim
@chessbyte
Apr 28 2016 21:24
oh yes, yes
but each call to RBAC was taking 30 seconds or something
Keenan Brock
@kbrock
Apr 28 2016 21:24
~10+ queries w/ +100,000 ids going over the wire ;)
each rbac call
Oleg Barenboim
@chessbyte
Apr 28 2016 21:25
and with your latest changes, what would Lucy's screen go down to (approximately)?
Keenan Brock
@kbrock
Apr 28 2016 21:25
this query is more complex
Oleg Barenboim
@chessbyte
Apr 28 2016 21:25
it is now around 4 minutes or something
Keenan Brock
@kbrock
Apr 28 2016 21:25
haven't gotten to the last query ironed out
Oleg Barenboim
@chessbyte
Apr 28 2016 21:25
roger
Keenan Brock
@kbrock
Apr 28 2016 21:25
but in theory 25s?
in practice this may be obese. those filters are impressive
looking up the filters (what chris complains about) is still ugly
it could be cached, since it is not results focused but filter focused
luckily, was able to make this 100% independent of the filters
Oleg Barenboim
@chessbyte
Apr 28 2016 21:27
so, 10x improvement or so from 4m=240s
Keenan Brock
@kbrock
Apr 28 2016 21:27
yea. that is my money
Oleg Barenboim
@chessbyte
Apr 28 2016 21:27
well, that is a HUGE win
Keenan Brock
@kbrock
Apr 28 2016 21:27
I think automate will see it most
Oleg Barenboim
@chessbyte
Apr 28 2016 21:27
let me know what I need to merge to get you to the finish line
Keenan Brock
@kbrock
Apr 28 2016 21:27
thanks
now I have to find out how to take multiple queries and merge all of those sub queries
non trivial, but no where as hard as what we've already done
Keenan Brock
@kbrock
Apr 28 2016 22:01
Yay @chessbyte our schema duplicate load bug we fixed is now in rails master