These are chat archives for ManageIQ/manageiq/performance

19th
Apr 2016
Keenan Brock
@kbrock
Apr 19 2016 18:39
rails/rails#24631 -- this will allow us to override this method and sort by virtual columns almost seamlessly
Dennis Metzger
@dmetzger57
Apr 19 2016 18:40
Huge (not to steal a candidates tag line) performance win
Oleg Barenboim
@chessbyte
Apr 19 2016 18:44
@kbrock seems like you are making steady/solid progress to minimize SQL queries and/or minimize SQL payload size
will pay big dividends everywhere
@dmetzger57 @akrzos hoping there is a way to measure impact of these changes
Keenan Brock
@kbrock
Apr 19 2016 18:45
still have a little work to do in the last mile - e.g. add the definitions to the classes and/or ensure some places are not saying virtual_attribute?(name) - oh no, lets just load the whole database
Dennis Metzger
@dmetzger57
Apr 19 2016 18:47
the virtual column one is easy to measure, other aspects will take a bit more but t we will get statistics
even more importantly, we’ll get smiling customers…...
Keenan Brock
@kbrock
Apr 19 2016 18:48
heh
I'm working on a wrapper to state a screen and for it to output the # queries, rows brought back, and objects instantiated
that will go a long way to just getting a sanity check on each screen
Jason Frey
@Fryguy
Apr 19 2016 18:52
very cool idea on the page wrapper :heart_eyes:
Keenan Brock
@kbrock
Apr 19 2016 18:53
I have something
but it is more one off
you give it the ruby, and it does that
but I want it to take a yaml file
and a user
want a separate one that shows the info on the left hand nav - which tends to be a bit problematic
Oleg Barenboim
@chessbyte
Apr 19 2016 18:53
yeah, lets get all screens down to 100s of queries and then another round to dozens of queries
Alex Krzos
@akrzos
Apr 19 2016 19:06
Was this naming convention intended (Web Server Worker) vs all the other workers:
24385 ?        Sl    23:02 MIQ Server
24557 ?        Sl     0:18  \_ MIQ: MiqEventHandler id: 1, queue: ems
24564 ?        Sl     1:11  \_ MIQ: MiqGenericWorker id: 2, queue: generic
24569 ?        Sl     0:54  \_ MIQ: MiqGenericWorker id: 3, queue: generic
24575 ?        Sl     0:53  \_ MIQ: MiqPriorityWorker id: 4, queue: generic
24580 ?        Sl     0:50  \_ MIQ: MiqPriorityWorker id: 5, queue: generic
24587 ?        Sl     0:17  \_ MIQ: MiqReportingWorker id: 6, queue: reporting
24592 ?        Sl     0:17  \_ MIQ: MiqReportingWorker id: 7, queue: reporting
24601 ?        Sl     1:11  \_ MIQ: MiqScheduleWorker id: 8
24611 ?        Sl     0:12  \_ puma 3.3.0 (tcp://127.0.0.1:5000) [MIQ: Web Server Worker]
24623 ?        Sl     0:23  \_ puma 3.3.0 (tcp://127.0.0.1:3000) [MIQ: Web Server Worker]
24648 ?        Sl     0:10  \_ puma 3.3.0 (tcp://127.0.0.1:4000) [MIQ: Web Server Worker]
Jason Frey
@Fryguy
Apr 19 2016 19:06
which naming convention?
oh, the "Web Server Worker"? I thought you made that PR :)
Keenan Brock
@kbrock
Apr 19 2016 19:07
I really like ps -aux | grep postgres very cool
Chris Arcand
@chrisarcand
Apr 19 2016 19:08
@kbrock The command, or the result of the command?
Keenan Brock
@kbrock
Apr 19 2016 19:08
result
with status and stuff
Alex Krzos
@akrzos
Apr 19 2016 19:08
@Fryguy It's prefixed with puma (version) and more stuff
Keenan Brock
@kbrock
Apr 19 2016 19:09
can use that instead of rake run some special status for manageiq
Alex Krzos
@akrzos
Apr 19 2016 19:09
I'd imagine "MIQ: WebServerWorker puma 3.3.0 (tcp://127.0.0.1:5000)" would be aa bit more inline with the other workers, unless puma wraps around that worker then?
Oleg Barenboim
@chessbyte
Apr 19 2016 19:09
@akrzos the UI and Web Service Workers run under Puma
Jason Frey
@Fryguy
Apr 19 2016 19:09
@akrzos We can't change that puma prefix bit, unfortunately
the puma gem owns the title and they allow you to tweak the part between the []
Alex Krzos
@akrzos
Apr 19 2016 19:10
@Fryguy / @chessbyte rgr that, I can still regex for it, just wondering the difference
Jason Frey
@Fryguy
Apr 19 2016 19:10
also sorry...I didn't read that you made the comment and I thought you were @jrafanie based on your picture
Keenan Brock
@kbrock
Apr 19 2016 19:10
:monkey: patch => :hear_no_evil: :speak_no_evil: :see_no_evil:
Jason Frey
@Fryguy
Apr 19 2016 19:11
the two of you have such close pictures it throws me every time :laughing:
Keenan Brock
@kbrock
Apr 19 2016 19:11
huh - yea
Alex Krzos
@akrzos
Apr 19 2016 19:11
hah, yeah
Jason Frey
@Fryguy
Apr 19 2016 19:12
@akrzos Also, you have to configure that [] part for puma super early, so we don't know which worker class it is (hence why they are all the same)
Alex Krzos
@akrzos
Apr 19 2016 19:13
@Fryguy but off the port we can tell if it's ui or webservice or websockets
Jason Frey
@Fryguy
Apr 19 2016 19:13
yes
300N, 400N, and 500N, respectively
Alex Krzos
@akrzos
Apr 19 2016 19:14
There is an open bz on MiqServer starting itself right
Joe Rafaniello
@jrafanie
Apr 19 2016 19:15
@akrzos will have to change his shirt in his avatar and retake the picture so he doesn't confuse @Fryguy
Jason Frey
@Fryguy
Apr 19 2016 19:16
Notice how @jrafanie doesn't offer to do the same ;)
Joe Rafaniello
@jrafanie
Apr 19 2016 19:16
If I remembered how I set it, I would ;-)
Alex Krzos
@akrzos
Apr 19 2016 19:16
haha, you'd think the green background would be good enough
Jason Frey
@Fryguy
Apr 19 2016 19:16
I'm gonna take a picture of myself with my own red shirt and change my avatar... :laughing:
Joe Rafaniello
@jrafanie
Apr 19 2016 19:16
LOL
give the fryguy a shirt, that would be killer
Jason Frey
@Fryguy
Apr 19 2016 19:17
hahaha...I do already have the one with the Red Hat
Joe Rafaniello
@jrafanie
Apr 19 2016 19:19
yeah, now give it a red shirt and you're good
just looking up through the avatars on this page, it's all red
Chris Arcand
@chrisarcand
Apr 19 2016 19:30
ruins red party
Keenan Brock
@kbrock
Apr 19 2016 20:00
hmm. maybe I'll turn my background red?
Oleg Barenboim
@chessbyte
Apr 19 2016 20:35
@dmetzger57 anything for you to present at tomorrow's sprint review?
Dennis Metzger
@dmetzger57
Apr 19 2016 20:36
Hmm, could mention the Virtual Column work
Oleg Barenboim
@chessbyte
Apr 19 2016 20:38
I would do a 1-page overview on Performance work
I know I merged a lot of PRs in that area this sprint
Keenan Brock
@kbrock
Apr 19 2016 20:38
heh
Dennis Metzger
@dmetzger57
Apr 19 2016 20:39
let me get the deck and add a page
Jason Frey
@Fryguy
Apr 19 2016 20:39
only mention stuff that was merged
because the sprint demo functions as the input to the changelog as well
Dennis Metzger
@dmetzger57
Apr 19 2016 21:06
I’d like to call out the base work done on RBAC working toward using scopes to reduce the SQL load, or would that be out bounds because it’s not complete?
Oleg Barenboim
@chessbyte
Apr 19 2016 21:09
you can give direction (but people may not know what scopes are) -- complete items are Service Tree improvement, any measurable RBAC improvements, anything else
Keenan Brock
@kbrock
Apr 19 2016 21:09
@Fryguy have you used a MiqReport from the console to drive a query?
is this easy enough?
I remember doing it before, but trying to get my mind back
Dennis Metzger
@dmetzger57
Apr 19 2016 21:10
got it
Jason Frey
@Fryguy
Apr 19 2016 21:17
@kbrock Can't remember
Keenan Brock
@kbrock
Apr 19 2016 21:17
thanks
Jason Frey
@Fryguy
Apr 19 2016 21:17
I'm sure I have in the past...can't remember how
Keenan Brock
@kbrock
Apr 19 2016 21:18
yea - I think I have within a few months... can't remember how ;)
Jason Frey
@Fryguy
Apr 19 2016 21:18
It's something like MiqReport.find_by(whatevs).generate_tables
Keenan Brock
@kbrock
Apr 19 2016 21:19
thanks
Jason Frey
@Fryguy
Apr 19 2016 21:19
singular...generate_table