These are chat archives for exceptionless/Discuss

29th
Sep 2015
Blake Niemyjski
@niemyjski
Sep 29 2015 15:56 UTC
man google has some great javascript
google docs keeps freezing my safari
Blake Niemyjski
@niemyjski
Sep 29 2015 16:39 UTC
woot
restoring whole cluster backups to our dev nodes
kinda excited to profile it against the whole data set :D
what will we find
Damiaan
@dampee
Sep 29 2015 16:41 UTC
how many GBytes are that?
Blake Niemyjski
@niemyjski
Sep 29 2015 16:41 UTC
each node has 1tb drive
a few hundred gbs compressed
not sure of total size as never really looked but it’s over 300gb for sure
were growing by atleast 800k events month after month
Damiaan
@dampee
Sep 29 2015 16:43 UTC
nice. That means that your dev cluster will now be costing a whole lot more :-)
Blake Niemyjski
@niemyjski
Sep 29 2015 16:43 UTC
na it’s a vm
lol
set price
Damiaan
@dampee
Sep 29 2015 16:44 UTC
luckely. A price increase would have been inevitable otherwise
Blake Niemyjski
@niemyjski
Sep 29 2015 16:44 UTC
our current live cluster is using <10% cpu and about 55% jvm memoery and 8iops
sitting there…. should be so dam fast
I have a little command center here right now :)
Damiaan
@dampee
Sep 29 2015 16:46 UTC
All logs running over screen you mean?
(yelling) screenshot, screenshot, screenshot, ... :-)
Blake Niemyjski
@niemyjski
Sep 29 2015 16:48 UTC
yeah
lol
gitter doesn’t have screenshots
Damiaan
@dampee
Sep 29 2015 16:49 UTC
twitter has :-p
Blake Niemyjski
@niemyjski
Sep 29 2015 16:49 UTC
lol
yeah
can’t wait for this restore to be completed and profile this
Damiaan
@dampee
Sep 29 2015 16:50 UTC
what are you going to profile?
Blake Niemyjski
@niemyjski
Sep 29 2015 16:50 UTC
we made massive changes for perf/async and noticed a query was taking really long last night and it shouldn’t have
Damiaan
@dampee
Sep 29 2015 16:51 UTC
ah that way
Blake Niemyjski
@niemyjski
Sep 29 2015 16:51 UTC
like 5+ seconds for most recent, which is just newest exceptions ordered by date..
Damiaan
@dampee
Sep 29 2015 16:51 UTC
That's a lot
Blake Niemyjski
@niemyjski
Sep 29 2015 16:51 UTC
but the one that does aggregations was instant lol
yeah
we want to speed everything up
across the whole site
Damiaan
@dampee
Sep 29 2015 16:52 UTC
looking forward to it!
Blake Niemyjski
@niemyjski
Sep 29 2015 16:54 UTC
me too
always something :sa:
Damiaan
@dampee
Sep 29 2015 16:55 UTC
So, basically, you are restoring the live cluster to dev because you don't know what was going on :-D
You hope to reproduce the issue
Blake Niemyjski
@niemyjski
Sep 29 2015 16:55 UTC
yeah
Damiaan
@dampee
Sep 29 2015 16:55 UTC
and if you don't find the issue you are in deep troubles
Blake Niemyjski
@niemyjski
Sep 29 2015 16:55 UTC
with large amounts of data
Damiaan
@dampee
Sep 29 2015 16:56 UTC
but because you have lots of data on the dev cluster, playing around with the DEV environment, playing will be more joyfull :-)
Blake Niemyjski
@niemyjski
Sep 29 2015 16:56 UTC
I think that we’ll see it with tons of random data
our sets in dev is what ever we generate so small amounts of unique data
yeah
Damiaan
@dampee
Sep 29 2015 16:57 UTC
We do that from time to time on our product too.
it's just so much easier to pinpoint real problems
Blake Niemyjski
@niemyjski
Sep 29 2015 16:57 UTC
yeah :)
I need to setup our dev environment to automatically restore backups once a week
do you use elastic search
Damiaan
@dampee
Sep 29 2015 16:58 UTC
no
it's all SQL for me
If we grow a bit, we might look into ES or solr (or ...)
but currently SQL is fast enough
it's only 600 MB max database
Blake Niemyjski
@niemyjski
Sep 29 2015 17:00 UTC
yeah
sql azure is slow as heck
Damiaan
@dampee
Sep 29 2015 17:00 UTC
I know
Blake Niemyjski
@niemyjski
Sep 29 2015 17:00 UTC
we have a small prod website using it and omg is it slow
Damiaan
@dampee
Sep 29 2015 17:00 UTC
I cache a lot :-)
Blake Niemyjski
@niemyjski
Sep 29 2015 17:00 UTC
cache all the things
you using foundatio :D?
Damiaan
@dampee
Sep 29 2015 17:01 UTC
No. I looked into it once
But was wondering how I could integrate it into an application that exists for 3+ years
lots of "foundation" has already been written
Blake Niemyjski
@niemyjski
Sep 29 2015 17:02 UTC
well you don’t have to use everything just pick the peices
Damiaan
@dampee
Sep 29 2015 17:02 UTC
true
Blake Niemyjski
@niemyjski
Sep 29 2015 17:02 UTC
first step would be to change a part of it like caching
what do you use for caching? redis?
Damiaan
@dampee
Sep 29 2015 17:03 UTC
Only in memory currently
Blake Niemyjski
@niemyjski
Sep 29 2015 17:04 UTC
we have some good unit tests for our stuff
we found issues early on with in memory cache where if you called set or get with a reference type and then updated the value the cache would be updated.
so we do a copy using expression trees
Damiaan
@dampee
Sep 29 2015 17:05 UTC
neat
Blake Niemyjski
@niemyjski
Sep 29 2015 17:06 UTC
wonder if your running into anything like that now :worried:
Damiaan
@dampee
Sep 29 2015 17:06 UTC
No problems with that
never had in fact
Blake Niemyjski
@niemyjski
Sep 29 2015 17:06 UTC
that’s good :)
okay time for lunch
Damiaan
@dampee
Sep 29 2015 17:07 UTC
I was very interested in the statsd things
have a good meal
cya
Blake Niemyjski
@niemyjski
Sep 29 2015 17:07 UTC
yeah, we use that :)
Damiaan
@dampee
Sep 29 2015 17:07 UTC
where is it hosted?
Blake Niemyjski
@niemyjski
Sep 29 2015 17:08 UTC
librato
if you haven’t implemented it yet check it out we use foundatio for the abstraction
the in memory stats client will output throughput information to the output window and then you can just flip a di injection and use statsd
Damiaan
@dampee
Sep 29 2015 17:09 UTC
I will, That was the reason why I was looking at foundatio
Blake Niemyjski
@niemyjski
Sep 29 2015 17:09 UTC
we want to get foundatio using vnext very soon too
ok brb
Damiaan
@dampee
Sep 29 2015 17:09 UTC
see you