Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Apr 01 23:46
    thtmorais edited #284
  • Mar 31 15:33
    lmribeiro starred bedezign/yii2-audit
  • Dec 18 2021 15:50
    lloyd966 opened #287
  • Dec 15 2021 08:48
    ashaduri opened #286
  • Dec 14 2021 09:03
    eluhr starred bedezign/yii2-audit
  • Dec 05 2021 16:02
    lloyd966 commented #285
  • Dec 03 2021 14:22
    lloyd966 opened #285
  • Nov 02 2021 08:42
    mazfreelance starred bedezign/yii2-audit
  • Oct 06 2021 11:02
    lucianolima00 starred bedezign/yii2-audit
  • Oct 05 2021 20:11
    thtmorais commented #284
  • Oct 05 2021 20:01
    thtmorais synchronize #284
  • Sep 18 2021 03:35
    thtmorais opened #284
  • Aug 13 2021 16:39
    bellinilo starred bedezign/yii2-audit
  • Jul 14 2021 13:53
    remorac starred bedezign/yii2-audit
  • Jul 13 2021 05:22
    suryaeko commented #278
  • Jul 13 2021 05:16

    Blizzke on master

    Update ErrorHandlerTrait.php s… Merge pull request #280 from kr… (compare)

  • Jul 13 2021 05:16
    Blizzke closed #280
  • Jul 13 2021 05:16
    Blizzke closed #274
  • Jul 13 2021 05:14
    suryaeko edited #283
  • Jul 13 2021 05:12
    suryaeko opened #283
Abayomi Osamiluyi
@yomexzo
really, it’s a logistics systems. we track packages
location_id is where the waybill/package was generated
source_id is where it is currently
arrival_time is when it got to where it is
of course, we know last_update_time and date_generated
Steve Guns
@Blizzke
but thats a full select?
Abayomi Osamiluyi
@yomexzo
that query takes forever (at least 17 secs) on the table
Steve Guns
@Blizzke
of the entire table
Abayomi Osamiluyi
@yomexzo
i just pray i make a little sense
nope, i cut out some of the aggregations for simplicity
but that should give a picture
yes. scans the entire table apparently
Steve Guns
@Blizzke
yeah but its the aggregations that will cause the slowdown, not what you just pasted
hmm
Abayomi Osamiluyi
@yomexzo
that’s the aggregations
sums, and counts
only selected those 6 for simplicity
Steve Guns
@Blizzke
yeah i see now
you should probably run that stuff with an explain on and see which indexes get used and which dont
Abayomi Osamiluyi
@yomexzo
of course. straight away
Steve Guns
@Blizzke
but as i see it it just selects the entire table every time just to generate your stats
Abayomi Osamiluyi
@yomexzo
id select_type table type possible_keys key key_len ref rows Extra
1 SIMPLE packages ALL NULL NULL NULL NULL 988883 NULL
1 SIMPLE currentStatus eq_ref PRIMARY PRIMARY 4 db.packages.package_status_id 1 NULL
yes. exactly. @entire table
Steve Guns
@Blizzke
yeah its not using indexes at all for the full table scan
Abayomi Osamiluyi
@yomexzo
yeah. because it’s a full table scan
right?
Steve Guns
@Blizzke
no because you're using ranges
for the timestamp
Abayomi Osamiluyi
@yomexzo
oh
honestly, a million records is very small to me
makes me wonder how people run analytics/reports e.t.c
i log in to dashboards of apps i sign up to
and voila, login is fast, report is fast and instant
Steve Guns
@Blizzke
probably by splitting the query into multiples
yeah but most of the time those are generated from aggregation tables, never the raw data
Abayomi Osamiluyi
@yomexzo
i would refer to google analytics scale, and would just stick with a product like mandrill that processes millions of records and still give you reports on demand
Steve Guns
@Blizzke
you log a bunch of data then run scripts to aggregate it into bitesized pieces of things you can output and use those
Abayomi Osamiluyi
@yomexzo
hmm
go on
Steve Guns
@Blizzke
in its simplest form you could just cache the result for a couple minutes
Abayomi Osamiluyi
@yomexzo
hmm...
Steve Guns
@Blizzke
yeah don't expect some kind of holy grail answer from me, all depends on a lot of things
Abayomi Osamiluyi
@yomexzo
lol… i was looking for more like holy grail :)
i understand you tho
i have a couple of ideas of my own. but just seeking something more standard approach
Steve Guns
@Blizzke
i'm not clairvoyant in any case, there are a lot of paths towards a working solution and much depends on how the data is used and how up to date it needs to be and so on
i'll throw a couple of my queries at you, see what you can tell about those, what do you think? :P
Abayomi Osamiluyi
@yomexzo
hit me
lol @being clairvoyant tho
Steve Guns
@Blizzke
i'm just kidding... just want to point out that its hard to jump in someone else's application just like that