These are chat archives for translate/dev

11th
Mar 2017
phlax
@phlax
Mar 11 2017 14:03
ping @JohnnyKing94
Gianfranco
@JohnnyKing94
Mar 11 2017 14:03
Hey
phlax
@phlax
Mar 11 2017 14:04
hey
so - re store size
in ttk it loads a representation of a file into memory
and if you are doing update it will also create a similar representation of the db file - the Store in memory in order to compare
so in terms of size to be able to do that it needs to be able to at least hold the size of all of the strings + quite a bit of overhead
there are other points in the code where it also does stuff at a store level - mostly to guarantee that its not going to load too much into mem
Gianfranco
@JohnnyKing94
Mar 11 2017 14:08
Ok, and what has to do with me? do i need to use some tools to check that? or what? xD I thought someone here would have known the answer :smile:
phlax
@phlax
Mar 11 2017 14:08
above it should say "all the strings" x2
well - like any FOSS project we learn from our users
how well we do that is up to both sides 8/
mysql also has various settings that set how much memory its willing to use for various tasks
and if you have very big stores you will likely hit that - so mysql will also start creating temp tables on disk
i would like to give you a simple answer - im going to go and look at what sizes we are seeing already
and probs experiment with them
Gianfranco
@JohnnyKing94
Mar 11 2017 14:12
You mean those parameters with MySQL
query_cache_size =
query_cache_limit =
phlax
@phlax
Mar 11 2017 14:13
not sure without going and looking up
its saturday here in the uk - so im not gonna do it right now 8/
i think there may be others
Gianfranco
@JohnnyKing94
Mar 11 2017 14:14
You know it's saturday even here... we live in the same continent (i think) :smile: xD
Do not worry
phlax
@phlax
Mar 11 2017 14:14
how about we raise a ticket to investigate what max store sizes are in the default context, and what they can be with some tweaking
i should probs put "default"
not sure what that is tbh
mysql defaults on debian would probs be my marker - but thats not always reliable
Gianfranco
@JohnnyKing94
Mar 11 2017 14:20
translate/pootle#6091
Done
phlax
@phlax
Mar 11 2017 14:20
thanks
@JohnnyKing94 - sorry i woke up a bit hazy today
to clarify when you say 108M you meant as in MB
i was getting that many strings - and i was :worried:
k - in that case im thinking more about mysql opti - than overall memory
Gianfranco
@JohnnyKing94
Mar 11 2017 14:23
108.362.828 byte :D ~105/106MB :D
phlax
@phlax
Mar 11 2017 14:23
8/
k - also - if you pm me the file im happy to look at it
but im quite busy atm - so not sure when
Gianfranco
@JohnnyKing94
Mar 11 2017 14:24
do not worry
it was just a report
i love pootle
phlax
@phlax
Mar 11 2017 14:25
8)
Gianfranco
@JohnnyKing94
Mar 11 2017 14:25
and i like to improve it with my reports
phlax
@phlax
Mar 11 2017 14:25
its really useful feedback
Gianfranco
@JohnnyKing94
Mar 11 2017 14:26
Anyway even after that you find a good size for a file, there's still the other 'experimentation' to do... in order to sync every files with the current submissions made
If i knew since the beginning.. i would have started with multiple files instead of a single one :D
However thanks for your patience @phlax
Have a good weekend
phlax
@phlax
Mar 11 2017 14:29
np