These are chat archives for DevrexLabs/OrigoDB

28th
Oct 2015
Robert Friberg
@rofr
Oct 28 2015 11:55
@jzoss This behavior should be a part of the API, I'll add it to the next version. I agree it should be part of the interface so there are multiple stores that need to be modified. Also, the FileJournalStore has file metadata that it can use, so no need to scan the directory.
Robert Friberg
@rofr
Oct 28 2015 12:02
Curious, how much disk space gets cleaned up? And how does that compare to the size of the snapshot? Also, you might want to consider using the protobuf serialization module. It is way faster, creates smaller snapshots and gives more control dealing with versioning.
Jon Z
@jzoss
Oct 28 2015 14:51
Hmm I will check that out... I can save a significant amount of space depending on what is going on.. I was adding 10000 items for a test .. then deleting them.. Not only did this clean up save lots of space then, I noticed it sped up queries, well at least the snapshot did.
I may have a few other suggestions, Let me play with it a bit.. I have a watcher thread that fires every 10 minutes to clean it up.. I think may that should go into the framework... Let me make sure mine is a bit more solid then I will post.
Jon Z
@jzoss
Oct 28 2015 15:23
Also.. totally a bug in the code I posted.. I guess if you take a snapshot and nothing has changed it does not make a new snapshot.. I need to account for that case.