mbdavid/LiteDB

LiteDB - A .NET NoSQL Document Store in a single data file - www.litedb.org

Leonardo Nascimento

@lbnascimento

You can't have a collection of "loose" BsonValues like string or int, you can only insert BsonDocuments in a collection

If you want to centralize the actual serialize/deserialize logic in Newtonsoft while still being able to use the class normally in LiteDB, you could do something like this:

Leonardo Nascimento

@lbnascimento

BsonMapper.Global.RegisterType<LogEvent>(
    serialize: (LogEvent) => LiteDB.JsonSerializer.Deserialize(JsonConvert.SerializeObject(LogEvent)),
    deserialize: (BsonValue) => JsonConvert.DeserializeObject<LogEvent>(BsonValue.AsDocument.ToString(), new LogEventJsonConverter(), new LogEventPropertyValueConverter())
);

WTTSoftwareSolutions

@WTTSoftwareSolutions

I noticed that the Delete methods on both the LiteRepository and the LiteCollection do not accomodate Delete<T>(T Entity, string collectionName) or DeleteMany<T>(IEnumerable<T> entities, string collectionName) as input. My class handles passing entities through to the LiteRepository but does not know anything about the entities passed in, so I can not get the id to pass in or to create a predicate. Is there a way to pass in an entity to be deleted?

Carlo Kok

@carlokok

LiteDB.LiteException: Invalid Data on 39099. Full zero: False. Page Type: Index. Prev/Next: 4294967295/4294967295. UniqueID: 20147. ShareCounter: 1.
at LiteDB.Engine.DataPage..ctor (LiteDB.Engine.PageBuffer buffer) [0x00017] in <ca87e3e06962463fb463e94e3bd88728>:0
at LiteDB.Engine.BasePage.ReadPage[T] (LiteDB.Engine.PageBuffer buffer) [0x000b7] in <ca87e3e06962463fb463e94e3bd88728>:0

Wbat does this mean and how can i fix ir?

Leonardo Nascimento

@lbnascimento

@WTTSoftwareSolutions Unfortunately this is currently not possible, I believe you may need to use something like Reflection to get the id. We'll consider adding an overload that takes the entity and gets its id for future versions.

@carlokok Could you send me your datafile?

Carlo Kok

@carlokok

@lbnascimento it's fairly large

(320mb)

Is there like a "recover" tool that I can use to recover it ?

Leonardo Nascimento

@lbnascimento

@carlokok There is no recovery tool, we're actually thinking of making something like that. In the meantime, you can send me the data file and I'll take a look a it, see what can be done. You should get pretty good compression on LiteDB data files.

Helmut Wahrmann

@hwahrmann

Need your help on deserializing a List.
i create dynamically a query and get the result like this:

var resultSet = _store.Execute(sql).ToEnumerable().Select(s => BsonMapper.Global.Deserialize<SongData>(s)).ToList();

In my SongData class i have:

public List<string> PictureHashList => _pictureHashList;

Using LiteDBStudio i can see that i have values in the list, but the above query returns an empty list.
Any ideas?

Leonardo Nascimento

@lbnascimento

@hwahrmann This is happening because the property PictureHashList doesn't have a public setter. The easiest fix is to simply create a public setter for it.

Leonardo Nascimento

@lbnascimento

@hwahrmann Actually, in the latest version of LiteDB, you don't even need a public setter, a private setter is enough. Having no setter at all (making it read-only) is a problem, though.

Helmut Wahrmann

@hwahrmann

@lbnascimento Problem solved. thanks for the quick answer

thejayman

@thejayman

Quick question if I may concerning the AutoId. I've designed my own serializing method to turn my class into a BsonDocument and I leave out the Id field so that the AutoId will set an appropriate Id for me. But, how can I force it to provide an int id instead of an ObjectId?

thejayman

@thejayman

Figured it out. I went through the source code for an hour or two and pieced together how it all worked. Turned out to be ridiculously simple and I'm almost embarrassed that I hadn't seen it. I can pass a selected AutoId in when I instantiate the collection.

using var _db = new LiteDatabase(_path);
var _dbCol = _db.GetCollection("CollectionName", BsonAutoId.Int32);

weirdyang

@weirdyang

Left expression MAP($.Properties.customer.Properties[*]=>@.FirstName) returns more than one result. Try use ANY or ALL before operant.

can someone help me iwth this query?
SELECT $ FROM LogMessage where $.Properties.customer.Properties[*].FirstName = "Jonathan"

Leonardo Nascimento

@lbnascimento

@captmomo$.Properties.customer.Properties[*].FirstName will return the FirstName of every document in $.Properties.customer.Properties

If you want to check whether any of these are equal to a value, you can use $.Properties.customer.Properties[*].FirstName any = 'Jonathan'. Similarly, if you want to check whether all of these are equal to a value, you can use $.Properties.customer.Properties[*].FirstName all = 'Jonathan'

weirdyang

@weirdyang

thank you!

Martin Vseticka

@MartyIX

Hi, has Mauricio David stopped developing LiteDB? I don't see any commits of his lately.

Mauricio David

@mbdavid

Hi Martin, I’m working in another project now, so I’m with no free time now. Maybe two more weeks and I will back with LiteDB development. For now, Leonardo works with me and if he needs any help he calls me.

Martin Vseticka

@MartyIX

I see, thank you for your answer! Thanks for you work on LiteDB!

Mi.Chi

@AlessioMiky76_twitter

Hi, this query works fine "select $.Car.doc0.name from TestQuery". It returns the value of name, doc0 is a sub document inside subdocument Car. How can i modifiy query to select all subdocuments inside Car and not only doc0 and get the values of name of all those subdocuments?

Mi.Chi

@AlessioMiky76_twitter

I've tried SELECT $.Car[*].name FROM TestQuery. No error are raised but result is empty. There are 8 subdocuments in Car with a [name] field

Ghost

@ghost~593a87c3d73408ce4f66068b

hi, was litedb stress tested with a million items in a collection? does it scale?

also, is it possible to store items sorted using a timestamp?

Jbm

@JbMarchal_twitter

HI, I have a similar question :) Is LiteDB an in-memory database? When we perform a (read) query, is there any physical disk usage or is everything done in memory? Thanks for these informations ;)

Piet Eckhart

@pietsoftwaretogo

Hi, A week ago I've asked about the date for upcomming release on github: mbdavid/LiteDB#1810
Does anyone have an answer?

Leonardo Nascimento

@lbnascimento

@AlessioMiky76_twitter This sort of query (iterating through values in a document) is currently not supported. You would have to create some code that does it.

@AlessioMiky76_twitter I believe it could be supported with some small changes to the SQL parser, I'll look into it.

Leonardo Nascimento

@lbnascimento

@raizam There is a LiteDB.Benchmarks project in our solution, which can be use to measure performance. We ran some tests earlier this year, but I can't seem to find the results, sorry about that.

@raizam You can create an index over a DateTime field or even make it your Id field. Due to the BSON spec, LiteDB only stores dates up to the miliseconds (losing a bit of precision). There is a simple workaround for that though, so let me know if you need help with that.

@JbMarchal_twitter LiteDB can be used as an in-memory database by using :memory: as its datafile or by using the LiteDatabase ctor that takes a Stream (you can pass a MemoryStream to it)

Ghost

@ghost~593a87c3d73408ce4f66068b

thanks @lbnascimento

@raizam You can create an index over a DateTime field or even make it your Id field. Due to the BSON spec, LiteDB only stores dates up to the miliseconds (losing a bit of precision). There is a simple workaround for that though, so let me know if you need help with that.

will the DateTime order be preserved when I'll iterate the records? in both indexed/key scenarios?

Mi.Chi

@AlessioMiky76_twitter

@lbnascimento thanks, i cross fingers, it is a must to have feature ;)

Leonardo Nascimento

@lbnascimento

@raizam Yes, the order will be preserved.

Ghost

@ghost~593a87c3d73408ce4f66068b

perfect :)

Ghost

@ghost~593a87c3d73408ce4f66068b

is it possible to get a list of ids without fetching the collection?

Leonardo Nascimento

@lbnascimento

@raizam If you don't have an open LiteCollection, you can use the LiteDatabase.Execute(string command)

@raizam Something like db.Execute("select $._id from collection").ToList(). This will give you a list of BsonDocuments containing the id

@raizam If you wanted to do it all in one command, I would suggest var ids = db.Execute("select $._id from collection").ToEnumerable().Select(doc => doc["_id"].AsInt32).ToList(); (assuming the id is Int32)

Ghost

@ghost~593a87c3d73408ce4f66068b

I see. I'm storing objects with large binary data, so retrieving BsonDocument would still allocate all the memory needed for the whole documents right?

I guess I should use DbRef

Leonardo Nascimento

@lbnascimento

@raizam Not exactly. LiteDB will still navigate through the documents in the collection (this is something we intend to optimize in future versions), but it will only deserialize the necessary fields.

martinweihrauch

@martinweihrauch

Hello everyone, I am using LiteDB, which I love because of the ease of use and quick deployment at customer's sites. I just have one question: I am using LiteDB for a self-written backup program für Azure blobs. Now, there is a situation, where I would like to "loop" through all database entries of one collection. I only found the possibility to load the entire collection as a List. Is there a possibility of a memory problem, if I have e. g. millions of records, which I want to loop through or do you have some way of caching? Thx

Leonardo Nascimento

@lbnascimento

@martinweihrauch Methods like LiteCollection<T>.Find(...) and LiteCollection<T>.FindAll() return an IEnumerable<T> and documents are only loaded when they're needed. So, you can simply use a foreach loop to iterate through this IEnumerable<T>.

Where communities thrive

People

Repo info

Activity