Hello there, I am just starting with Bedrock Jobs and have some questions, I hope this is the right place?
I want my consumers to wait up to 30s for any Job thats with "hello.", so I send this request:
GetJob name: hello.* connection: wait timeout: 30000
But this command immediately returns a "404 No job found". Shouldn't it wait 30s before returning?
Connection: waitis currently not working. I believe we broke it when adding some multi-threaded optimizations, and hasn't been rebuilt yet. Is that right @tylerkaraszewski ?
would hope to be able to completely lose the .db file for a particular node when/if a crash happens on an instances or a VM needs a reboot (and be able to easily restore from s3 using an initContainer before starting bedrockdb).
Ah we do have a method to bootstrap from a S3 backup and then catch up, but we haven't automated it to the level you are likely thinking (ie, it doesn't identify the most recent backup and download it automatically). I could imagine you adding this without too much effort however. (I'm not 100% sure if our backup code is open source now that I think about it, we could look into this if you were seriously interested.)
the last question is about priority and whether or not one can be assigned dynamically on startup? So if i have a startup script that assigns a random integer as the priority are there any drawbacks to that?
Yes, that could likely work fine. In practice we find it makes the system easier to manage if the priorities are static, as then you have a better sense of which nodes are doing which without needing to consult the logs.
Would you guys accept pull requests for these types of enhancements? It would obviously have to touch other places in the codebase so just checking before putting in time here.
Yes, PRs very welcome!!
I like #sqlite and works pretty much good with #strapi and #directus
seems to me still better choice than use "cloud db" but I need more instances into 1file - so I searched and found this article https://sqlite.org/forum/info/339d237d6517783a which refers to you
I what I read is pretty great https://bedrockdb.com very good builded project 😃👏
Q) so it is process service above #sqlite connected through port for sync ?
Q) it that communications encrypted somehow ?
Q) how colisions are handeled ?
For MySQL or PostgreSQL, if you sometime get a lot of data, it may happen that you would need to migrate to SQLite to keep costs manageable:
Many small queries are efficient in SQLite:
Using SQLite is 35% faster than using filesystem:
For GDPR encrypted stuff, there is Databunker:
If MySQL is not your preferred option, you could also look is MySQL compatible Noria any better:
nc localhost 8888
Query: SELECT 1 AS foo, 2 AS bar;
foo | bar
1 | 2