Where communities thrive

Join over 1.5M+ people
Join over 100K+ communities
Free without limits
Create your own community

Explore more communities

Netflix/dynomite

A generic dynamo implementation for different k-v storage engines

People

Repo info

Activity

Marcel Forti

@mforti

Hello people. In our company, we will use dynomite in production, where we will have two data centers, each with 3 redis servers. Our initial configuration was made with 1 rack for redis server, with a token equal to 4294967295 in all dyn_seeds declared in both data centers( 3 racks/ 3 redis for dc). However, we note that data is not always being replicated on all servers. Could someone give an example of configuration for our need?

matrixbot

@matrixbot

m_ueberall > <@gitter_mforti:matrix.org> Hello people. In our company, we will use dynomite in production, where we will have two data centers, each with 3 redis servers. Our initial configuration was made with 1 rack for redis server, with a token equal to 4294967295 in all dyn_seeds declared in both data centers( 3 racks/ 3 redis for dc). However, we note that data is not always being replicated on all servers. Could someone give an example of configuration for our need?

Did you try to pretend that all servers shared a single rack and compare the results (NB you might want to check the secure_server_option in that case)?

matrixbot

@matrixbot

m_ueberall (All servers within the same DC, that is.)

Mike Dziedziela

@widgetpl

This message was deleted

Mike Dziedziela

@widgetpl

This message was deleted

Flávio Schuindt

@flavioschuindt

Hi, guys.

So, I opened this issue Netflix/conductor#1443 in conductor repo, but I think is partially related with dynomite/redis. Anyone could help? Thank you!

Kevzz81517

@Kevzz81517

Hi guys @ipapapa @marimcmurtrie @smukil I am trying to implement dynomite cluster along with the dyno client. I have used local host and token provider. I have 2 questions :-

What does setFallbackEnabled(true) do ?

Kevzz81517

@Kevzz81517

2 I had setFallBackEnabled(true) and configuration as dc1 - rack1 & dc2-rack1 with one node each. Both hosted on same machine with different ports. Then I stopped the dc1-rack1 . On doing this, the dyno-client didn't failover . And error stack is as follows :- com.netflix.dyno.connectionpool.exception.NoAvailableHostsException: NoAvailableHostsException: [host=Host [hostname=UNKNOWN, ipAddress=UNKNOWN, port=0, rack: UNKNOWN, datacenter: UNKNOW, status: Down, hashtag=null, password=null], latency=0(0), attempts=0]Local rack host offline and could not find any remote hosts for fallback connection

Kevzz81517

@Kevzz81517

Hello @ipapapa In my cluster what happens when a local datacenter goes down and comes back again ? Does the data that was stored in other nodes is replicated back to the local datacenter ? Because I tried it, didn't work in my case

Fabrice Gregoire

@jyriok

hello everybody ! Do you know any way for adding authentification (or just password protect) to Dynomite, please ? :) i did'nt found something about that on internet ... thanks for your help

neokyle1

@neokyle1

hello

qq, does anyone know if priority overrules fifo or not? I was looking at the code and it appears that the priority value would only really matter when multiple jobs were scheduled for the exact same millisecond which seems odd

related: Netflix/conductor#1224

sorry, to clarify, this is a dyno-queues question

neokyle1

@neokyle1

I also noticed some PRs that seem to be related (e.g. Netflix/dyno-queues#82) and was wondering if those were attempts to fix this issue

optimal-rhythm

@optimal-rhythm

Hi, can anyone please clarify if it is possible to set up dyno queues to use an (enterprise) Redis cluster directly instead of dynomite?

maha

@mahalaxmiganesh

I am looking for similar option as mentioned by @optimal-rhythm pls suggesst

madhurid-91

@madhurid-91

Hi, i have deployed dynomite as StatefulSet. The deployment is not persistent and am suffering data loss if pods are recreated. Has anyone tried deploying dynomite with persistent volume?

kmurthy7

@kmurthy7_twitter

I am trying to build a dynomite-manager to make it work in my own data center. I could not make it work. And the instructions are not clear its very confusing or not accurate information. Does anyone made it work Dynomite manager working in our own hosted environment instead of aws ?

matrixbot

@matrixbot

t-summer hae

nabajyoti123

@nabajyoti123

Hi , im facing problem in data rebalancing in redis -dynomite clustering.

nabajyoti123

@nabajyoti123

Basically i have 2 DC in 2 servers .if serverB goes down im able to set data to cluster using serverA redis nodes .when serverB redis nodes comes up ,im not able to get latest data using serverB nodes .any body can help me with this ? link : Netflix/dynomite#770

nabajyoti123

@nabajyoti123

hi is there any example for using dynomite-manager in other environments? how do i implement those interfaces to use dynomite-manager ? any example for that?

srirama-rayaprolu

@srirama-rayaprolu

Hi All,
In my production am using dynomite for REDIS.
When doing scan it is returning some keys, however when doing get of the key it is returning nil.
Certain keys are getting value returned but for some keys it is returning empty.

How can debug further?

srirama-rayaprolu

@srirama-rayaprolu

what is the vnode in the below documentation taken from https://github.com/Netflix/dynomite
tokens: The token(s) owned by a node. Currently, we don't support vnode yet so this only works with one token for the time being.

srirama-rayaprolu

@srirama-rayaprolu

hi
while compiling the project with Jedis and DynoClient Jedis. It is giving compilation error for Jedis client related class though the required jar file is present.
Any suggestion for resolving the compilation issue.
Netflix/dyno#298
I am using JAVA8, JEDIS and MAVEN
Pl. let me know any other information required.

srirama-rayaprolu

@srirama-rayaprolu

After checking dependencies for dyno-client, changed the jedis version from 2.9.1 to 3.0.1 in my project.
After that, it started compiling with out any errors.

Thanks for reading.

msdhivya

@msdhivya

Hi all, How to set redis password in dynomite conf?

Jelmer Kuperus

@jelmerk

Hi i am looking at dynomite and it seems great but my main concern seems to be that the project does not look very active and you ca't find many resources online about it

can someone elaborate on the status of the project? is it still used by netflix etc ?

Sailesh Mukil

@smukil

Hi, the project is still active. There will be more active development on it continuing soon. For now, there are some bandwidth issues on being able to reply to all OSS questions, we're hoping the community will be able to fill in here. But we're having one more developer join soon and keep the project more active.

Jelmer Kuperus

@jelmerk

At what kind of scale is this project being used ?

Is this a small operation within the netflix org or is it pretty core

Sailesh Mukil

@smukil

While I'm unable to share any numbers, it has significant usage within the org and is quite stable as a distributed HA cache.

Jelmer Kuperus

@jelmerk

and as a primary storage solution?

i am looking at it as a cassandra replacement for relatively small read heavy workloads

as cassandra tens to be "operationally complex"

Sailesh Mukil

@smukil

@jelmerk Certain use-cases can use it as a primary datastore depending on the guarantees required. You can vet it based on the guarantees mentioned in the wiki here:
https://github.com/Netflix/dynomite/wiki