These are chat archives for atomix/atomix

13th
Jun 2018
Jordan Halterman
@kuujo
Jun 13 2018 00:00
Aside from all that, Atomix is agnostic as to the architecture of specific systems and aims only to provide building blocks for higher level distributed systems architectures.
We use it in ONOS for cluster management, messaging, replicating configurations, electing leaders to control external network resources, and even for building more distributed systems protocols.
The architecture of Atomix is extremely flexible (you configure where state is replicated, and primitives are generally partitioned when possible) can theoretically scale to any size, but we still use it in small clusters because of our use case, and I do suspect especially the group membership protocol will have problems at scale. You need to be able to at least segment the cluster to reduce the overhead of failure detectors/heartbeats at that scale.
Johno Crawford
@johnou
Jun 13 2018 00:05
@kuujo think you just wrote the introduction
Jordan Halterman
@kuujo
Jun 13 2018 00:05
Haha
Johno Crawford
@johnou
Jun 13 2018 00:05
:smile:
Ronnie
@rroller
Jun 13 2018 00:06
yes, very nice
what about a few number of nodes but lots of throughput? Is that known?
for example, many many locks
Jordan Halterman
@kuujo
Jun 13 2018 00:45

Depends on how you use them. Many instances of the same lock being locked/unlocked continuously will have major scalability problems that are unavoidable because all operations have to go to the same partition and locks really require multiple phases to acquire and release:
• Raft write to acquire a lock
• Event to the client to notify it that the lock was acquired
• Raft write to release the lock

If you’re using many different locks then they will be scaled across all the configured partitions. You could also use the primary-backup protocol for locks, but I wouldn’t.

actually there was a bug in the ONOS tests
#639
running them again
Jordan Halterman
@kuujo
Jun 13 2018 01:14
ONOS tests passed 🎈 🎉 🎊
With the set PR anyways
Maybe will release it tomorrow
moranl
@moranl
Jun 13 2018 03:22
Thanks for the detailed explanation!