Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • 14:57

    vyazelenko on master

    [Java] Hide JCStress output. [Java] Add a task to parse the … (compare)

  • 12:36

    vyazelenko on master

    [Java] Upgrade to JUnit 5.8.2. (compare)

  • 12:34

    vyazelenko on master

    [Java] Upgrade to JUnit 5.8.2. (compare)

  • 02:00
    mikeb01 synchronize #1261
  • 01:03
    mikeb01 synchronize #1261
  • Nov 28 23:33
    mikeb01 synchronize #1261
  • Nov 28 22:32
    mikeb01 commented #1261
  • Nov 28 22:28
    mikeb01 synchronize #1261
  • Nov 28 20:19
    mikeb01 updated the wiki
  • Nov 26 18:11
    mjpt777 updated the wiki
  • Nov 26 18:09
    mjpt777 updated the wiki
  • Nov 26 17:45

    tmontgomery on 1.37.0

    (compare)

  • Nov 26 17:45

    tmontgomery on master

    1.37.0 released. post release bump (compare)

  • Nov 26 14:04
    spshuklaji opened #1262
  • Nov 26 12:59

    mjpt777 on master

    [C/C++] Warnings cleanup. (compare)

  • Nov 26 12:27

    mjpt777 on master

    [C/C++] Warnings cleanup. (compare)

  • Nov 26 11:17

    mjpt777 on master

    [Java] Warnings cleanup. (compare)

  • Nov 26 11:03

    mjpt777 on master

    [Java] Remove some uses of Stri… (compare)

  • Nov 26 06:25
    mikeb01 synchronize #1261
  • Nov 26 04:02
    mikeb01 opened #1261
Ronen
@ronenhamias
Hello everyone is there somewhere a simple benchmark for aeron-cluster that i can learn from?
Michael Barker
@mikeb01

Hi @ronenhamias, the focus of this channel is community contribution discussion. Support questions should come through a commercial contract or via stackoverflow.

We have a cluster benchmark here: https://github.com/real-logic/benchmarks/blob/master/benchmarks-aeron/src/test/java/uk/co/real_logic/benchmarks/aeron/remote/ClusterTest.java.

Ronen
@ronenhamias
@mikeb01 thank you very much!
Bill Segall
@billsegall
@mjpt777 I'm probably being blind and not seeing it but is there any documentation on the aeron-archive security model. I'm looking to implement this in aeron-go and I've been looking at the java code. I'm not sure I really comprehend the model for either connection establishment and/or message delivery.
Todd L. Montgomery
@tmontgomery
@billsegall the archive uses the cluster model for Authenticator, etc.
Bill Segall
@billsegall
Lovely! So this is connection auth. Am I right there is no mechanism for selective delivery of messages so this is all I need to worry about?
Todd L. Montgomery
@tmontgomery
yes, it is on the connection.
Bill Segall
@billsegall
Thanks!
Todd L. Montgomery
@tmontgomery
no worries
supergaga
@supergaga
Can I subscribe 2 different UDP channel in one aeronCluster Client?
Michael Barker
@mikeb01
Hi @supergaga we are using this chat room is for public contributor discussions. For support queries you can post your question to stack overflow (https://stackoverflow.com/questions/tagged/aeron) or contact Real Logic for a commercial support contract.
supergaga
@supergaga
@mikeb01 okay . thanks reply
William
@ilove7412369_twitter

@keithwong1 ConcurrentPublication is thread safe; ExclusivePublication is not thread safe. ConcurrentPublication is returned from Aeron.addPublication. ThreadingMode for the driver is an independent feature for configuring thread usage by the driver.

But is ConcurrentPublication safe to use when multiple "processes" publish to same endpoint?

Martin Thompson
@mjpt777
@ilove7412369_twitter We do not offer support in this channel. Please ask questions on Stackoverflow.
William
@ilove7412369_twitter
I thought my level of question is the same level as Keithwong1, so is that Keithwong1 has paid support so can ask it here?
Martin Thompson
@mjpt777
We have a support mailing list for those on commercial support.
Historically we have given support on this channel and people have taken advantage.
KabDeveloper
@KabDeveloper

Caused by: java.lang.IllegalStateException: Missing file for cnc: c:\datapath\cnc

Someone can help with this error?

Michael Barker
@mikeb01
@KabDeveloper We have switched to using this channel for public contribution discussion. For support queries you can post your question to stack overflow (https://stackoverflow.com/questions/tagged/aeron) or contact Real Logic for a commercial support contract.
Welly Tambunan
@welly87

hi all, i try posting on stackoverflow but seems it not the appropriate place for this questions it's getting closed :D

Previously i read in docs that C Media Driver currently still on going development but doesn't support clustering like Java does. Is this still the case today? I try to look at source code but seems it's no clustering related code there. Not sure if i'm looking at right branch.

Is it a goal for C Media Driver to be in par with Java Media Driver? And which direction it will go?

thanks a lot

Martin Thompson
@mjpt777
@welly87 If Stackoverflow will not accept your question the you should take that up with them. No reason they should deny it.
This channel is for contributor discussions. You can consider a support subscription - sales@real-logic.co.uk.
Welly Tambunan
@welly87:matrix.org
[m]
thanks @mjpt777 . will reopen the questions as per your edit review.
Nikita
@NikitaMishin
Hi everyone, have several small questions:
1) https://github.com/real-logic/aeron/wiki/Channel-Configuration :
term-length: is it defined in bytes i.e can i pass number of bytes 65536 or is it should be passed in kbytes? Given some threshold on messages is it better to changes this property to some specific value, eg 10 times bigger then max length of message
2) can subscriber detect that he slowly process data so he can skip all old messages and start to process the last one (also can he notify publisher that it can skip old messages too)? Is this refers to property "reliable"?
Martin Thompson
@mjpt777
We do not answer support questions or give free consultancy in this channel. Please ask specific questions on Stackoverflow or sign up for commercial support at sales@real-logic.co.uk.
Nikita
@NikitaMishin
ok, C++ exception with description "no response from driver in 10000 ms" thrown in the test body. when running test with embedded cmedia driver. should i do smth apart from what written in docs?
Michael Barker
@mikeb01
@NikitaMishin As mentioned, if you could ask support questions on Stack Overflow and tag it with "aeron". You are more likely to get a response there.
Vitaly
@rvit34
ratcash
@ratcashdev
Hello gents, could you please help with the following scenario regarding cluster election? Assuming a leader dies with appendPositionL and commitPositionL. Next one of the members becomes a candidate while having commitPositionM1 < commitPositionL < appendPositionM1 < appendPositionL. So i was wondering what happens when he gets (eventually) elected?
a) he truncates his log to commitPositionM1 (just like all the followers do onNewLeadershipTerm ),
b) he keeps the messages in his log (beyond the commit position) and eventually distributes these to members and form a consensus
c) nothing is guaranteed during elections, and he may or may not retain those log entries beyond the commit position.
thanks in advance.
Martin Thompson
@mjpt777
@ratcashdev You know we don't offer support via this channel. Please consider signing up to commercial support. You are long over due ;-)
ratcash
@ratcashdev
Yes! I am. You're right, sorry. You made me smile big time, btw, so thanks for that.
Chris Jones
@chrisejones

Hi, we have a multi-socket box and have two processes using Aeron IPC on a different numa node to where the media driver is running. The IPC term buffers are ending up on the media driver node according to /proc/<pid>/numa_maps.

Do we need a separate media driver on the other socket to avoid this?

Martin Thompson
@mjpt777
@chrisejones Please ask general questions on Stackoverflow.
Chris Jones
@chrisejones
sure, thanks
nemanjalucicfidexx
@nemanjalucicfidexx
Hello! SBE C++ generated code changes field names to upper case for methods like put, get and skip (e.g. for field "payload" C++ class contains "putPayload" method). It would greatly benefit our generic code if the field name format could be controllable using cmd arguments. Even better if we could switch between camel case and snake case. We played a bit with SBE code and managed to modify it accordingly. We a contribution like this from our side be something that you would consider?
Martin Thompson
@mjpt777
@nemanjalucicfidexx This is not the place for SBE discussions. Please use the SBE repo if you wish to have a PR considered.
nemanjalucicfidexx
@nemanjalucicfidexx
Oh, sure. Thanks!
Michael Barker
@mikeb01
@denisxor This channel is for community contributions. Please post support questions to https://stackoverflow.com/questions/tagged/aeron or contact Real Logic Ltd for a commercial support contract.
denisxor
@denisxor
@mikeb01 thanks. I'll go to stackoverflow.
Doru-Mihai Muntean
@DoruM

Hello,

What is the coding style of Aeron based on? I remember that there was a keynote lecture or something. Can someone please point me to it?

4 replies
Nikita
@NikitaMishin

Hello!

i have a quick question regarding benchmarks
found weird downside when testing on two remote machines:

Subscrbier:
java -cp aeron-all/build/libs/aeron-all-1.34.0.jar -Daeron.sample.embeddedMediaDriver=true -Daeron.sample.channel="aeron:udp?endpoint=0.0.0.0:20006" io.aeron.samples.RateSubscriber
Publisher
java -cp aeron-all/build/libs/aeron-all-1.34.0.jar -Daeron.sample.embeddedMediaDriver=true -Daeron.sample.channel="aeron:udp?endpoint=34.245.39.15:20006" io.aeron.samples.StreamingPublisher

on both machines i adjust $ sudo sysctl net.core.rmem_max=2097152
$ sudo sysctl net.core.wmem_max=2097152 as mentioned in your wiki page.

this is small snapshot:
6336 msgs/sec, 2.027e+05 payload bytes/sec, totals 57032 messages 1 MB
6247 msgs/sec, 1.999e+05 payload bytes/sec, totals 63284 messages 1 MB
6255 msgs/sec, 2.001e+05 payload bytes/sec, totals 69544 messages 2 MB
6288 msgs/sec, 2.012e+05 payload bytes/sec, totals 75838 messages 2 MB
6266 msgs/sec, 2.005e+05 payload bytes/sec, totals 82110 messages 2 MB
6270 msgs/sec, 2.006e+05 payload bytes/sec, totals 88384 messages 2 MB
6269 msgs/sec, 2.006e+05 payload bytes/sec, totals 94658 messages 2 MB
6279 msgs/sec, 2.009e+05 payload bytes/sec, totals 100942 messages 3 MB
6291 msgs/sec, 2.013e+05 payload bytes/sec, totals 107238 messages 3 MB
6292 msgs/sec, 2.013e+05 payload bytes/sec, totals 113534 messages 3 MB
6279 msgs/sec, 2.009e+05 payload bytes/sec, totals 119818 messages 3 MB

Am i missed smth? Do i need to setup specific configuration to run your benchmarks

because for same setup when launched on same machine for udp i get
1.047e+06 msgs/sec, 3.351e+07 payload bytes/sec, totals 1048218 messages 31 MB
8.934e+06 msgs/sec, 2.859e+08 payload bytes/sec, totals 10000000 messages 305 MB

Martin Thompson
@mjpt777
We don't provide support or answer general questions in this channel.
John Davis
@unicomp21
Has anyone taken a look at Seastar and co_await? For Aeron? The redpanda kafka replacement is benefiting greatly from it.
Michael Szymczak
@michaelszymczak
Hi, I have noticed some interesting and potentially dangerous use case in how Artio treats numeric constants such as ZERO. I did not know what to make of it, so I created an issue for that real-logic/artio#452
1 reply
Vachagan Balayan
@vach_b_twitter
Hi Everyone, i'm having some hard time with aeron cluster, are there any books resources that could take alook before buggin you here?
i'm reworking a core services for an exchange (every essential service + matching engine) to achieve insane speeds and TPS,
however this one is crypto exchange and they cant just restart things over weekend like banks, so i'm trying to dive into Raft via aeron
but there are some things i cant see how to control and configure...
Michael Barker
@mikeb01
Hi @vach_b_twitter, we don't do Aeron support on this channel (it is for community contribution discussions). You can contact Real Logic to arrange support and consulting (http://real-logic.co.uk). Or you have specific questions on Stack Overflow (using the aeron tag). There is also a tutorial available: https://github.com/real-logic/aeron/wiki/Cluster-Tutorial.
Vachagan Balayan
@vach_b_twitter
thanks, sent an email )