Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Jan 23 15:47

    mjpt777 on master

    Support Static Linking (#1261) … (compare)

  • Jan 23 15:47
    mjpt777 closed #1261
  • Jan 21 12:20

    mjpt777 on master

    Extend recording concurrent pub… (compare)

  • Jan 21 12:20
    mjpt777 closed #1283
  • Jan 21 01:46

    mikeb01 on master

    [C] Correct uses of cached cloc… [C] Hoist check to receiver so … (compare)

  • Jan 20 06:16

    mikeb01 on master

    [C] Change send_to_sm_poll_rati… (compare)

  • Jan 20 00:13
    mikeb01 synchronize #1283
  • Jan 19 23:38
    mikeb01 synchronize #1283
  • Jan 19 20:17
    mikeb01 synchronize #1283
  • Jan 19 14:23
    mjpt777 commented #1282
  • Jan 19 05:46
    mikeb01 synchronize #1283
  • Jan 19 04:30
    kwbc commented #1282
  • Jan 19 04:27
    kwbc synchronize #1282
  • Jan 19 04:19
    kwbc synchronize #1282
  • Jan 19 03:11
    mikeb01 opened #1283
  • Jan 18 22:14
    tmontgomery review_requested #1282
  • Jan 17 14:56

    mjpt777 on master

    [Java] Group time related field… (compare)

  • Jan 17 04:45
    kwbc commented #1282
  • Jan 17 04:43
    kwbc commented #1282
  • Jan 16 21:53
    mikeb01 commented #1282
Bill Segall
@billsegall
Thanks!
Todd L. Montgomery
@tmontgomery
no worries
supergaga
@supergaga
Can I subscribe 2 different UDP channel in one aeronCluster Client?
Michael Barker
@mikeb01
Hi @supergaga we are using this chat room is for public contributor discussions. For support queries you can post your question to stack overflow (https://stackoverflow.com/questions/tagged/aeron) or contact Real Logic for a commercial support contract.
supergaga
@supergaga
@mikeb01 okay . thanks reply
William
@ilove7412369_twitter

@keithwong1 ConcurrentPublication is thread safe; ExclusivePublication is not thread safe. ConcurrentPublication is returned from Aeron.addPublication. ThreadingMode for the driver is an independent feature for configuring thread usage by the driver.

But is ConcurrentPublication safe to use when multiple "processes" publish to same endpoint?

Martin Thompson
@mjpt777
@ilove7412369_twitter We do not offer support in this channel. Please ask questions on Stackoverflow.
William
@ilove7412369_twitter
I thought my level of question is the same level as Keithwong1, so is that Keithwong1 has paid support so can ask it here?
Martin Thompson
@mjpt777
We have a support mailing list for those on commercial support.
Historically we have given support on this channel and people have taken advantage.
KabDeveloper
@KabDeveloper

Caused by: java.lang.IllegalStateException: Missing file for cnc: c:\datapath\cnc

Someone can help with this error?

Michael Barker
@mikeb01
@KabDeveloper We have switched to using this channel for public contribution discussion. For support queries you can post your question to stack overflow (https://stackoverflow.com/questions/tagged/aeron) or contact Real Logic for a commercial support contract.
Welly Tambunan
@welly87

hi all, i try posting on stackoverflow but seems it not the appropriate place for this questions it's getting closed :D

Previously i read in docs that C Media Driver currently still on going development but doesn't support clustering like Java does. Is this still the case today? I try to look at source code but seems it's no clustering related code there. Not sure if i'm looking at right branch.

Is it a goal for C Media Driver to be in par with Java Media Driver? And which direction it will go?

thanks a lot

Martin Thompson
@mjpt777
@welly87 If Stackoverflow will not accept your question the you should take that up with them. No reason they should deny it.
This channel is for contributor discussions. You can consider a support subscription - sales@real-logic.co.uk.
Welly Tambunan
@welly87:matrix.org
[m]
thanks @mjpt777 . will reopen the questions as per your edit review.
Nikita
@NikitaMishin
Hi everyone, have several small questions:
1) https://github.com/real-logic/aeron/wiki/Channel-Configuration :
term-length: is it defined in bytes i.e can i pass number of bytes 65536 or is it should be passed in kbytes? Given some threshold on messages is it better to changes this property to some specific value, eg 10 times bigger then max length of message
2) can subscriber detect that he slowly process data so he can skip all old messages and start to process the last one (also can he notify publisher that it can skip old messages too)? Is this refers to property "reliable"?
Martin Thompson
@mjpt777
We do not answer support questions or give free consultancy in this channel. Please ask specific questions on Stackoverflow or sign up for commercial support at sales@real-logic.co.uk.
Nikita
@NikitaMishin
ok, C++ exception with description "no response from driver in 10000 ms" thrown in the test body. when running test with embedded cmedia driver. should i do smth apart from what written in docs?
Michael Barker
@mikeb01
@NikitaMishin As mentioned, if you could ask support questions on Stack Overflow and tag it with "aeron". You are more likely to get a response there.
Vitaly
@rvit34
ratcash
@ratcashdev
Hello gents, could you please help with the following scenario regarding cluster election? Assuming a leader dies with appendPositionL and commitPositionL. Next one of the members becomes a candidate while having commitPositionM1 < commitPositionL < appendPositionM1 < appendPositionL. So i was wondering what happens when he gets (eventually) elected?
a) he truncates his log to commitPositionM1 (just like all the followers do onNewLeadershipTerm ),
b) he keeps the messages in his log (beyond the commit position) and eventually distributes these to members and form a consensus
c) nothing is guaranteed during elections, and he may or may not retain those log entries beyond the commit position.
thanks in advance.
Martin Thompson
@mjpt777
@ratcashdev You know we don't offer support via this channel. Please consider signing up to commercial support. You are long over due ;-)
ratcash
@ratcashdev
Yes! I am. You're right, sorry. You made me smile big time, btw, so thanks for that.
Chris Jones
@chrisejones

Hi, we have a multi-socket box and have two processes using Aeron IPC on a different numa node to where the media driver is running. The IPC term buffers are ending up on the media driver node according to /proc/<pid>/numa_maps.

Do we need a separate media driver on the other socket to avoid this?

Martin Thompson
@mjpt777
@chrisejones Please ask general questions on Stackoverflow.
Chris Jones
@chrisejones
sure, thanks
nemanjalucicfidexx
@nemanjalucicfidexx
Hello! SBE C++ generated code changes field names to upper case for methods like put, get and skip (e.g. for field "payload" C++ class contains "putPayload" method). It would greatly benefit our generic code if the field name format could be controllable using cmd arguments. Even better if we could switch between camel case and snake case. We played a bit with SBE code and managed to modify it accordingly. We a contribution like this from our side be something that you would consider?
Martin Thompson
@mjpt777
@nemanjalucicfidexx This is not the place for SBE discussions. Please use the SBE repo if you wish to have a PR considered.
nemanjalucicfidexx
@nemanjalucicfidexx
Oh, sure. Thanks!
Michael Barker
@mikeb01
@denisxor This channel is for community contributions. Please post support questions to https://stackoverflow.com/questions/tagged/aeron or contact Real Logic Ltd for a commercial support contract.
denisxor
@denisxor
@mikeb01 thanks. I'll go to stackoverflow.
Doru-Mihai Muntean
@DoruM

Hello,

What is the coding style of Aeron based on? I remember that there was a keynote lecture or something. Can someone please point me to it?

4 replies
Nikita
@NikitaMishin

Hello!

i have a quick question regarding benchmarks
found weird downside when testing on two remote machines:

Subscrbier:
java -cp aeron-all/build/libs/aeron-all-1.34.0.jar -Daeron.sample.embeddedMediaDriver=true -Daeron.sample.channel="aeron:udp?endpoint=0.0.0.0:20006" io.aeron.samples.RateSubscriber
Publisher
java -cp aeron-all/build/libs/aeron-all-1.34.0.jar -Daeron.sample.embeddedMediaDriver=true -Daeron.sample.channel="aeron:udp?endpoint=34.245.39.15:20006" io.aeron.samples.StreamingPublisher

on both machines i adjust $ sudo sysctl net.core.rmem_max=2097152
$ sudo sysctl net.core.wmem_max=2097152 as mentioned in your wiki page.

this is small snapshot:
6336 msgs/sec, 2.027e+05 payload bytes/sec, totals 57032 messages 1 MB
6247 msgs/sec, 1.999e+05 payload bytes/sec, totals 63284 messages 1 MB
6255 msgs/sec, 2.001e+05 payload bytes/sec, totals 69544 messages 2 MB
6288 msgs/sec, 2.012e+05 payload bytes/sec, totals 75838 messages 2 MB
6266 msgs/sec, 2.005e+05 payload bytes/sec, totals 82110 messages 2 MB
6270 msgs/sec, 2.006e+05 payload bytes/sec, totals 88384 messages 2 MB
6269 msgs/sec, 2.006e+05 payload bytes/sec, totals 94658 messages 2 MB
6279 msgs/sec, 2.009e+05 payload bytes/sec, totals 100942 messages 3 MB
6291 msgs/sec, 2.013e+05 payload bytes/sec, totals 107238 messages 3 MB
6292 msgs/sec, 2.013e+05 payload bytes/sec, totals 113534 messages 3 MB
6279 msgs/sec, 2.009e+05 payload bytes/sec, totals 119818 messages 3 MB

Am i missed smth? Do i need to setup specific configuration to run your benchmarks

because for same setup when launched on same machine for udp i get
1.047e+06 msgs/sec, 3.351e+07 payload bytes/sec, totals 1048218 messages 31 MB
8.934e+06 msgs/sec, 2.859e+08 payload bytes/sec, totals 10000000 messages 305 MB

Martin Thompson
@mjpt777
We don't provide support or answer general questions in this channel.
John Davis
@unicomp21
Has anyone taken a look at Seastar and co_await? For Aeron? The redpanda kafka replacement is benefiting greatly from it.
Michael Szymczak
@michaelszymczak
Hi, I have noticed some interesting and potentially dangerous use case in how Artio treats numeric constants such as ZERO. I did not know what to make of it, so I created an issue for that real-logic/artio#452
1 reply
Vachagan Balayan
@vach_b_twitter
Hi Everyone, i'm having some hard time with aeron cluster, are there any books resources that could take alook before buggin you here?
i'm reworking a core services for an exchange (every essential service + matching engine) to achieve insane speeds and TPS,
however this one is crypto exchange and they cant just restart things over weekend like banks, so i'm trying to dive into Raft via aeron
but there are some things i cant see how to control and configure...
Michael Barker
@mikeb01
Hi @vach_b_twitter, we don't do Aeron support on this channel (it is for community contribution discussions). You can contact Real Logic to arrange support and consulting (http://real-logic.co.uk). Or you have specific questions on Stack Overflow (using the aeron tag). There is also a tutorial available: https://github.com/real-logic/aeron/wiki/Cluster-Tutorial.
Vachagan Balayan
@vach_b_twitter
thanks, sent an email )
zaradai
@zaradai
I have a gripe with the generated c SBE code for the template id. As an example it generated
SBE_ONE_DEF uint16_t events_instrumentLoad_sbe_template_id(void)
{
return (uint16_t)16;
}
this isn't compile time constant so i am unable to a switch in a fragment handler. I would prefer a simple switch to handle different incoming events vs a hash lookup, am i missing something?
zaradai
@zaradai
just noticed comment above about SBE discussions, please ignore I'll go to SBE.
Niel de Wet
@nieldw

With no changes to our code, but just a restart, we are suddenly facing an unusual ERROR when the Consensus Module is starting up. What could be possible causes? Full stack trace in thread.

ERROR io.aeron.cluster.ConsensusModuleAgent java.lang.IllegalStateException: Cannot assign long arg5 to int

2 replies
MarshalOfficial
@MarshalOfficial
how to run java media driver in ram-disk (a Windows drive that mapped from Ram) location in windows??
The problem is when I ran the media driver in normal mode the speed is very slow than Linux, in Linux it uses the shm location.
MarshalOfficial
@MarshalOfficial
it seems that if I could set some input parameters when starting the media driver to force it to create its folder in ram-disk instead of the windows temp folder. it will be ok, but how to do this?
Martin Thompson
@mjpt777
@MarshalOfficial This channel is for contribution discussions and not for free support.
MarshalOfficial
@MarshalOfficial

@MarshalOfficial This channel is for contribution discussions and not for free support.

ok @mjpt777