These are chat archives for UnderstandLingBV/Tuktu

31st
May 2016
Erik Tromp
@ErikTromp
May 31 2016 07:06
@dmassart apparently the back pressure helps, but it's not aggressive enough?
you should toy around with the different parameters for back pressure
and maybe debug a bit to see if it's really working
Akka itself isn't really back pressure ready
maybe we will start using Akka Streams once that gets mature enough
David Massart
@dmassart
May 31 2016 07:10
OK, I need to finish something today. I will try to investigate it more later this week
I wrote some java benchmark and it processes 13 M records in about 1.5 hours, once the problem is fixed, I expect tuktu to be at least as fast
Erik Tromp
@ErikTromp
May 31 2016 14:00
sure
with the current back pressure, the generator is throttled for a while (or at least it should, BP hasnt been extensively tested this way)
my guess is the throttling isn't enough