Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Matthew Goslett
    @matthewgoslett
    It's an issue for me with Laravel specifically, when I composer update a package, and this is followed by a 'optimise' which combines all classes into a single compiled.php

    eg: Generating autoload files

    Illuminate\Foundation\ComposerScripts::postUpdate
    php artisan optimize
    %3|1473321097.324|FAIL|rdkafka#consumer-1| 127.0.0.1:9092/bootstrap: Connect to ipv4#127.0.0.1:9092 failed: Connection refused
    %3|1473321097.324|ERROR|rdkafka#consumer-1| 127.0.0.1:9092/bootstrap: Connect to ipv4#127.0.0.1:9092 failed: Connection refused
    %3|1473321097.324|ERROR|rdkafka#consumer-1| 1/1 brokers are down
    Generating optimized class loader

    Magnus Edenhill
    @edenhill
    @matthewgoslett: You could call addBrokers() later when you want to get started
    just make sure not to specify any bootstrap.servers/metadata.broker.list properties
    Matthew Goslett
    @matthewgoslett
    ah ok got it, easy enough for the addBrokers() but for $conf->set('metadata.broker.list', $config['brokers']), my high level consumer is already created
    I know you said conf can't be changed after creation, but is their way to change the metadata.broker.list on the consumer?
    Magnus Edenhill
    @edenhill
    Nope.
    Efimov Evgenij
    @edefimov
    Hi everyone! I have a problem sending message in php7. I'm producing message via cli, the message is successfully published into kafka. When the script is about to terminate the RdKafka\Producer::__destruct method is called and hangs forever, so the cli process never dies. Has anyone encountered with such a behaviour?
    Magnus Edenhill
    @edenhill
    @edefimov: do you know which underlying librdkafka version you are using?
    Efimov Evgenij
    @edefimov
    @edenhill , 0.9.1
    Magnus Edenhill
    @edenhill
    okay, there are some fixes on master for termination hangs
    and there will be a new formal release in about a month
    Efimov Evgenij
    @edefimov
    thanks!
    sbscrape
    @sbscrape
    hi, just been experimenting with this, but I cant find any reference to how to do offsetRequest-s, whereas I don't want to store the offset but ask for it based on a timestamp, is that currentyl possible at all?
    Frédéric G. MARAND
    @fgm
    Hello, there. I've been working with the extension for a few days, but I just fell onto what appears to be an extension bug: "php(30494,0x7fffa5de73c0) malloc: error for object 0x7fe6c356dfe0: pointer being freed was not allocated set a breakpoint in malloc_error_break to debug"
    I'm using library 2.0.0 compiled from sources on PHP 7 on macOS.
    Any pointer on how I could try to debug this ?
    Magnus Edenhill
    @edenhill
    @FGM See if it can create a core file (or run it through gdb) and then do gdb php core followed by bt to get a backtrace
    Frédéric G. MARAND
    @fgm
    how would I go about creating a core file for a php extension ?
    Magnus Edenhill
    @edenhill
    ulimit -c unlimited ; then run your php program from the same directory
    should produce a core file when it crashes
    But I dont really know PHP so that's as much as I can help :)
    Frédéric G. MARAND
    @fgm
    Just tried it with a PHP CLI, but there is no core dump. Am I correct in assuming this is a C error, not a C++ one, because of the malloc/free ? This would at least allow limiting where to look for. This happens in the KafkaConsumer (high-level consumer) ctor, FWIW.
    Frédéric G. MARAND
    @fgm
    Found how to reproduce, although without actually debugging: the extension crashes instead of returning an error or throwing an exception if the group.id is not set in the configuration passed to the ctor.
    Frédéric G. MARAND
    @fgm
    This message was deleted
    Issue is at arnaud-lb/php-rdkafka#88
    Paul Dragoonis
    @dragoonis
    Hello everyone! :D
    Hey @edenhill great to see you here :)
    Paul Dragoonis
    @dragoonis
    For the life of me I can't get the broker address to change from 127.0.0.1 :(
        private function initialize(array $brokers)
        {
            $conf = new ConsumerConf();
            $conf->set('metadata.broker.list', implode(',', $brokers));
            $consumer = new Consumer($conf);
    
            $consumer->addBrokers(implode(',', $brokers));
            $this->setConsumer($consumer);
        }
    didn't work with just ->addBrokers(), tried the metadata.broker.list too, still tries to go to 127.0.0.1 :( :(
    Paul Dragoonis
    @dragoonis
    Nobody seems to be around - I've raised this bug - arnaud-lb/php-rdkafka#92
    Magnus Edenhill
    @edenhill
    You shouldn't use addBrokers, config is enough
    Paul Dragoonis
    @dragoonis
    let me remove addBrokers()
    Magnus Edenhill
    @edenhill
    Can you print the string you set?
    Paul Dragoonis
    @dragoonis
    No change - yes here's the string.
            $conf = new ConsumerConf();
            $conf->set('metadata.broker.list', 'xx.xx.xx.xx:9092');
            $consumer = new Consumer($conf);
    %3|1479475193.723|ERROR|rdkafka#consumer-1| 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused
    Magnus Edenhill
    @edenhill
    Ah, 127.0.0.1 is coming from the broker. Check its advertised.listener config
    Paul Dragoonis
    @dragoonis
    interesting, do you think ti's talking to remote broker
    but broker isn't listening on external IP ?
    suggestion on how I can run sniffer on remote server, on specific port ? to check incoming traffic
    I'm running kafka using this docker IMG - https://hub.docker.com/r/wurstmeister/kafka/
    aha
    docker-compose.yml was set to this .. tweaking
          KAFKA_ADVERTISED_HOST_NAME: 127.0.0.1
    Paul Dragoonis
    @dragoonis
    I'm able to connect to the broker now, that ENV var becomes advertised.host.name
    still some issues, but this is good progress - thanks @edenhill
    Magnus Edenhill
    @edenhill
    👍
    Paul Dragoonis
    @dragoonis
    I'm replacing another tech stack with a kafka solution, I need to learn kafka FAST! what's your suggestions on best places to learn from ?
    Paul Dragoonis
    @dragoonis
    @edenhill this is what's being set in server.properties
    #advertised.listeners=PLAINTEXT://your.host.name:9092