Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    tstuber
    @tstuber
    I have a question regarding passwords in URI Syntax + using camel metrics. When I scrape my MicroProfile endpoints, I see the full camelContext (inklusive. passwords). How can I prevent the exposure of passwords?
    For example, I have it in the case of SSL Kafka Configurations
    Sascha Wiegandt
    @TheSasch
    @tstuber do you mean with scrape the .to(log:) output or within a processor by your own? if its to(log:) then there is a option "logMask" see https://camel.apache.org/components/latest/log-component.html
    tstuber
    @tstuber
    ah sorry, I am exposing the metrics via MicroProflie Metrics (https://camel.apache.org/camel-quarkus/latest/reference/extensions/microprofile-metrics.html)
    and all the endpointNames are exposed (including topicName, brokers and plaintext passwords)
    Sascha Wiegandt
    @TheSasch
    what about to replace the passwords with a simple processor before you put it to the metrics endpoint?
    i didn't used the microprofile metrics, but dependent on your body you could write a processor if you have objects or if its xml then an xpaht to replace that or if its string an regex with a transform or something like that.
    tstuber
    @tstuber
    @TheSasch The metrics are exposing the endpoint password. So for example I configure the Kafka endpoint like kafka:topic1?brokers=localhost:9092?truststoreLocation=/var/ca.p12?truststoreKey=xks5/30223!da.... I see the full endpoint configuration in the /metrics endpoint
    So whan scraping the /metrics endpoint, I would see something like: application_camel_exchange_processing_...{endpointName=kafka://topic1?brokers=localhost:9092?truststoreLocation=/var/ca.p12?truststoreKey=xks5/30223!da..
    Sascha Wiegandt
    @TheSasch
    yes, but the core thing of camel is that you have a message-exchange which you could make everything you want. within your route from kafka to the metrics-endpoint you also could do other things. try it first with a .process(p -> { <some code here> }) and set a breakpoint. when you get your message your breakpoint would break and you could see the whole body and all header data. what is the problem to mask there the passwords and send the data to the exchange?
    within the micro-profile page i did not found any mask option. but as i said i didn't used it before
    tstuber
    @tstuber
    @TheSasch My actual camel route is form HTTP (REST API) to Kafka. I already do processing on the body. That is fine.
    But I want to monitor my camel application from the outside via Prometheus-metrics (via micro-profile). I do not think that is possible to modify the exposure logic from that microprofile as it is reporting for all components / endpoints
    Or maybe I totally misunderstand somethere here :-)
    I found a workaround: I disabled exchange metrics (quarkus.camel.metrics.enable-exchange-event-notifier=false). The exchange processing times contained all endpoint data. By doing so, I lose some processing metrics, but at least no passwords are exposed. @TheSasch Thanks for inputs - very appreciated!
    Sascha Wiegandt
    @TheSasch
    if i read the documentation of the metrics component then it looks like any other datasink where you could put data to. it is possible that within the component there would be something like aggregation. but at the first look ist does not look other than any other consumer. with the from and the metrics-to i thought about that you could change everything you want. if i have such a problem i first introduce a processor to have a look which structure the body and the header data are and have a look if i could find my passwort. then a own solution would help or someone else wrote such a solution ,-)
    Sascha Wiegandt
    @TheSasch

    if i read the documentation of the metrics component then it looks like any other datasink where you could put data to. it is possible that within the component there would be something like aggregation. but at the first look ist does not look other than any other consumer. with the from and the metrics-to i thought about that you could change everything you want. if i have such a problem i first introduce a processor to have a look which structure the body and the header data are and have a look if i could find my passwort. then a own solution would help or someone else wrote such a solution ,-)

    While going to the outside get running. i thought about i wrote and i made a mistake. so sorry. documentation also says it is a produce and not a consumer. but it must have also consuming parts because of the behavior you wrote. so please have a look if you could get a execution endpoint within the producer to change some parts of the message.

    Jose Montoya
    @jam01
    Hey guys, I'm trying to find out what camel-jasypt-starter does. The docs don't offer much currently.
    oh sorry, actually there are no docs for the jasypt starter
    We have also found this https://github.com/ulisesbocchio/jasypt-spring-boot/ but wanted to know if maybe we're not seeing something with camel's own starter
    Raju Parashar
    @rajuparashar23

    Hello Everyone,
    Good day

    while working with camel 3.0.0, below piece of code was working

    from("...")
    .process(this::configureExchangeProperties)
    ...
    .to("...")

    private Processor configureExchangeProperties()
    {
    return x-> {
    //.. some general header population
    };
    }

    As mentioned in 3.0 to 3.1 upgradation guide, the supplier version of ProcessorDefintion has been removed,
    and so we modified our code as below before upgrading to 3.1

    from("...")
    .process(this::configureExchangeProperties)
    ...
    .to("...")

    private void configureExchangeProperties(Exchange exchange)
    {
    //.. some general header population
    }

    Now, with just this change, or code started behaving weird. No output were generating. Also, nothing suspicious was found in logs
    Could you please tell, what may be the probable reason ?

    Luca Burgazzoli
    @lburgazzoli
    @jam01 @rajuparashar23 the official camel chat has been moved over Zulip https://camel.zulipchat.com, please move your question there
    Jose Montoya
    @jam01
    Ah ok. Thanks.
    Raju Parashar
    @rajuparashar23
    ok..thank you
    Luca Burgazzoli
    @lburgazzoli
    HEADS UP: the channel for discussing camel has been moved to https://camel.zulipchat.com/
    akhileshacc
    @akhileshacc

    Hi, Can we download all blobs from Azure blob storage, by just specifying container name.
    Something like in Amazon s3, where I specify bucket name and it picks all files in that bucket.

    Currently, I see we need to specify blob name and it will download that file.

    from("azure-storage-blob:/camelazure/container1?blobName=hello.txt&accessKey=yourAccessKey").
    to("file://blobdirectory");
    Luca Burgazzoli
    @lburgazzoli
    @akhileshacc please use https://camel.zulipchat.com/ as this room is not more active
    TwilightAngelo
    @TwilightAngelo

    Probably there is no reconnection mechanism

    As far as I undersstand from this folowing gode: https://is.gd/H3EcX2, there is some problems with single Connection. One for all events, so, maybe I'm not a really good programmer, but, can you please answer me, I really need an advice, if I try to rewrite my own pg_event and use PGPoolingDataSource for estabilishing connection will it be a good decision or not? Is there any troubles to use PGPoolingDataSource except of DataSource? Many thanks!

    Andrea Tarocchi
    @valdar
    @TwilightAngelo please use https://camel.zulipchat.com/ as this room is not more active.
    Leonardo Golfeto
    @leonardogolfeto
    Hi guys
    The RabbitMq is accepting messages in the default exchange from another application and able to view thru the WEb console...but Camel is displayne error
    Caused by: com.rabbitmq.client.ShutdownSignalException: channel error; protocol method: #method<channel.close>(reply-code=403, reply-text=ACCESS_REFUSED - operation not permitted on the default exchange, class-id=40, method-id=10)
    Am i doing some thing wrong
    Andrea Tarocchi
    @valdar
    @leonardogolfeto please use https://camel.zulipchat.com/ as this room is not more active.
    Vaibhav Bansal
    @vaibhavflip
    hi guys, i have a route containing a loop. when graceful shutdown happens, this route keeps on running because of this loop and does not get interrupted till forceful shutdown. Is there a way to interrupt this loop on shutdown
    Luca Burgazzoli
    @lburgazzoli
    @vaibhavflip please use https://camel.zulipchat.com/ as this room is not more active.
    Vaibhav Bansal
    @vaibhavflip
    thanks @lburgazzoli
    gbarreto2020
    @gbarreto2020
    Quick question here. I am using the Camel Salesforce component and I am trying to clear the value of a field on a specific sobject. Any ideas on how to do that?
    Setting the field to null and performing an update does not seem to work.
    gbarreto2020
    @gbarreto2020
    Nevermind all. I figured it out.
    KimJohn Quinn
    @kjq
    Am I just missing something dumb here? I am pulling in this dependency (pom/import) because I just want the starters only and let my SpringBoot POM drive the version. It looks like this BOM pulls in Camel Tooling then Camel spring-boot which has a spring-boot version so I have multiple versions (for example spring-web) and that is causing me issues. I am using the latest SpringBoot.
    <dependency>
         <groupId>org.apache.camel.springboot</groupId>
         <artifactId>camel-spring-boot-bom</artifactId>
          <version>3.5.0</version>
          <scope>import</scope>
          <type>pom</type>
     </dependency>
    KimJohn Quinn
    @kjq
    I was able to override the older spring boot by redeclaring the newer spring boot in a lower Pom.
    Dmitry Volodin
    @dmvolod
    @kjq please use https://camel.zulipchat.com/ as this room is not more active.
    @gbarreto2020 please use https://camel.zulipchat.com/ as this room is not more active.
    Pedro Catalão
    @pedrocatalao
    greetings everyone, quick question, does anyone know if it's possible to fetch a file listing with the FTP component?
    Luca Burgazzoli
    @lburgazzoli
    @pedrocatalao please use https://camel.zulipchat.com/ as this room is not more active.
    Pedro Catalão
    @pedrocatalao
    thanks @lburgazzoli :thumbsup:
    Levent Divilioglu
    @bzdgn

    Hello all, I'm trying to convert my existing queues to virtual topics within Apache Camel. I've applied the examples I've seen in the internet;

    For producers;

    VirtualTopic.<queue_name>

    Also wrapped them with ActiveMQTopic instances. But in my local running AMQ, I cant see the entries.

    is there any reliable hello world example for using Virtual Queues (with ActiveMQ) within Apache Camel?

    Thanks

    Andrea Tarocchi
    @valdar
    @bzdgn please use https://camel.zulipchat.com/ as this room is not more active.
    Levent Divilioglu
    @bzdgn

    @bzdgn please use https://camel.zulipchat.com/ as this room is not more active.

    Thanks!

    Gabriel Soto
    @gsoto
    Should I go with Groovy or JavaScript as my scripting language?
    Andrea Tarocchi
    @valdar
    @gsoto please use https://camel.zulipchat.com/ as this room is not more active.
    Gabriel Soto
    @gsoto
    oh, sure!