Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    tmnuwan12
    @tmnuwan12
    @rajatkatyal1986_twitter Hi... From my experience having the configuration in your application make the code-base more portable. In our projects we are using https://github.com/zalando/spring-cloud-config-aws-kms extension to secure the properties. It's a great extension and works well. But can't comment on the config server. Haven't used it. But configuration over multiple regions can be achieved using custom @Beans declarations and custom property loaded for those said beans via property file.\
    tmnuwan12
    @tmnuwan12
    @lhartzman_gitlab Well if you need to talk to master then end point should be master endpoint (AWS endpoint url).. If it's the read replica you need to use use the AWS provided endpoint. AWS provided endpoint will have the fail-over handled by AWS. You don't have to worry. But depends on the use case which url to use.
    José Antonio Jiménez
    @logistark
    Umm, i have one question related to the integration with AWS SNS. We recently have been surprised to find out that in order to use this integration you need to have list-topics permissions in SNS. Why spring-cloud-aws works this way? I mean using list-topics and getting the topic-arn for publishing a message.
    tmnuwan12
    @tmnuwan12
    @logistark Not sure you fully explain the question here or I understand it fully.. Well having to get permission to list topics is not related to Spring cloud. It's something enforced from the AWS side.
    tmnuwan12
    @tmnuwan12
    For example in one of our project we do setup queues but for that we first query for queue by name and then get the ARN for the queue via an API call. Then using ARN we communicate with the queue. hard-coded ARN in the code (can be in configuration) make it difficult to change over time. In my case I feel it makes the code-base less portable. Not sure this answer the question if not please do let know.
    José Antonio Jiménez
    @logistark
    Yeah, it was my mistake. We have another library in Clojure that publish to sns, and i had the wrong idea that for publishing in SNS you only need the name of the topic. And just checked it, and is as you describe. Sorry.
    Yasin Kothia
    @YasinK-IW
    Is anyone using spring-sleuth with spring-cloud-aws? does it work out of the box? I wanted to send traceIds when sending messages via SQS.
    Edward Brighton
    @edwardbrighton84
    hi all,i need to configure multiple SimpleMessageListenerContainerFactory.how can i set it for per SqsListener? thnks
    2 replies
    Srinivas
    @Sriniva63328880_twitter
    Hi all
    hdutra
    @hdutra
    Hello all,
    hdutra
    @hdutra

    I'm trying use the spring-cloud-aws-jdbc in my project, but when I receive a large number of user I have a problem, It seems like my pool of connections is full.

    Exception: Pool empty. Unable to fetch a connection in 30 seconds, none available[size:100; busy:100; idle:0; lastwait:30000]

    I have used C3P0 in it with no problem. Is possible I use C3P0 for pool connection instead Tomcat pool?

    2 replies
    Mateusz Mrozewski
    @mateuszmrozewski
    Hi. Is mvn package reformatting sources of spring-cloud-aws for you as well? Do I need to do any additional setup not to have such behavior?
    ayusuf
    @ayusuf
    Hi, does anybody know how to use multiple AWS keys in a single Spring Cloud AWS project?
    harinjy
    @harinjy
    HI, I am trying to integrate spring cloud with aws secrets manager. I attached an instance profile to my EC2 which allows reading parameters from Secrets manager. I am getting connection timeout error. It is trying to connect to cloudformation.us-east-1.amazonaws.com. I guess the call is routing to internet and firewall is blocking it. I sthere way i can configure my spring boot project to use cloudformation endpointso that it won't go to public internet? I am following this..https://cloud.spring.io/spring-cloud-static/spring-cloud-aws/2.1.0.RELEASE/single/spring-cloud-aws.html#_integrating_your_spring_cloud_application_with_the_aws_secrets_manager
    Raj
    @rajjaiswalsaumya
    How to connect to aurora db rds ?
    Robert Wiesner
    @rowi1de

    Hey guys ... question to spring-cloud-aws / multiple listeners on one queue

     class A{
      @SqsListener(value = "some-queue", deletionPolicy = ON_SUCCESS)
      public void onMessageReceived1(String payload, @Header(TYPE) String messageType) {}
     }
    
     class B {
      @SqsListener(value = "some-queue", deletionPolicy = ON_SUCCESS)
      public void onMessageReceived2(@Payload SomeMessagePayload message, @Header(TYPE) String messageType) {}
     }

    would that work? btw. is the Method Name taken into account?

    I got "Ambiguous handler methods mapped for destination " when both methods are called "onMessageReceived"

    1 reply
    Kris Krishna
    @kriskrishna
    Anybody used AWS MSK with spring-cloud-aws
    nbenjamin
    @nbenjamin

    Hi all, When i am using @SqsListener with Object its not getting the value

        @SqsListener("Demo")
        public void processMessage(Person person) {
            System.out.println("Message Received - " + person.getName());
        }

    I get the value - Message Received - null

    When i debug i can see the GenericMessage payload with actual value. I thought If jackson library is in class path message converstion happens automatically

    I have configured QueueMessageHandlerFactory with StrictContentTypeMatch- false

        @Bean
        public QueueMessageHandlerFactory queueMessageHandlerFactory() {
            QueueMessageHandlerFactory factory = new QueueMessageHandlerFactory();
            MappingJackson2MessageConverter messageConverter = new MappingJackson2MessageConverter();
    
            //set strict content type match to false
            messageConverter.setStrictContentTypeMatch(false);
            factory.setArgumentResolvers(Collections.singletonList(new PayloadMethodArgumentResolver(messageConverter)));
            return factory;
        }
    nbenjamin
    @nbenjamin
    Getting this error
    org.springframework.messaging.converter.MessageConversionException: Cannot convert from [java.lang.String] to [com.nbenjam.springcloudawsmessaging.domain.Person] for GenericMessage [payload={
    "Type" : "Notification",
    "MessageId" : "6f18d976-c801-58a8-be7a-8fdc47069ac8",
    "TopicArn" : "arn:aws:sns:us-east-1:88s8s8s:demo-topic",
    "Message" : "{\"name\":\"Ryan-Adam\",\"age\":10}",
    "Timestamp" : "2020-01-28T19:34:31.951Z",
    "SignatureVersion" : "1",
    Taylor Bruce
    @tbruce731CH
    Hello All, I want to be able to extend message visibility in SQS. How can I do this using Spring Framework? Currently I have it working well and deserializing my body payload to an object however I want to be able to get the ReceiptHandle for the message in order to extend the message visibility as my application does work.
    Thanks!
    Fernando Montes
    @ferzerkerx

    Hi
    I've upgraded from spring-boot from 2.2.2.RELEASE to 2.2.4.RELEASE. and this seems to change the behavior of the sent metrics to aws (I'm getting lot's of The parameter MetricData.member.7.Dimensions.member.5.Value is required.) I'm using io.micrometer:micrometer-registry-cloudwatch:1.3.2 (I've also tried 1.3.3), on a separate note I've just noticed that io.micrometer:micrometer-registry-cloudwatch is now deprecated and that there is a io.micrometer:micrometer-registry-cloudwatch2 (I've tried this one but it fails to be picked up by spring)

    so the questions are:

    • how can I debug which metric is causing problems? any logs I can enable?
    • seems like io.micrometer:micrometer-registry-cloudwatch2 is they way to go now is it compatible with spring-cloud-aws?
    • have you encountered something similar? and how did you fix it

    thanks in advance

    @nbenjamin I've seen that problem, in a nutshell you seem to be expecting a raw message, but you are getting a wrapped message, try to change your mapping from:

    foo(Person person){} to foo (@NotificationMessage Person person) I'm assuming this is the listener (your queue on aws should not send the raw message)

    Taylor Bruce
    @tbruce731CH
    Also I believe I am having a memory leak in the spring cloud aws library - Ive removed all business logic from my application and simply have a SQSListener that spits out the message to stdout. After running through about 30k messages across 10 k8s pods the memory starts to run away. Any pointers?
    junior6886
    @junior6886
    Do I need spring cloud to use spring cloud aws?
    1 reply
    Harish Chava
    @hchava
    Hello There, Is there a way to monitor any new objects creation events on Aws S3 bucket using Spring?
    If so, Please provide the best practices. Fyi, I've only read access for a 3rd party S3 bucket using aws access and secret keys.
    Bernardo Martins
    @bsamartins
    @hchava, best way is setting up a rule in S3 that reacts to certain events and will push them to SQS or similar.
    You can then have a listener in Spring that consumes those events.
    https://docs.aws.amazon.com/AmazonS3/latest/dev/NotificationHowTo.html
    Harish Chava
    @hchava
    @bsamartins Thank you for the reply! unfortunately I don't have any other access to the bucket apart from the read access using certain prefix. we're consumers for a Third party S3 bucket.
    Maciej Walkowiak
    @maciejwalkowiak
    👋
    Oleksandr
    @giova333
    👋
    Eddú Meléndez Gonzales
    @eddumelendez
    hi!
    Eddú Meléndez Gonzales
    @eddumelendez
    have been thinking about 2 things looking at the current source code. 1. Remove the @Autowire annotations and go for constructor injection or use ObjectProvide for those with required=false. 2 . Move the cloudwatch support to v2
    Maciej Walkowiak
    @maciejwalkowiak
    Hi @eddumelendez! :+1: to both ideas. I am thinking about solid re-do of configuration classes. For 2.3.x I think we can drop XML support and also drop @Enable classes. This would allow us move all configuration completely to autoconfigure module and use Spring Boot @Conditional annotations. There we could use ObjectProviders
    I'll put today/tomorrow together my thoughts on 2.3.x and 3.x. I see 3.x as move to AWS SDK v2 - this will be a lot of work and I would like to drop everything we don't need and don't want to support just to reduce amount of code to migrate.
    I started working already on 2.3.x but everything is up to discussion and your input @eddumelendez will be extremely welcome!
    Spencer Gibb
    @spencergibb
    :+1: @eddumelendez
    jarc0der
    @jarc0der
    Hi @maciejwalkowiak !
    Currently looking at the spring cloud messaging. Seems a lot of code are based on spring messaging framework.
    Looking at you reactive-sqs PoC looks more readable and understandable. Of course it's PoC and more features should be implemented.
    Are you considering migration from spring messaging mechanism for sqs/sns support on spring cloud?
    Maciej Walkowiak
    @maciejwalkowiak
    Hi @jarc0der! Ideally we do not migrate away from Spring Messaging as there are some downstream projects that depend on Spring Cloud AWS like Spring Integration AWS and I am afraid we could break them. Perhaps there is a way to use reactive approach and keep it Spring Messaging compatible (just guessing, I am still digging into this topic). Ideally whatever abstraction we come up with should let us build something like Spring Cloud Stream SQS. I did a POC for that long time ago https://github.com/maciejwalkowiak/spring-cloud-stream-binder-sqs but since it's based on Spring Cloud AWS it also has all the flaws of current implementation of SQS listener.
    Philip Riecks
    @rieckpil_twitter
    Hey :wave: I just submitted an issue to optimize the integration test setup(spring-cloud/spring-cloud-aws#572). It would be great if you can share some thoughts on this :thumbsup:
    Philip Riecks
    @rieckpil
    Does the Intellij_Spring_Boot_Java_Conventions file supersedes the eclipse-code-formatter.xml? While reading the README in the coding conventions it says to install the Eclipse Formatter for IntelliJ while in the IntelliJ IDE setup one should use the coding conventions from Spring Cloud Build?
    Maciej Walkowiak
    @maciejwalkowiak
    @rieckpil IDE setup is another thing that needs to be refreshed. I did not use eclipse-code-formatter plugin at all. Code is being formatter through spring-javaformat Maven plugin automatically when you build the project
    3 replies
    Shawn Johnson
    @shawnjohnson
    I feel like I am missing a major concept with the SqsListener - How/where is it determined how frequently the SQS queue is checked?
    Rory Byrne
    @synek
    Is it possible to register two listeners for a single SQS queue? One or the other should be used to handle the event, depending on the structure of the message body. Example:
    @Slf4j
    @Component
    public class MyListener {
    
      @SqsListener("my-queue")
      public void handler(Foo foo) {
        log.debug(foo);
      }
    
      @SqsListener("my-queue")
      public void otherHandler(Bar bar) {
        log.debug(bar);
      }
    
    }
    My queue receives different messages for different events, so I'd like to have a different handler for each event type
    Maciej Walkowiak
    @maciejwalkowiak
    @synek you would need to implement this dispatching logic yourself. It's meant to have single @SqsListener per queue
    Mete Alpaslan Katırcıoğlu
    @mkatircioglu
    Hi @maciejwalkowiak I have provided configuration properties for AmazonRdsDatabaseAutoConfiguration as you suggested in spring-cloud/spring-cloud-aws#598 but I couldn't find how I can bind AnnotationAttributes to configuration properties for AmazonRdsInstanceConfiguration. How can I handle that? I would be very happy, if you can guide me.
    Rory Byrne
    @synek
    Hi folks there's a bug with the Spring Cloud AWS documentation website - code examples are illegible due to the text color matching the background color. https://cloud.spring.io/spring-cloud-aws/2.2.x/reference/html/
    1 reply
    Or is it just me? I suppose it's possible that my browser is broken
    Rory Byrne
    @synek
    image.png
    Petar Tahchiev
    @ptahchiev
    Hey everyone, I'm searching all over the internet to see if it possible to delete a file on AWS S3 using the spring-cloud API, and I found this: https://stackoverflow.com/questions/51304075/how-to-delete-file-from-s3-using-spring-cloud-aws
    which claims that is is not possible. Is this really the case??? This seems like a very basic functionality
    2 replies