Where communities thrive

  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
Repo info
    ashish gupta k
    hello, Spring cloud Sleuth and Zipkin packages do not support SQS Senders, only RabbitMq and Kafka streams. I am planning to add https://github.com/openzipkin/zipkin-aws/tree/master/sender-sqs to spring-cloud-sleuth-zipkin-1.3.3.RELEASE.jar and include in my gradle package. Do you recommend this approach? Or is there a library which already does it?
    Quantum Fusion
    Are there any tech recruiters in here?
    Quantum Fusion
    Is anyone using Athena on AWS for serverless database with AWS Lambda serverless?
    Gaurav Rawat
    Hi have there been any changes to the sqs functionality from Finchley.M9 to Finchley.RELEASE . AS post upgrade we have started getting connection timeout errors while polling SQS . Are the changes somehow overriding our default AWS clientconfigurations ?
    Jorge Luiz Reis Tavares
    Hi folks, I had a problem with spring cloud aws auto configuration, the project was not recognize the aws region (setted on application.yml) and throw a "com.amazonaws.SdkClientException:Unable to find a region via the region provider chain. Must provide an explicit region in the builder or setup environment to supply a region." when I try to configure a AWSSimpleSystemsManagement client, some one can help me? I have an example in my github for exemplify my problem, follow https://github.com/omundodebob/springcloud-aws-config-poc. Note: The accessKey and secretKey is a fake, just to test this problem :).
    rajat katyal
    @here I want to use Spring cloud config with AWS EC2(Application). Could somebody recommend whether it will be wise to use that or maintaining the configurations in the applications is better?
    Currently we have the configurations in the DB and want to migrate this to the cloud config.
    Or there are any better approach for the single Application with configurations of multiple regions?
    Hi all
    @here Hi all, I am trying to look into this enhancement (spring-cloud/spring-cloud-aws#372) but not sure how to setup the project locally so that I can implement and test this. Can anyone help me?
    @rajatkatyal1986_twitter Hi... From my experience having the configuration in your application make the code-base more portable. In our projects we are using https://github.com/zalando/spring-cloud-config-aws-kms extension to secure the properties. It's a great extension and works well. But can't comment on the config server. Haven't used it. But configuration over multiple regions can be achieved using custom @Beans declarations and custom property loaded for those said beans via property file.\
    @lhartzman_gitlab Well if you need to talk to master then end point should be master endpoint (AWS endpoint url).. If it's the read replica you need to use use the AWS provided endpoint. AWS provided endpoint will have the fail-over handled by AWS. You don't have to worry. But depends on the use case which url to use.
    José Antonio Jiménez
    Umm, i have one question related to the integration with AWS SNS. We recently have been surprised to find out that in order to use this integration you need to have list-topics permissions in SNS. Why spring-cloud-aws works this way? I mean using list-topics and getting the topic-arn for publishing a message.
    @logistark Not sure you fully explain the question here or I understand it fully.. Well having to get permission to list topics is not related to Spring cloud. It's something enforced from the AWS side.
    For example in one of our project we do setup queues but for that we first query for queue by name and then get the ARN for the queue via an API call. Then using ARN we communicate with the queue. hard-coded ARN in the code (can be in configuration) make it difficult to change over time. In my case I feel it makes the code-base less portable. Not sure this answer the question if not please do let know.
    José Antonio Jiménez
    Yeah, it was my mistake. We have another library in Clojure that publish to sns, and i had the wrong idea that for publishing in SNS you only need the name of the topic. And just checked it, and is as you describe. Sorry.
    Yasin Kothia
    Is anyone using spring-sleuth with spring-cloud-aws? does it work out of the box? I wanted to send traceIds when sending messages via SQS.
    Edward Brighton
    hi all,i need to configure multiple SimpleMessageListenerContainerFactory.how can i set it for per SqsListener? thnks
    2 replies
    Hi all
    Hello all,

    I'm trying use the spring-cloud-aws-jdbc in my project, but when I receive a large number of user I have a problem, It seems like my pool of connections is full.

    Exception: Pool empty. Unable to fetch a connection in 30 seconds, none available[size:100; busy:100; idle:0; lastwait:30000]

    I have used C3P0 in it with no problem. Is possible I use C3P0 for pool connection instead Tomcat pool?

    2 replies
    Mateusz Mrozewski
    Hi. Is mvn package reformatting sources of spring-cloud-aws for you as well? Do I need to do any additional setup not to have such behavior?
    Hi, does anybody know how to use multiple AWS keys in a single Spring Cloud AWS project?
    HI, I am trying to integrate spring cloud with aws secrets manager. I attached an instance profile to my EC2 which allows reading parameters from Secrets manager. I am getting connection timeout error. It is trying to connect to cloudformation.us-east-1.amazonaws.com. I guess the call is routing to internet and firewall is blocking it. I sthere way i can configure my spring boot project to use cloudformation endpointso that it won't go to public internet? I am following this..https://cloud.spring.io/spring-cloud-static/spring-cloud-aws/2.1.0.RELEASE/single/spring-cloud-aws.html#_integrating_your_spring_cloud_application_with_the_aws_secrets_manager
    How to connect to aurora db rds ?
    Robert Wiesner

    Hey guys ... question to spring-cloud-aws / multiple listeners on one queue

     class A{
      @SqsListener(value = "some-queue", deletionPolicy = ON_SUCCESS)
      public void onMessageReceived1(String payload, @Header(TYPE) String messageType) {}
     class B {
      @SqsListener(value = "some-queue", deletionPolicy = ON_SUCCESS)
      public void onMessageReceived2(@Payload SomeMessagePayload message, @Header(TYPE) String messageType) {}

    would that work? btw. is the Method Name taken into account?

    I got "Ambiguous handler methods mapped for destination " when both methods are called "onMessageReceived"

    2 replies
    Kris Krishna
    Anybody used AWS MSK with spring-cloud-aws

    Hi all, When i am using @SqsListener with Object its not getting the value

        public void processMessage(Person person) {
            System.out.println("Message Received - " + person.getName());

    I get the value - Message Received - null

    When i debug i can see the GenericMessage payload with actual value. I thought If jackson library is in class path message converstion happens automatically

    I have configured QueueMessageHandlerFactory with StrictContentTypeMatch- false

        public QueueMessageHandlerFactory queueMessageHandlerFactory() {
            QueueMessageHandlerFactory factory = new QueueMessageHandlerFactory();
            MappingJackson2MessageConverter messageConverter = new MappingJackson2MessageConverter();
            //set strict content type match to false
            factory.setArgumentResolvers(Collections.singletonList(new PayloadMethodArgumentResolver(messageConverter)));
            return factory;
    Getting this error
    org.springframework.messaging.converter.MessageConversionException: Cannot convert from [java.lang.String] to [com.nbenjam.springcloudawsmessaging.domain.Person] for GenericMessage [payload={
    "Type" : "Notification",
    "MessageId" : "6f18d976-c801-58a8-be7a-8fdc47069ac8",
    "TopicArn" : "arn:aws:sns:us-east-1:88s8s8s:demo-topic",
    "Message" : "{\"name\":\"Ryan-Adam\",\"age\":10}",
    "Timestamp" : "2020-01-28T19:34:31.951Z",
    "SignatureVersion" : "1",
    Taylor Bruce
    Hello All, I want to be able to extend message visibility in SQS. How can I do this using Spring Framework? Currently I have it working well and deserializing my body payload to an object however I want to be able to get the ReceiptHandle for the message in order to extend the message visibility as my application does work.
    Fernando Montes

    I've upgraded from spring-boot from 2.2.2.RELEASE to 2.2.4.RELEASE. and this seems to change the behavior of the sent metrics to aws (I'm getting lot's of The parameter MetricData.member.7.Dimensions.member.5.Value is required.) I'm using io.micrometer:micrometer-registry-cloudwatch:1.3.2 (I've also tried 1.3.3), on a separate note I've just noticed that io.micrometer:micrometer-registry-cloudwatch is now deprecated and that there is a io.micrometer:micrometer-registry-cloudwatch2 (I've tried this one but it fails to be picked up by spring)

    so the questions are:

    • how can I debug which metric is causing problems? any logs I can enable?
    • seems like io.micrometer:micrometer-registry-cloudwatch2 is they way to go now is it compatible with spring-cloud-aws?
    • have you encountered something similar? and how did you fix it

    thanks in advance

    @nbenjamin I've seen that problem, in a nutshell you seem to be expecting a raw message, but you are getting a wrapped message, try to change your mapping from:

    foo(Person person){} to foo (@NotificationMessage Person person) I'm assuming this is the listener (your queue on aws should not send the raw message)

    Taylor Bruce
    Also I believe I am having a memory leak in the spring cloud aws library - Ive removed all business logic from my application and simply have a SQSListener that spits out the message to stdout. After running through about 30k messages across 10 k8s pods the memory starts to run away. Any pointers?
    Do I need spring cloud to use spring cloud aws?
    1 reply
    Harish Chava
    Hello There, Is there a way to monitor any new objects creation events on Aws S3 bucket using Spring?
    If so, Please provide the best practices. Fyi, I've only read access for a 3rd party S3 bucket using aws access and secret keys.
    Bernardo Martins
    @hchava, best way is setting up a rule in S3 that reacts to certain events and will push them to SQS or similar.
    You can then have a listener in Spring that consumes those events.
    Harish Chava
    @bsamartins Thank you for the reply! unfortunately I don't have any other access to the bucket apart from the read access using certain prefix. we're consumers for a Third party S3 bucket.
    Maciej Walkowiak
    Eddú Meléndez Gonzales
    Eddú Meléndez Gonzales
    have been thinking about 2 things looking at the current source code. 1. Remove the @Autowire annotations and go for constructor injection or use ObjectProvide for those with required=false. 2 . Move the cloudwatch support to v2
    Maciej Walkowiak
    Hi @eddumelendez! :+1: to both ideas. I am thinking about solid re-do of configuration classes. For 2.3.x I think we can drop XML support and also drop @Enable classes. This would allow us move all configuration completely to autoconfigure module and use Spring Boot @Conditional annotations. There we could use ObjectProviders
    I'll put today/tomorrow together my thoughts on 2.3.x and 3.x. I see 3.x as move to AWS SDK v2 - this will be a lot of work and I would like to drop everything we don't need and don't want to support just to reduce amount of code to migrate.
    I started working already on 2.3.x but everything is up to discussion and your input @eddumelendez will be extremely welcome!
    Spencer Gibb
    :+1: @eddumelendez
    Hi @maciejwalkowiak !
    Currently looking at the spring cloud messaging. Seems a lot of code are based on spring messaging framework.
    Looking at you reactive-sqs PoC looks more readable and understandable. Of course it's PoC and more features should be implemented.
    Are you considering migration from spring messaging mechanism for sqs/sns support on spring cloud?
    Maciej Walkowiak
    Hi @jarc0der! Ideally we do not migrate away from Spring Messaging as there are some downstream projects that depend on Spring Cloud AWS like Spring Integration AWS and I am afraid we could break them. Perhaps there is a way to use reactive approach and keep it Spring Messaging compatible (just guessing, I am still digging into this topic). Ideally whatever abstraction we come up with should let us build something like Spring Cloud Stream SQS. I did a POC for that long time ago https://github.com/maciejwalkowiak/spring-cloud-stream-binder-sqs but since it's based on Spring Cloud AWS it also has all the flaws of current implementation of SQS listener.
    Philip Riecks
    Hey :wave: I just submitted an issue to optimize the integration test setup(spring-cloud/spring-cloud-aws#572). It would be great if you can share some thoughts on this :thumbsup:
    Philip Riecks
    Does the Intellij_Spring_Boot_Java_Conventions file supersedes the eclipse-code-formatter.xml? While reading the README in the coding conventions it says to install the Eclipse Formatter for IntelliJ while in the IntelliJ IDE setup one should use the coding conventions from Spring Cloud Build?