spring-cloud/spring-cloud-aws

Integration for Amazon Web Services APIs with Spring

MohanJagadheeswaran

@MohanJagadheeswaran

Unable to calculate MD5 hash: preview4.jpg (The system cannot find the file specified)",

try {
                Upload uploadObject = transferManager.upload("jagadheestest", "TestFile", uploadFile);
                UploadResult result = uploadObject.waitForUploadResult();

                //uploadObject.waitForCompletion();
            } catch (AmazonServiceException e) {
                System.err.println(e.getErrorMessage());
            }

can anyone send me a simple exaple for a file upload. I just followed spring cloud aws

Sanjay Rawat

@RawSanj

Here, try my sample app https://github.com/RawSanj/aws-s3-file-system

MohanJagadheeswaran

@MohanJagadheeswaran

Thanks for the reply. I'll give that a shot

And wondering y my code didn't worked. Followed the setup in spring cloud aws doc

Chandrakanth Reddy

@CHANDRAKANTHREDDY93

Hi All
I need some help
I want to create a Java program using an AWS lambda S3 event which triggers when a file is uploaded in a bucket
Can anyone please help me in doing it so?

Ghost

@ghost~5810adcfd73408ce4f30f99f

Hi everyone,
We need help in a matter.
We are looking for a deployment solution for the project we are developing. We are using SpringSoft project as our project and MySQl as database. We are using Redis for session storage. We target 100 users in the first stage. In this context, we recommend which deployment solutions to consider pricing. (We developed the frontend with angular and used the amazon S3 service)
Amazon BeanStalk
Amazon EC2
Digital ocean cloud

Les Hartzman

@lhartzman_gitlab

Hi All,
I've got a Spring Boot app that connects to an RDS Aurora instance through the usual spring.datasource property. But I want to now be able to connect to RDS and have access to a read replica. When I added properties for the DB instance and replica support, I got a strange error:
code
.ApplicationContextException: Unable to start web server; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'servletEndpointRegistrar' defined in class path resource [org/springframework/boot/actuate/autoconfigure/endpoint/web/ServletEndpointManagementContextConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.boot.actuate.endpoint.web.ServletEndpointRegistrar]: Factory method 'servletEndpointRegistrar' threw exception;
code

Does anyone have an example of how to configure the app to hit the master and read-replica?
Thanks.

Les

Les Hartzman

@lhartzman_gitlab

All,

More on the error with the Spring Boot/Aurora problem. I'm also getting an AmazonCloudFormationException saying the user is not authorized to perform: cloudformation:DescribeStackResources, and returns a 403. Not sure where this is coming from either.

Les

Sanjay Rawat

@RawSanj

I don't know about RDS coz I couldn't get it to work for Postgresql but for Cloudformation error I think you need to disable some properties

cloud.aws.stack.auto=false should work

Else you'd have to add IAM Roles for Cloudformation and attach it to the EC2 instance running the app

Les Hartzman

@lhartzman_gitlab

i just found that too, Sanjay. thanks. i'm going to go ahead and try it.

Les Hartzman

@lhartzman_gitlab

All,

I am trying to use an Aurora MySQL cluster of 1 writer and 1 read replica.

I set up my properties as follows:

cloud.aws.rds.db-write-instance.username=ABCD
cloud.aws.rds.db-write-instance.password=pass
cloud.aws.rds.db-write-instance.readReplicaSupport=true
cloud.aws.rds-db-write-instance.databaseName=mydb

But when I look at processlist for the writer and read-replica hosts, only the writer has had any activity. Do I need additional configuration set up? This is a Spring Boot app integrated with Spring Cloud for AWS.

Thanks.

(The db instance name matches the master name)

Maciej Walkowiak

@maciejwalkowiak

@mehmetranas digital ocean most likely can be cheaper than AWS, but AWS does a lot for you so you have to worry about less things. I would recommend to go with Beanstalk. We can chat privately if you need more guidance.

@FelipeAdorno regarding SQS polling, consider increasing wait time on SimpleMessageListernerContainer. There is an issue related to it spring-cloud/spring-cloud-aws#319

Sanjay Rawat

@RawSanj

Hey @maciejwalkowiak just saw your tweet about PR on spring-cloud-aws, if you've time then please look into the RDS Support.

It wasn't working for any other database other than Mysql

So I ignored the RDS support and used the url, password directly in th app

Maciej Walkowiak

@maciejwalkowiak

Hi @RawSanj! First I want to tackle SQS and messaging in general and then look at RDS and caching support. But I am just a regular contributor, I have no rights to actually push anything to master branch.

Have you considered digging into the issue and submiting PR with fix?

Sanjay Rawat

@RawSanj

I wanted to but got super busy with the project work in office.

Maciej Walkowiak

@maciejwalkowiak

Sure, understood. I used RDS just using classic Spring Boot + Spring Data integration. But no transparent replica support then.

Sanjay Rawat

@RawSanj

Oh ok. I ended up doing the same and it is working fine for now.

Maciej Walkowiak

@maciejwalkowiak

Can you file an issue on Github regarding running with other databases? (if it’s not there yet). Including your setup and exception you’re getting. Would be helpful for investigation.

Sanjay Rawat

@RawSanj

I think there's already one but if not I'll create it as soon as I get time

Ghost

@ghost~5810adcfd73408ce4f30f99f

@maciejwalkowiak thanks for answer

ashish gupta k

@ashishguptak

hello, Spring cloud Sleuth and Zipkin packages do not support SQS Senders, only RabbitMq and Kafka streams. I am planning to add https://github.com/openzipkin/zipkin-aws/tree/master/sender-sqs to spring-cloud-sleuth-zipkin-1.3.3.RELEASE.jar and include in my gradle package. Do you recommend this approach? Or is there a library which already does it?

Quantum Fusion

@quantum-fusion

Are there any tech recruiters in here?

Quantum Fusion

@quantum-fusion

Is anyone using Athena on AWS for serverless database with AWS Lambda serverless?

Gaurav Rawat

@gauravbrills

Hi have there been any changes to the sqs functionality from Finchley.M9 to Finchley.RELEASE . AS post upgrade we have started getting connection timeout errors while polling SQS . Are the changes somehow overriding our default AWS clientconfigurations ?

Jorge Luiz Reis Tavares

@jorgetavares89

Hi folks, I had a problem with spring cloud aws auto configuration, the project was not recognize the aws region (setted on application.yml) and throw a

"com.amazonaws.SdkClientException:Unable to find a region via the region provider chain. Must provide an explicit region in the builder or setup environment to supply a region."

when I try to configure a AWSSimpleSystemsManagement client, some one can help me? I have an example in my github for exemplify my problem, follow https://github.com/omundodebob/springcloud-aws-config-poc. Note: The accessKey and secretKey is a fake, just to test this problem :).

rajat katyal

@rajatkatyal1986_twitter

@here I want to use Spring cloud config with AWS EC2(Application). Could somebody recommend whether it will be wise to use that or maintaining the configurations in the applications is better?

Currently we have the configurations in the DB and want to migrate this to the cloud config.

Or there are any better approach for the single Application with configurations of multiple regions?

Srini555

@Srini555

Hi all

tmnuwan12

@tmnuwan12

@here Hi all, I am trying to look into this enhancement (spring-cloud/spring-cloud-aws#372) but not sure how to setup the project locally so that I can implement and test this. Can anyone help me?

tmnuwan12

@tmnuwan12

@rajatkatyal1986_twitter Hi... From my experience having the configuration in your application make the code-base more portable. In our projects we are using https://github.com/zalando/spring-cloud-config-aws-kms extension to secure the properties. It's a great extension and works well. But can't comment on the config server. Haven't used it. But configuration over multiple regions can be achieved using custom @Beans declarations and custom property loaded for those said beans via property file.\

tmnuwan12

@tmnuwan12

@lhartzman_gitlab Well if you need to talk to master then end point should be master endpoint (AWS endpoint url).. If it's the read replica you need to use use the AWS provided endpoint. AWS provided endpoint will have the fail-over handled by AWS. You don't have to worry. But depends on the use case which url to use.

José Antonio Jiménez

@logistark

Umm, i have one question related to the integration with AWS SNS. We recently have been surprised to find out that in order to use this integration you need to have list-topics permissions in SNS. Why spring-cloud-aws works this way? I mean using list-topics and getting the topic-arn for publishing a message.

tmnuwan12

@tmnuwan12

@logistark Not sure you fully explain the question here or I understand it fully.. Well having to get permission to list topics is not related to Spring cloud. It's something enforced from the AWS side.

tmnuwan12

@tmnuwan12

For example in one of our project we do setup queues but for that we first query for queue by name and then get the ARN for the queue via an API call. Then using ARN we communicate with the queue. hard-coded ARN in the code (can be in configuration) make it difficult to change over time. In my case I feel it makes the code-base less portable. Not sure this answer the question if not please do let know.

José Antonio Jiménez

@logistark

Yeah, it was my mistake. We have another library in Clojure that publish to sns, and i had the wrong idea that for publishing in SNS you only need the name of the topic. And just checked it, and is as you describe. Sorry.

Yasin Kothia

@YasinK-IW

Is anyone using spring-sleuth with spring-cloud-aws? does it work out of the box? I wanted to send traceIds when sending messages via SQS.

Edward Brighton

@edwardbrighton84

hi all,i need to configure multiple SimpleMessageListenerContainerFactory.how can i set it for per SqsListener? thnks

2 replies

Srinivas

@Sriniva63328880_twitter

Hi all

hdutra

@hdutra

Hello all,

hdutra

@hdutra

I'm trying use the spring-cloud-aws-jdbc in my project, but when I receive a large number of user I have a problem, It seems like my pool of connections is full.

Exception: Pool empty. Unable to fetch a connection in 30 seconds, none available[size:100; busy:100; idle:0; lastwait:30000]

I have used C3P0 in it with no problem. Is possible I use C3P0 for pool connection instead Tomcat pool?

2 replies

Mateusz Mrozewski

@mateuszmrozewski

Hi. Is mvn package reformatting sources of spring-cloud-aws for you as well? Do I need to do any additional setup not to have such behavior?

Where communities thrive

People

Repo info

Activity