Hello all - I'm working on a project with Quarkus and graal native. It looks like my
s3:DeleteObjects requests works fine in JVM mode, but it appears that graal is stripping out some of the classes that calculate the content-md5 header, so my requests fail. Can someone point me to the code that does the md5 calculation?
@debora-ito Thank you for the response. I did try AssociateRouteTableRequest before I posted the question. The approach didn't create an route to the routetable. I found the following work for me. CreateRouteRequest createRouteRequest = CreateRouteRequest.builder().gatewayId(internetGateway.internetGatewayId()).destinationCidrBlock("0.0.0.0/0").
routeTableId(createRouteTableResponse.routeTable().routeTableId()).build();
CreateRouteResponse routeResponse = ec2Client.createRoute(createRouteRequest);
routeTableId(createRouteTableResponse.routeTable().routeTableId()).build();
CreateRouteResponse routeResponse = ec2Client.createRoute(createRouteRequest);
@ericknet I believe SQSConnectionFactory is from the https://github.com/awslabs/amazon-sqs-java-messaging-lib project, which is not owned by the SDK Team. You can +1 to ask them to support the Java SDK 2.x here: awslabs/amazon-sqs-java-messaging-lib#78
@squadgazzz y You should be able to configure at the HTTP client level, here's some examples: https://docs.aws.amazon.com/sdk-for-java/v2/developer-guide/client-configuration-http.html
hello. anyone knows if there's a way to disable autoloading (paginated results) from the dynamodb table scans? [Java SDK 1.x] - the article I found here says that it's not even possible to do that https://aws.amazon.com/blogs/developer/auto-pagination-feature-in-java-sdk-2-0/ by implying it's a feature of the SDK 2.x (mind you, quite old article); but the javadoc says the following
Network calls can be triggered when the collection is iterated across page boundaries. - or, put in different terms, is there a way of disabling it in any of the SDK versions?
@dragosmc you can still do manual pagination - https://docs.aws.amazon.com/sdk-for-java/v2/developer-guide/examples-pagination.html
@/all We are happy to announce the release of the DynamoDB Enhanced Client for the AWS SDK for Java 2.0. Read the blog post for more details: https://aws.amazon.com/blogs/developer/introducing-enhanced-dynamodb-client-in-the-aws-sdk-for-java-v2/
please i want to use the amazon s3 in an apache ant build web app and so i tried an executable jar with maven. i built just the s3 service and got the .jar snapshot which i added to the jar library but al the import statements for the com.amazonaws.services.s3 keep throwing errors and i dont want to use the complete build of all services as it is too large and makes my app war file too large. please anyone who can help should reply
Is this normal behavior? I’m using the AsyncS3Client to list objects and after a while I see in the debug logs a bunch of
IdleConnectionReaperHandler - Closing unused connection (052c6fe5) because it has been idle for longer than 5000 milliseconds. followed by java.io.IOException: Channel was closed before it could be written to. and my program crashing. Is that a red herring or something odd going on there?
@joswal it seems the s3 jar was not correctly added to your classpath, check your build configurations for external libraries.
@debora-ito the library was actually included in the classpath, thanks a lot. I later finally got it working by using just the core and s3 jar files from the V1. the V2 did not work still though.
I'm trying to use the aws toolkit. But I'm running into an issue ("No Maven executable found!"). I followed this documentation (the part that says "Work with AWS Serverless Applications"). https://docs.aws.amazon.com/toolkit-for-jetbrains/latest/userguide/key-tasks.html#key-tasks-sam
I got to the step that says "Add as Maven Project" but my IntelliJ IDEA Ultimate 2019.3 doesn't have that option. So I just tried running "sam build" and it just says "No Maven executable found!"
2 replies
Hi All, I am using AWS SDK v2 and invoking putObject() using S3AsyncClient. But I am facing with
software.amazon.awssdk.services.s3.model.S3Exception: null (Service: S3, Status Code: 500, Request ID: null)
at software.amazon.awssdk.protocols.xml.internal.unmarshall.AwsXmlPredicatedResponseHandler.handleErrorResponse(AwsXmlPredicatedResponseHandler.java:156)
at software.amazon.awssdk.protocols.xml.internal.unmarshall.AwsXmlPredicatedResponseHandler.handleResponse(AwsXmlPredicatedResponseHandler.java:106)
at software.amazon.awssdk.protocols.xml.internal.unmarshall.AwsXmlPredicatedResponseHandler.handle(AwsXmlPredicatedResponseHandler.java:84)
at software.amazon.awssdk.protocols.xml.internal.unmarshall.AwsXmlPredicatedResponseHandler.handle(AwsXmlPredicatedResponseHandler.java:42)
at software.amazon.awssdk.core.internal.handler.BaseClientHandler.lambda$successTransformationResponseHandler$4(BaseClientHandler.java:214)
at software.amazon.awssdk.core.internal.http.async.AsyncResponseHandler.lambda$prepare$0(AsyncResponseHandler.java:88)
at java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(Unknown Source)
at java.base/java.util.concurrent.CompletableFuture.postComplete(Unknown Source)
at java.base/java.util.concurrent.CompletableFuture.complete(Unknown Source)
at software.amazon.awssdk.core.internal.http.async.AsyncResponseHandler$BaosSubscriber.onComplete(AsyncResponseHandler.java:129)
at software.amazon.awssdk.http.nio.netty.internal.ResponseHandler.runAndLogError(ResponseHandler.java:179)
at software.amazon.awssdk.http.nio.netty.internal.ResponseHandler.access$500(ResponseHandler.java:69)
at software.amazon.awssdk.http.nio.netty.internal.ResponseHandler$PublisherAdapter$1.onComplete(ResponseHandler.java:295)
at software.amazon.awssdk.http.nio.netty.internal.nrs.HandlerPublisher.publishMessage(HandlerPublisher.java:402)
at software.amazon.awssdk.http.nio.netty.internal.nrs.HandlerPublisher.flushBuffer(HandlerPublisher.java:338)
at software.amazon.awssdk.http.nio.netty.internal.nrs.HandlerPublisher.receivedDemand(HandlerPublisher.java:291)
at software.amazon.awssdk.http.nio.netty.internal.nrs.HandlerPublisher.access$200(HandlerPublisher.java:61)
at software.amazon.awssdk.http.nio.netty.internal.nrs.HandlerPublisher$ChannelSubscription$1.run(HandlerPublisher.java:495)
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:497)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.base/java.lang.Thread.run(Unknown Source)
<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>SignatureDoesNotMatch</Code><Message>The request signature we calculated does not match the signature you provided. Check your key and signing method.</Message><Key></Key><BucketName></BucketName><Resource>/b1324</Resource><RequestId></RequestId><HostId></HostId></Error>
3 replies
AWSCredentials awsCredentials = new BasicAWSCredentials(signatureKey.getAccessKey(),
signatureKey.getSecretAccessKey());
signatureKey.getSecretAccessKey());
AWS4Signer signer = new AWS4Signer();
String bodySHA256 = BinaryUtils.toHex(signer.hash(input.getXmlPayload()));
String date = AWS4SignerUtils.formatTimestamp(now.getTime());
DefaultRequest<?> signableRequest = new DefaultRequest<>(signatureKey.getServiceName());
signableRequest.setHttpMethod(HttpMethodName.PUT);
signableRequest.setEndpoint(URI.create(url));
signableRequest.addHeader(HeadersName.CONTENT_TYPE, HeadersName.CONTENT_TYPE_XML);
signableRequest.addHeader(HeadersName.X_AMZ_CONTENT_SHA256, bodySHA256);
signableRequest.addHeader(HeadersName.X_AMZ_DATE, date);
signer.setOverrideDate(now);
signer.setEndpointPrefix(inputHolder.getEndpoint());
signer.setServiceName(signatureKey.getServiceName());
signer.setRegionName(signatureKey.getRegionName());
signer.sign(signableRequest,awsCredentials);
String authorization = signableRequest.getHeaders().get("Authorization");
System.out.println(authorization);
i have facining issue any solution on this
@all I have defined a life cycle configuration for the subfolder of a S3 bucket using the below code. But the objects are not getting deleted after the expiration. Any idea on this ?
LifecycleRule rule = LifecycleRule
.builder()
.id(name)
.prefix(path)
.expiration(LifecycleExpiration.builder().days(1).build())
.status(ExpirationStatus.ENABLED)
.build();
The image above shows that xamz expiration has been set to two days prior. But still the object has not been deleted yet.. Am I missing something here?
Any possible way to use RSocket for binary transmission of high quality, huge volume video files from Amazon S3 to end user mobile devices. Use Back-Pressure mechanism (Either from Project Reactor or from RSocket) to handle the transmission rate without any buffering. Capable of controlling transmission according to end-user device capability and network bandwidth.
Hi! Does anyone know if the largePayloadSupportEnabled that one could use via the SqsExtendedClient is available in the sdk v2 sqs for java? The feature is basically that if a message is larger than 256kb it uploads the payload to s3 and seemlessly worked out a sqs-message with a pointer to that
2 replies
Using the CloudWatchAsyncClient, I am getting "Acquire operation took longer than the configured maximum time. This indicates that a request cannot get a connection from the pool within the specified maximum time. This can be due to high request rate." when calling putMetricsData(). I aggregate a bunch of metrics and publish them once per minute using a scheduled executor with a fixed delay, so I'm skeptical this is due to a high request rate, unless perhaps the underlying http client is shared with other aws sdk clients. I'm not setting a specific http client on any of my aws sdk clients - just using the default. I don't see a way to get information about the state of the default http client being used. Any ideas on diagnosing what might be causing this error?
Is there any documentation about "release policy" or "backwards compatibility"? Looks there are daily releases, but of course we cannot afford to upgrade on a daily basis (esp. if there are no assurances about backwards compatibility). How are others handling this?
1 reply
I was moving some of our code over to SDKv2 as a test, but hit a problem with the enhanced DynamoDb annotations: They are for member functions only, which makes them incompatible with lombok. (The dynamodbmapper annotations could be applied to member variables, which lombok would then copy to the setters and getters). Is there any way to make the enhanced attributes work with lombok?
I am just getting started AWS SDK java . I would like to to use AWS SDK 2.0 for java. I could not find a place where I can download it. The link in the documentation still refers to AWS SDK 1.2. I tried to build it from github and its throwing lot of errors. Can someone please help me with a location to download AWS SDK 2.0 jar file
@code4purpose You don't mention if you are using Maven or gradle - but here's the documentation page you probably want -- https://docs.aws.amazon.com/sdk-for-java/v2/developer-guide/setup-project-maven.html. It shows how to add it to your project and maven will download it automatically.
i'am consuming data from kinesis using aws-sdk-java-v2 but i got the exception this message
my dependency my pom.xml
<dependencyManagement>
<dependencies>
<dependency>
<groupId>software.amazon.awssdk</groupId>
<artifactId>bom</artifactId>
<version>2.13.25</version>
<type>pom</type>
<scope>import</scope>
</dependency>
<dependency>
<groupId>software.amazon.kinesis</groupId>
<artifactId>amazon-kinesis-client</artifactId>
<version>2.2.11</version>
</dependency>
</dependencies>
</dependencyManagement>i got exception
18:10:08.917 [handleFailure:267] [aws-java-sdk-NettyEventLoop-0-6] DEBUG s.a.a.h.n.n.i.NettyRequestExecutor - Failed to create connection to https://kinesis.ap-northeast-2.amazonaws.com/
io.netty.handler.codec.http2.Http2Exception: First received frame was not SETTINGS. Hex dump for first 5 bytes: 485454502f
at io.netty.handler.codec.http2.Http2Exception.connectionError(Http2Exception.java:103)
at io.netty.handler.codec.http2.Http2ConnectionHandler$PrefaceDecoder.verifyFirstFrameIsSettings(Http2ConnectionHandler.java:338)
at io.netty.handler.codec.http2.Http2ConnectionHandler$PrefaceDecoder.decode(Http2ConnectionHandler.java:239)
at io.netty.handler.codec.http2.Http2ConnectionHandler.decode(Http2ConnectionHandler.java:438)
@foryou7242 Hello! The
amazon-kinesis-client is a separate lib owned by the Kinesis team, they should be able to help you in their github repo: https://github.com/awslabs/amazon-kinesis-client
@/all The preview of the client-side Metrics feature is now released! Check the blog post for more info: https://aws.amazon.com/blogs/developer/using-the-new-client-side-metrics-feature-in-the-aws-sdk-for-java-v2/