Hello - I am very new to using was and java sdk - just trying things out - is this correct forum to ask I am stuck here questions ? - Is there another forum for such discussions ? ((Service: AWSKMS; Status Code: 400; Error Code: NotFoundException; Request ID: 007d6f7d-9a98-4ef9-8d8d-241d821b82bf))
1 reply
Hi. I have never contributed to aws-sdk-java before. Yet I found what seems a performance bug in aws-java-sdk-s3. What's the expected scrutiny when it comes to submitting the pull request?
e.g. a unit test for the change meethod? JMH benchmark showing the improvement?
e.g. a unit test for the change meethod? JMH benchmark showing the improvement?
2 replies
I am deploying Cloudformation stack in the newly created sub account using cdk but I got error Stack [stack1] already exists (Service: CloudFormation, Status Code: 400, Request ID: 8f6972f4-9f26-42ea-a3d3-56ade88fc75b). I checked that there is no stack named stack1 in my account. why is this happening
1 reply
how can I triage this
Can Request ID: 8f6972f4-9f26-42ea-a3d3-56ade88fc75b help what had happened at that time
Hello - Is there a way we can run select object content (s3 select) on specific version of s3 object using version Id? I cannot find any references in select object content documentation to specify the version Id like we have version Id field in get Object request. Any help is appreciated?
2 replies
Hi,
I am using the AWS SDKv2 to audit my S3 buckets. My S3 buckets are spread out across different regions. Is there a way to create a region agnostic S3 Client ? Or can we add more than one regions in the S3Client ? Since S3 bucket names are globally unique, S3Client should be self sufficient in the terms of figuring out which region a bucket is in. As I understand, we can query a bucket to know its location but that is an extra network call.
I am using the AWS SDKv2 to audit my S3 buckets. My S3 buckets are spread out across different regions. Is there a way to create a region agnostic S3 Client ? Or can we add more than one regions in the S3Client ? Since S3 bucket names are globally unique, S3Client should be self sufficient in the terms of figuring out which region a bucket is in. As I understand, we can query a bucket to know its location but that is an extra network call.
3 replies
Hi folks, I'm using S3Client.builder()...build() and it's working fine, but i now need to configure proxy settings. I see documentation refering to a ClientConfiguration class, but i don't see that, or how you install it with the builder? Anyone point me in the right direction?
8 replies
A quick general question are sqs generated messageIds (UUID) unique . Can they be used as identifiers for the consuming system to figure our message uniqueness checks say for s3 event notifications . Also is there a chance of the consumer receiving a duplicate message id from a queue on 2 different messages.
Hi All, I have a very basic question regarding S3 buckets. The API to get Server Side Encryption Rule
s3Client.getBucketEncryption(bucketName).getServerSideEncryptionConfiguration().getRules() returns a List<ServerSideEncryptionRule>. Since there are no option of selection multiple Server Side Encryptions (The console has a radio button to select between various encryption types), why a list of Rules with just element is returned. Would it not have been a better API design to just return a ServerSideEncryptionRule instead of a list ?
Hi all, I am trying to build a client application using Cognito, but I would like the user to be logged into multiple "workspaces" at the same time, like slack. Amplify seems too restrictive because I think it stores the session as a singleton...is that correct? Do you think this should be possible using the Java SDK?
Hi, I am creating a spot instance and I get instance ID returned as a string, now I need more details about this instance like the ipaddress, Can anyone help me here on how to do this. For a on demand instance I get an Instance object returned while creating the instance which has all these details. But not able to do the same for spot instance.
2 replies
let's say at a path A/, I have uploaded, F1, F2, ... F30 in that order.
So, now we have A/F1, A/F2, A/F3, A/F4, ... A/F30.
Is there a way to upload objects to the s3 bucket at a path - let's say A/ maintaining the number of objects uploaded at that path only at a fixed number? for example, in this case, if I fix that number to 10, is there a way that when I'm updating F11, F1 will get deleted and when I'm uploading F12, F2 will get deleted and so on.. (keeping the number of objects within A as max 10)
So, now we have A/F1, A/F2, A/F3, A/F4, ... A/F30.
Is there a way to upload objects to the s3 bucket at a path - let's say A/ maintaining the number of objects uploaded at that path only at a fixed number? for example, in this case, if I fix that number to 10, is there a way that when I'm updating F11, F1 will get deleted and when I'm uploading F12, F2 will get deleted and so on.. (keeping the number of objects within A as max 10)
Hey All,
I'm trying to create a signed request to use in the vault-java-driver (https://github.com/BetterCloud/vault-java-driver/blob/fef74b881b9f3620b68759f1b0d297591f80975e/src/main/java/com/bettercloud/vault/api/Auth.java#L838-L917)
What's the correct way to go about creating a signed request and passing along the signed data?
Using the golang SDK you could just create a request objet and then call ..sign on it. I was hoping there would be something similar in Java.
I have submitted an enhancement request for the Java SDK for that. Is there presently any other way to approach this? I want to avoid writing token renewal code and use STSAssumeRoleSessionCredentialsProvider for that
Hello,
For the SES API v2 (aws-java-sdk-sesv2) we should handle maximum sending rate per second error in the same way it was in SES API v1 (Throttling errorCode) (https://aws.amazon.com/blogs/messaging-and-targeting/how-to-handle-a-throttling-maximum-sending-rate-exceeded-error/) or in SES API v2 we should catch the TooManyRequestsException for the SendEmail operation (https://docs.aws.amazon.com/ses/latest/APIReference-V2/API_SendEmail.html) ?
For the SES API v2 (aws-java-sdk-sesv2) we should handle maximum sending rate per second error in the same way it was in SES API v1 (Throttling errorCode) (https://aws.amazon.com/blogs/messaging-and-targeting/how-to-handle-a-throttling-maximum-sending-rate-exceeded-error/) or in SES API v2 we should catch the TooManyRequestsException for the SendEmail operation (https://docs.aws.amazon.com/ses/latest/APIReference-V2/API_SendEmail.html) ?
2 replies
Thank you for your help
You can create a PR for our Docs Github Code examples here -- https://github.com/awsdocs/aws-doc-sdk-examples
Model :
@DynamoDBTable(tableName = "ignored")
data class PendingOrder(
@DynamoDBHashKey
var PK: String? = null,
@DynamoDBRangeKey
@DynamoDBIndexRangeKey(globalSecondaryIndexName = "pendingOrders")
var createdAt: String? = null,
@DynamoDBIndexHashKey(globalSecondaryIndexName = "pendingOrders")
var pending: Int? = null,
...
) open fun findPendingOrders(createdAt: String): List<PendingOrder>? {
val expression = DynamoDBQueryExpression<PendingOrder>()
.withConsistentRead(false)
.withIndexName("pendingOrders")
.withKeyConditionExpression("pending = :pending AND createdAt < :createdAt")
.withExpressionAttributeValues(
mapOf(
":pending" to AttributeValue().withN("1"),
":createdAt" to AttributeValue(createdAt)
)
)
return mapper.query(PendingOrder::class.java, expression)
}
Error i am getting :
PendingOrder; no mapping for HASH key: com.amazonaws.services.dynamodbv2.datamodeling.DynamoDBMappingException
com.amazonaws.services.dynamodbv2.datamodeling.DynamoDBMappingException: PendingOrder; no mapping for HASH key@DynamoDBTable(tableName = "ignored")
data class PendingOrder(
@get:DynamoDBHashKey(attributeName = "PK")
var PK: String? = null,
@get:DynamoDBRangeKey
@get:DynamoDBIndexRangeKey(globalSecondaryIndexName = "pendingOrders")
var createdAt: String? = null,
@get:DynamoDBIndexHashKey(globalSecondaryIndexName = "pendingOrders")
var pending: Int? = null,
fixes it
Hello. We have a spring boot application that allows file uploads which we are sending to s3 via aws-java-sdk. It is about to receive a lot of traffic in the very near future. We've been doing load testing and trying to improve the performance of many concurrent file uploads and it seems the upload to s3 is one of the bottlenecks. Our files are between 3-10mb, but there will be many many of them. We are in the process of implementing transfermanager, but I am doubtful that this will gain us much performance since the files themselves are mostly below the 5Mb limit. I've also read that it is not possible to use inputstreams to stream files directly to s3 via transfermanager (aws/aws-sdk-java#689) or at least that it won't improve performance. Is there a better way to improve performance for many concurrent file uploads?
I am trying to understand if two events in some way can be posted together using the SDK. We need to post multiple events concurrently and we can rely on another framework that calls the SDK to do that. Does the SDK do that ? I am not asking about transactions. Just code support.
We want to send two events to SQS. If one is not sent because we have a timeout we should let the other succeed.
We shouldn't let the other succeed.
Hi there, faced with a problem during uploading 100gb file to S3 using AmazonS3EncryptionClientV2 with multipart upload. After 65gb SDK throws exception. Docs says that by default CryptoMode.StrictAuthenticatedEncryption are used, and 2^36-32, or ~64G the maximum message size in bytes that can be encrypted. Is any other way to upload such files with client side encryption?
8 replies
Hi there. I need to run spark + hadoop on a k8 cluster using IAM roles for service accounts. I noticed the latest Hadoop version depends on an aws sdk version that does not have
WebIdentityTokenCredentialsProvider. I thought I'd try backporting WebIdentityTokenCredentialsProvider and related classes to the same version that Hadoop depends on and provide a custom build. That might make things work as I need. Does this sound like a reasonable thing to do? :)
2 replies
I am using TransferManager to upload file to s3 server. I am trying to reuse the instance of TransferManager for all my uploads. And at the end of upload i am trying to shutdown with false input parameter. However this only works for the first file upload. If i remove the shutdown, it works fine for all the files. I am wondering if it is good to not shutdown after the file is uploaded, will it create a memory leak? Or is there a way to startup the same TransferManager when a new file to be uploaded? Appreciate your help in the topic..
2 replies
How can I know programmatically that used AWS SDK version is compatible with any of the AWS region?
For eg. I am using the aws-java-sdk-cognitoidentity version 1.11.967 and if I want to check that given version supported in eu-west-1 region or not. How can I check?
2 replies
@/all Hello everyone! We have raised the SDK version from 1.11 to 1.12 in order to upgrade the version of the jackson dependencies. Check our blog post for additional info: https://aws.amazon.com/blogs/developer/aws-sdk-for-java-version-1-12/