aws/aws-sdk-java

The official AWS SDK for Java. https://aws.amazon.com/sdkforjava

Mohit Hapani

@mohithapani

Hello - Is there a way we can run select object content (s3 select) on specific version of s3 object using version Id? I cannot find any references in select object content documentation to specify the version Id like we have version Id field in get Object request. Any help is appreciated?

2 replies

manasshukla

@manasshukla

Hi,
I am using the AWS SDKv2 to audit my S3 buckets. My S3 buckets are spread out across different regions. Is there a way to create a region agnostic S3 Client ? Or can we add more than one regions in the S3Client ? Since S3 bucket names are globally unique, S3Client should be self sufficient in the terms of figuring out which region a bucket is in. As I understand, we can query a bucket to know its location but that is an extra network call.

3 replies

Dave Brosius

@mebigfatguy_twitter

Hi folks, I'm using S3Client.builder()...build() and it's working fine, but i now need to configure proxy settings. I see documentation refering to a ClientConfiguration class, but i don't see that, or how you install it with the builder? Anyone point me in the right direction?

8 replies

Gaurav Rawat

@gauravbrills

A quick general question are sqs generated messageIds (UUID) unique . Can they be used as identifiers for the consuming system to figure our message uniqueness checks say for s3 event notifications . Also is there a chance of the consumer receiving a duplicate message id from a queue on 2 different messages.

manasshukla

@manasshukla

Hi All, I have a very basic question regarding S3 buckets. The API to get Server Side Encryption Rule s3Client.getBucketEncryption(bucketName).getServerSideEncryptionConfiguration().getRules() returns a List<ServerSideEncryptionRule>. Since there are no option of selection multiple Server Side Encryptions (The console has a radio button to select between various encryption types), why a list of Rules with just element is returned. Would it not have been a better API design to just return a ServerSideEncryptionRule instead of a list ?

Paolo Di Tommaso

@pditommaso

hi all, any suggestion to retrieve all buckets in a region without doing n+1 API calls (list all + bucket location for each one)?

Paolo Di Tommaso

@pditommaso

ok, not possible https://github.com/aws/aws-sdk-java/issues/920#issuecomment-261091731

manasshukla

@manasshukla

Hi All, I am trying to find a way to query S3 Bucket and check if the "Object-level logging" is enabled or disabled for that bucket. Any ideas how I can do that ?

murtuza boxwala

@tuzamama_twitter

Hi all, I am trying to build a client application using Cognito, but I would like the user to be logged into multiple "workspaces" at the same time, like slack. Amplify seems too restrictive because I think it stores the session as a singleton...is that correct? Do you think this should be possible using the Java SDK?

soumyathampi

@soumyathampi

Hi, I am creating a spot instance and I get instance ID returned as a string, now I need more details about this instance like the ipaddress, Can anyone help me here on how to do this. For a on demand instance I get an Instance object returned while creating the instance which has all these details. But not able to do the same for spot instance.

2 replies

aasifkhan7

@aasifkhan7

let's say at a path A/, I have uploaded, F1, F2, ... F30 in that order.
So, now we have A/F1, A/F2, A/F3, A/F4, ... A/F30.
Is there a way to upload objects to the s3 bucket at a path - let's say A/ maintaining the number of objects uploaded at that path only at a fixed number? for example, in this case, if I fix that number to 10, is there a way that when I'm updating F11, F1 will get deleted and when I'm uploading F12, F2 will get deleted and so on.. (keeping the number of objects within A as max 10)

Reza Nikoopour

@rnikoopour

Hey All,

I'm trying to create a signed request to use in the vault-java-driver (https://github.com/BetterCloud/vault-java-driver/blob/fef74b881b9f3620b68759f1b0d297591f80975e/src/main/java/com/bettercloud/vault/api/Auth.java#L838-L917)

What's the correct way to go about creating a signed request and passing along the signed data?

Using the golang SDK you could just create a request objet and then call ..sign on it. I was hoping there would be something similar in Java.

cpatelhealthfidelity

@cpatelhealthfidelity

Hi All, I am trying to pass session tags for STSAssumeRoleSessionCredentialsProvider but the builder STSAssumeRoleSessionCredentialsProvider.Builde does not provide any way to set the tags that can be passed during the STS assume role operation..

I have submitted an enhancement request for the Java SDK for that. Is there presently any other way to approach this? I want to avoid writing token renewal code and use STSAssumeRoleSessionCredentialsProvider for that

macportter

@macportter

Hello,
For the SES API v2 (aws-java-sdk-sesv2) we should handle maximum sending rate per second error in the same way it was in SES API v1 (Throttling errorCode) (https://aws.amazon.com/blogs/messaging-and-targeting/how-to-handle-a-throttling-maximum-sending-rate-exceeded-error/) or in SES API v2 we should catch the TooManyRequestsException for the SendEmail operation (https://docs.aws.amazon.com/ses/latest/APIReference-V2/API_SendEmail.html) ?

2 replies

qohat-lulo

@qohat-lulo

Hello,
I'm new here, so i don't wanna make you waste your time guys... I have a problem trying to connect multiple consumer to kinesis shard... Someone know how could i do it? I'm using Java

Thank you for your help

gilsharon321

@gilsharon321

Hi! Is there a way to be able to contribute code to this project? ( can I create a PR? )

Scott Macdonald

@scmacdon

You can create a PR for our Docs Github Code examples here -- https://github.com/awsdocs/aws-doc-sdk-examples

gilsharon321

@gilsharon321

and what about aws/aws-sdk-java ?

1 reply

Michael Brewer

@michaelbrewer

I am trying to query a table by a GSI and then update it and i am getting a no mapping for HASH key error

Model :

@DynamoDBTable(tableName = "ignored")
data class PendingOrder(
    @DynamoDBHashKey
    var PK: String? = null,
    @DynamoDBRangeKey
    @DynamoDBIndexRangeKey(globalSecondaryIndexName = "pendingOrders")
    var createdAt: String? = null,

    @DynamoDBIndexHashKey(globalSecondaryIndexName = "pendingOrders")
    var pending: Int? = null,
...
)

    open fun findPendingOrders(createdAt: String): List<PendingOrder>? {
        val expression = DynamoDBQueryExpression<PendingOrder>()
            .withConsistentRead(false)
            .withIndexName("pendingOrders")
            .withKeyConditionExpression("pending = :pending AND createdAt < :createdAt")
            .withExpressionAttributeValues(
                mapOf(
                    ":pending" to AttributeValue().withN("1"),
                    ":createdAt" to AttributeValue(createdAt)
                )
            )
        return mapper.query(PendingOrder::class.java, expression)
    }

Error i am getting :

PendingOrder; no mapping for HASH key: com.amazonaws.services.dynamodbv2.datamodeling.DynamoDBMappingException
com.amazonaws.services.dynamodbv2.datamodeling.DynamoDBMappingException: PendingOrder; no mapping for HASH key

Michael Brewer

@michaelbrewer

looks like it is a kotlin issue.

@DynamoDBTable(tableName = "ignored")
data class PendingOrder(
    @get:DynamoDBHashKey(attributeName = "PK")
    var PK: String? = null,
    @get:DynamoDBRangeKey
    @get:DynamoDBIndexRangeKey(globalSecondaryIndexName = "pendingOrders")
    var createdAt: String? = null,

    @get:DynamoDBIndexHashKey(globalSecondaryIndexName = "pendingOrders")
    var pending: Int? = null,

fixes it

springroll12

@springroll12

Hello. We have a spring boot application that allows file uploads which we are sending to s3 via aws-java-sdk. It is about to receive a lot of traffic in the very near future. We've been doing load testing and trying to improve the performance of many concurrent file uploads and it seems the upload to s3 is one of the bottlenecks. Our files are between 3-10mb, but there will be many many of them. We are in the process of implementing transfermanager, but I am doubtful that this will gain us much performance since the files themselves are mostly below the 5Mb limit. I've also read that it is not possible to use inputstreams to stream files directly to s3 via transfermanager (aws/aws-sdk-java#689) or at least that it won't improve performance. Is there a better way to improve performance for many concurrent file uploads?

Unstoppa博

@mytxz

Hello, I meet high CPU usage 100% problem when upload a large file about 800+MB to AWS s3 using aws-java-sdk-s3 1.11.731. I use TransferManager to upload the big file. Could you please tell me how to solve it?

r_mohan

@r_mohan_twitter

I am trying to understand if two events in some way can be posted together using the SDK. We need to post multiple events concurrently and we can rely on another framework that calls the SDK to do that. Does the SDK do that ? I am not asking about transactions. Just code support.

We want to send two events to SQS. If one is not sent because we have a timeout we should let the other succeed.

We shouldn't let the other succeed.

r_mohan

@r_mohan_twitter

Like a CompletableFuture's two stages are joined. We have SDK 1.x because SDK 2 does not have support for JMS listeners. May be I am wrong about this support.

Cristopher K. Pinzón Resendiz

@cristopher.pinzon_gitlab

Hi, can someone guide in how to run the sample codes?, I have tried with installing the package with mvn or opening the Kinesis Sample project and running ant but both fail

2 replies

igudkov-da

@igudkov-da

Hi there, faced with a problem during uploading 100gb file to S3 using AmazonS3EncryptionClientV2 with multipart upload. After 65gb SDK throws exception. Docs says that by default CryptoMode.StrictAuthenticatedEncryption are used, and 2^36-32, or ~64G the maximum message size in bytes that can be encrypted. Is any other way to upload such files with client side encryption?

8 replies

markocevar

@markocevar

Quick question, does the v1 SDK, create temporary files on the filesystem when uploading a file to the S3?

Jorge Aliss

@jaliss

Hi there. I need to run spark + hadoop on a k8 cluster using IAM roles for service accounts. I noticed the latest Hadoop version depends on an aws sdk version that does not have WebIdentityTokenCredentialsProvider. I thought I'd try backporting WebIdentityTokenCredentialsProvider and related classes to the same version that Hadoop depends on and provide a custom build. That might make things work as I need. Does this sound like a reasonable thing to do? :)

2 replies

AdityaPadhy

@AdityaPadhy

I am using TransferManager to upload file to s3 server. I am trying to reuse the instance of TransferManager for all my uploads. And at the end of upload i am trying to shutdown with false input parameter. However this only works for the first file upload. If i remove the shutdown, it works fine for all the files. I am wondering if it is good to not shutdown after the file is uploaded, will it create a memory leak? Or is there a way to startup the same TransferManager when a new file to be uploaded? Appreciate your help in the topic..

2 replies

Günter Platzer

@platzerg

hi all,
i am using amazon-sqs-java-messaging-lib.
is in SQSConnection some auto reconnection mechanism?
Thanks

pkalal

@pkalal:matrix.org

[m]

How can I know programmatically that used AWS SDK version is compatible with any of the AWS region?

For eg. I am using the aws-java-sdk-cognitoidentity version 1.11.967 and if I want to check that given version supported in eu-west-1 region or not. How can I check?

2 replies

Debora N. Ito

@debora-ito

@/all Hello everyone! We have raised the SDK version from 1.11 to 1.12 in order to upgrade the version of the jackson dependencies. Check our blog post for additional info: https://aws.amazon.com/blogs/developer/aws-sdk-for-java-version-1-12/

Kini

@Kini_Leo1_twitter

Hi guys, how can I know my default cluster in aws-eks?

2 replies

Sergej Andropov

@BeFoggy_gitlab

Hi there! Is it possible to use one presigned url for uploading multiple files?

rnaval

@rnaval

Hello! How can I get the StorageClass or StorageType values from an S3 Bucket?

JasonVoss

@JasonVoss

Hi, I am working on a bug fix and a feature from the issues. I read the contributing guidelines- can you please assign this to me? I see this is a good functionality to have. One of these was flagged for community support. The issues seem straightforward.
aws/aws-sdk-java#1648
aws/aws-sdk-java#2072

Dmytro Chasovskyi

@ChameleonTartu

Hi, I connected owasp plugin to my project and it complaints about these libraries:
[ERROR] aws-java-sdk-lexmodelsv2-1.12.128.jar: CVE-2020-36460
[ERROR] aws-java-sdk-prometheus-1.12.128.jar: CVE-2019-3826

There are 2 questions:

Are you planning to fix it any time soon? It seems the problem exists in a few versions now.
If not, what are workarounds to mitigate these vulnerabilities?

rnaval

@rnaval

Hello all! I'm currently trying to monitor the namespace AWS/Events via Cloudwatch. I noticed that there seems to be an undocumented dimension called EventBusName when I try to list metrics:

{
    "Metrics": [
        {
            "Namespace": "AWS/Events",
            "MetricName": "FailedInvocations",
            "Dimensions": [
                {
                    "Name": "EventBusName",
                    "Value": "test-event-bus"
                },
                {
                    "Name": "RuleName",
                    "Value": "test-rule-custom"
                }
            ]
        },
        {
            "Namespace": "AWS/Events",
            "MetricName": "Invocations",
            "Dimensions": [
                {
                    "Name": "EventBusName",
                    "Value": "test-event-bus"
                },
                {
                    "Name": "RuleName",
                    "Value": "test-rule-custom"
                }
            ]
        },
        {
            "Namespace": "AWS/Events",
            "MetricName": "TriggeredRules",
            "Dimensions": [
                {
                    "Name": "EventBusName",
                    "Value": "test-event-bus"
                },
                {
                    "Name": "RuleName",
                    "Value": "test-rule-custom"
                }
            ]
        }
    ]
}

The interesting this here is that when the event bus being used is the default event bus, this dimension disappears:

{
    "Metrics": [
        {
            "Namespace": "AWS/Events",
            "MetricName": "TriggeredRules",
            "Dimensions": [
                {
                    "Name": "RuleName",
                    "Value": "test-rule-default"
                }
            ]
        },
        {
            "Namespace": "AWS/Events",
            "MetricName": "Invocations",
            "Dimensions": [
                {
                    "Name": "RuleName",
                    "Value": "test-rule-default"
                }
            ]
        },
        {
            "Namespace": "AWS/Events",
            "MetricName": "FailedInvocations",
            "Dimensions": [
                {
                    "Name": "RuleName",
                    "Value": "test-rule-default"
                }
            ]
        }
    ]
}

Any idea on why this is the case? It looks like a bug, but keen to know if this is expected by any chance. Thanks!

Israel Perales

@ripper2hl

Hi , can you help me with this problem?

javax.net.ssl.SSLProtocolException: Connection reset

i used java sdk for download videos

<dependency>
            <groupId>com.amazonaws</groupId>
            <artifactId>aws-java-sdk</artifactId>
            <version>1.11.920</version>
        </dependency>

I don't watch any deprecation message for this version of SDK but today I can't download any video of my s3 bucket :(

Faiz Kidwai

@fykidwai

Hi, In TransferManager for multipart upload, is there any performance difference (upload time) when using InputStream or File?

Where communities thrive

People

Repo info

Activity