aws/aws-sdk-go

AWS SDK for the Go programming language.

Vivek Singh

@viveksinghggits

@PravinRanjan10 did you try changing the region to us-east-1

1 reply

Petro

@pgbce

Looking for a basic lambda golang producer.
I've seen the implementation using https://github.com/a8m/kinesis-producer. But I'm looking for a basic implementation for PutRecord.
I keep getting a timeout between lambda->kinesis stream.
I've went through this - https://aws.amazon.com/premiumsupport/knowledge-center/kinesis-data-streams-lambda-invocation/ and the current lambda function execution time is 90s and memory is at 512mb (tried with 1024mb)...
Full Kinesis Permissions seem to be set on lambda execution role...
DescribeStream also fails. So it keeps pointing me back to Permissions but nothing in CloudWatch..
*the kinesis client is set, able to log the details out.

Chih-Chieh

@cch0

Currently running into issue with error message SignatureDoesNotMatch: Credential should be scoped to a valid region, not 'us-gov-east-1' when using Terragrunt trying to create IAM policy in Gov. This line may (?) suggest we can only use us-gov-west-1 for IAM resources. Looking for guidance on how I can either create or reference IAM resources if I am authenticated to us-gov-east-1 region.

Adnan Rashid

@arashid290

hi - does anyone here use selenium? any ideas how to get extensions to load on Chrome when running an automated test via the CLI?

ilu123

@ilu123

hello, I have setup s3 endpoint for my VPC and I can download the file object directly via Ec2's curl without creds, then I wanna call the s3 GetObject API in the EC2 using this SDK without setting creds, but it got error:

operation error S3: GetObject, failed to sign request: failed to retrieve credentials: no EC2 IMDS role found, operation error ec2imds: GetMetadata, http response error StatusCode: 404, request to EC2 IMDS failed

. Can anyone help me? thanks

salim6655

@salim6655

Anyone please assiist with "func (c CloudFormation) ListStacks(input ListStacksInput) (*ListStacksOutput, error)"

what is the "input" parameter to be used here

any examples would be of help

kumar-shrey

@kumar-shrey

hi, I am looking for API to consume events from event bridge. I am using Redshift Data API ExecuteStatement with WithEvent flag as true. and want to listen to completion event. Any example would be helpful

Lulu

@404cn

hi, I am trying to use cloudwatch event to monit Exposed AccessKey, and looking for API to get this info if this event is trigger.

Does this sdk have that func?

Thoufic

@LEDgEr67

Hi, I am trying to create a Lambda function that is triggered through dynamoDB Streams on data modify and updating new data to the Elastic Search in "Golang" can anyone help me with boiler plate code

vincent youmans

@vinceyoumans

I am looking for an example golang cli app ( using cobra for example) that makes a call to a GoLang Lambda. anything out there?

pradeepp28

@pradeepp28

Currently I am using aws s3manager BatchUploadIterator to upload all files we have in multipart form, how do we do this in aws-sdk-go-v2?
I searched the documentation, couldn't find the similar one in aws-sdk-go-v2

jimmason1001

@jimmason1001

how do I retrieve the data from the test full stack serverless stack?

Bipin

@BipinRPandey_twitter

How can i execute simple select query in Redshift using Go (Redshift Data API)
Also, Can one help me resolving error while installing package - "go get github.com/aws/aws-lambda-go"
Error - go get: module github.com/aws/aws-lambda-go: Get "https://proxy.golang.org/github.com/aws/aws-lambda-go/@v/list": dial tcp: i/o timeout

fezekilePlaatyi

@fezekilePlaatyi

Hello, How to make a timestamp field on AWS Console for date on custom fields?

nallasai

@nallasai

Hi, Are there any code example of the RequestRetryer interface? I'm trying to use retries to fix 'Rate limiting' and throttling errors while making IAM API calls.

1 reply

Cristian Spinetta

@cspinetta

Hi everyone!
With my team we are building a reverse proxy to intercept all outgoing requests to S3 in order to audit and control the access from the different apps.
We've successfully implemented almost all operations by streaming the content of the files. For instance, to upload with single operation we used the s3manager.Uploader to stream the body of the incoming request (which is an io.Reader) to S3 and to download (both single and multipart flavor) we used the primitive io.Copy to write the response from the ´s3.GetObjectOutput.Body´ (which is an io.ReadCloser).
The only operation we still couldn't implement via streaming was the upload-part (in the context of a multipart uploading). The problem is that s3.UploadPartInput needs a aws.ReadSeekCloser and to pass the body of the incoming request you need to buffer it in some place (for example, in memory). Is there a way to stream an incoming request of an UploadPart with no need to store the entire body in memory?

Cristian Spinetta

@cspinetta

Hi everyone!
With my team we are building a reverse proxy to intercept all outgoing requests to S3 in order to audit and control the access from the different apps.
We've successfully implemented almost all operations by streaming the content of the files. For instance, to upload with single operation we used the s3manager.Uploader to stream the body of the incoming request (which is an io.Reader) to S3 and to download (both single and multipart flavor) we used the primitive io.Copy to write the response from the ´s3.GetObjectOutput.Body´ (which is an io.ReadCloser).
The only operation we still couldn't implement via streaming was the upload-part (in the context of a multipart uploading). The problem is that s3.UploadPartInput needs a aws.ReadSeekCloser and to pass the body of the incoming request you need to buffer it in some place (for example, in memory). Is there a way to stream an incoming request of an UploadPart with no need to store the entire body in memory?

just in case, here I asked this question: https://stackoverflow.com/q/67624774/3392786

SathiyaraJ

@sathiit_twitter

hi , how we can set the custom type attribute value in dynamodb.attributeValue? in golang

"ID": {
S: aws.String(<custom type here>),
},

avexbesuke

@avexbesuke

https://docs.aws.amazon.com/sdk-for-go/api/service/cloudfront/sign/#URLSigner.Sign
Hi, func (URLSigner) Sign If I specify a custom domain as the argument url for this method, will it still return the signed URL?
For example, "https://xxx.co.us" + s3ObjectKey.

zhu jun

@SozzzZ_gitlab

InvalidClientTokenId: The security token included in the request is invalid.

how can i get the true tiken

Cristian M.S.

@cristim

did anyone try to parse the pricing API data in into a native Go object? I'm having a hard time with this

{"product":{"productFamily":"Storage","attributes":{"storageMedia":"SSD-backed","maxThroughputvolume":"1000 MiB/s","volumeType":"Provisioned IOPS","maxIopsvolume":"64000","servicecode":"AmazonEC2","usagetype":"EBS:VolumeUsage.io2","locationType":"AWS Region","volumeApiName":"io2","location":"US East (N. Virginia)","servicename":"Amazon Elastic Compute Cloud","maxVolumeSize":"16 TiB","operation":""},"sku":"6V576P37PS7K7KYU"},"serviceCode":"AmazonEC2","terms":{"OnDemand":{"6V576P37PS7K7KYU.JRTCKXETXF":{"priceDimensions":{"6V576P37PS7K7KYU.JRTCKXETXF.6YS6EN2CT7":{"unit":"GB-month","endRange":"Inf","description":"$0.125 per GB-month of Provisioned IOPS SSD (io2)  provisioned storage - US East (Northern Virginia)","appliesTo":[],"rateCode":"6V576P37PS7K7KYU.JRTCKXETXF.6YS6EN2CT7","beginRange":"0","pricePerUnit":{"USD":"0.1250000000"}}},"sku":"6V576P37PS7K7KYU","effectiveDate":"2021-07-01T00:00:00Z","offerTermCode":"JRTCKXETXF","termAttributes":{}}}},"version":"20210709001917","publicationDate":"2021-07-09T00:19:17Z"}

and json-to-go gives this output

type AutoGenerated struct {
    Product struct {
        ProductFamily string `json:"productFamily"`
        Attributes    struct {
            StorageMedia        string `json:"storageMedia"`
            MaxThroughputvolume string `json:"maxThroughputvolume"`
            VolumeType          string `json:"volumeType"`
            MaxIopsvolume       string `json:"maxIopsvolume"`
            Servicecode         string `json:"servicecode"`
            Usagetype           string `json:"usagetype"`
            LocationType        string `json:"locationType"`
            VolumeAPIName       string `json:"volumeApiName"`
            Location            string `json:"location"`
            Servicename         string `json:"servicename"`
            MaxVolumeSize       string `json:"maxVolumeSize"`
            Operation           string `json:"operation"`
        } `json:"attributes"`
        Sku string `json:"sku"`
    } `json:"product"`
    ServiceCode string `json:"serviceCode"`
    Terms       struct {
        OnDemand struct {
            SixV576P37PS7K7KYUJRTCKXETXF struct {
                PriceDimensions struct {
                    SixV576P37PS7K7KYUJRTCKXETXF6YS6EN2CT7 struct {
                        Unit         string        `json:"unit"`
                        EndRange     string        `json:"endRange"`
                        Description  string        `json:"description"`
                        AppliesTo    []interface{} `json:"appliesTo"`
                        RateCode     string        `json:"rateCode"`
                        BeginRange   string        `json:"beginRange"`
                        PricePerUnit struct {
                            Usd string `json:"USD"`
                        } `json:"pricePerUnit"`
                    } `json:"6V576P37PS7K7KYU.JRTCKXETXF.6YS6EN2CT7"`
                } `json:"priceDimensions"`
                Sku            string    `json:"sku"`
                EffectiveDate  time.Time `json:"effectiveDate"`
                OfferTermCode  string    `json:"offerTermCode"`
                TermAttributes struct {
                } `json:"termAttributes"`
            } `json:"6V576P37PS7K7KYU.JRTCKXETXF"`
        } `json:"OnDemand"`
    } `json:"terms"`
    Version         string    `json:"version"`
    PublicationDate time.Time `json:"publicationDate"`
}

any clues how to handle the OnDemand and PriceDimensions structs?

Cristian M.S.

@cristim

I ended up doing some regex replaces on those SKU values before unmarshaling, this is so fugly

Cristian M.S.

@cristim

I finally got some code able to parse the EBS pricing and expose it in a more user-friendly format, if anyone is interested in this please let me know, I will eventually open source it but I can share it earlier upon demand

Pragyan Aryal

@pragyanaryal

Hello Can anyone help me using Cognito Admin API using aws-sdk-go-v2

I get the error no EC2 IMDS role found

I can Create users using the API, client.SignUp

But, cannot get the user using API, client.AdminGetUser

Yuval Lifshitz

@yuvalif

Hi,
I'm looking for a way to set the signature version explicitly for a client. found documentation for various SDKs, but not for golang
https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingAWSSDK.html#specify-signature-version

@jkgithubrepo

Hi,
I am trying to use AWS SDK for Go to implement S3 apis to connect with third party storage provider (Dell OneFS) who support S3 API. First in place, is AWS SDK is tightly coupled with AWS or it can be used to connect with any storage provider who support S3 API? If so, can someone help me to configuring the target host and other details?

Thanks
JK

Yuval Lifshitz

@yuvalif

you can connect to any storage that supports S3. e.g. i use it to connect to object storage gateway of Ceph (https://ceph.io/en/)
I use the NewSession() call from: github.com/aws/aws-sdk-go/aws/session
you pass it a NewConfig() with endpoint, credentials, region, and all other parameters pointing to your storage provider

@jkgithubrepo

Thank you Yuval, for the response on this. Let me check and confirm on this.

@jkgithubrepo

Yuval, it's working... great thanks for your help on this... it is really appreciated...

@jkgithubrepo

Hi yuvalif, when I am uploading document bucket name is appended to the Put request. Getting error "RequestError: send request failed
caused by: Put "http://bucketname.hostname.com:9020/uploaddoc.pdf": dial tcp: lookup bucketname.hostname.com: no such host"

Did you face such problem? how to avoid appending bucketname in the url? or is there any other work around?

Yuval Lifshitz

@yuvalif

yes , had this problem :-)
use: WithS3ForcePathStyle(true) in the config, so that the bucket name would appear in the "path" and not the "host"

@jkgithubrepo

@yuvalif you are the saviour :) it worked. I am not getting what they are coming to say when I am reading aws documentation for this method. I felt the documentation is not clear... Thanks a lot for the help on this...

@jkgithubrepo

@yuvalif , I am setting some user defined metadata while uploading a file. How to retrieve these metadata using Go SDK?

Yuval Lifshitz

@yuvalif

@JK sorry, don't know about that

Cristian M.S.

@cristim

Is there any tooling to help with migration of a relatively large project from v1 to v2?

puvvadav

@puvvadav

Hi, does aws-sdk-go accepts . (dot) as part of keys ?

puvvadav

@puvvadav

How to pass session token while creating new session ?

Nilesh Akhade

@TheNilesh

Can someone help me with documentation on guidelines for retrying s3 upload on error?

What kind of errors is retriable?
Detecting "SlowDown" and stopping retries?

    uploader := s3manager.NewUploader(sess)
    _, err := uploader.Upload()

1 reply

Where communities thrive

People

Repo info

Activity