Hello, I have created a pgcli/mycli-like command line tool for AWS Athena https://github.com/dbcli/athenacli , welcome to try it. ;)
Hi all! Is there a way for
aws s3 sync to throttle down disk I/O? My intention was to sync ~600 GB of pictures to S3, but every time I try to do that, the disk usage jumps up to 100% and makes a huge impact on the site operation. I saw in strace output that the tool walks recursively over the directory tree and collects stats, so I'd love to find a way to decrease the rate limit of those operations, if possible.
Thanks in advance!
@Like-all have you tried to reduce max_concurrent_requests https://docs.aws.amazon.com/cli/latest/topic/s3-config.html#max-concurrent-requests
hi! does anyone knows how to install python requirements on the AWS server that runs the lambda function? because I uploading modules like numpy that ware installed in a virtual env for mac to aws linux like it says in the documentation but this module has c compiled libraries that need to be installed on aws linux and not mac.
architecture question....
i have a docker image i want to use to "chunk" up large CSV files. what is the best feature on AWS to run and scale this on?
I want to be able to fire a payload to it from a lambda when it finds a file that is too big is detected in S3
have tried using fargate but we hit the 20 instances cap quite quickly
i have a docker image i want to use to "chunk" up large CSV files. what is the best feature on AWS to run and scale this on?
I want to be able to fire a payload to it from a lambda when it finds a file that is too big is detected in S3
have tried using fargate but we hit the 20 instances cap quite quickly
If the run the script from emr I won’t be needing the aws credentials but if I try the same in local system I need the credentials. Just a quick question, when you give the aws credentials using fs.s3a.access.key how does the pyspark program understand that those are meant for aws only?! Do I need to include any package as well for that? - still a noob in aws
Is it possible to set http headers on S3 objects using the aws cli?
in particular I have automated deployment to s3 where I would like to set the cache control header on one of the objects I create
i can't seem to find anything relevant
Hey everyone, what's a good way to get a list of all possible cloudtrail events that can be generated in AWS? According to this, the API names map to cloudtrail eventNames (https://forums.aws.amazon.com/thread.jspa?messageID=789434).
How to get a list of APIs from aws cli?
How to get a list of APIs from aws cli?
Hi there,
we are setting up an EKS and would love to see these very handy PRs merged:
aws/aws-cli#3683
aws/aws-cli#3684
Is the chat the right way for requesting a PR or is it preferred to contact the AWS support directly?
anyone can help me out in that
I have created my AWS account last year on July but I didn't link my card so now if I link it will I get 1 year free trial from now or from the date I have created my account?
Yes I have full control from that account. I even switched to the master account and got the same error. I found out that I can’t attach a policy. However if I go in the Console and click permissions Then ACL and set both ACLs to false then go to the individual object and set that object as public then I am able to view the site. But I am still unable to set any policy on the entire bucket. I wonder if this is a bad thing to do. I am new to AWS so please shed some light.
is this the right place to ask a question concerning AWS cloudfront redirection using S3 ?
I'm having some problems connecting to an instance of EB and my log is showing an SSL problem:
ERROR: URLError - <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:852)>
I believe its related to the load balancer in some way
@/all
Hello everyone
can you please suggest, while connecting or during sync of larger folders from source to s3 bucket, session timeouts occurs.I want to copy/sync 500 GB to s3 bucket...
do I have any possibilities to increase session timeout or reload a new session/tickets which is approx 1 hour?
can you please suggest, while connecting or during sync of larger folders from source to s3 bucket, session timeouts occurs.I want to copy/sync 500 GB to s3 bucket...
do I have any possibilities to increase session timeout or reload a new session/tickets which is approx 1 hour?
maybe with testing or documenting
The only thing I can find that looks like it might help is to..... create an AWS Config collection then look at the resources it finds. Problem is it doesn't find all resources and it only picks up what's in its region.
I receive that error a couple of times then it asks for codecommit y/n and whatever I do I get a few more of those warnings then nothing
