Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • Jan 31 2019 05:57
    bergkampsliew opened #383
  • Jan 31 2019 05:12
    bergkampsliew opened #382
  • Jan 30 2019 23:37
    jantman commented #379
  • Jan 30 2019 23:36

    jantman on develop

    ensure 100% coverage Merge pull request #381 from ja… (compare)

  • Jan 30 2019 23:35

    jantman on 6.1.0

    (compare)

  • Jan 30 2019 23:34
    jantman unlabeled #380
  • Jan 30 2019 23:34
    jantman unlabeled #381
  • Jan 30 2019 23:34

    jantman on 380

    (compare)

  • Jan 30 2019 23:34
    jantman closed #380
  • Jan 30 2019 23:34

    jantman on master

    Add Network interfaces per Regi… Set ENI limit type to AWS::EC2:… Update ENI limit from API if 5x… and 7 more (compare)

  • Jan 30 2019 23:34
    jantman closed #381
  • Jan 30 2019 23:34
    codecov-io commented #381
  • Jan 30 2019 23:33
    codecov-io commented #381
  • Jan 30 2019 23:33
    codecov-io commented #381
  • Jan 30 2019 23:33
    codecov-io commented #381
  • Jan 30 2019 23:32
    codecov-io commented #381
  • Jan 30 2019 23:32
    codecov-io commented #381
  • Jan 30 2019 23:32
    codecov-io commented #381
  • Jan 30 2019 23:32
    codecov-io commented #381
  • Jan 30 2019 23:31
    codecov-io commented #381
Jason Antman
@jantman
ah ok
so there are only some limits that you can get from Trusted Advisor or the APIs
for any limits not marked with a check for TrustedAdvisor or API, you'll need to manually specify your current limit
DashuShiel
@DashuShiel
Yes, thanks! 🙏 your tool is very helpful!
Jason Antman
@jantman
thanks! I'm glad it's useful
rushinbarot
@rushinbarot

Hi, I have started using awslimitchecker. some of the values like ec2 running-on-demand-m4_2xlarge-instances those are not being updated. like in my account I have the limit set to 100 but still, it shows default limit.
here is my setup

checker = AwsLimitChecker(
warning_threshold=60, critical_threshold=80, region=region, profile_name=profile,
ta_refresh_mode=21600, ta_refresh_timeout=3600
)

ec2 running-on-demand-m4_2xlarge-instances (82.0) (limit=20.0)

Jason Antman
@jantman
Once again, if you need support or have questions, please open an issue on GitHub
that particular limit can only be updated automatically if you have Trusted Advisor
@rushinbarot ^^^
unless you have Trusted Advisor, there is no programmatic way to tell what your current limit is. You'll need to manually provide an override for it
rushinbarot
@rushinbarot
Thanks @jantman for the response. I do have trusted advisor.
Jason Antman
@jantman
ok. sure.
rushinbarot
@rushinbarot
For now i have manually overriding-limits. Thanks
dinesh_repo
@dineshrathee12
Hi Guys,
pritam2277
@pritam2277
Hi Guys,
I am just starting to explore awslimitchecker. I have two questions.
  1. Does awslimitchecker works for accounts with basic support?
  2. For awslimitchecker module to work, it needs certain minimum IAM permissions as mentioned here(https://awslimitchecker.readthedocs.io/en/latest/iam_policy.html) . Can we modify this permissions as some of this services are scp denied in my organization?
Jason Antman
@jantman
Yes, it definitely works with basic support.
@pritam2277 That minimum policy is the minimum needed for all features of awslimitchecker to work. You can certainly modify the policy it runs under, but you'll need to be aware of the impacts of that. For example, if you deny "SES" permissions, you'll need to also tell awslimitchecker not to check SES limits, or it will error.
pritam2277
@pritam2277
@jantman Thanks for the response. This is helpful.
pritam2277
@pritam2277
Hi, I am getting throttling exception from service quota while performing list-service-quota operation. I am thinking of increasing default retries from four to 8 as below.
os.environ["BOTO_MAX_RETRIES_service-quotas"] = "8" .
Is that it? Do we need to pass this environment variable to any method?
Thanks!
JerryFeng
@JerryFengChn

Hi @jantman , I'm based in China, Installed the awslimitchecker version 10.0.0, When query the EC2 limit , it returns error. Could you please check when you have time , thank you .

2021-01-22 17:08:17,268 [INFO trustedadvisor.py:147 - awslimitchecker.trustedadvisor.update_limits() ] Not using Trusted Advisor in regions outside of China or GovCloud; export FORCE_USE_TA=true to override.
2021-01-22 17:08:17,272 [INFO connectable.py:119 - awslimitchecker.connectable.connect() ] Connected to ec2 in region cn-northwest-1
2021-01-22 17:08:17,285 [INFO connectable.py:139 - awslimitchecker.connectable.connect_resource() ] Connected to ec2 (resource) in region cn-northwest-1
2021-01-22 17:08:17,285 [INFO ec2.py:440 - awslimitchecker.services.ec2._update_limits_from_api() ] Querying EC2 DescribeAccountAttributes for limits
2021-01-22 17:08:17,286 [DEBUG connectionpool.py:957 - urllib3.connectionpool._new_conn() ] Starting new HTTPS connection (1): ec2.cn-northwest-1.amazonaws.com.cn:443
2021-01-22 17:08:18,384 [DEBUG connectionpool.py:428 - urllib3.connectionpool._make_request() ] https://ec2.cn-northwest-1.amazonaws.com.cn:443 "POST / HTTP/1.1" 200 1716
Traceback (most recent call last):
File "/home/aa100521/limitchecker/bin/awslimitchecker", line 8, in <module>
sys.exit(console_entry_point())
File "/home/aa100521/limitchecker/lib/python3.8/site-packages/awslimitchecker/runner.py", line 550, in console_entry_point
r.console_entry_point()
File "/home/aa100521/limitchecker/lib/python3.8/site-packages/awslimitchecker/runner.py", line 520, in console_entry_point
res, problems, problem_str = self.check_thresholds(metrics)
File "/home/aa100521/limitchecker/lib/python3.8/site-packages/awslimitchecker/runner.py", line 332, in check_thresholds
problems = self.checker.check_thresholds(
File "/home/aa100521/limitchecker/lib/python3.8/site-packages/awslimitchecker/checker.py", line 631, in check_thresholds
cls._update_limits_from_api()
File "/home/aa100521/limitchecker/lib/python3.8/site-packages/awslimitchecker/services/ec2.py", line 445, in _update_limits_from_api
val = attrib['AttributeValues'][0]['AttributeValue']
IndexError: list index out of range

kevinLFGregory
@kevinLFGregory
Hey folks, New hear. I am looking to deploy awslimitchecker to on of our EKS clusters. I might add, that my knowledge of EKS is rather limited. I have done some EKS work, but as for installing awslimitchecker to an EKS cluster. It feels like I would have better luck going to the moon. :-)
I have a cluster set up that I can work on installing that is in my aws sandbox, so I was able to get that far. Now just to get this installed is my next trip to the moon. (so to speak)
ksuhakua
@ksuhakua
Hello guys. has anyone tried to integrate awslimitchecker with existing Prometheus server? I see here is an example of exporting metrics to Prometheus server which is started locally https://github.com/felixkrohn/awslimitchecker/blob/master/docs/examples/prometheus.py
How can I modify it to send metrics to remote server?
Jason Antman
@jantman
I know there's a PR in for Prometheus AlertManager... I assume that's something different?
I'm not sure how to modify it to not start a local server though, you'd need to read the documentation of the prometheus_client package...
ksuhakua
@ksuhakua
It can work with AlertManager, as for official example it has start_http_server but i don't see how I can edit it to send metrics to remote Prometheus or AlertManager, I expect a post action or should node-exporter be used somehow?
Jason Antman
@jantman
I've never used prometheus in my life, sorry, so I know very little about this...
All I know is that https://github.com/jantman/awslimitchecker/blob/master/docs/examples/prometheus.py#L6 is:
from prometheus_client import start_http_server, Summary, Gauge
and then on line 27 ( https://github.com/jantman/awslimitchecker/blob/master/docs/examples/prometheus.py#L27 ) we're calling:
start_http_server(port)
I can only imagine that the prometheus_client library has a method for setting up a client to an existing remote server, instead of running a local one
it appears that prometheus_client is this: https://github.com/prometheus/client_python
so I think you'd need to look there, to figure out how to do what you want
ksuhakua
@ksuhakua
ok, thank you @jantman
Jason Antman
@jantman
sure. sorry I can't really be of more help, but I know essentially nothing about Prometheus at all, other than it's a thing that does something with metrics.
Zakii Rétchii
@adrzod:matrix.org
[m]
Hello All, i am a new user of awslimitchecker, can someone juste paste an explicit python code with ak/sk account configuration just for me to test on my side! i m kindof lost 😕
Thanks
Jason Antman
@jantman
if you're using access key / secret key directly, they should be loaded automatically the way normal AWS SDKs do - from environment variables or your config file or whatever
Zakii Rétchii
@adrzod:matrix.org
[m]
Thank you for the quick response, do you mean something like the following would work ?
c = AwsLimitChecker(aws_access_key_id="toto", aws_secret_access_key="tata",region='us-east-1')
result = c.get_limits()
Jason Antman
@jantman
sorry, I didn't see that other message.
please read the documentation. There's a whole section on credentials: https://awslimitchecker.readthedocs.io/en/latest/getting_started.html#credentials
Zakii Rétchii
@adrzod:matrix.org
[m]
thanks a lot 😊
Jason Antman
@jantman
sure
kevinLFGregory
@kevinLFGregory
HI All, I am new to not only Limitchecker but to coding itself, and I have been working through installing this in an environment and I have hit a wall. I was getting an error that the default region not being specified and Managed to plug that in during the deployment on my EKS cluster. Now I am getting an error that the user does not have assume roll permissions. botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the AssumeRoleWithWebIdentity operation: Not authorized to perform sts:AssumeRoleWithWebIdentity I have a service that is created in the code pipe line and that service is given complete control to the cluster, so I am not sure if the permission issue is on the side of EKS or there is more permissions that have to be created while deploying the Limitchchecker pod on EKS? I am so close to getting this running, but hit this snag. Help. Please? :-)
Jason Antman
@jantman
I've never used EKS, sorry. AssumeRoleWithWebIdentity seems very wrong to me, as that's usually for use by a human, not an automated process. It might be easier to look into the Fargate example: https://github.com/jantman/awslimitchecker/tree/master/docs/examples/terraform-fargate
kevinLFGregory
@kevinLFGregory
Thank you ever so much for the input