cristim/autospotting

Automatically replace AWS EC2 instances in AutoScaling groups with cheapest compatible spot instances https://autospotting.org

Cristian M.S.

@cristim

so far I sent it as a draft, but it seemed to work well in my initial tests

I used the new Spot FIS integration to try it out

mello7tre

@mello7tre

Sure, on Monday i will look at the code and begin to test it in my dev env.
Thanks @cristim for this really useful new feature.

Cristian M.S.

@cristim

@mello7tre happy to have finally been able to work on this, it turned out much easier to do than I expected, the code changes are relatively small for such an impactful feature

Naggappan

@naggappan

Hi i have a quick question, what is the advantage of using Autospotting, when we already have spot instance percentage option while creating a new auto-scaling / editing an existing autoscalig group from aws UI?

Cristian M.S.

@cristim

Thanks for your interest in AutoSpotting, Naggappan

It's more about migration of existing on demand Autoscaling groups to Spot without having to drive configuration changes to lots of groups

Also there are benefits like the failover to on-demand instances in the rare occasions when failing to launch any spot instances, and the upgrade of storage volumes from GP2 to GP3

But quick adoption at scale is the main reason why people adopt AutoSpotting, especially in mid to large organizations

Cristian M.S.

@cristim

I've seen it used at organizations that adopted it over 100+ aws accounts and converted a good percentage of their fleet to Spot literally overnight

Naggappan

@naggappan

ok thanks for the info

Cristian M.S.

@cristim

@naggappan How many groups and aws accounts do you have?

Cristian M.S.

@cristim

You can also join us on Slack at https://join.slack.com/t/cloudutil/shared_invite/zt-xodcoi9j-1IcxNozXx1OW0gh_N08sjg since we no longer hang out in here so much

Naggappan

@naggappan

thanks i will join in that group

Naggappan

@naggappan

hi team i tried to run your code and this is the error i am getting, any idea on how to fix it?

[TSS\nramukannan@a-m9zs8coj0bb5 AutoSpotting]$ docker-compose run autospotting
Building autospotting
Step 1/6 : FROM golang:alpine
---> dd6fd110e957
Step 2/6 : ARG flavor
---> Using cache
---> 710224afc66b
Step 3/6 : RUN apk add -U --no-cache ca-certificates git make
---> Running in 143d331cf9df
fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/APKINDEX.tar.gz
WARNING: Ignoring https://dl-cdn.alpinelinux.org/alpine/v3.15/main: temporary error (try again later)
fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/community/x86_64/APKINDEX.tar.gz
WARNING: Ignoring https://dl-cdn.alpinelinux.org/alpine/v3.15/community: temporary error (try again later)
ERROR: unable to select packages:
git (no such package):
required by: world[git]
make (no such package):
required by: world[make]
ERROR: Service 'autospotting' failed to build: The command '/bin/sh -c apk add -U --no-cache ca-certificates git make' returned a non-zero code: 2

i used the command "docker-compose run autospotting"

also in docker-compose.yaml how should i add below values?
environment:

      - AWS_ACCESS_KEY_ID
      - AWS_SECRET_ACCESS_KEY
      - AWS_SESSION_TOKEN

just replace the AWS_ACCESS_KEY_ID with my actual key ? actually in IAM i have only 2 values ACCESS_KEY _ID and SECRET_ACCESS_KEY, there is not session token so what should I use?

Cristian M.S.

@cristim

Let's continue on Slack

ilaysimon

@ilaysimon

hi,
i get this error :
RequestId: 022d7c8a-9b7f-489a-aa95-573202c29506 Error: fork/exec ./AutoSpotting: exec format error
Runtime.InvalidEntrypoint
i did all with cloudformation , an open source way

Cristian M.S.

@cristim

Make sure you use the image of the right CPU architecture

ilaysimon

@ilaysimon

i use this image

Architecture ARM64

what can i do in order to fix the error? :)

ilaysimon

@ilaysimon

ok, i changed to x86_64

its fix the error, but now i get new error

Autospotting expired, please install a newer nightly version, build it from source or get a stable build.

and you can see that i installed the newer nightly version from dockerhub

Cristian M.S.

@cristim

The Docker Hub image is no longer supported, please build it from source code or use the AWS marketplace build

I'll try to delete it altogether and document this situation

ilaysimon

@ilaysimon

Thanks for the quick response

ilaysimon

@ilaysimon

can you please explain me how to set up all with the source code? do you have any tutorial or something like that?

Cristian M.S.

@cristim

It's documented on the github repo

I only offer support for the marketplace builds

ilaysimon

@ilaysimon

https://github.com/cloudutil/AutoSpotting/blob/master/CUSTOM_BUILDS.md
this is the document?

Cristian M.S.

@cristim

Yes, I'd love to see a PR addressing any issues or inaccuracies in the documentation

ilaysimon

@ilaysimon

What is the validity of the license if i build it from source code?

Cristian M.S.

@cristim

I think 100 years

ilaysimon

@ilaysimon

are you sure?

Cristian M.S.

@cristim

The expiration year is 2122

Cristian M.S.

@cristim

But I'd love to hear why isn't the marketplace build a viable option for you, do you consider the 5% of the savings too much?

And what would be an acceptable amount for you

ilaysimon

@ilaysimon

i am a Technical person, it's company issue.
if you want you can talk privately with my manger

Where communities thrive

People

Repo info

Activity