@hexylena:matrix.org sorry, I got yanked away to a meeting in the middle of typing up my reply…. do you have a link to an example (Terraform, IAM, GitHub)? The only real issue is the credentials and the Jetstream allocation; I have Anisble playbooks and Terraform manifests for creating VMs, but I only have access to a “dev” allocation on Jetstream and I will need to do some cleaning to make space before launching any more instances.
Enis is away on holidays this week, but I will ask him about requesting an increase in our dev allocation or requesting a separate allocation that we can use for release testing.
I spun up three VMs can be used admin testing. I can spin up more or ones with a different OS (these have Ubuntu 20.04) if needed. User name is "ubuntu". I will send you the SSH key in a DM. 220.127.116.11 18.104.22.168 22.214.171.124
It should be relatively straight-forward to take the Terraform stuff from admin training (and/or the eu infra) and stick it into a GitHub Action to get a system that creates clusters on demand; merge a PR, get a cluster.
honestly the other answer is: find a way to remove SSL, then we can run the entire set of tutorials on the github runner
no VMs needed.
That works for testing the tutorials, but I actually want this infra for another long term project I am working on. I want to borrow as much as I can from git-gat, combine it with the GalaxyBenchmarker one of Björn's students wrote, and run a bunch of benchmarks on non-trivial amounts of data on various cluster configurations on AWS, GCP, and Jetstream.
so we've already got a lot of that in the admin training repo. we've got:
the bootstrapping playbooks (necessary)
the terraform playbooks to setup DNS for individual machines (the terraform files to launch machines were temporarily in another repo until I could get terraform to behave with multiple openstacks configured simultaneously)
the testing scripts
you can also push secrets there, I assume.
https://github.com/galaxyproject/admin-training/ if there's a chance you want to work in there, it's already got a lot of the infrastructure and secrets setup necessary for testing admin training and it'd be the easiest place to finish it. (Also I've already started there.) If you want to pull it out into another repo separate from that's fine, but, it would be a lot of extra work for me to re-set everything up
The one on the 25th definitely won't be happening. AFAIK the one on the 11th was still on, though.
I just looked at the roundtable schedule and I am super interested in Alex’s talk on 11/11 and don’t want to take away any of his time. That leaves encroaching on Marius on 12/9. Any presentation would be 5-10 minutes with 2-5 slides: we ran some tests, we found some bugs.