Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    Helena Rasche
    @hexylena:matrix.org
    [m]
    but whatever works for y'all is fine for me :)
    Keith Suderman
    @ksuderman
    @hexylena:matrix.org sorry, I got yanked away to a meeting in the middle of typing up my reply…. do you have a link to an example (Terraform, IAM, GitHub)? The only real issue is the credentials and the Jetstream allocation; I have Anisble playbooks and Terraform manifests for creating VMs, but I only have access to a “dev” allocation on Jetstream and I will need to do some cleaning to make space before launching any more instances.
    Enis is away on holidays this week, but I will ask him about requesting an increase in our dev allocation or requesting a separate allocation that we can use for release testing.
    1 reply
    Keith Suderman
    @ksuderman
    I spun up three VMs can be used admin testing. I can spin up more or ones with a different OS (these have Ubuntu 20.04) if needed. User name is "ubuntu". I will send you the SSH key in a DM.
    129.114.16.211
    129.114.16.161
    129.114.16.172
    It should be relatively straight-forward to take the Terraform stuff from admin training (and/or the eu infra) and stick it into a GitHub Action to get a system that creates clusters on demand; merge a PR, get a cluster.
    2 replies
    Helena Rasche
    @hexylena:matrix.org
    [m]
    Sure, I've pasted it here. I really love terraform haha. https://gist.github.com/hexylena/9beb7ca8d19e4b82fd636a766d8c47d5
    Helena Rasche
    @hexylena:matrix.org
    [m]
    yep, can get in.
    I'll setup a job in admin-training github actions and we should be sorted for now :)
    Helena Rasche
    @hexylena:matrix.org
    [m]
    honestly the other answer is: find a way to remove SSL, then we can run the entire set of tutorials on the github runner
    no VMs needed.
    Keith Suderman
    @ksuderman
    That works for testing the tutorials, but I actually want this infra for another long term project I am working on. I want to borrow as much as I can from git-gat, combine it with the GalaxyBenchmarker one of Björn's students wrote, and run a bunch of benchmarks on non-trivial amounts of data on various cluster configurations on AWS, GCP, and Jetstream.
    Helena Rasche
    @hexylena:matrix.org
    [m]
    so we've already got a lot of that in the admin training repo. we've got:
    • the bootstrapping playbooks (necessary)
    • the terraform playbooks to setup DNS for individual machines (the terraform files to launch machines were temporarily in another repo until I could get terraform to behave with multiple openstacks configured simultaneously)
    • the testing scripts
    you can also push secrets there, I assume.
    https://github.com/galaxyproject/admin-training/ if there's a chance you want to work in there, it's already got a lot of the infrastructure and secrets setup necessary for testing admin training and it'd be the easiest place to finish it. (Also I've already started there.) If you want to pull it out into another repo separate from that's fine, but, it would be a lot of extra work for me to re-set everything up
    2 replies
    Helena Rasche
    @hexylena:matrix.org
    [m]
    sure, sounds good
    Helena Rasche
    @hexylena:matrix.org
    [m]
    @ksuderman: are any of the environments you're setting up on GCP/AWS/etc for testing using the proxy-path feature of galaxy?
    that has broken a lot in the past for small admins and might be a useful testing target
    Marius
    @mvdbeek:matrix.org
    [m]
    That reminds me, we should add this back to the selenium tests
    Helena Rasche
    @hexylena:matrix.org
    [m]
    ah also works!
    Keith Suderman
    @ksuderman
    @hexylena:matrix.org If you mean running Galaxy behind Nginx with a path prefix (eg. https://benchmarking.usegvl.org/initial/galaxy/) then yes, that is the default deployment strategy on Kubernetes.
    Helena Rasche
    @hexylena:matrix.org
    [m]
    nice! That's fantastic to hear. We often had bugs around js missing the proxy-prefix and resulting in nested views or just failing
    that will be very helpful to catch that.
    John Chilton
    @jmchilton:matrix.org
    [m]
    Quick meeting in 20 minutes - I've put together a couple quick question to guide the meeting - feel free to add as needed. https://docs.google.com/document/d/1snlWvf9Jvuusell_I_aekxWMroPtdtky0ePTcnnTnPw/edit?usp=sharing
    sergey
    @ic4f:matrix.org
    [m]
    i have an idea i'd like to briefly discuss - i'll add to the agenda as soon as your cursor stops moving 😆
    John Chilton
    @jmchilton:matrix.org
    [m]
    I'll take a break!
    sergey
    @ic4f:matrix.org
    [m]
    done! :)
    Keith Suderman
    @ksuderman
    Is there a zoom link? I thought I would sit in.
    John Chilton
    @jmchilton:matrix.org
    [m]
    I'll copy that into the notes
    John Chilton
    @jmchilton:matrix.org
    [m]
    Did Google always try to sell longer meetings like this
    Sorry all :(
    Sergey Golitsynskiy
    @ic4f
    another 2 min maybe?
    unless we have meetings to attend
    or e could chat here
    John Chilton
    @jmchilton:matrix.org
    [m]
    Here is a new meeting
    dannon
    @dannon:matrix.org
    [m]
    Is the testing process done for 21.09? I think we're looking to release very soon and I want to make sure we've covered what we wanted here.
    Marius
    @mvdbeek:matrix.org
    [m]
    pretty much, I think, but the release-testing channel is https://matrix.to/#/#galaxyproject_release-testing:gitter.im
    dannon
    @dannon:matrix.org
    [m]
    I was not aware of that one, thanks!
    John Chilton
    @jmchilton:matrix.org
    [m]
    https://meet.google.com/avo-hheh-nxs We have a meeting scheduled in a half hour. I don't have anything to discuss but I've created an empty slot in https://docs.google.com/document/d/1snlWvf9Jvuusell_I_aekxWMroPtdtky0ePTcnnTnPw/edit?usp=sharing - feel free to add topics.
    Maybe we can skip the meeting if no topics are added?
    Sergey Golitsynskiy
    @ic4f
    OK with me
    Björn Grüning
    @bgruening
    Germany has holiday today.
    John Chilton
    @jmchilton:matrix.org
    [m]
    Lets go ahead and say the meeting is skipped today then. Next meeting is December 6th.
    Keith Suderman
    @ksuderman
    Do we want a roundtable presentation from the 21.09 release testing team? I’m looking at the Google Calendar and the next two roundables (Nov 11 & Nov 25) both fall on US holidays.
    dannon
    @dannon:matrix.org
    [m]
    The one on the 25th definitely won't be happening. AFAIK the one on the 11th was still on, though.
    Keith Suderman
    @ksuderman
    I just looked at the roundtable schedule and I am super interested in Alex’s talk on 11/11 and don’t want to take away any of his time. That leaves encroaching on Marius on 12/9. Any presentation would be 5-10 minutes with 2-5 slides: we ran some tests, we found some bugs.
    dannon
    @dannon:matrix.org
    [m]
    To keep it relevant I'd really suggest taking the 5-10 on 11/11.
    I can look up what Alex requested, but I don't remember it being a full 60
    I looked it up. He requested 30 minutes. I would suggest, if you want to talk about the testing, to do it first on 11/11 and then he'd take the rest.