Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    Long Vu
    @tlvu

    FYI, the jenkin-config repo (https://github.com/Ouranosinc/jenkins-config) I did to deploy Ouranos internal Jenkins uses docker-compose and has that feature that the sensitive info is separated into a different repo and is combined back at deployment time.

    It's much more trivial than what we need but can serve as an inspiration.

    See https://github.com/Ouranosinc/jenkins-config/blob/ba72822660e3a3cbffb396b8e865cd9af6a67aac/env.local.example#L12-L21 for private override capability and https://github.com/Ouranosinc/jenkins-config/blob/ba72822660e3a3cbffb396b8e865cd9af6a67aac/jenkins-compose.sh#L36-L45 for how the 2 repos are recombined at deployment time.

    Long Vu
    @tlvu
    I also did a lightning talk about that Jenkins Configuration at the Canarie conference https://www.canarie.ca/software/canadian-research-software-conference/program-details/#day1, the slides are here, you have to download it and open locally in your browser (firefox/chrome only, no Internet Explorer/Edge) because github do not play html slides https://raw.githubusercontent.com/Ouranosinc/jenkins-config/master/canarie-presentation/presentation.slides.html
    MacPingu
    @cehbrecht

    @tlvu Thanks for sharing the jenkins config. I will keep it on my mind. Currently we just use an ansible deployment script which we run manually on a VM.

    I still haven’t used rancher by myself. Some of my colleagues do. As I remember from a presentation it looked simple to use and it works with docker-compose.

    David Huard
    @huard
    @cehbrecht I think your skip-py2 changes in birdy broke the emu test suite. There is no self.auth object assigned anywhere.
    MacPingu
    @cehbrecht
    @huard ok … I check it. Maybe the merge didn’t go well …
    Long Vu
    @tlvu
    @cehbrecht Can you release birdy 0.6.5 to conda? I see last release is 0.6.2 https://anaconda.org/birdhouse/birdhouse-birdy/files. There's a fix we need on our side. Thanks.
    MacPingu
    @cehbrecht
    @huard done :)
    David Huard
    @huard
    Thanks !
    Long Vu
    @tlvu
    Thanks cehbrecht, that was quick.
    Trevor James Smith
    @Zeitsperre
    @tlvu and I also just looked into this. @cehbrecht I'm wondering how you released 0.6.5 to conda; the conda recipes on GitHub only show 0.6.2 at moment.
    MacPingu
    @cehbrecht
    @tlvu probably I forgot to make a git push. I have removed owslib from the birdhouse channel.
    @Zeitsperre @tlvu maybe we should bring birdy to conda-forge.
    Trevor James Smith
    @Zeitsperre
    That's a reasonable proposal. Want me to look into setting that up?
    @cehbrecht Can you ping me when the 0.6.5 recipe is updated? I can take that and put it into conda-forge with very minimal effort once I have it.
    Long Vu
    @tlvu
    @cehbrecht thanks for removing old owslib from birdhouse channel. Rebuilding my docker image now. The birdy conda recipe Trevor was asking is probably this one https://github.com/bird-house/conda-recipes/blob/master/birdhouse-birdy/meta.yaml where we still see 0.6.2.
    MacPingu
    @cehbrecht
    @Zeitsperre I will push it on monday. Probably there are not much changes.
    Trevor James Smith
    @Zeitsperre
    @cehbrecht Sounds good. Have a good weekend!
    MacPingu
    @cehbrecht
    @Zeitsperre I have pushed the birdy conda recipe to github. It would be nice if you can bring it to conda-forge :) You can add me as maintainer so we can update it together.
    Trevor James Smith
    @Zeitsperre
    @cehbrecht The work is coming along. Unfortunately, my build tends to fail due a missing library (owslib-esgfwps). I'm wondering if this is something that needs to be migrated to conda-forge as well.
    MacPingu
    @cehbrecht
    oh … this one is optional. I would take it out of the requirements for now.
    Trevor James Smith
    @Zeitsperre
    From what I understand, all package dependencies need to be in conda (defaults, conda-forge) or PyPI.
    Alrighty!
    Trevor James Smith
    @Zeitsperre
    I'm still getting errors, but now from owslib: After installation, it doesn't seem to be able to find python-dateutil.
    MacPingu
    @cehbrecht
    @Zeitsperre I just tried the birdy from conda-forge. It works :) Thanks for getting this done :) I will update the birdy docs and remove the birdy package from the birdhouse channel.
    MacPingu
    @cehbrecht

    I have removed birdhouse-birdy from the conda birdhouse channel:
    https://anaconda.org/birdhouse/birdhouse-birdy/files

    Please use birdy from conda-forge.
    https://birdy.readthedocs.io/en/latest/installation.html

    Long Vu
    @tlvu
    Oh, we could have simply leave all the old versions under the old name there, would not cause any harms, not overshadowing the new release with the new name. Hope no one is pinning an old version because that environment is not reproducible anymore.
    MacPingu
    @cehbrecht
    @tlvu I have kept the latest version in the dev channel and can switch it to main again.
    Long Vu
    @tlvu

    Oh, we are fine at Ouranos. We are not pinning any old version of birdy, and we have docker images to pin old versions, thanks for your concern.

    I was simply stating the fact that removing old publicly released version might impact other people if they ever want to recreate an old environment.

    In general, old publicly released versions should only be deleted if they are actually causing real harm.

    Nils Hempelmann
    @nilshempelmann

    @all:
    Dear all
    Please update the doodle for the next video Conference, I ll fix the next date_time the upcoming days:

    https://github.com/bird-house/bird-house.github.io/wiki/Meetings

    Let me know who wants to get informed also by email.

    MacPingu
    @cehbrecht
    @tlvu Right. It just felt confusing to have birdy in both channels and with different names. I will ask before I do other clean ups :) I have been lazy so far … but I think for stable releases we should make the effort and move needed packages to conda-forge and not rely on the birdhouse channel.
    Trevor James Smith
    @Zeitsperre
    @cehbrecht If there are any other packages that were previously on Birdhouse that need migration, let me know.
    MacPingu
    @cehbrecht
    @Zeitsperre probably there are some … we will figure out when skipping the birdhouse channel in the build.
    Long Vu
    @tlvu
    FYI, we are able to install the latest birdy 0.6.5 from conda-forge and completely drop the birdhouse channel in one of our docker build, see this commit Ouranosinc/PAVICS-e2e-workflow-tests@e738939
    MacPingu
    @cehbrecht
    @tlvu nice to hear :)
    Nils Hempelmann
    @nilshempelmann

    @/all
    The next VC will be

    Thursday 26.Sep 15:00-16:00 UTC

    https://github.com/bird-house/bird-house.github.io/wiki/Meetings

    See you online soon.

    David Huard
    @huard
    @cehbrecht I've created a ticket for a PyWPS release. The last one was in December. There does not seem to be a schedule for releases. Has this been discussed at Geopython ?
    David Huard
    @huard
    @nilshempelmann How about we release the current FP as 1.5 ? It seems all tickets have been adressed. I then suggest we canvas the open issues and create a new 1.6 milestone.
    David Huard
    @huard
    I went ahead and released 1.4.2. Feel free to update it to 1.5.
    MacPingu
    @cehbrecht
    @nilshempelmann I should probably update FP to the latest cookiecutter template. But I don’t promise before next week.
    Nils Hempelmann
    @nilshempelmann
    @cehbrecht @huard thanks for the release. I was quite occupied the last weeks to make business running again. :-) Should be getting better so I can wrap up with coding from my side as well.
    I ll put FP 1.6 on the VC agenda.
    @cehbrecht I can give it a try to update FP with the latest cookiecutter template in a new brach.
    MacPingu
    @cehbrecht
    @nilshempelmann It is a bit tricky … I re-run the cookiecutter again with the same settings and copy it over the project … then I have to manually select and merge. See:
    bird-house/hummingbird#33
    Nils Hempelmann
    @nilshempelmann
    @cehbrecht OK. I got it. I ll let you doing it :-)
    Suggest to make the cookingcutter update the v1.5. Does that sounds good?
    MacPingu
    @cehbrecht
    @nilshempelmann Ok, I will let you know when FP is ready.
    David Huard
    @huard
    I suggest we wait for a new PyWPS release, then tag it in FP 1.5.
    MacPingu
    @cehbrecht
    @huard ok.
    Nils Hempelmann
    @nilshempelmann
    Good :-)