Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    RyanAhola
    @RyanAhola
    I'm also not able to log in. ryan.ahola@nrcan-rncan.gc.ca
    eskild
    @iameskild
    Ryan, I reset your password. Could you please try again?
    RyanAhola
    @RyanAhola
    Thanks @iameskild! I'm in now.
    eskild
    @iameskild
    Wonderful :)
    Josh Lieberman
    @lieberjosh
    eskild, could you add my github id? lieberjosh
    eskild
    @iameskild
    @lieberjosh you've been added :)
    Josh Lieberman
    @lieberjosh
    Thanks!
    Kim Pevey
    @kcpevey
    For this sprint, we've set up the filesystem-ogc environment which is kind of a "kitchen sink" for all the demos.
    Dharhas Pothina
    @dharhas
    https://esip-ogc.nebari.dev/hub/user-redirect/lab/tree/shared/disaster-pilot-2022/test.ipynb
    https://esip-ogc.nebari.dev/hub/user-redirect/lab/tree/nebari-ogc-disaster-pilot-2022/00_overview.ipynb
    NazihFino
    @NazihFino
    did not work
    Kim Pevey
    @kcpevey
    If the first link doesn't work, do you have access to the /shared/disaster-pilot-2022 folder?
    NazihFino
    @NazihFino
    yes first link works now
    Kim Pevey
    @kcpevey
    ok great!
    Simon Gagnon
    @Sigagnon
    keep going!
    eskild
    @iameskild
    Hi folks, we'll be resuming momentarily
    Rich Signell
    @rsignell-usgs
    I'll be gone for a bit, hopefully back soon.
    Simon Gagnon
    @Sigagnon
    thx great presentation this morning!
    Dharhas Pothina
    @dharhas
    Thank you. I was making updates to it a couple of minutes before we started and we are using a new version of Nebari that we released last night so I'm happy it went so smoothly.
    Kim Pevey
    @kcpevey

    As people come back in, I'd like hear more about you! Where are you from? What is your job title?

    I'm a Software Engineer at Quansight, working from the Gulf Coast of Mississippi.

    Simon Gagnon
    @Sigagnon
    Hey Kim,
    I'm from Canada, Sherbrooke and I work as a Research professionnal in geosciences on groundwater management projects.
    Rich Signell
    @rsignell-usgs
    Rich Signell, Research Oceanographer at USGS, working on Cape Cod, Massachusetts, USA
    Kim Pevey
    @kcpevey
    Nice! My background is in Civil Engineering - Water Resources
    RyanAhola
    @RyanAhola
    Hi Kim, I'm also from Canada (Ottawa). I work on advancing geospatial standards for Canadian needs, particularly through the OGC. I work with Natural Resources Canada.
    Kim Pevey
    @kcpevey
    Great. Glad to have you here!
    Dharhas Pothina
    @dharhas
    Dharhas Pothina, CTO at Quansight. Formerly at ERDC, USACE and before that the Texas Water Development Board. Original Background in Computational Fluids (Aerospace & Civil Engg - Water Resources) but have done a lot of stuff since.
    Josh Lieberman
    @lieberjosh
    Some other OGC work was recently done on notebook batch processing, leveraging Papermill and some other tools: https://docs.ogc.org/per/20-035.html
    Kim Pevey
    @kcpevey
    kbatch docs on nebari: https://www.nebari.dev/how-tos/kbatch-howto
    Josh Lieberman
    @lieberjosh
    Did not cover the deployment tasks that nebari does, though.
    One approach to containerization is https://github.com/jupyterhub/repo2docker but it requires a repo for each container.
    eskild
    @iameskild
    If you're in the nebari-ogc-disaster-pilot-2022 folder and if you ran kbatch config, you can submit the job I just demoed: kbatch job submit -f 04a_kbatch_job.yaml
    Kim Pevey
    @kcpevey
    https://esip-ogc.nebari.dev/hub/dashboards/hrrr-explorer
    View all the dashboards available here: https://esip-ogc.nebari.dev/hub/dashboards
    eskild
    @iameskild
    @lieberjosh repo2docker is great tool for this problem. This is the repo I created to build and push this docker image: https://github.com/iameskild/repo2registry
    (publishing to Github container registry - ghcr)
    Rich Signell
    @rsignell-usgs
    Is the NOAA tide gauge explorer hitting ERDDAP?
    Kim Pevey
    @kcpevey
    shared/analyst/kcpevey/water_dashboard_v2.ipynb
    @rsignell-usgs I'm using this package for data collection: https://github.com/GClunies/noaa_coops
    Looks like its using:
        For data retrieval API, see https://tidesandcurrents.noaa.gov/api/.
    For metadata API, see: https://tidesandcurrents.noaa.gov/mdapi/latest/
    For data inventory info, see: https://opendap.co-ops.nos.noaa.gov/axis/
    Rich Signell
    @rsignell-usgs
    Okay, custom API. :( but python package that makes it easy! :)
    Kim Pevey
    @kcpevey
    Yeah I was hoping to avoid creating an API myself. Is there a better API?
    Josh Lieberman
    @lieberjosh
    Question: how would one use nebari to "scale" an interactive dashboard for many users?
    Rich Signell
    @rsignell-usgs
    Did anyone get kbatch working? I got this output -- does it tell me what is wrong? https://esip-ogc.nebari.dev/hub/user-redirect/lab/tree/shared/disaster-pilot-2022/rsignell/kbatch.log
    eskild
    @iameskild
    Taking a look now
    Rich Signell
    @rsignell-usgs
    Let's see the intake example
    eskild
    @iameskild
    When you submit your job, this json will be outputted. And this looks correct to me
    You can validate that your job is running by listing your jobs: kbatch job list -o table
    Josh Lieberman
    @lieberjosh
    Thanks Dharhas. Good to identify that use case and possible solutions. Lots of useful indicator publication is limited by concerns about dashboard elasticity.
    Rich Signell
    @rsignell-usgs
    @iameskild , yes, you were right! The "kbatch" did work! It was just taking a while! 
    $ aws s3 ls esip-nebari-dev/testing/rsignell/
2022-07-07 12:21:45        850 ogc-cog-validation.txt