Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    Josh Lieberman
    @lieberjosh
    Thanks!
    Kim Pevey
    @kcpevey
    For this sprint, we've set up the filesystem-ogc environment which is kind of a "kitchen sink" for all the demos.
    NazihFino
    @NazihFino
    did not work
    Kim Pevey
    @kcpevey
    If the first link doesn't work, do you have access to the /shared/disaster-pilot-2022 folder?
    NazihFino
    @NazihFino
    yes first link works now
    Kim Pevey
    @kcpevey
    ok great!
    Simon Gagnon
    @Sigagnon
    keep going!
    eskild
    @iameskild
    Hi folks, we'll be resuming momentarily
    Rich Signell
    @rsignell-usgs
    I'll be gone for a bit, hopefully back soon.
    Simon Gagnon
    @Sigagnon
    thx great presentation this morning!
    Dharhas Pothina
    @dharhas
    Thank you. I was making updates to it a couple of minutes before we started and we are using a new version of Nebari that we released last night so I'm happy it went so smoothly.
    Kim Pevey
    @kcpevey

    As people come back in, I'd like hear more about you! Where are you from? What is your job title?

    I'm a Software Engineer at Quansight, working from the Gulf Coast of Mississippi.

    Simon Gagnon
    @Sigagnon
    Hey Kim,
    I'm from Canada, Sherbrooke and I work as a Research professionnal in geosciences on groundwater management projects.
    Rich Signell
    @rsignell-usgs
    Rich Signell, Research Oceanographer at USGS, working on Cape Cod, Massachusetts, USA
    Kim Pevey
    @kcpevey
    Nice! My background is in Civil Engineering - Water Resources
    RyanAhola
    @RyanAhola
    Hi Kim, I'm also from Canada (Ottawa). I work on advancing geospatial standards for Canadian needs, particularly through the OGC. I work with Natural Resources Canada.
    Kim Pevey
    @kcpevey
    Great. Glad to have you here!
    Dharhas Pothina
    @dharhas
    Dharhas Pothina, CTO at Quansight. Formerly at ERDC, USACE and before that the Texas Water Development Board. Original Background in Computational Fluids (Aerospace & Civil Engg - Water Resources) but have done a lot of stuff since.
    Josh Lieberman
    @lieberjosh
    Some other OGC work was recently done on notebook batch processing, leveraging Papermill and some other tools: https://docs.ogc.org/per/20-035.html
    Kim Pevey
    @kcpevey
    Josh Lieberman
    @lieberjosh
    Did not cover the deployment tasks that nebari does, though.
    One approach to containerization is https://github.com/jupyterhub/repo2docker but it requires a repo for each container.
    eskild
    @iameskild
    If you're in the nebari-ogc-disaster-pilot-2022 folder and if you ran kbatch config, you can submit the job I just demoed: kbatch job submit -f 04a_kbatch_job.yaml
    View all the dashboards available here: https://esip-ogc.nebari.dev/hub/dashboards
    eskild
    @iameskild
    @lieberjosh repo2docker is great tool for this problem. This is the repo I created to build and push this docker image: https://github.com/iameskild/repo2registry
    (publishing to Github container registry - ghcr)
    Rich Signell
    @rsignell-usgs
    Is the NOAA tide gauge explorer hitting ERDDAP?
    Kim Pevey
    @kcpevey
    shared/analyst/kcpevey/water_dashboard_v2.ipynb
    @rsignell-usgs I'm using this package for data collection: https://github.com/GClunies/noaa_coops
    Looks like its using:
        For data retrieval API, see https://tidesandcurrents.noaa.gov/api/.
        For metadata API, see: https://tidesandcurrents.noaa.gov/mdapi/latest/
        For data inventory info, see: https://opendap.co-ops.nos.noaa.gov/axis/
    Rich Signell
    @rsignell-usgs
    Okay, custom API. :( but python package that makes it easy! :)
    Kim Pevey
    @kcpevey
    Yeah I was hoping to avoid creating an API myself. Is there a better API?
    Josh Lieberman
    @lieberjosh
    Question: how would one use nebari to "scale" an interactive dashboard for many users?
    Rich Signell
    @rsignell-usgs
    Did anyone get kbatch working? I got this output -- does it tell me what is wrong? https://esip-ogc.nebari.dev/hub/user-redirect/lab/tree/shared/disaster-pilot-2022/rsignell/kbatch.log
    eskild
    @iameskild
    Taking a look now
    Rich Signell
    @rsignell-usgs
    Let's see the intake example
    eskild
    @iameskild
    When you submit your job, this json will be outputted. And this looks correct to me
    You can validate that your job is running by listing your jobs: kbatch job list -o table
    Josh Lieberman
    @lieberjosh
    Thanks Dharhas. Good to identify that use case and possible solutions. Lots of useful indicator publication is limited by concerns about dashboard elasticity.
    Rich Signell
    @rsignell-usgs
    @iameskild , yes, you were right! The "kbatch" did work! It was just taking a while!
    $ aws s3 ls esip-nebari-dev/testing/rsignell/
    2022-07-07 12:21:45        850 ogc-cog-validation.txt
    eskild
    @iameskild
    @rsignell-usgs maybe adding time.sleep was overkill haha
    Rich Signell
    @rsignell-usgs
    Here's an LANDSAT example using STAC (from Element84)
    Rich Signell
    @rsignell-usgs
    I'm testing out building a new environment that includes geogif
    Dharhas Pothina
    @dharhas
    Great. One bug that didn't get fixed in time for this workshop is that only environments created in the git repo are accessible for dashboard sharing. For all other cases, the conda-store UI is fine for creation of environments
    Rich Signell
    @rsignell-usgs
    I'm building it in the "disaster-pilot-2022" namespace with name "ogc". Is it a problem having the same environment name? (e.g. disaster-pilot-2022/ogc and filesystem/ogc)