Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    Simon Gagnon
    @Sigagnon
    thx great presentation this morning!
    Dharhas Pothina
    @dharhas
    Thank you. I was making updates to it a couple of minutes before we started and we are using a new version of Nebari that we released last night so I'm happy it went so smoothly.
    Kim Pevey
    @kcpevey

    As people come back in, I'd like hear more about you! Where are you from? What is your job title?

    I'm a Software Engineer at Quansight, working from the Gulf Coast of Mississippi.

    Simon Gagnon
    @Sigagnon
    Hey Kim,
    I'm from Canada, Sherbrooke and I work as a Research professionnal in geosciences on groundwater management projects.
    Rich Signell
    @rsignell-usgs
    Rich Signell, Research Oceanographer at USGS, working on Cape Cod, Massachusetts, USA
    Kim Pevey
    @kcpevey
    Nice! My background is in Civil Engineering - Water Resources
    RyanAhola
    @RyanAhola
    Hi Kim, I'm also from Canada (Ottawa). I work on advancing geospatial standards for Canadian needs, particularly through the OGC. I work with Natural Resources Canada.
    Kim Pevey
    @kcpevey
    Great. Glad to have you here!
    Dharhas Pothina
    @dharhas
    Dharhas Pothina, CTO at Quansight. Formerly at ERDC, USACE and before that the Texas Water Development Board. Original Background in Computational Fluids (Aerospace & Civil Engg - Water Resources) but have done a lot of stuff since.
    Josh Lieberman
    @lieberjosh
    Some other OGC work was recently done on notebook batch processing, leveraging Papermill and some other tools: https://docs.ogc.org/per/20-035.html
    Kim Pevey
    @kcpevey
    Josh Lieberman
    @lieberjosh
    Did not cover the deployment tasks that nebari does, though.
    One approach to containerization is https://github.com/jupyterhub/repo2docker but it requires a repo for each container.
    eskild
    @iameskild
    If you're in the nebari-ogc-disaster-pilot-2022 folder and if you ran kbatch config, you can submit the job I just demoed: kbatch job submit -f 04a_kbatch_job.yaml
    View all the dashboards available here: https://esip-ogc.nebari.dev/hub/dashboards
    eskild
    @iameskild
    @lieberjosh repo2docker is great tool for this problem. This is the repo I created to build and push this docker image: https://github.com/iameskild/repo2registry
    (publishing to Github container registry - ghcr)
    Rich Signell
    @rsignell-usgs
    Is the NOAA tide gauge explorer hitting ERDDAP?
    Kim Pevey
    @kcpevey
    shared/analyst/kcpevey/water_dashboard_v2.ipynb
    @rsignell-usgs I'm using this package for data collection: https://github.com/GClunies/noaa_coops
    Looks like its using:
        For data retrieval API, see https://tidesandcurrents.noaa.gov/api/.
        For metadata API, see: https://tidesandcurrents.noaa.gov/mdapi/latest/
        For data inventory info, see: https://opendap.co-ops.nos.noaa.gov/axis/
    Rich Signell
    @rsignell-usgs
    Okay, custom API. :( but python package that makes it easy! :)
    Kim Pevey
    @kcpevey
    Yeah I was hoping to avoid creating an API myself. Is there a better API?
    Josh Lieberman
    @lieberjosh
    Question: how would one use nebari to "scale" an interactive dashboard for many users?
    Rich Signell
    @rsignell-usgs
    Did anyone get kbatch working? I got this output -- does it tell me what is wrong? https://esip-ogc.nebari.dev/hub/user-redirect/lab/tree/shared/disaster-pilot-2022/rsignell/kbatch.log
    eskild
    @iameskild
    Taking a look now
    Rich Signell
    @rsignell-usgs
    Let's see the intake example
    eskild
    @iameskild
    When you submit your job, this json will be outputted. And this looks correct to me
    You can validate that your job is running by listing your jobs: kbatch job list -o table
    Josh Lieberman
    @lieberjosh
    Thanks Dharhas. Good to identify that use case and possible solutions. Lots of useful indicator publication is limited by concerns about dashboard elasticity.
    Rich Signell
    @rsignell-usgs
    @iameskild , yes, you were right! The "kbatch" did work! It was just taking a while!
    $ aws s3 ls esip-nebari-dev/testing/rsignell/
    2022-07-07 12:21:45        850 ogc-cog-validation.txt
    eskild
    @iameskild
    @rsignell-usgs maybe adding time.sleep was overkill haha
    Rich Signell
    @rsignell-usgs
    Here's an LANDSAT example using STAC (from Element84)
    Rich Signell
    @rsignell-usgs
    I'm testing out building a new environment that includes geogif
    Dharhas Pothina
    @dharhas
    Great. One bug that didn't get fixed in time for this workshop is that only environments created in the git repo are accessible for dashboard sharing. For all other cases, the conda-store UI is fine for creation of environments
    Rich Signell
    @rsignell-usgs
    I'm building it in the "disaster-pilot-2022" namespace with name "ogc". Is it a problem having the same environment name? (e.g. disaster-pilot-2022/ogc and filesystem/ogc)
    eskild
    @iameskild
    I might give it another name to be safe. I'm not sure if that bug has been fully addressed.
    Dharhas Pothina
    @dharhas
    I think it's an issue using the envs from the terminal but not from jupyter but to be safe lets use something else.
    Rich Signell
    @rsignell-usgs
    can I kill the build?
    oh, it's done already!
    Dharhas Pothina
    @dharhas
    well I guess lets see if it works :)
    Rich Signell
    @rsignell-usgs
    too late. I deleted it
    Dharhas Pothina
    @dharhas
    as an fyi it showed in my kernel list without a restart
    Rich Signell
    @rsignell-usgs
    nice
    well, maybe not too late. I clicked the "delete" button on the build (build 8) but it still seem to be there?
    But I'm building again "odc-rps"
    Dharhas Pothina
    @dharhas
    I think 'delete' queues it for delete but it might take a bit of time. Chris would have to chime in on that.