Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    Kevin Paul
    @kmpaul
    To kickstart this discussion, this is the HackMD document that we started for this working group here in Seattle: https://hackmd.io/@4FHbYxmiS4m9l8b1yVMWAA/rJEFG4i4r
    Matthew Hanson
    @matthewhanson
    Hello everyone :wave:
    Norman Barker
    @normanbarker_twitter
    :wave:
    Matthew Hanson
    @matthewhanson
    What’s not captured in the document from the first day meeting is what we discussed day 2 about STAC. We came up with a preliminary Earth System Model STAC extension and talked about how climate data (focusing on CMIP6) fit into the STAC paradigm.
    Our goal now is to first generate some STAC examples for CMIP6 and/or LENS data and get that out to the larger group for comment, as the organization of the data should ultimately be based on how users primarily discover and use this data.
    Then, we will want to create a catalog, for CMIP6 and/or LENS, index that into sat-api so we have a searchable endpoint people can start playing with. I’d like to have some CMIP6 data indexed by the CMIP6 hackathon.
    Anderson Banihirwe
    @andersy005
    Did someone take notes for Day 2 discussion about preliminary Earth System Model STAC extension?
    Kevin Paul
    @kmpaul
    No notes, @andersy005. Sorry. But I'm trying to put together a short description of a starting point for what a STAC spec might look like for CESM LENS and/or CMIP6.
    There will be updates here as we sketch out what it should really look like.
    Matthew Hanson
    @matthewhanson
    The prelim STAC extension will be in a branch at https://github.com/radiantearth/stac-spec, after I finish the draft, will post an update here when it’s pushed.
    Also, will be creating a stac-lens repo (is that what it should be called?) for creating a STAC catalog for the LENS public dataset, because as that already exists on AWS it might be easier to start with that and show everyone what an Earth System Model catalog would look like.
    Is the LENS data static or are there updates?
    Kevin Paul
    @kmpaul
    It is static.
    Aimee Barciauskas
    @abarciauskas-bgse
    :wave:
    thanks @kmpaul for adding me
    Kevin Paul
    @kmpaul
    :wave: @abarciauskas-bgse You're welcome! Glad to have you on board.
    Daniel Rothenberg
    @darothen
    Hi all,
    I've created a Doodle poll for a first group meeting -> https://doodle.com/poll/vt7geeiwfn7dzvsg
    Please respond before the holiday weekend!
    Aimee Barciauskas
    @abarciauskas-bgse
    Thank you @darothen !
    Rich Signell
    @rsignell-usgs
    Was there a Pangeo Data Working Group meeting at 2pm ET today?
    Matthew Hanson
    @matthewhanson
    @rsignell-usgs There was, @normanbarker_twitter ran it and there should be some notes. I missed it as I'm at The Big E chaperoning school band trip today!
    Aimee Barciauskas
    @abarciauskas-bgse
    @rsignell-usgs Chelle Gentemann applied and was already approved to publish MUR SST to AWS Public Data sets. We would like to publish it in zarr and also create some infrastructure to append the new data. I'm organizing a call with myself, Chelle and a few JPL / PO.DAAC to make a plan. Can I add you or is there another zarr expert you would recommend?
    And by "add you" I mean : forward the email thread and add you to a doodle poll
    David Bianco
    @talldave_twitter
    @normanbarker_twitter is there a data call today?
    Matthew Hanson
    @matthewhanson
    sorry @talldave_twitter I think you aren’t on the list. Norman is in England and several of us couldn’t make it so we canceled it.
    We’ll get you added onto the email list
    David Bianco
    @talldave_twitter
    ok thx
    Pascal Bourgault
    @aulemahal
    Hi all, I am trying to play around with the cmip6 data on AWS, to get an idea of how all this works. I was able to list some data in the S3 bucket, but I haven't found a catalog or a list of what's in there? I mean, listing the entire bucket is clearly not a good idea, it's so big! Is there an intake catalog or something like that?
    3 replies