What’s not captured in the document from the first day meeting is what we discussed day 2 about STAC. We came up with a preliminary Earth System Model STAC extension and talked about how climate data (focusing on CMIP6) fit into the STAC paradigm. Our goal now is to first generate some STAC examples for CMIP6 and/or LENS data and get that out to the larger group for comment, as the organization of the data should ultimately be based on how users primarily discover and use this data. Then, we will want to create a catalog, for CMIP6 and/or LENS, index that into sat-api so we have a searchable endpoint people can start playing with. I’d like to have some CMIP6 data indexed by the CMIP6 hackathon.
Did someone take notes for Day 2 discussion about preliminary Earth System Model STAC extension?
No notes, @andersy005. Sorry. But I'm trying to put together a short description of a starting point for what a STAC spec might look like for CESM LENS and/or CMIP6.
There will be updates here as we sketch out what it should really look like.
The prelim STAC extension will be in a branch at https://github.com/radiantearth/stac-spec, after I finish the draft, will post an update here when it’s pushed. Also, will be creating a stac-lens repo (is that what it should be called?) for creating a STAC catalog for the LENS public dataset, because as that already exists on AWS it might be easier to start with that and show everyone what an Earth System Model catalog would look like. Is the LENS data static or are there updates?
It is static.
thanks @kmpaul for adding me
:wave: @abarciauskas-bgse You're welcome! Glad to have you on board.
Was there a Pangeo Data Working Group meeting at 2pm ET today?
@rsignell-usgs There was, @normanbarker_twitter ran it and there should be some notes. I missed it as I'm at The Big E chaperoning school band trip today!
@rsignell-usgs Chelle Gentemann applied and was already approved to publish MUR SST to AWS Public Data sets. We would like to publish it in zarr and also create some infrastructure to append the new data. I'm organizing a call with myself, Chelle and a few JPL / PO.DAAC to make a plan. Can I add you or is there another zarr expert you would recommend?
And by "add you" I mean : forward the email thread and add you to a doodle poll
@normanbarker_twitter is there a data call today?
sorry @talldave_twitter I think you aren’t on the list. Norman is in England and several of us couldn’t make it so we canceled it. We’ll get you added onto the email list
Hi all, I am trying to play around with the cmip6 data on AWS, to get an idea of how all this works. I was able to list some data in the S3 bucket, but I haven't found a catalog or a list of what's in there? I mean, listing the entire bucket is clearly not a good idea, it's so big! Is there an intake catalog or something like that?