Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • 15:05
    rabernat unlabeled #816
  • 12:06
    github-actions[bot] labeled #816
  • 12:06
    github-actions[bot] commented #816
  • Apr 16 16:15

    github-actions[bot] on gh-pages

    Update documentation (compare)

  • Apr 16 16:14

    rsignell-usgs on master

    remove goofy bullets (compare)

  • Apr 16 16:11

    github-actions[bot] on gh-pages

    Update documentation (compare)

  • Apr 16 16:10

    rsignell-usgs on master

    add doi badges (compare)

  • Apr 16 14:01

    github-actions[bot] on gh-pages

    Update documentation (compare)

  • Apr 16 14:00

    rsignell-usgs on master

    Adding link to talk 2 (compare)

  • Apr 15 20:44
    jbusecke commented #830
  • Apr 15 18:55
    kmpaul opened #830
  • Apr 15 05:11
    RichardScottOZ commented #356
  • Apr 13 18:44
    jbusecke commented #798
  • Apr 12 15:07

    github-actions[bot] on gh-pages

    Update documentation (compare)

  • Apr 12 15:06

    rsignell-usgs on done-with-gmt

    (compare)

  • Apr 12 15:06

    rsignell-usgs on master

    Update meeting-notes.rst Merge pull request #829 from pa… (compare)

  • Apr 12 15:06
    rsignell-usgs closed #829
  • Apr 12 15:01

    github-actions[bot] on done-with-gmt-preview

    Update documentation (compare)

  • Apr 12 15:01
    github-actions[bot] commented #829
  • Apr 12 15:01
    jhamman opened #829
yuvipanda
@Yuvi:matrix.org
[m]
please don't publicize this widely, but I've been working on a simple 'ipynb.pub' service for publishing notebook files, kinda like a pastebin. https://ipynb.pub/view/4d81ee06423295cb71cfa2dc10e1180e225113be774db7e577907e421a6be009 check it out, and let me know what you think. It has hypothes.is annotation in built, so we can collaboratively take notes & annotate a published file :) Published notebooks are immutable and can not be changed.
1 reply
yuvipanda
@Yuvi:matrix.org
[m]
@cgentemann: yay! Can you tell me what problems it would solve? Am just messing around and trying to build something useful
3 replies
yuvipanda
@Yuvi:matrix.org
[m]
@cgentemann: ah, that's awesome. Yeah, the immutability is a core built-in part of it. Later on, I could allow people to declare ownership with an ORCID or something during upload, but once uploaded that will be immutable too
yuvipanda
@Yuvi:matrix.org
[m]
You can try uploading notebooks to it from the commandline with curl -F "upload=@-" https://ipynb.pub/upload -w '%{redirect_url}' < YOUR_NOTEBOOK_FILE.ipynb, this will output the URL you can share
although note that I'm still playing around, so you can lose notebooks :D
Yuvi
@Yuvi:matrix.org
[m]
yeah, ipynb.pub will not help with keeping it 'working' in the sense it doesn't know / do anything about the environment. Just the content. I would love to give it a DOI too though.
should be possible to link it to an environment repo though, so you can 'run' it in something specific.
yuvipanda
@Yuvi:matrix.org
[m]
with 2i2c-org/pilot-hubs#281, I figured out how to automatically create a service account per hub that can be given the appropriate roles to fetch data from 'requester pays' buckets! But it's general enough to create other resources, like GCS buckets. So next step would be to create a shared bucket per hub, and then maybe one bucket per user!
https://github.com/pangeo-data/pangeo-cloud-federation/blob/b512e11dfb185a3fe65af7ed208607431d93846c/deployments/gcp-uscentral1b/Makefile was very helpful in sorting out the IAM rules - thank you @jhamman and Tom (not sure if he's here)
Ryan Abernathey
@rabernat
Hi folks. I have a conflict with the Cloud Ops WG meeting today, so I won't make it.
Joe Hamman
@jhamman
I’m planning on being there.
Rich Signell
@rsignell-usgs
Dharhas is planning on attending as well
(and me)
Ryan Abernathey
@rabernat
Hi Folks! Weekly meeting happening now!
Wesley Banfield
@WesleyTheGeolien

Hey everyone :)

Got a quick xarray question if it is too complicated Id be happy to move this Github or somewhere where it is findable again.

I have a rectilinear xarray file (180 x 360) one of the attributes tells me the outflow point (to the ocean) of each watershed.

I have a curvilinear grid (coarser res x = 149 by y =182) with another variable I want to use.

I am looking for a way to "map" my output points from my rectilinear grid onto my curvilinear grid to find the values of the cells.

I have tried using interp with method='nearest' (linear misses tons of values only 20 basins out of 2600) but this still misses roughly half of my exit points.

I wondered if there is an "easy" way to see which cell(s) a given long / lat falls in in a curvilinear grid? The annoying things is using geoviews I can superpose these datasets!!

Would Spatial pandas help out here?

Cheers,

Rich Signell
@rsignell-usgs
Wesley, I do think this would be a good pangeo discourse question!
1 reply
Wesley Banfield
@WesleyTheGeolien
Ryan Abernathey
@rabernat
Weekly meeting happening now! https://columbiauniversity.zoom.us/j/953527251
James A. Bednar
@jbednar
D'oh! I've got two meeting entries for some reason, and one of them didn't change with DST, so I missed the meeting today. Next time...
Ryan Abernathey
@rabernat
Ryan Abernathey
@rabernat
What does it mean when the dask worker tasks bar is green?
image.png
And the same worker shows up as red on the workers tab?
image.png
Martin Durant
@martindurant
Last seen 1071s? That accounts for the red colour.
Ryan Abernathey
@rabernat
what does the green mean?
it looks like the worker is not responding, but that same worker has all the tasks
and no one can steal them, so the whole thing is just frozen
Deepak Cherian
@dcherian

https://github.com/portugueslab/split_dataset

Split datasets are numpy-like array saved over multiple h5 files. The concept of spli datasets is not different from e.g. zarr arrays; however, relying on h5 files allow for partial reading even within the same file, which is crucial for visualizing volumetric time series, the main application split_dataset has been developed for

Ryan Abernathey
@rabernat
Zarr now supports partial reading from blosc data
Ryan Abernathey
@rabernat
What's the best way to view a dask progress report gist as actual rendered html: https://gist.github.com/rabernat/60e9dd299032ff3d4234239c257fa49d/c04c47989d11c0c31efc05c95e8f3cdb1fe347b1
Deepak Cherian
@dcherian
I think @mrocklin uploaded them to raw.githack.com
(hah misssed the last mesage)
Ryan Abernathey
@rabernat
That was fun!
Rich Signell
@rsignell-usgs
Cloud meeting at 12:30ET today, right?
Joe Hamman
@jhamman
Yes!
Rich Signell
@rsignell-usgs
The calendar seems to show the time as 11:30ET?
https://pangeo.io/meeting-notes.html#meetings-calendar
perhaps the calendar should be GMT
Joe Hamman
@jhamman
oh! yes. you are correct.
I think I regret having us use GMT as our timezone.
I vote we keep the meeting at 8:30a PT, 11:30a ET and update the timezone on the pangeo website.
Rich Signell
@rsignell-usgs
Okay, 8:30 PT!
Wesley Banfield
@WesleyTheGeolien
Maybe this could be useful to the community, a way to interactively select coords from netcdf files using holoviews: https://cerege-cl.github.io/Notebooks-Gallery/notebooks/Retreive_coordinates.html
Kapture 2021-04-14 at 13.57.25.gif
James A. Bednar
@jbednar
Nice!