Just to let you know that I'm about to release a long due 0.1.7 for argopy, probably not very clean, but last release was in Aug. 2020, a long time ago
Hello everybody, I am trying to use argopy for the first time right now and I can't get the example to work ftproot = argopy.tutorial.open_dataset('localftp')[0]
then fetch data:
with argopy.set_options(src='localftp', local_ftp=ftproot):
ds = ArgoDataFetcher().float(1900857).to_xarray()
print(ds)
I am using version argopy-0.1.7
when I try argo_loader = ArgoDataFetcher().region([lonmin,lonmax,latmin,latmax,0,4000., '1998-01-01', '2021-03-05']) I get a Client Connector Error:
ClientConnectorError: Cannot connect to host www.ifremer.fr:443 ssl:default [Name or service not known]
Is this a known issue?
what's the error in the 1st case (trying to fetch 1900857 from the tuto dataset) ?
URLError: <urlopen error [Errno -2] Name or service not known>argopyargopy
this should work
and default datasource is also online, so no connection could cause your second error.
can you check if there are some files in your
ftproot ?
I am sorry I do not know how to check the ftproot
I am trying to fix this first by contacting our help desk and then if it is still problematic I will get back to here - I am sorry for interrupting your work - Have a very nice weekend
but my guess is a connection issue
also, I don't know your area of interest, but carefull when requesting too large (region([lonmin,lonmax,latmin,latmax,0,4000., '1998-01-01', '2021-03-05']))
no it is a small region in the subpolar North-Atlantic and it should be a download of maybe max 5 min.
Can someone auth the CI run for my codespell pr? It's super simple and this is usually how I start when looking at a project that I haven't seen before. euroargodev/argopy#89
5 replies
Hi @schwehr
FTP (ftp://ftp.ifremer.fr/ifremer/argo) or snapshots DOIs (https://www.seanoe.org/data/00311/42182/#85023) are maybe better allies.
FTP (ftp://ftp.ifremer.fr/ifremer/argo) or snapshots DOIs (https://www.seanoe.org/data/00311/42182/#85023) are maybe better allies.
If that snapshot is all of the quality controlled data, should folks just be using that?
if you rsync all argo from vdmzrs.ifremer.fr, you will also get the QC data
just the latest (and already unzipped) version of it
So what would a typical user of Argo want? e.g. I'm a marine geologist/geophysicist, not an oceanographer. I'm trying to figure out what a user of Earth Engine or Big Query would want to find available by default. I'm trying to pick back up on this work from 2014: https://github.com/cobbc12/MyRandomCode/blob/master/Argo_BigQuery.ipynb
Hi @schwehr I guess you should work with a snapshot of the ftp (one from here https://www.seanoe.org/data/00311/42182/#85023 as pointed out by @quai20 ). The snapshot is compressed, it will be larger on disk. And the rsync service is more for experts who want to keep up with the full dataset and last available data.
(Note that for the rsync, the 1st sync is very very long as you noticed, 20 years of data is a lot, but then all the updates are much faster, since about 300 profiles are added daily)
Ok. I accidentally removed a subdir while prepping the data so I'll need to rsync the subdir again. rsync is an old friend from decades ago. What's one persons big data (my thesis lab data fit on a floppy disc) is another person's tiny data. And now I'm in the world of satellite images where each one is order of 15GB. I found that gzip -9 gave 10% the original size and xz -9 did drastically better than that. A compressing column store should do great
Hi folks, @tylertucker202 , anyone noticed that the argovis can't return data anymore ? See more here donatagiglio/Argovis#3
Just in case someone would stop by here, I just opened https://github.com/euroargodev/argopy/discussions
So, please move your items there so that it becomes our main discussion channel
So, please move your items there so that it becomes our main discussion channel