Argo floats/argopy

A python library for Argo data beginners and experts

Kevin Balem

@quai20

:thumbsup:

Guillaume Maze

@gmaze

hi there, I have a lot of difficulties to ensure successfull unit testing on github actions, simply because the tests environments is evolving with depedencies new versions, while my dev local environement is rather fixed (i.e. evolves much less frequently than regular builds on github actions). How do you guys manage this ?

We should not enforce a spefic versions of depedencies, but then unit testing becomes quite difficult because it's not easy to identify errors from code design, vs errors from new version of depedencies

Filipe

@ocefpaf

I use conda-lock, but having a "free" testing item on the matrix is useful to future proof the library.

I can send a PR with an example later if you want to go that route.

Guillaume Maze

@gmaze

I'm not sure to realy understand all the implications here. We would have a tests suite for multiple python versions, os and also conda environnement (so that we could control, or not, depedencies versions), is that correct ?

Filipe

@ocefpaf

Yep.

Guillaume Maze

@gmaze

Great, to be honest I don't know how to do this properly, do you feel you could do or show us ?

Filipe

@ocefpaf

There are lockfile for pip as well. pip-tools and pipenv can do the same.

I'll send a draft PR soon.

Guillaume Maze

@gmaze

thanks @ocefpaf !

Guillaume Maze

@gmaze

Hi folks, my small friday project: status page for argopy web APIs: https://github.com/euroargodev/argopy-status

updated every 5 mins

results push to a clean webpage: https://argopy.statuspage.io/

and nice badges: Erddap status

Argovis status

Guillaume Maze

@gmaze

I also implemented a core and BGC profiles counter at https://argopy.statuspage.io/

Guillaume Maze

@gmaze

Hi @tylertucker202 , I invited you on argopy so that you could review the PR #36 ...

Guillaume Maze

@gmaze

Happy new year folks !

Just to let you know that I'm about to release a long due 0.1.7 for argopy, probably not very clean, but last release was in Aug. 2020, a long time ago

phand

@HandmannP

Hello everybody, I am trying to use argopy for the first time right now and I can't get the example to work ftproot = argopy.tutorial.open_dataset('localftp')[0]

then fetch data:
with argopy.set_options(src='localftp', local_ftp=ftproot):
ds = ArgoDataFetcher().float(1900857).to_xarray()
print(ds)

I am using version argopy-0.1.7

when I try argo_loader = ArgoDataFetcher().region([lonmin,lonmax,latmin,latmax,0,4000., '1998-01-01', '2021-03-05']) I get a Client Connector Error:

ClientConnectorError: Cannot connect to host www.ifremer.fr:443 ssl:default [Name or service not known]

Is this a known issue?

Kevin Balem

@quai20

Hi !

what's the error in the 1st case (trying to fetch 1900857 from the tuto dataset) ?

phand

@HandmannP

Oh sorry- that is:

URLError: <urlopen error [Errno -2] Name or service not known>argopyargopy

Kevin Balem

@quai20

import argopy
from argopy import DataFetcher as ArgoDataFetcher
ftproot = argopy.tutorial.open_dataset('localftp')[0]
with argopy.set_options(src='localftp', local_ftp=ftproot):
    ds = ArgoDataFetcher().float(1900857).to_xarray()
    print(ds)

this should work

phand

@HandmannP

I did not post the import before - so its the same code that I tried - it is still not working:
URLError: <urlopen error [Errno -2] Name or service not known>argopyargopy I am using argopy on an HPC System

Kevin Balem

@quai20

when do the error occurs ? at the import ?

phand

@HandmannP

the URLError occurs here: ftproot = .tutorial.open_dataset('localftp')[0]

Kevin Balem

@quai20

do you have access to internet from your HPC job ?

phand

@HandmannP

Ususally yes

Kevin Balem

@quai20

when first called, argopy.tutorial downloads sample data, so no internet could cause the error

and default datasource is also online, so no connection could cause your second error.

can you check if there are some files in your ftproot ?

phand

@HandmannP

yes - though I just checked and I am not sure weather the ftp problem for the latter case for actually downloading data is related to the HPC Firewall

I am sorry I do not know how to check the ftproot

Kevin Balem

@quai20

you're running a notebook ?

phand

@HandmannP

yes

Kevin Balem

@quai20

import os
os.listdir(ftproot)

phand

@HandmannP

ftproot is not defined apparently

I am trying to fix this first by contacting our help desk and then if it is still problematic I will get back to here - I am sorry for interrupting your work - Have a very nice weekend

Kevin Balem

@quai20

You're welcome, feel free to ask any questions

but my guess is a connection issue

also, I don't know your area of interest, but carefull when requesting too large (region([lonmin,lonmax,latmin,latmax,0,4000., '1998-01-01', '2021-03-05']))

phand

@HandmannP

Yeah I am guessing that too - I guess they selectively let you use github, and conda...

no it is a small region in the subpolar North-Atlantic and it should be a download of maybe max 5 min.

Where communities thrive

People

Repo info

Activity