Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    MacPingu
    @cehbrecht
    no worries :)
    Just van den Broecke
    @justb4
    ok thanks @tomkralidis @cehbrecht !
    Tom Kralidis
    @tomkralidis
    @/all FYI I’ve started working on a refactor of OGC API support given how things are evolving. This will result in breaking changes. Branch in https://github.com/geopython/OWSLib/compare/oapi-refactor . Will issue a PR in the next few weeks
    Just van den Broecke
    @justb4
    @tomkralidis good to hear! At that time we'll need to adapt the GeoHealthCheck OGC API Probe (already uses workarounds for OWSLib OGC API).
    Tom Kralidis
    @tomkralidis
    hi all: FYI as an OSGeo Community project we can request a budget of some funding for 2020 (budget meeting is Monday). Suggesting $1000 USD to help some of us get to the OSGeo code sprint. Thoughts?
    Jorge Samuel Mendes de Jesus
    @jorgejesus
    Dont want to sound ungrateful but $1000 is very low 🤔
    Couldnwe ask for 5k with argument of supporting junior develoers to attend OsGEO code sprints ??
    Tom Kralidis
    @tomkralidis
    good point @jorgejesus . We should aim to become an official OSGeo project in this case.
    Tom Kralidis
    @tomkralidis
    FYI 0.19.1 released. cc @cehbrecht
    MacPingu
    @cehbrecht
    @tomkralidis thanks :)
    Tom Kralidis
    @tomkralidis
    thank you @cehbrecht and all for support of improving OWSLib !
    Tom Kralidis
    @tomkralidis
    @justb4 RE: geopython/OWSLib#653, getting clarification from ldproxy as well as OGC. Stay tuned/will update
    MacPingu
    @cehbrecht
    @tomkralidis are you ok with dropping python 3.5 in owslib? geopython/OWSLib#659
    Tom Kralidis
    @tomkralidis
    @cehbrecht no objections
    Tom Kralidis
    @tomkralidis
    hi @cehbrecht . For #609, some comments:
    • looks like the culprit is the verify=True default in owslib.util.openURL
    • perhaps we can change to verify=None and test for the value being set, and then True or False, this might be a short term solution?
    diff --git a/owslib/util.py b/owslib/util.py
    index 24e7af6..704dfce 100644
    --- a/owslib/util.py
    +++ b/owslib/util.py
    @@ -143,7 +143,7 @@ class ResponseWrapper(object):
    
    
     def openURL(url_base, data=None, method='Get', cookies=None, username=None, password=None, timeout=30, headers=None,
    -            verify=True, cert=None, auth=None):
    +            verify=None, cert=None, auth=None):
         """
         Function to open URLs.
    
    @@ -170,7 +170,7 @@ def openURL(url_base, data=None, method='Get', cookies=None, username=None, pass
                 auth.password = password
             if cert:
                 auth.cert = cert
    -        if verify and not auth.verify:
    +        if verify is not None and verify and not auth.verify:
                 auth.verify = verify
         else:
             auth = Authentication(username, password, cert, verify)
    basically option 3 in #609
    MacPingu
    @cehbrecht
    The code looks confusing … if verify=None helps for now then we can go for it. But probably we need to refactor this.
    Tom Kralidis
    @tomkralidis
    agree, longer term we need a refactor. I am thinking we can build this out over time and apply to the new OGC API standards support.
    Tom Kralidis
    @tomkralidis
    @cehbrecht I’m going to merge geopython/OWSLib#685 and add some info about the workaround to our docs, at which point I’ll cut 0.20.0 on Friday. Makes sense?
    MacPingu
    @cehbrecht
    @tomkralidis ok. Thanks :)
    Tom Kralidis
    @tomkralidis
    @cehbrecht around for a 0.20.0 release?
    MacPingu
    @cehbrecht
    @tomkralidis today? I have a telco in the next minutes … after that I should be available for half an hour ...
    Tom Kralidis
    @tomkralidis
    Excellent. I’ve staged it at geopython/OWSLib#694 for your review.
    MacPingu
    @cehbrecht
    Ok … I check it.
    @tomkralidis I’m ok with it :) Should I add the PR links to the changes?
    Tom Kralidis
    @tomkralidis
    sure, you can do that or make your own PR on CHANGES.rst and I’ll remove mine. Whatever is easier for you
    MacPingu
    @cehbrecht
    I can make the change on the existing PR branch.
    I will let you know when done.
    Tom Kralidis
    @tomkralidis
    kk
    MacPingu
    @cehbrecht
    @tomkralidis changes done.
    Tom Kralidis
    @tomkralidis
    thanks. Moving ahead.
    MacPingu
    @cehbrecht

    @tomkralidis I have a question about the catalog service csw. Is it possible to search for updated/new records? We harvest records from a CSW service and after the initial full request we would like to search only for updated and new records. This is a behaviour supported by OAI services … using the from parameter:
    https://sickle.readthedocs.io/en/latest/tutorial.html?highlight=from#using-the-from-parameter

    The current dev code for harvesting with CSW looks like this:
    https://github.com/cehbrecht/md-ingestion/blob/pingudev/mdingestion/ng/harvester/csw.py

    Tom Kralidis
    @tomkralidis
    @cehbrecht you’ll need to issue CSW requests with a filter (XML) like modified > YYYY-MM-DD type thing
    Tom Kralidis
    @tomkralidis
    so like (untested):
    from owslib import fes
    from owslib.csw import CatalogueServiceWeb
    
    filter_ = fes.PropertyIsGreaterThan(‘modified', ‘2020-05-10’)
    
    c = CatalogueServiceWeb(‘http://example.org/csw')
    
    c.getrecords2(constraints=[filter_])
    MacPingu
    @cehbrecht
    @tomkralidismodified is a field which is always available on a CSW? … or does this depend on the records schema?
    Tom Kralidis
    @tomkralidis
    @cehbrecht sorry, should be dct:modified, which is CSW core (see Subclause 10.2.5.3.2 and Table 53 of http://portal.opengeospatial.org/files/?artifact_id=20555)
    MacPingu
    @cehbrecht
    @tomkralidis ok. Thanks :)
    Luís de Sousa
    @ldesousa

    Hi folks. Some of my WCS notebooks stopped working with time outs. The services reply correctly to direct requests, but GetCoverage requests through OWSLib fail. Here is an example:

    from owslib.wcs import WebCoverageService

    wcs = WebCoverageService('http://maps.isric.org/mapserv?map=/map/phh2o.map',
    version='2.0.1')
    cov_id = 'phh2o_0-5cm_mean'
    ph_0_5 = wcs.contents[cov_id]
    subsets = [('X', -1784000, -1140000), ('Y', 1356000, 1863000)]
    crs = "http://www.opengis.net/def/crs/EPSG/0/152160"

    response = wcs.getCoverage(
    identifier=[cov_id],
    crs=crs,
    subsets=subsets,
    resx=250, resy=250,
    format=ph_0_5.supportedFormats[0])

    But the equivalent request directly sent through HTTP is successful:

    https://maps.isric.org/mapserv?map=/map/phh2o.map&
    SERVICE=WCS&
    VERSION=2.0.1&
    REQUEST=GetCoverage&
    COVERAGEID=phh2o_0-5cm_mean&
    FORMAT=GEOTIFF_INT16&
    SUBSET=X(-1784000,-1140000)&
    SUBSET=Y(1356000,1863000)&
    SUBSETTINGCRS=http://www.opengis.net/def/crs/EPSG/0/152160&
    OUTPUTCRS=http://www.opengis.net/def/crs/EPSG/0/152160

    Any clues?

    Tom Kralidis
    @tomkralidis

    hey @cehbrecht FYI for the OSGeo AGM, given OWSLib is a community project, any chance you/others can update the AGM deck at https://docs.google.com/presentation/d/1C6llSnWZ28c2aWQgttPiOnoo6dttdqKg07ugU_yr6Uc/edit#slide=id.g9401e4b2da_178_10 (currently slide 75).

    FYI AGM is this Thursday.

    Thanks

    MacPingu
    @cehbrecht
    @tomkralidis I have updated the owslib slide.
    Tom Kralidis
    @tomkralidis
    Thanks @cehbrecht
    Tom Kralidis
    @tomkralidis
    @cehbrecht are you attending the AGM today? Would you be able to talk to the OWSLib slide (slide 84)?
    MacPingu
    @cehbrecht
    @tomkralidis sorry … I’m not at AGM ...
    Tom Kralidis
    @tomkralidis
    ok np, just presented, thanks again for the input
    MacPingu
    @cehbrecht
    @tomkralidis thanks for taking care of this :)
    MacPingu
    @cehbrecht
    Has someone more experience with WFS to check this pull request?
    geopython/OWSLib#706
    @huard Can we add someone from your side to the maintainers of owslib? (ping @tomkralidis).
    David Huard
    @huard
    We're a bit stretched thin at the moment. We're currently hiring a new programmer. Give me a few weeks and I'll come back to you about this.
    Paul van Genuchten
    @pvgenuchten
    hi, dummy question here, i try to follow the instructions at https://github.com/geopython/OWSLib/blob/master/docs/en/index.rst#csw, for this line: csw.transaction(ttype='insert', typename='gmd:MD_Metadata', record=open("file.xml").read()), it seems to always throw "xml.etree.ElementTree.ParseError: mismatched tag: line 22, column 5", no matter what xml i try to feed it, any idea how to debug this?
    Tom Kralidis
    @tomkralidis
    Hi @pvgenuchten do you have a sample metadata to test?