Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Sep 27 14:39
    ksonda opened #787
  • Sep 27 14:39
    ksonda labeled #787
  • Sep 27 00:25

    tomkralidis on master

    add queryable support for CSV a… (compare)

  • Sep 27 00:25
    tomkralidis closed #555
  • Sep 27 00:23
    tomkralidis assigned #555
  • Sep 27 00:21
    tomkralidis milestoned #786
  • Sep 26 11:40
    tomkralidis closed #782
  • Sep 26 11:40
    tomkralidis commented #782
  • Sep 26 11:39
    tomkralidis commented #756
  • Sep 26 11:10

    tomkralidis on doc-csv-table

    (compare)

  • Sep 26 11:10

    tomkralidis on master

    docs: make CSV table more reada… (compare)

  • Sep 26 11:01

    tomkralidis on doc-csv-table

    docs: make CSV table more reada… (compare)

  • Sep 25 11:07
    tomkralidis commented #291
  • Sep 25 11:05
    tomkralidis commented #747
  • Sep 25 11:03

    tomkralidis on master

    Add postgres provider query par… (compare)

  • Sep 25 10:48
    tomkralidis commented #783
  • Sep 25 10:48

    tomkralidis on master

    782: Replaced the literal strin… Merge branch '782_subsetting_us… Merge branch 'MetServiceDev-782… and 1 more (compare)

  • Sep 21 11:15

    tomkralidis on master

    Update pygeoapi-config.yml (compare)

  • Sep 21 10:34

    tomkralidis on master

    Update SECURITY.md (compare)

  • Sep 20 20:17
    francbartoli commented #630
Tom Kralidis
@tomkralidis
if I'm guessing records, then you can use the OARec properties.assocations structure to house your record specific links
EHJ-52n
@EHJ-52n
Thank you very much for your fast response and pointing me to this. I'll give it a try!
EHJ-52n
@EHJ-52n
Adding general purpose link for external resource works like a charm.
paul van genuchten
@pvgenuchten
i probably should ask on qgis list, but wanted to verify here first, do you share the experience that loading ogc-api-features (polygons) from pygeoapi is really slow on qgis? tested with https://apisandbox.geonovum.nl/pygeoapi_SU; in a browser fetching features takes parts of a second in qgis the screen builds up in 10 to 20 seconds
Tom Kralidis
@tomkralidis
I find it slow as well, +1 to ask on QGIS. I'm also not sure whether QGIS is attemping to fetch all features, or not.
you can check the network traffic in the qgis network logger, they always include a bbox filter
image.png
Tom Kralidis
@tomkralidis
what's their page size?
paul van genuchten
@pvgenuchten
you can set the page size as a parameter on the connection
let me check which is the default
Tom Kralidis
@tomkralidis
also check if it's being honoured
paul van genuchten
@pvgenuchten
default pagesize is 100
image.png
and it is honoured
Just van den Broecke
@justb4
the pygeoapi config is here. Source data is a GPKG, Driver is OGR. Maybe can play with GDAL_CACHEMAX.
paul van genuchten
@pvgenuchten
a thing to check is why is the json rendering much slower then html rendering (2 sec vs 17ms)
Just van den Broecke
@justb4
indeed for me curl -o f.json 'https://apisandbox.geonovum.nl/pygeoapi_SU/collections/StatisticalUnits_Gemeente_2020/items?limit=500&f=json' is 2 secs.
or am i limited by the unpredictable wifi speed in my hotel :-)
Tom Kralidis
@tomkralidis
is this something that gzip compression can help with on the server?
paul van genuchten
@pvgenuchten
compression of json always is a good idea, can we easily add that @justb4 ?
so you expect this is a problem of download size/speed; not some rendering issue?
Just van den Broecke
@justb4
For performance investigation one needs to analyse the entire chain of the data fetch. Usually the weakest link in the chain is the bottleneck. So from a hotel WIFI here to how fast OGR reads from a GeoPackage. Thus everything inbetween. Traefik is the proxy here, may gzip encoding help? Don't know. Needs investigation.
paul van genuchten
@pvgenuchten
the raw json is 6.4mb, that could be slow on this wifi
gzipped is 500k
Tom Kralidis
@tomkralidis
The JSON response is ~6MB, whereas the HTML response (which includes the JSON response inline) is 1.75MB. Not sure what's going on there.
paul van genuchten
@pvgenuchten
maybe the inline json does not have the limit=500?
Just van den Broecke
@justb4
for f=html the GeoJSON is embedded 1.8MB. for f=json 6MB the JSON appears formatted. Maybe the difference is just spaces?
Tom Kralidis
@tomkralidis
good point @just ; @pvgenuchten set server.pretty_print to false and try again?
KoalaGeo
@KoalaGeo
For interest, today saw "ogcldapi" demonstrated - http://floods.surroundaustralia.com/collections/HF2021/items/1020 . Implements OGCAPI-Features but with focus on Linked Data, includes a SPARQL endpoint - https://github.com/surroundaustralia/ogcldapi
nagyrobir
@nagyrobir
Hi everybody, I was wondering, is there any method to define a basic or Token based auth for given published API's? so access could be restricted to a few users for a given Layer? or maybe it is better to use Nginx for this? Thank you again for your time and patience.
Tom Kralidis
@tomkralidis
@nagyrobir pygeoapi doesn't do anything with Auth yet. You can do basic auth through your web server. We should consider token based auth for future functionality
nagyrobir
@nagyrobir
Thank you again! See you at Foss4G, registered to the workshop, super hyped!
:D
Tom Kralidis
@tomkralidis
ah, great to hear!
EHJ-52n
@EHJ-52n
How can I add the latest development version of pygeoapi to my venv which I use to develop my own processor?
Tom Kralidis
@tomkralidis

Options:

  • create your venv, git clone and install
  • pip install https://github.com/geopython/pygeoapi/archive/master.zip

Is this what you mean?

2 replies
EHJ-52n
@EHJ-52n
Does the tinydb process manager implement some clean-up procedure regarding the jobs and the according results?
Tom Kralidis
@tomkralidis
not by default. You need to delete a job per se via OAProc
EHJ-52n
@EHJ-52n
Is there any example of a long running processor showing how the interaction between processor and job manager should be implemented?
I am currently raising ProcessorExecuteError errors on backend errors in my execute method. The resulting job fails but the message is not shown in the job status. Here, the last message is status 5% and InvalidParameterValue: Error updating job.
1 reply
EHJ-52n
@EHJ-52n
How can I tell pygeoapi that my process supports only async execution?
Adding 'jobControlOptions': 'async-execute', does not result in any change of the finally returned process description
3 replies
Just van den Broecke
@justb4
Sharing: deploying pygeoapi via GitOps (=DevOps+Git) is a breeze using the GitHub Template repo @pvgenuchten and I developed at Geonovum for deploying a multi-service stack with OSGeo software front-ended with Traefik.
Now just created an instance for EC JRC. See all via https://jrc.map5.nl/.
Martin Pontius
@MartinPontius
Hi everyone,
I would like to offer a coverage collection with pygeoapi in multiple file formats (GeoTIFF, netCDF), but couldn't find anything about it in the documentation. What would be the preferred way of doing this?
Tom Kralidis
@tomkralidis
@francbartoli @pvgenuchten @kalxas @justb4 FYI I am drafting the pygeoapi presentation. Will email you all by Monday with a draft for review/comment and orchestration.
Tom Kralidis
@tomkralidis

all: as well: https://twitter.com/pygeoapi/status/1441815933543231488

Please get in touch if you’d like your project(s) added to our presentation.

Thanks

Sander Schaminee
@GeoSander
FYI/ICYMI I am also presenting something about the multilingual stuff on Wednesday (but I am not nearly done yet with the presentation... 😬)
Tom Kralidis
@tomkralidis
:+1: