pelias/pelias

Pelias is a modular open-source geocoder using ElasticSearch for fast geocoding.

Quốc Nhật

@tranquocnhat

@Rishav_Jayswal_twitter you need sub project in github of Pelias include pelias/schema for create index pip service for enrich es data and openstreetmap importer so that u need

Mansoor Sajjad

@mansoor-sajjad

Is it possible to import custom fields in pelias elasticsearch and get them indexed?
We want to import some fields which are not present in the pelias model and want them to be indexed.
There is addendum field, but is it indexed?

1 reply

Christopher M Patino

@chris-patino-zartico

Hello all, I was wondering if there was any update to the reverse API call. Currently trying to bring in county, city names and ids for every H3 Uber Index Centroid, but notice that for slightly rural areas or even some on the the edge of the citys, are only return County in the response. Could recommend a better way to do it? I have a planet pelias stood up. Tried using the PIP service too but get the following curl -G "http://localhost:3102/-84.151651/32.216551"
curl: (7) Failed to connect to localhost port 3102: Connection refused

2 replies

Christopher M Patino

@chris-patino-zartico

As an update was able to get PIP service to work but still nothing (I had the wrong port in first attempt)

Quốc Nhật

@tranquocnhat

Hi everyone, i dont know polyline importer algorithm, maybe:

Use centroid of each polyline and enrich by pip service(It mean 1 polyline in 1 admin hirachy)
Use element node of each polyline and enrich by pip service
Or other method....
Please help me give correct answer!! Thanks you!

saravananperiyasamy

@saravanan-periyasamy03

Hi Everyone, I'm looking for documentation to install pelias in kubernetes. I found https://github.com/pelias-deprecated/kubernetes, but looks like it is stated as deprecated. Do we have any other document which can be referred for k8s installation or helm chart provided in the https://github.com/pelias-deprecated/kubernetes is valid? If anyone already installed pelias in k8s successfully can you please share the helm chart for the same.

jdomagalski

@jdomag

Hi Guys,
Is pelias still under the active development? I see the last commits are one year old

1 reply

Brad Hards

@bradh

@jdomag I think the evidence is at https://github.com/pelias

And of course, I'm sure they would love some help...

ellenhp

@ellenhp:matrix.org

[m]

Hey all, I've noticed that Pelias struggles to geocode queries (on the autocomplete endpoint) like "seattle arboretum" or "ballard target" while queries like "seattle arboretum" and "target ballard" tend to do fine. I'm sure it's language dependent but I feel like people do tend to construct queries like that in english so I was wondering if there's anything I could do to improve performance for those queries.

1 reply

I don't really understand the internals of Pelias quite yet but I noticed specifically that the geocoding.query.parsed_text field of the response seems to always assume admin area is the last word of the query. https://maps.earth/pelias/v1/autocomplete?text=seattle%20target

ellenhp

@ellenhp:matrix.org

[m]

The other thing I wanted to ask about is whether it may be possible to add a URL param to adjust focus.point bias strength. For this project I want to be able to bias very strongly if the user is zoomed in to like z15 or something and bias a lot less if they're out at z8. There was a way to do that in Photon and I'm hoping something like that could be implemented for Pelias. I don't mind being the one to go do it but I would like guidance on where the relevant parts of the codebase are if possible :)

ellenhp

@ellenhp:matrix.org

[m]

Could I modify that to call placeholder perhaps? Looking specifically for whether parts of the query may make sense as coarse locations.

ellenhp

@ellenhp:matrix.org

[m]

:point_up: Edit: Hey all, I've noticed that Pelias struggles to geocode queries (on the autocomplete endpoint) like "seattle arboretum" or "ballard target" while queries like "arboretum seattle" and "target ballard" tend to do fine. I'm sure it's language dependent but I feel like people do tend to construct queries like that in english so I was wondering if there's anything I could do to improve performance for those queries.

Mansoor Sajjad

@mansoor-sajjad

Arne Setzer

@arnesetzer

Hi guys, is there any way to force the wof-admin-lookup to use a specific language?
I downloaded the wof-data for germany and austria, but only in germany the country name is in german. In austria all the county/region/macrocountry/country names are in english for some reason. Any idea what could cause this issue?

Jean-Jérôme Casalonga

@Jean-Jerome-Casalonga-i2

Hi all,
I've a question regarding the answers of a simple geocoding search.
When I search this : "12 Bd Richard Lenoir, Paris", it finds the location.
When I search this : "12 Bd Lenoir, Paris", it finds the location.
But when I search this : "12 Bd R. Lenoir, Paris", it does not find the location.

Same for this searches :
"12 avenue philippe auguste, Paris" works
"12 avenue ph. auguste, Paris" doesn't find anything...

Is there a way to tweak Elasticsearch to make the searches work when one of the word is not complete ?

Thanks in advance.

Jean-Jérôme Casalonga

@Jean-Jerome-Casalonga-i2

Question 2.
I've installed and setup the Portland-Metro example. It's working.
Now, I want to add another country. I understand that I must do the same steps as for the Portland-metro, but if I do this, will the install for the new country delete the Portland data ? Or the 2 data will coexist ?
Thanks

Nguyễn Dương

@duongnv1989

I want to add dictionary when using docker (https://github.com/pelias/libpostal-service), how do I configure?
Thank you

Jim Hurd

@imoldfella

Is it expected that structured queries are dramatically slower than text queries? The blog post on the subject seems to suggest they should be faster

Samarth Sudarshan

@Samarth2898

Is there a way to enable fuzziness to the autocomplete API?
I'm using the docker setup.
It would be great if someone could help me out with this! Thanks!

Alexey Nikitin

@NewGlad

Does geocode.earth allow uploading custom data? Is it possible to use pelias csv-importer for this?

yogi222

@yogi222

esclient error message=Request Timeout after 120000ms, status=408,

error: [dbclient-whosonfirst] esclient error message=Request Timeout after 120000ms, status=408, displayName=RequestTimeout, stack=Error: Request Timeout after 120000ms
at /code/pelias/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:397:9
at Timeout.<anonymous> (/code/pelias/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:429:7)
at listOnTimeout (internal/timers.js:554:17)
at processTimers (internal/timers.js:497:7)
error: [dbclient-whosonfirst] invalid resp from es bulk index operation
info: [dbclient-whosonfirst] retrying batch [500]
error: [dbclient-whosonfirst] esclient error message=Request Timeout after 120000ms, status=408, displayName=RequestTimeout, stack=Error: Request Timeout after 120000ms
at /code/pelias/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:397:9
at Timeout.<anonymous> (/code/pelias/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:429:7)
at listOnTimeout (internal/timers.js:554:17)
at processTimers (internal/timers.js:497:7)
error: [dbclient-whosonfirst] invalid resp from es bulk index operation
info: [dbclient-whosonfirst] retrying batch [500]
error: [dbclient-whosonfirst] esclient error message=Request Timeout after 120000ms, status=408, displayName=RequestTimeout, stack=Error: Request Timeout after 120000ms
at /code/pelias/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:397:9
at Timeout.<anonymous> (/code/pelias/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:429:7)
at listOnTimeout (internal/timers.js:554:17)
at processTimers (internal/timers.js:497:7)
error: [dbclient-whosonfirst] invalid resp from es bulk index operation

help me short out this method

Creative Sapiens

@creativesapiens

@yogi222 did you find any help on this issue? I have been facing the same issue and was wondering if you had any more information on it, that might save a lot of research time on this issue

I was wondering if increasing timeout in pelias.json would be of any help

2022-10-23T22:29:55.234Z - error: [dbclient-whosonfirst] esclient error message=Request Timeout after 120000ms, status=408, displayName=RequestTimeout, stack=Error: Request Timeout after 120000ms
    at /home/user/Softwares/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:397:9
    at Timeout.<anonymous> (/home/user/Softwares/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:429:7)
    at listOnTimeout (node:internal/timers:559:17)
    at processTimers (node:internal/timers:502:7)
2022-10-23T22:29:55.238Z - error: [dbclient-whosonfirst] invalid resp from es bulk index operation
2022-10-23T22:29:55.239Z - info: [dbclient-whosonfirst] retrying batch [500]
2022-10-23T22:29:56.091Z - error: [dbclient-whosonfirst] esclient error message=Request Timeout after 120000ms, status=408, displayName=RequestTimeout, stack=Error: Request Timeout after 120000ms
    at /home/user/Softwares/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:397:9
    at Timeout.<anonymous> (/home/user/Softwares/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:429:7)
    at listOnTimeout (node:internal/timers:559:17)
    at processTimers (node:internal/timers:502:7)
2022-10-23T22:29:56.091Z - error: [dbclient-whosonfirst] invalid resp from es bulk index operation
2022-10-23T22:29:56.091Z - info: [dbclient-whosonfirst] retrying batch [500]
2022-10-23T22:29:56.117Z - error: [dbclient-whosonfirst] esclient error message=Request Timeout after 120000ms, status=408, displayName=RequestTimeout, stack=Error: Request Timeout after 120000ms
    at /home/user/Softwares/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:397:9
    at Timeout.<anonymous> (/home/user/Softwares/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:429:7)
    at listOnTimeout (node:internal/timers:559:17)
    at processTimers (node:internal/timers:502:7)
2022-10-23T22:29:56.117Z - error: [dbclient-whosonfirst] invalid resp from es bulk index operation
2022-10-23T22:29:56.117Z - info: [dbclient-whosonfirst] retrying batch [500]
2022-10-23T22:29:56.143Z - error: [dbclient-whosonfirst] esclient error message=Request Timeout after 120000ms, status=408, displayName=RequestTimeout, stack=Error: Request Timeout after 120000ms
    at /home/user/Softwares/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:397:9
    at Timeout.<anonymous> (/home/user/Softwares/whosonfirst/node_modules/elasticsearch/src/lib/transport.js:429:7)
    at listOnTimeout (node:internal/timers:559:17)
    at processTimers (node:internal/timers:502:7)
2022-10-23T22:29:56.143Z - error: [dbclient-whosonfirst] invalid resp from es bulk index operation
2022-10-23T22:29:56.143Z - info: [dbclient-whosonfirst] retrying batch [500]
2022-10-23T22:29:56.567Z - info: [dbclient-whosonfirst] retrying batch [500]
2022-10-23T22:29:56.568Z - error: [dbclient-whosonfirst] transaction error invalid bulk payload length. Payload received: []
2022-10-23T22:29:56.584Z - info: [dbclient-whosonfirst] retrying batch [500]
2022-10-23T22:29:56.584Z - error: [dbclient-whosonfirst] transaction error invalid bulk payload length. Payload received: []
2022-10-23T22:29:59.559Z - info: [dbclient-whosonfirst] retrying batch [500]
2022-10-23T22:29:59.559Z - error: [dbclient-whosonfirst] transaction error invalid bulk payload length. Payload received: []
2022-10-23T22:29:59.560Z - info: [dbclient-whosonfirst] retrying batch [500]
2022-10-23T22:29:59.567Z - error: [dbclient-whosonfirst] transaction error invalid bulk payload length. Payload received: []

The above was the issue that occured for me

Cyprien Huissoud

@slvlirnoff

Hello everyone, does someone know which importer produce these type of documents: https://pelias.github.io/compare/#/v1/place?ids=openstreetmap%3Apostalcode%3ADE79688 ? Source is openstreetmap and layer is postalcode. Is OpenStreetMap used at all for admin lookup? That feature seemed on hold for now: pelias/pelias#389

Cyprien Huissoud

@slvlirnoff

Also another quick question: is it possible to request the response in the 'default' language? It doesn't seems so anymore and if the right 'local' language isn't known at request time it seems impossible to retrieve the result using the default preferred language of the place (oustide asking for an obscure language code that isn't translated). Does someone knows a way to do so?

George Hamster

@geoops

Hello, on a fresh planet index build I am getting 53 regressions but I am able to replicate these 'regressions' on pelias.github.io.

Aggregate test results
Pass: 608
Improvements: 18
Expected Failures: 109
Placeholders: 0
Regressions: 53
Total tests: 788
Took 47101ms
Test success rate 93.27%

FATAL ERROR: 53 regression(s) detected.
ERROR: 1

Here is one example regressions

  ✘ regression [7] "/v1/search?sources=wof&text=Città del Vaticano, Vatican": score 3 out of 6
  diff:
    name
      expected: Vatican City
      actual:   Città del Vaticano
    locality
      expected: Vatican City
      actual:   Città del Vaticano
    country
      expected: Vatican City
      actual:   Vatican

But comparing this output to https://pelias.github.io/compare/#/v1/search?sources=wof&text=Citt%C3%A0+del+Vaticano%2C+Vatican I see that the same 'regression' exists

"properties": {
        "id": "101914185",
        "gid": "whosonfirst:locality:101914185",
        "layer": "locality",
        "source": "whosonfirst",
        "source_id": "101914185",
        "country_code": "VA",
---> "name": "Città del Vaticano",
        "confidence": 0.1,
        "match_type": "unknown",
        "accuracy": "centroid",
---> "country": "Vatican",
        "country_gid": "whosonfirst:country:85632187",
        "country_a": "VAT",
        "region": "Vatican",
        "region_gid": "whosonfirst:region:85688891",
        "region_a": "VA",
---> "locality": "Città del Vaticano",
        "locality_gid": "whosonfirst:locality:101914185",
        "continent": "Europe",
        "continent_gid": "whosonfirst:continent:102191581",
        "label": "Città del Vaticano, VA, Vatican"

Is this something I should crate a bug report for?

Quốc Nhật

@tranquocnhat

I'm import csv data to elasticsearch but script ./bin/start no exit, can every one explain why ?

Edward Mac Gillavry

@emacgillavry

Hi there, how are population or popularity taken into account by pelias? Are these values used as supplied in the WOF database? Also postalcode have a default value of 9000. Can these be changed somehow?

Daniel Padrón Morales

@saturnino:matrix.org

[m]

Hi ¡¡ How can i do modify data in db wof ? it's possible?
I have found this project, but it is not stable https://github.com/pelias/wof

Arne Setzer

@arnesetzer

If I understand you correctly you need to edit the .geojson files and than export them as sqlite into the correct directory. After that you need to (re)import these with pelias import wof if you're using the docker version

uerdemiryukatech

@uerdemiryukatech

Hi there, i installed Pelias Planet build on my server with prepare extracts from Geoearth rather than preparing myself but i got some errors when i ran test script. What can be it reason? I shared test result.

Pass: 503
Improvements: 14
Expected Failures: 101
Placeholders: 0
Regressions: 138
Total tests: 756
Took 19113ms
Test success rate 81.75%

Nazareno Cavazzon

@NazarenoCavazzon

1 reply

Hi guys, I'm trying to run the pelias download all command and I get this error

Jane foster

@Janefoster68_gitlab

1 reply

shrutiverma05

@shrutiverma05

shrutiverma05

@shrutiverma05

Hello everyone, I want to create a new project for the UK in Pelias for that I have created the pelias.json file above is my JSON file can someone guide me is that the correct way to create JSON for UK services because I am getting errors while running this file.

Here is the error which I am facing while importing the data into elasticsearch

Arne Setzer

@arnesetzer

Do you use the docker version? In this case: What does pelias elastic status returns?

shrutiverma05

@shrutiverma05

yes, I am using docker version 20.10.21 and checked the Pelias elastic status it is giving 200.

shrutiverma05

@shrutiverma05

@arnesetzer do you have a solution I have been stuck on it for the last 2 days and I don't understand the problem and how can we fix it please let me know if you find anything, Thank you

Arne Setzer

@arnesetzer

Then check your elasticsearch connection. Your provided log looks like that wof couldn't connect to es.
If you want an easy solution: Copy the german/austrian/etc. project and just replace the download urls

And did you follow the https://github.com/pelias/docker#quickstart-build-script ?

Where communities thrive

People

Repo info

Activity