Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Julian Simioni
    @orangejulius
    if you're running a full planet PIP service 8GB ram total would be pretty tight
    the PIP service itself is almost 8, and the API and Placeholder each take a few hundred MB. Doesn't leave much room
    Benoît Bouré
    @bboure
    ok thanks for the tips.
    Will try with r5.large + 1 c5.large to start with and see from there
    cyfugr
    @cyfugr
    is it possible searching with pelias general types of venues, like coffee shop in london?
    Benoît Bouré
    @bboure
    @cyfugr yes, you can use the (undocumented) /nearby endpoint. It has a "categories" parameter
    Benoît Bouré
    @bboure
    /v1/nearby?categories=food:coffee_shop&boundary.circle.radius=10&point.lat=51.4896314&point.lon=-0.1248264
    cyfugr
    @cyfugr
    Cheers @bboure , i guess you can not just type it in search, like i will need fist to get the points od london and then perform that search.
    Benoît Bouré
    @bboure
    You can use search/autocomplete, but the use-case is a bit different. With search/autocomplete you would search for a specific coffee-shop: eg: Starbucks
    cyfugr
    @cyfugr
    @bboure got it, thank you.
    mdoakes42
    @mdoakes42
    Hello, New to Pelias but have docker setup and have some custom data loaded. THings working well. Question I have and hoping someone can help. Does the standard pelias schema contain geo location "shapes" (Polygons/lines)... Or is there just a centroid lat/lon. If so, can we do a spatial query on top of the polygon. IE, Only return records where polygon falls inside of bbox. (verse just checking the centroid...which may or may not be in the bbox)
    Edward Mac Gillavry
    @emacgillavry
    Would like to contribute updates and improvements to the dictionaries for the Netherlands as used by the parser (https://github.com/pelias/parser/tree/master/resources/libpostal/dictionaries/nl). How would these changes be made available to libpostal too?
    16 replies
    cyfugr
    @cyfugr
    Is there a way to get the type of a point? ie 'hotel', 'bar' etc from osm, wof data ?
    Francisco Sauceda
    @saucedaf
    Hello, has this been implemented? https://pelias.io/milestones/categories/
    gdi-disy
    @DisyGdi_twitter

    Hello everyone,
    i am struggling with the configuration for authentication via token for elasticsearch.
    curl calls from pelias-api pod to elasticsearch-master work with api-key auth but using pelias-api calls it fails with the following error

    Does anyone have an idea?

    authenticate={ 0=\"Bearer realm=\\\"security\\\"\" & 1=\"ApiKey\" & 2=\"Basic realm=\\\"security\\\" charset=\\\"UTF-8\\\"\" } } } :: {\"path\":\"/pelias/_search\",\"query\":{\"search_type\":\"dfs_query_then_fetch\"},\"body\":\"{\\\"query\\\":{\\\"function_score\\\":{\\\"query\\\":{\\\"bool\\\":{\\\"minimum_should_match\\\":1,\\\"should\\\":[{\\\"bool\\\":{\\\"_name\\\":\\\"fallback.street\\\",\\\"must\\\":[{\\\"match_phrase\\\":{\\\"address_parts.street\\\":{\\\"query\\\":\\\"westring\\\",\\\"slop\\\":4,\\\"analyzer\\\":\\\"peliasQuery\\\"}}}],\\\"filter\\\":{\\\"term\\\":{\\\"layer\\\":\\\"street\\\"}},\\\"boost\\\":5}},{\\\"bool\\\":{\\\"_name\\\":\\\"fallback.address\\\",\\\"must\\\":[{\\\"match_phrase\\\":{\\\"address_parts.number\\\":{\\\"query\\\":\\\"501\\\"}}},{\\\"match_phrase\\\":{\\\"address_parts.street\\\":{\\\"query\\\":\\\"westring\\\",\\\"slop\\\":4,\\\"analyzer\\\":\\\"peliasQuery\\\"}}}],\\\"filter\\\":{\\\"term\\\":{\\\"layer\\\":\\\"address\\\"}},\\\"boost\\\":10}}],\\\"filter\\\":{\\\"bool\\\":{\\\"must\\\":[]}}}},\\\"functions\\\":[]}},\\\"size\\\":20,\\\"track_scores\\\":true}\",\"statusCode\":401,\"response\":\"{\\\"error\\\":{\\\"root_cause\\\":[{\\\"type\\\":\\\"security_exception\\\",\\\"reason\\\":\\\"missing authentication credentials for REST request [/pelias/_search?search_type=dfs_query_then_fetch]\\\",\\\"header\\\":{\\\"WWW-Authenticate\\\":[\\\"Bearer realm=\\\\\\\"security\\\\\\\"\\\",\\\"ApiKey\\\",\\\"Basic realm=\\\\\\\"security\\\\\\\" charset=\\\\\\\"UTF-8\\\\\\\"\\\"]}}],\\\"type\\\":\\\"security_exception\\\",\\\"reason\\\":\\\"missing authentication credentials for REST request [/pelias/_search?search_type=dfs_query_then_fetch]\\\",\\\"header\\\":{\\\"WWW-Authenticate\\\":[\\\"Bearer realm=\\\\\\\"security\\\\\\\"\\\",\\\"ApiKey\\\",\\\"Basic realm=
    \\\\\\\"security\\\\\\\" charset=\\\\\\\"UTF-8\\\\\\\"\\\"]}},\\\"status\\\":401}\",\"wwwAuthenticateDirective\":\"Bearer realm=\\\"security\\\", ApiKey, Basic realm=\\\"security\\\" charset=\\\"UTF-8\\\"\"}","label":"api","timestamp":"2021-01-28T16:26:48.806Z"}

    pelias.json

    {
        "esclient": {
          "hosts": [{
            "host": "x.43.155.194",
            "port": 9200,
            "protocol": "https"
          }],
            "auth": { "apiKey": "VU9ETlNYY0J3cEtTcWdJT2pjLWM6ZXAwTldIRkRTTkMyYTNIdjNYZGRqZw==" }
        }
    curl request works
    curl -H "Authorization: ApiKey VU9ETlNYY0J3cEtTcWdJT2pjLWM6ZXAwTldIRkRTTkMyYTNIdjNYZGRqZw==" -k https://x.43.155.194:9200/_cluster/health
    
    {"cluster_name":"elasticsearch","status":"green","timed_out":false,"number_of_nodes":2,"number_of_data_nodes":2,"active_primary_shards":1,"active_shards":2,"relocating_shards":0,"initializing_shards":0,"unassigned_shards":0,"delayed_unassigned_shards":0,"number_of_pending_tasks":0,"number_of_in_flight_fetch":0,"task_max_waiting_in_queue_millis":0,"active_shards_percent_as_number":100.0}
    Phlegx Systems OG
    @phlegx
    Hi there! I was wondering that if with https://github.com/pelias/openstreetmap we can also import already existing files, or if we do have to always pass an URL to the file?
    3 replies
    Phlegx Systems OG
    @phlegx
    And another question: This whoisonfirst importer is not available in the helm chart, right? I'm running into this issue, when I try to import some OSM DB: pelias/openstreetmap#544 So that means I would need to run the whoisfirstimport first before the openstreetmap iimporter, right?
    1 reply
    Oleksandr Zholob
    @ShoSashko
    Hello everyone,
    I see from the documentation that I can't install Pelias from the portland-metro example on Windows locally.
    What If I am using linux-containers for docker on Windows? Is that still be a problem? :)
    spshealy
    @spshealy
    Does Pelias use Tiger files for forward geocoding of street addresses in the US? Reason I am asking isI modified the north-america docker project to download all the tiger files. But when I forward geocoded some street addresses(that have been around forever) in the county next to mine it can't find a high confidence hit and returns the centorid of the locality from whosonfirst. I notice that there is no openaddresses file(Richland County,SC) but I would still think the address would be estimate-able form TIGER address data. Perhaps i am misunderstanding how Pelias uses TIGER data. TIA
    benbiju
    @benbiju
    hi, i have setup pelias docker and imported OSM data. I am testing the /search endpoint and some fields are missing in the response compared to https://pelias.github.io/compare/#/v1/search. For example, when i searched for Nicollet Mall in the server, it returned
    "layer": "venue", "source": "openstreetmap", "source_id": "node/3452611421", "name": "The Nicollet Diner", "housenumber": "1428", "street": "Nicollet Avenue", "postalcode": "55403", "confidence": 0.8, "match_type": "fallback", "accuracy": "point", "label": "The Nicollet Diner",
    But if i search for Nicollet Mall in https://pelias.github.io/compare/#/v1/search?sources=osm&text=nicollet+mall, i am getting more fields like county, region, country names etc. Is there a way i can expose these information in the /search response from my pelias setup
    Phlegx Systems OG
    @phlegx
    For the whoseonefirst importer, do we have a PELIAS_CONFIG as well? Checked the code and doesn't seem to be there. How else can I set the filename for the pelias confi?
    2 replies
    Nirmal Kumar
    @nirmalkq

    Hi, I am getting this error with whoseonefirst importer . Any idea how to resolve this .Creating pelias_whosonfirst_run ... done
    /code/pelias/whosonfirst/import.js:18
    throw new Error(err.message);
    ^

    Error
    at /code/pelias/whosonfirst/import.js:18:11
    at getDBList (/code/pelias/whosonfirst/src/bundleList.js:54:12)
    at Object.getList [as generateBundleList] (/code/pelias/whosonfirst/src/bundleList.js:61:12)
    at Object.<anonymous> (/code/pelias/whosonfirst/import.js:15:9)
    at Module._compile (internal/modules/cjs/loader.js:955:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:991:10)
    at Module.load (internal/modules/cjs/loader.js:811:32)
    at Function.Module._load (internal/modules/cjs/loader.js:723:14)
    at Function.Module.runMain (internal/modules/cjs/loader.js:1043:10)
    at internal/main/run_main_module.js:17:11

    cyfugr
    @cyfugr
    Hi, i want to rank results that are first in a specific country and then everything else, any ideas ?
    kkflorian
    @kkflorian
    Does pelias provide pre-built search indices (like for example photon does)?
    Phlegx Systems OG
    @phlegx
    Hi there! Can I do this schema also with the Pelias Kubernetes Helm Chart? https://github.com/pelias/schema/
    2 replies
    Adam Rousell
    @rabidllama
    Hi everyone, I'm doing some testing to get a full planet import (using docker) working and everything goes fine until I go to running the import and prepare again to update the data. My question is what is the best approach for updating everything to make sure the geocoder is up to date? I can get the import of ElasticSearch working with a little bit of scripting and automation with ES aliases, but I run into problems with services like placeholder. During the "pelias prepare all" i get errors from sqlite along the lines of SqliteError: UNIQUE constraint failed: docs.id, so I guess that is because the service is already running from bringing the geocoder API up. Is there a way to do everything without running into such issues?
    1 reply
    petertoner
    @petertoner
    @DisyGdi_twitter I'm having the same issue "missing authentication credentials for REST request" - did you manage to resolve this?
    Hamza Rhaiem
    @hamzarhaiem
    I installed Pelias with Docker but i can't find where to install my ssl certificate and makes Docker listen to the 443? Thanks.
    gdi-disy
    @DisyGdi_twitter

    @DisyGdi_twitter I'm having the same issue "missing authentication credentials for REST request" - did you manage to resolve this?

    Hello @petertoner we are still working on this issue. currently trying to connect to elasticsearch via debugger-Pod. What we have learned so far: you need to adjust the pelias.config in the esclient-Part e.g. as mentioned above
    (shift+enter for line break) "esclient": { "hosts": [{ "host": "x.x.x.2", "port": xxxx, "protocol": "https" }], "auth": { "ApiKey": <API-KEY> } ... }
    Furthermore, the security-settings for for elasticsearch must set correctly. curl for cluster API works, but queries for the index do not work. Could be a misconfiguration on the elasticsearch component. We have to test that. Yet, it seems that the esconfig-Part is read correctly and send to the elasticsearch-Client (see https://github.com/pelias/api/blob/master/routes/v1.js#L33).

    Hamza Rhaiem
    @hamzarhaiem
    I installed Pelias with Docker but i can't find where to install my ssl certificate and makes Docker listen to the 443? Thanks.
    Phlegx Systems OG
    @phlegx
    Lets say I have imporrted the OSM into ES/Pelias. If I restart the import afterwards, will it be overwritten or how does that work?
    JuanM2
    @JuanM2

    I have installed Pelias with docker. I am trying to find US Census tracts from points I find with the search API (much faster and accurate than Nominatim thanks to rich openaddresses). I have an encoded a polyline file (precision 6, null byte for columns, new line for rows) with the census tracts in California and their FIPS codes. I've tried importing this from my project's pelias.json configuration file but it does not show up in PIP (port 4200) results (only WOF data shows up in this results). Pelias PIP return of WOF data is 10X faster than my existing GDAL/OGR for a Census Tracts shapefile, so I am hoping to implement a Pelias solution. Do you have any suggestions for how to proceed?

    This is for a batch process for a research project. I am new to Pelias but determined to get this working.

    op_pelias
    @op_pelias:matrix.org
    [m]
    Hi, From past few days I have been testing pelias and i found few issues. It would be great if someone helps me to deploy on my local machine not the docker build. So, that I can try to fix the issues I discovered and help the community
    Michael Bushey
    @mabushey
    Hello. I'm trying to bring up a full planet env in Kubernetes. When running Polylines prepare (docker_extract.sh), it errors saying the file is over one Gig (It's 47GB) and I should use Valhalla instead. Does anyone have any comments or config for this?
    Michael Bushey
    @mabushey
    The reason I ask it it seems all valhalla dockerfiles / images are broken.
    Michael Bushey
    @mabushey
    Are there other utilities besides polylines or valhalla that can take the Peanut-Butter-Fig file and turn it into the usable data?
    Michael Bushey
    @mabushey
    Any idea about elias@1-openaddresses-rjk4r:/code/pelias/openaddresses$ ./bin/download info: [openaddresses-download] Attempting to download all data error: [openaddresses-download] Failed to download data message=Command failed: unzip -o -qq -d /data/openaddresses /tmp/202123-37-12tjcyy.caci.zip [/tmp/202123-37-12tjcyy.caci.zip] End-of-central-directory signature not found. Either this file is not ??
    Michael Bushey
    @mabushey
    @op_pelias:matrix.org I'm not sure it's possible to make this stuff work. It's a collection of mostly broken separate tools from a company that went out of business 5 years ago. Do you know of any alternatives?
    Michael Bushey
    @mabushey
    @JuanM2 Can you tell me about your existing method? 10x slower sounds like it actually works.
    @hamzarhaiem You need to run some kind of Ingress controller like Istio or Traffik. This has nothing to do with Pelias.
    callaghan-ashley
    @callaghan-ashley
    Is it possible to setup local pelias installation to require an api key?
    Michael Bushey
    @mabushey
    @callaghan-ashley if you use Istio, you could just make that a routing condition.
    Michael Bushey
    @mabushey
    Does anywhere know where I can Download openaddr-collected-global.zip and openaddr-collected-global-sa.zip from?
    Michael Bushey
    @mabushey
    Looks like you have to set a referrer, this works from docker: curl --referer https://results.openaddresses.io/ -O /data/openaddresses/openaddr-collected-global.zip "https://data.openaddresses.io/openaddr-collected-global.zip"
    SilvrDuck
    @SilvrDuck

    Hi everyone,

    I am currently running a pelias instance using custom csv-imported data for Switzerland.

    It seems to be working quite well, but some addresses are not found.

    For example, the following query:

    qry = "Chemin de la Pré-de-la-Raisse 11"
    qry = urllib.parse.quote(req)
    requests.get(f"{pelias}search?text={qry}&layers=address").json()

    Yields:

    {
        "geocoding": {
            "version": "0.2",
            "attribution": "http://api.yourpelias.com/attribution",
            "query": {
                "text": "Chemin de la Pré-de-la-Raisse 11",
                "size": 10,
                "layers": ["address"],
                "private": False,
                "lang": {
                    "name": "English",
                    "iso6391": "en",
                    "iso6393": "eng",
                    "via": "default",
                    "defaulted": True,
                },
                "querySize": 20,
                "parser": "pelias",
                "parsed_text": {
                    "subject": "11 Chemin de la Pré-de-la-Raisse",
                    "street": "Chemin de la Pré-de-la-Raisse",
                    "housenumber": "11",
                },
            },
            "engine": {"name": "Pelias", "author": "Mapzen", "version": "1.0"},
            "timestamp": 1615458787863,
        },
        "type": "FeatureCollection",
        "features": [],
    }

    With no features.

    While if I explore directly elasticsearch using this query:

    GET pelias/_search
    {
      "query":{
        "match": {
          "address_parts.street": "Chemin du Pré-de-la-Raisse"
        }
      }
    }

    I do have an exact match with the following document:

    {
    "_index" : "pelias",
    "_type" : "_doc",
    "_id" : "admin_ch:address:295517056-0",
    "_score" : 17.968594,
    "_source" : {
        "center_point" : {
        "lon" : 6.130037,
        "lat" : 46.167932
        },
        "parent" : {
        "continent" : [
            "Europe"
        ],
        "continent_id" : [
            "102191581"
        ],
        "continent_a" : [
            null
        ],
        "country" : [
            "Switzerland"
        ],
        "country_id" : [
            "85633051"
        ],
        "country_a" : [
            "CHE"
        ],
        "region" : [
            "Geneva"
        ],
        "region_id" : [
            "85682291"
        ],
        "region_a" : [
            "GE"
        ],
        "county" : [
            "Genève"
        ],
        "county_id" : [
            "102062917"
        ],
        "county_a" : [
            null
        ],
        "locality" : [
            "Plan-les-Ouates"
        ],
        "locality_id" : [
            "1125887615"
        ],
        "locality_a" : [
            null
        ],
        "localadmin" : [
            "Plan-les-Ouates"
        ],
        "localadmin_id" : [
            "404328619"
        ],
        "localadmin_a" : [
            null
        ]
        },
        "name" : { },
        "address_parts" : {
        "street" : "Chemin du Pré-de-la-Raisse",
        "number" : "5",
        "zip" : "1228"
        },
        "source" : "admin_ch",
        "source_id" : "295517056-0",
        "layer" : "address"
    }
    }

    I don't understand why this particular exemple doesn't work, as many of my other test addresses do indeed work.

    Does anyone have an idea where to look for? How to debug that?

    Thanks in advance :)

    DataRx
    @DataRx
    Quick question: I'd like to get FIPS returned from an address. I've searched web for solution, but found wanting. Can anyone point me in the right direction?
    Oleksandr Zholob
    @ShoSashko
    How many guys here without actual answers? :)
    Brad Hards
    @bradh
    If I knew the answer, I'd say. If you need production support then maybe paying someone (not me, obviously) might be worth investigating.
    Vlad Predovic
    @Vladis466
    Quick question for the community regarding pelias API, Is it strictly a geocoder? address/place or long/lat?
    Vlad Predovic
    @Vladis466
    As an example, if I wanted to find all points of interest in a specific area, I could do that with overpassAPI. Does this have the same functionality? And if not, curious as to whether it is due to a clear design choice or just a resource limitation. I see it does have the concept of places.