Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    collinjc
    @collinjc:matrix.org
    [m]
    I've got a North America build for Pelias and we've noticed some issues related to the source data (fields duplicated to incorrect fields, missing fields, etc.) and I was wondering if there was a way to identify and clean up such occurrences. Also, is there a preferred way to update the data? I can't seem to find any documentation addressing either of these questions.
    jcushner
    @jcushner
    do postal codes show up for you @collinjc:matrix.org ? I did a full planet build and most of the time I am not seeing zip codes, although sometimes they appear
    collinjc
    @collinjc:matrix.org
    [m]
    @jcushner: Some are there and some are not. Missing zip codes are definitely one of the most common issues I'm seeing though.
    jcushner
    @jcushner
    ok at least someone else has this issue..
    I am also interested in a method to update the data
    collinjc
    @collinjc:matrix.org
    [m]
    Yeah, I know I can certainly do a full re-download, then wipe the data from elasticsearch and re-import, but doing so would result in down-time, which is obviously problematic for larger datasets. I could also just try re-importing, but I am not certain if that will result in duplicated records.
    jcushner
    @jcushner
    I'd guess we'd have to do the "prepare" steps as well again right?
    collinjc
    @collinjc:matrix.org
    [m]
    Yeah, I imagine so
    jcushner
    @jcushner
    I'm actually surprised they don't list common scenarios such as this.. I was really interested as well in what occurs when running a command again.. like would running the same command twice cause issues or just replace what exists.
    collinjc
    @collinjc:matrix.org
    [m]
    Yeah, scrolling through the history here, it seems to have come up a few times. I'm not seeing any answers though. Definitely should be something mentioned in the docs, I think
    Oleksandr Zholob
    @ShoSashko
    image.png
    Hello, I currently see pip-service loading only a small portion of features:
    Is there any idea how to force loading more files?
    mdoakes42
    @mdoakes42
    Hello, In pelias.config how do i use wild card to load only a select number of osm.pbf files.. like this
    "openstreetmap": {
    "leveldbpath": "/tmp",
    "datapath": "/share/data/osm",
    "importVenues": true,
    "import": [
    {"filename": "*"}
    ]
    this doesn't seem to work. i get an error that it "failed to stat pbf file: /share/data/osm/*
    how do i use wildcards..
    like if I only wanted a*, etc..
    I see this param but doesn't make sense to me on how to use it imports.openstreetmap.import[0].filename
    haraldkofler
    @haraldkofler
    you can merge the pbf files into one single file and then import this into your pelias instance
    collinjc
    @collinjc:matrix.org
    [m]
    @jcushner: We have found that a large part of our data quality issues (particularly with autocomplete) are from the openaddresses us/fl/_loveland dataset. Have you noticed a similar pattern?
    This dataset seems to be missing ZIP codes and has a very large number of occurrences where the house number and street name are the same number. Some spot checking finds that these are bogus addresses.
    AIDARXAN
    @AIDARXAN
    Hello, is there a way to make docker-compose up only minimal number of images, that api could work, without interpolation, openaddress?
    collinjc
    @collinjc:matrix.org
    [m]
    @AIDARXAN: I have not tried it myself, but I imagine you could remove the unwanted bits from docker-compose.yml
    1 reply
    massimogentilini
    @massimogentilini
    help needed: I'm trying to download the global openaddresses dataset from AWS and if I use the docker file I get a 403 error, the same if I use wget. So I want to use S3, to avoid costs for OA but the aws-cli requires a bucket id and a key. What are they? There is not a single sample online I can refer to...
    aws s3api get-object s3://v2.openaddresses.io/batch-prod/collection-global.zip --request-payer requester --bucket ?????? --key ?????
    what do I need to put in the ???? part????
    Brad Hards
    @bradh
    @massimogentilini why use the s3api? s3 high level operations are much simpler.
    massimogentilini
    @massimogentilini
    which tool do I need to use? I've a linux server in AWS cloud with just SSH, so the best option to me seems to be to install the aws-cli, but if there are better tools I'm willing to try
    need is to put the 18 GB zip file on the Ubuntu server so that the Pelias docker stack can access it
    massimogentilini
    @massimogentilini
    IT WORKED!!!!
    as a reminder if someone google it
    Install aws client (sudo apt-get install awscli)
    initialize the configuration with your key and secret (aws configure)
    download the file: aws s3 cp s3://v2.openaddresses.io/batch-prod/collection-global.zip . --request-payer requester
    wait...
    Brad Hards
    @bradh
    Congratulations
    Nick Hope
    @Nick-Hope
    Hello. Some newcomer questions here... I am building an application in Drupal 9 for displaying wildlife photos and other media. When a user sets point coordinates for a photo, I would like to reverse geocode those coordinates to determine which ecoregion(s) the photo was taken in. Polygonal data from ecoregion datasets such as TEOW and MEOW is available as kml or shapefile. The Drupal Geocoder module supports a number of providers including Pelias. Is Pelias is an appropriate provider to achieve this? How would I go about importing the TEOW data? Is there some sort of generic importer for polygonal geometry or would I need to write a custom importer, perhaps based on whosonfirst and wof-admin-lookup? Any pointers welcome!
    6 replies
    collinjc
    @collinjc:matrix.org
    [m]
    Is there any documentation out there that discusses the process of migrating data from one pelias instance to another?
    The goal, of course, is to try to avoid the process of re-downloading and re-importing. I've seen a few mentions scattered in the documentation about migrating the elasticsearch indexes, but I'm not 100% certain about the requirements for the target system outside of the elasticsearch indexes
    Phlegx Systems OG
    @phlegx
    Hi there! If I import OSM with the openstreetmap importer, do I always need to run whoisfirst first? Or can I also only import OSM alone? If that is possible, what do I need to set to disable WOF?
    2 replies
    And my second question is: If I use openstreetmap Europe map in combination with WOF, would I need to download (set) all European countries in the pelias.json for europe?
    Adam Rousell
    @rabidllama
    Hi everyone - has anyone else experienced issues recently with using the pelias command to download the openaddresses global dataset (pelias download oa)? Whenever I run it, I get an error about not finding the zip file, but I can download the file manually. From what I can tell, when you run the command for the global dataset it doesn't wait for the download to complete before trying to unzip the file, so I don't know if something is going wrong with threading. I have tried on multiple machines and always get the same problem...
    2 replies
    Łukasz Gurdek
    @ukasiu
    Hi! I'd like to use Pelias mainly for autocomplete, but the problem is whosonfirst data for Poland is essentially broken. Is it possible to force pelias to use addr:city from osm to for the city name?
    Freshm4at
    @Freshm4at

    Hi Guys, I have an issue with download all data "pelias download all"! i open a bug report on the repo! pelias/docker#261

    Can you help me with this issue ? thank's :)

    Teo Stocco
    @zifeo
    This message was deleted
    Hello, is there a benchmark or general guidlines on how to optimize latency/caching/preload with elastic in case of a high number of reverse geocoding requests?
    3 replies
    AIDARXAN
    @AIDARXAN

    Hello, currently struggling with intersections.

    1. Does they work?
    2. If work how to write search query correctly

    I have read the pelias/api#1058 conversation and it is stated that intersection support is implemented, but i can't query it XD

    Thinh Vu
    @ThinhVu

    My co-worker already build pelias server which only support 'us' address.
    Now I want to add more 'de' address to this server, it's there any way to add addresses for 'de' without re-build docker containers?

    I already tried to modify pelias.json file and copy required data to importers path but it's seem doesn't work.

    Rasul
    @RasulAV
    Hello everyone, please tell me (or share a link with information) is it possible to somehow import an .osm format (not archived in pbf) map into Pelias and do this without downloading it from the Internet, but importing the one that is located locally on the server. Another words - this is my own map, not from general sources.
    Unfortunately I can’t find this information in the official documentation.