Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    collinjc
    @collinjc:matrix.org
    [m]
    Yeah, I imagine so
    jcushner
    @jcushner
    I'm actually surprised they don't list common scenarios such as this.. I was really interested as well in what occurs when running a command again.. like would running the same command twice cause issues or just replace what exists.
    collinjc
    @collinjc:matrix.org
    [m]
    Yeah, scrolling through the history here, it seems to have come up a few times. I'm not seeing any answers though. Definitely should be something mentioned in the docs, I think
    Oleksandr Zholob
    @ShoSashko
    image.png
    Hello, I currently see pip-service loading only a small portion of features:
    Is there any idea how to force loading more files?
    mdoakes42
    @mdoakes42
    Hello, In pelias.config how do i use wild card to load only a select number of osm.pbf files.. like this
    "openstreetmap": {
    "leveldbpath": "/tmp",
    "datapath": "/share/data/osm",
    "importVenues": true,
    "import": [
    {"filename": "*"}
    ]
    this doesn't seem to work. i get an error that it "failed to stat pbf file: /share/data/osm/*
    how do i use wildcards..
    like if I only wanted a*, etc..
    I see this param but doesn't make sense to me on how to use it imports.openstreetmap.import[0].filename
    haraldkofler
    @haraldkofler
    you can merge the pbf files into one single file and then import this into your pelias instance
    collinjc
    @collinjc:matrix.org
    [m]
    @jcushner: We have found that a large part of our data quality issues (particularly with autocomplete) are from the openaddresses us/fl/_loveland dataset. Have you noticed a similar pattern?
    This dataset seems to be missing ZIP codes and has a very large number of occurrences where the house number and street name are the same number. Some spot checking finds that these are bogus addresses.
    AIDARXAN
    @AIDARXAN
    Hello, is there a way to make docker-compose up only minimal number of images, that api could work, without interpolation, openaddress?
    collinjc
    @collinjc:matrix.org
    [m]
    @AIDARXAN: I have not tried it myself, but I imagine you could remove the unwanted bits from docker-compose.yml
    1 reply
    massimogentilini
    @massimogentilini
    help needed: I'm trying to download the global openaddresses dataset from AWS and if I use the docker file I get a 403 error, the same if I use wget. So I want to use S3, to avoid costs for OA but the aws-cli requires a bucket id and a key. What are they? There is not a single sample online I can refer to...
    aws s3api get-object s3://v2.openaddresses.io/batch-prod/collection-global.zip --request-payer requester --bucket ?????? --key ?????
    what do I need to put in the ???? part????
    Brad Hards
    @bradh
    @massimogentilini why use the s3api? s3 high level operations are much simpler.
    massimogentilini
    @massimogentilini
    which tool do I need to use? I've a linux server in AWS cloud with just SSH, so the best option to me seems to be to install the aws-cli, but if there are better tools I'm willing to try
    need is to put the 18 GB zip file on the Ubuntu server so that the Pelias docker stack can access it
    massimogentilini
    @massimogentilini
    IT WORKED!!!!
    as a reminder if someone google it
    Install aws client (sudo apt-get install awscli)
    initialize the configuration with your key and secret (aws configure)
    download the file: aws s3 cp s3://v2.openaddresses.io/batch-prod/collection-global.zip . --request-payer requester
    wait...
    Brad Hards
    @bradh
    Congratulations
    Nick Hope
    @Nick-Hope
    Hello. Some newcomer questions here... I am building an application in Drupal 9 for displaying wildlife photos and other media. When a user sets point coordinates for a photo, I would like to reverse geocode those coordinates to determine which ecoregion(s) the photo was taken in. Polygonal data from ecoregion datasets such as TEOW and MEOW is available as kml or shapefile. The Drupal Geocoder module supports a number of providers including Pelias. Is Pelias is an appropriate provider to achieve this? How would I go about importing the TEOW data? Is there some sort of generic importer for polygonal geometry or would I need to write a custom importer, perhaps based on whosonfirst and wof-admin-lookup? Any pointers welcome!
    6 replies
    collinjc
    @collinjc:matrix.org
    [m]
    Is there any documentation out there that discusses the process of migrating data from one pelias instance to another?
    The goal, of course, is to try to avoid the process of re-downloading and re-importing. I've seen a few mentions scattered in the documentation about migrating the elasticsearch indexes, but I'm not 100% certain about the requirements for the target system outside of the elasticsearch indexes
    Phlegx Systems OG
    @phlegx
    Hi there! If I import OSM with the openstreetmap importer, do I always need to run whoisfirst first? Or can I also only import OSM alone? If that is possible, what do I need to set to disable WOF?
    2 replies
    And my second question is: If I use openstreetmap Europe map in combination with WOF, would I need to download (set) all European countries in the pelias.json for europe?
    Adam Rousell
    @rabidllama
    Hi everyone - has anyone else experienced issues recently with using the pelias command to download the openaddresses global dataset (pelias download oa)? Whenever I run it, I get an error about not finding the zip file, but I can download the file manually. From what I can tell, when you run the command for the global dataset it doesn't wait for the download to complete before trying to unzip the file, so I don't know if something is going wrong with threading. I have tried on multiple machines and always get the same problem...
    2 replies
    Łukasz Gurdek
    @ukasiu
    Hi! I'd like to use Pelias mainly for autocomplete, but the problem is whosonfirst data for Poland is essentially broken. Is it possible to force pelias to use addr:city from osm to for the city name?
    Freshm4at
    @Freshm4at

    Hi Guys, I have an issue with download all data "pelias download all"! i open a bug report on the repo! pelias/docker#261

    Can you help me with this issue ? thank's :)

    Teo Stocco
    @zifeo
    This message was deleted
    Hello, is there a benchmark or general guidlines on how to optimize latency/caching/preload with elastic in case of a high number of reverse geocoding requests?
    3 replies
    AIDARXAN
    @AIDARXAN

    Hello, currently struggling with intersections.

    1. Does they work?
    2. If work how to write search query correctly

    I have read the pelias/api#1058 conversation and it is stated that intersection support is implemented, but i can't query it XD

    Thinh Vu
    @ThinhVu

    My co-worker already build pelias server which only support 'us' address.
    Now I want to add more 'de' address to this server, it's there any way to add addresses for 'de' without re-build docker containers?

    I already tried to modify pelias.json file and copy required data to importers path but it's seem doesn't work.

    Rasul
    @RasulAV
    Hello everyone, please tell me (or share a link with information) is it possible to somehow import an .osm format (not archived in pbf) map into Pelias and do this without downloading it from the Internet, but importing the one that is located locally on the server. Another words - this is my own map, not from general sources.
    Unfortunately I can’t find this information in the official documentation.
    Thanks in advance
    Brad Hards
    @bradh
    @RasulAV What have you already tried? It shouldn't be hard to modify the scripts or to convert the file, so if you can say what you are stuck on, that might help.
    Rasul
    @RasulAV

    @RasulAV What have you already tried? It shouldn't be hard to modify the scripts or to convert the file, so if you can say what you are stuck on, that might help.

    Hello Brad, thank you for your answer .
    I tried install it with Docker, using instruction from here :
    https://github.com/pelias/docker/

    So standard installation with embedded maps works fine, then I started to setup new custom project in "<pelias-folder>/docker/projects" folder by creating copy of "portland-metro" folder, inside of it I edited pelias.js file, so I added there this lines of code:

    {
      "interpolation": {
        "client": {
          "adapter": "http",
          "host": "http://localhost:9999"
        }
      },
      "imports": {
        "geonames": {
          "datapath": "/media/hdd"
        },
        "openstreetmap": {
          "datapath": "/home/rasul/pelias/docker/projects/Custom",
          "import": [{
            "filename": "address.osm.pbf"
          }]
        },
        "openaddresses": {
          "datapath": "~/openaddresses",
          "files": [
            "us-ny-nyc.csv"
          ]
        },
        "polyline": {
          "datapath": "~/polyline",
          "files": [
            "road_network.polylines"
          ]
        },
        "whosonfirst": {
          "datapath": "/media/hdd/whosonfirst"
        }
      }
    }

    The only settings I interested in is:

    "openstreetmap": {
          "datapath": "/home/rasul/pelias/docker/projects/Custom",
          "import": [{
            "filename": "address.osm"
          }]

    so I want to specify my map file "address.osm" which is located on local storage of my Pelias server.
    but after command "pelias download osm" it gives me an error:

    2021-04-18T15:40:10.135Z - error: [openstreetmap-download] error making directory /home/rasul/pelias/docker/projects/Custom message=ENOENT: no such file or directory, mkdir, stack=Error: ENOENT: no such file or directory, mkdir, errno=-2, code=ENOENT, syscall=mkdir

    It is strange, because the folder exist, and I think the only reason why it doesn’t work is misconfiguration of the "pelias.json" file.
    Please give me a сlue what to do next, what I need to check.

    Brad Hards
    @bradh
    Does /home/rasul/pelias/docker/projects/Custom exist inside the docker container?
    If you still have issues, and you have it working with the portland-metro set, how about making small steps, like making the same file available on a webserver on your local machine. Then you can just change the download link to that instead.
    Rasul
    @RasulAV

    You mean change "datapath" in pelias.json ?
    In this object ? :

    "openstreetmap": {
          "datapath": "/home/rasul/pelias/docker/projects/Custom",
          "import": [{
            "filename": "address.osm"
          }]

    And yes, as long as I understand it inside of docker container.

    Nicolas Florentin
    @nflorentin
    Hi there,
    I opened an issue on github pelias/pelias#904
    I'm seeing a difference in the data between the pelias github demo and a fresh installation of docker pelias.
    Accents are missing on some macroregion names in my self hosted pelias, but they are present in the pelias demo. (more details in the issue)
    If anyone has an idea of the problem, I would be very grateful!