Tom Howard
@tompahoward
Hi @vr-aus12 ๐Ÿ‘‹
Tom Howard
@tompahoward
@mountainpass/addressr@1.0.260 is now available ๐ŸŽ‰๐ŸŽ‰
Previous versions inadvertently included GPL v2 code. This release removes that dependency in line with addressrโ€™s Apache 2.0 license
If you have any questions about this release or features youโ€™d like to see in future releases, please let us know
mrnaz
@mrnaz
Hi there!
I'm using the self-hosted version of Addressr
It fails to start since the Aug 21 gnaf update. I can see that a fix appears to have been pushed to Github, but installing from npm does not seem to have the fix yet (npm is still on 260)
is there any chance that the published npm package can be updated? thanks!
Tom Howard
@tompahoward
Hi @mrnaz , weโ€™ll have a look at why the fix didnโ€™t push out a new version and sort it out ๐Ÿ‘
Tom Howard
@tompahoward
@mountainpass/addressr@1.0.261 is now available ๐ŸŽ‰๐ŸŽ‰
@mrnaz this fixes the issue you were having with the Aug21 GNAF file ๐Ÿ‘
mrnaz
@mrnaz
great! many thanks!
mrnaz
@mrnaz
when running addressr loadr i get this error:
image.png
running 261, and nov21 data
is that the same error as the aug21 data?
mrnaz
@mrnaz
i just tried a clean install on a fresh vm... i still get that error the loader errors out during the loading process
Tom Howard
@tompahoward
Looks like an issue handling the Nov 21 data. Weโ€™ll get working on a fix ๐Ÿ‘
mrnaz
@mrnaz
cool!
mrnaz
@mrnaz
just out of interest, is the GNAF format changing, or is it edge cases in the data that caused these issues?
i'm also doing some data ingest work, and we get tripped up by things like invalid chars in data sets or malformed structures
eg a csv file with improperly escaped commas in cells
gelsas
@gelsas
Hi I am trying to self host addressr but it shows me this:
image.png
It says something about authentication failed. What do I need to do now?
gelsas
@gelsas
I tried to follow the steps here: https://hub.docker.com/r/mountainpass/addressr
Tom Howard
@tompahoward
@mrnaz sometimes it changes in how the gnaf is packed, but this time itโ€™s an edge case in the data
Hi @gelsas, instead of 1.0.1, try with latest or 1.0.261
gelsas
@gelsas
Is it normal that when following this guide that i have multiple docker images running seperatly from each other ?
And what about this:
gelsas
@gelsas
I have followed all the steps now @tompahoward now I do not see that red message anymore. But i still get the waiting for error/warning messages
mrnaz
@mrnaz
@tompahoward is there a fix on that nov21 data issue?
would it be a good idea to set it to raise an error and continue when there are import issues? if there is an address or two missing from the index, i'm sure most people would not notice haha
gelsas
@gelsas
Hi I am getting an error when running: addressr-loader
Invalid Zip file
These were my steps which led to this error:
unnamed.png
- Installed centos7.
- Configured nginx.
- Installed docker using these commands:
• sudo yum install -y yum-utils
• sudo yum-config-manager \ --add-repo \ https://download.docker.com/linux/centos/docker-ce.repo

docker engine:
- sudo yum install docker-ce docker-ce-cli containerd.io

start docker:
- sudo systemctl start docker

installed npm using these commands:
- curl -sL https://rpm.nodesource.com/setup_12.x | sudo bash -
- sudo yum install nodejs
- node –version

Install addressr
- sudo npm install @mountainpass/addressr -g
- sudo docker pull docker.elastic.co/elasticsearch/elasticsearch:7.2.0
- docker run -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node"
docker.elastic.co/elasticsearch/elasticsearch:7.2.

Start API server. In a second window run:
- export ELASTIC_PORT=9200
- export ELASTIC_HOST=localhost
- addressr-server

Setup the env vars for the data loader. In a third window run:
- export ELASTIC_PORT=9200
- export ELASTIC_HOST=localhost
- export ADDRESSR_INDEX_TIMEOUT=30s
- export ADDRESSR_INDEX_BACKOFF=1000
- export ADDRESSR_INDEX_BACKOFF_INCREMENT=1000
- export ADDRESSR_INDEX_BACKOFF_MAX=10000

Run data Loader
- addressr-loader

Causes then: error in the zip file. Invalid zip file
@tompahoward @mrnaz Any ideas what this error is and how it could be fixed ?
gelsas
@gelsas
Does this commit here fix the issue ?
mountain-pass/addressr#361
gelsas
@gelsas
Tried it with latest version available, still having same error
aley1
@aley1
Hi there, I am also facing problems downloading and extracing Nov 21 data using addressr-loader

api extracting target/gnaf/incomplete/g-naf_nov21_australia_gda94_psv_104/G-NAF/G-NAF NOVEMBER 2021/Standard/VIC_ADDRESS_DETAIL_psv.psv +57ms
node:events:368
throw er; // Unhandled 'error' event
^

Error: Stream finished in an invalid state, uncompression failed
at UnzipStream._flush (/usr/lib/node_modules/@mountainpass/addressr/node_modules/unzip-stream/lib/unzip-stream.js:734:19)
at UnzipStream.final [as _final] (node:internal/streams/transform:112:25)
at callFinal (node:internal/streams/writable:694:27)
at prefinish (node:internal/streams/writable:719:7)
at finishMaybe (node:internal/streams/writable:729:5)
at UnzipStream.Writable.end (node:internal/streams/writable:631:5)
at ParserStream._flush (/usr/lib/node_modules/@mountainpass/addressr/node_modules/unzip-stream/lib/parser-stream.js:33:22)
at ParserStream.final [as _final] (node:internal/streams/transform:112:25)
at callFinal (node:internal/streams/writable:694:27)
at prefinish (node:internal/streams/writable:719:7)
Emitted 'error' event on ParserStream instance at:
at emitErrorNT (node:internal/streams/destroy:157:8)
at emitErrorCloseNT (node:internal/streams/destroy:122:3)
at processTicksAndRejections (node:internal/process/task_queues:83:21)

Tom Howard
@tompahoward
@aley1 if the download is interrupted, it can leave the zip file in an invalid state. Pls delete your target directory and try running the loader again.
@mrnaz I'm double-checking this right now. So far so good...
@gelsas please try deleting your target directory and trying again. I've just double-checked that the download and uncompress works with the Nov data
Tom Howard
@tompahoward
@mrnaz some errors are skipable, but many aren't. What do you think of mountain-pass/addressr#362 as a solution?
Tom Howard
@tompahoward
@mrnaz loader ran successfully for the current Nov GNAF file. Running again with geo enabled...
Tom Howard
@tompahoward
@mrnaz confirmed working with geo enabled. Are you sure you're using the latest version of Addressr?
Tom Howard
@tompahoward
FYI I couldn't get notifications working for the gitter app on my phone. I've now got Element and FluffyChat installed and notifications appear to be working, so I should be faster at responding now. Sorry for the previous delays.
intisarezabir
@intisarezabir
Hi there I have a car rental app build on django. Would it be possible to use your api in my system for real time address verification of my customers?