Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • Dec 11 19:28
    duartejc commented #513
  • Dec 11 18:27
    tidwall commented #513
  • Dec 11 18:27
    tidwall commented #513
  • Dec 11 18:20

    tidwall on 1.19.3

    (compare)

  • Dec 11 18:20
    tidwall closed #513
  • Dec 11 18:20

    tidwall on master

    Fix tile38-cli from freezing wi… 1.19.3 (compare)

  • Dec 11 17:20
    jose-lpa commented #513
  • Dec 11 17:19
    pdrum closed #512
  • Dec 11 16:04
    jose-lpa commented #513
  • Dec 11 12:52
    naveenchlsn edited #515
  • Dec 11 12:52
    naveenchlsn edited #515
  • Dec 11 12:50
    naveenchlsn opened #515
  • Dec 10 14:18
    duartejc commented #513
  • Dec 10 14:04
    duartejc commented #513
  • Dec 10 13:21
    duartejc commented #513
  • Dec 10 10:23
    tidwall commented #514
  • Dec 10 10:14
    naveenchlsn opened #514
  • Dec 10 10:13
    tidwall commented #513
  • Dec 10 10:12
    tidwall commented #512
  • Dec 10 02:45
    duartejc opened #513
Pavel Makarenko
@m1ome
@tidwall did you have time to see Kafka PR?
Josh Baker
@tidwall
@m1ome I began reviewing yesterday. I need some more time to familiarize myself with Kafka first. I'll keep you posted.
Pavel Makarenko
@m1ome
@tidwall awesome!
Josh Baker
@tidwall
@m1ome All set. Kafka PR is merged. !! Yay!
Pavel Makarenko
@m1ome
@tidwall finished with MQTT but need some test over it, have a strange feeling this should be tested well :)
Josh Baker
@tidwall
@m1ome ok. We'll spend a little extra time on testing and perhaps get additional feedback on best practices around MQTT and IoT.
Pavel Makarenko
@m1ome
@tidwall ok i will jump on proto geojson issue, researching it.
Pavel Makarenko
@m1ome
@tidwall in a few days i will submit PR with a geobuf support
need to write library and add some test to it :)
And we will be ready to move on geo PROTOBUF outout
*output
Josh Baker
@tidwall
@m1ome 👍 porting the geobuf library sounds like a fun.
Pavel Makarenko
@m1ome
@tidwall i will provide additional .proto i don’t port a geobuf, beacuse they use proto v2 and need’s a lot of addition to support RFC of GeoJSON
Josh Baker
@tidwall
@m1ome will it still be compatible with geobuf?
Pavel Makarenko
@m1ome
@tidwall you wanna keep compatible version to use node.js library?
@tidwall i mean, all can use any .proto file to implement what they want and i can provide node.js/js library
Josh Baker
@tidwall
@m1ome I think it might be nice to keep compatibility with geobuf format. As long as a user can pass the same geobuf blobs to Tile38 as they would to services that utilize the JS version, I'm good.
Pavel Makarenko
@m1ome
@tidwall i can provide a node.js/js library for it :)
Josh Baker
@tidwall
@m1ome Do you mean a node.js client library?
Pavel Makarenko
@m1ome
@tidwall yes
Josh Baker
@tidwall
@m1ome :+1:
Pavel Makarenko
@m1ome
@tidwall i tried .proto file from geobuf (node.js version) and it’s kinda messy
Pavel Makarenko
@m1ome
@tidwall and if we starting to change proto file we loose compatability :(
Josh Baker
@tidwall
@m1ome what do you suggest?
Pavel Makarenko
@m1ome
@tidwall bad thing about “geobuf” is:
JSON -> PROTOBUF -> JSON conversion
it’s useless if you wanna provide speed and compact protocol
i mean i will provide JSON to PROTOBUF conversion, but you can manually do this in your application using .proto file
It’s quite simple
Josh Baker
@tidwall
@m1ome I agree that we shouldn't touch JSON in the processes. It could just go straight from geobuf to the native object format that Tile38 uses today. And vice versa.
Pavel Makarenko
@m1ome
Yeah with a small interface :)
And that’s a main idea
I will prepare JSON Pack/Unpack function also for a external use
Josh Baker
@tidwall
@m1ome I think we're on the same page. :+1:
Pavel Makarenko
@m1ome
@tidwall wonderful :)
Josh Baker
@tidwall
Tile38 2.0 pre-alpha benchmarks tidwall/tile38#171
Agustin Bacigalup
@redraw
Hi! hey. promising project. I've seen latest Redis versions support spatial queries, however, concerning tile38, is it like a modified Redis with extended geo features written in Go? Is it built on top of Redis?
Josh Baker
@tidwall
Hi Agustin. It's not built on Redis. Totally custom code base. It only shares the same network protocol making it easy to use most popular Redis clients.
Agustin Bacigalup
@redraw
Great
Justin Lowery
@umpc
Hi @tidwall. I hope you’re doing well. How is Tile38 version 2 coming along?
Josh Baker
@tidwall
Hi @umpc. All is well and I'm sorry 2.0 is taking so long. The progress is slow at the moment with most of the effort going towards data structures that support new spheroid calculations. There's a few low hanging features that will improve performance which I may introduce into the codebase prior to 2.0.
Justin Lowery
@umpc
@tidwall I’m patient for it. It seems to be worth the wait!
I understand deciding on the scope and experimenting first before going public with it.
Josh Baker
@tidwall
@umpc Thanks for your patience. I do think it'll worth the wait. :smile:
Josh Baker
@tidwall
@/all Tile38 v1.9.1 is now available!
Justin Lowery
@umpc

@tidwall Would you happen to know if there is a faster way to check if a point is within an inserted multipolygon than running (*collection).Intersects and passing in the point?

The question is probably wishful thinking, though I’m trying to find the quickest way to group some points by country/state to sort with.

I am currently using https://github.com/busrapidohq/world-countries-boundaries/tree/master/geojson/10m and am getting back under 150 points per second when running the intersect queries in parallel (using the collection package)

I probably just need to lower the resolution, though this seemed slow to the point that I’m doing something inefficiently given how the intersects method works and I figured that I would ask.

Josh Baker
@tidwall
@umpc It's possible that the slowness is due to the complexity of the multipolygon. Testing a single point on a mutlipolygon will perform a point in polygon operation over each polygon until it gets a hit. For a few simple rectangles this will be fast, but for country boundaries, not so much.
Justin Lowery
@umpc
okay. thank you
Josh Baker
@tidwall
Perhaps a better way is to group the points in a reverse lookup like https://gist.github.com/tidwall/b99f633bb567c0fb679f1009347691b0
Justin Lowery
@umpc
that is true, thanks. i am going to reduce memory to just what i am proccessing and will try something like that