Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    automenta
    @automenta
    i got JSONStream working in the following stream: MongoDB -> Netention object filtering -> Express request response
    so that should eliminate needing to store an entire query result in memory at any given time
    it could be separated from the netention stuff and used as a smokesignal example
    it creates N peers, each connected to the previous one. alternate topologies could be programmed
    alternate seed topologies to be specific. i dont know how these nodes will choose which other nodes to connect to
    on the first node i set a pipe from broadcast to stdout to see what's being transmitted
    using that i was able to eliminate some duplicate feedback from scuttlebutt by setting the incoming stream only half duplex
    so the result is that the inbox should remain synchronized with the sum of all other peers outbox contents
    ie. inbox should be much larger than outbox
    but peer -> peer direct synchronization will be preferable when possible
    Marcel Klehr
    @marcelklehr
    yea.
    automenta
    @automenta
    i needed to start each node with a delay. when i oriignaly tried smokesignal i created two peers simultaneously and they connected but immediately disconnected. then 10s later reconnect
    maybe there's a way to allow nodes to remain connected even if they are created simultaneously
    Marcel Klehr
    @marcelklehr
    peer -> peer should actually always be possible, since nodes can find peers automagically ;)
    automenta
    @automenta
    cool
    Marcel Klehr
    @marcelklehr
    I feel like smokesignal needs some love, in general..
    automenta
    @automenta
    are u familiar with PSON or any of these other JSON compressors?
    my code as well
    Marcel Klehr
    @marcelklehr
    just checked out PSON, seems very useful for smokesignal
    automenta
    @automenta
    PSON can compress JSON to a Buffer
    and use a dictionary that adapts to elements used by the JSON
    (more efficient if the dictionary is known ahead of time)
    Marcel Klehr
    @marcelklehr
    bbbiab
    automenta
    @automenta
    PSON might be better applied in the scuttlebutt protocol because scuttlebutt emits the raw stream, not the objects that PSON would be encoding/decoding. but smokesignal could use PSON too in a method specifically for sending objects
    Marcel Klehr
    @marcelklehr
    well, with a tool like smokesignal you either use multiple tcp sockets between peers or you multiplex, which is what I'm doing (this is what nssocket is used for atm). So, I'm actually re-packaging the "raw stream" that people pipe into the peer or into the broadcast.
    automenta
    @automenta
    cool so could PSON improve things there?
    Marcel Klehr
    @marcelklehr
    possibly, yes
    automenta
    @automenta
    ok webrtc should be working on http://geekery.biz now
    including video
    its in the main chat window, if other people are online and they have webrtc they will appear thee with a button
    i think the p2p server network will be able to share webrtc peers so that you can connect to peers on another server
    one of the first tests of the p2p network will be to send chat messages (non-webrtc, what now appears in the "main channel") between servers
    automenta
    @automenta
    making some progress. i have a scuttlebucket containing an expiry-model for each channel connected through smokesignal
    these are for communication chat channels
    automenta
    @automenta
    Screenshot from 2014-05-30 21:50:15.png
    automenta
    @automenta
    two netention nodes connected to each other, exchaning chat messages
    Marcel Klehr
    @marcelklehr
    Nice. You might want to check out https://github.com/maxogden/multiplex which could be used in front of node#broadcast
    gives you "channels" for free
    I'm currently drafting what might become the next version of smokesignal here: https://github.com/marcelklehr/smokesignal/wiki/Draft:-Next-version
    automenta
    @automenta
    can you go on irc.freenode.net #netention
    me and another developer i just met are discussing things