Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Jan 26 2022 21:38

    ninabreznik on master

    Create CNAME (compare)

  • Jan 19 2022 15:39

    ninabreznik on master

    Fix blog link (compare)

  • Jan 13 2022 23:47

    ninabreznik on master

    Update blog links (compare)

  • Jan 13 2022 23:31

    ninabreznik on master

    Update links (compare)

  • Jan 08 2022 00:11

    ninabreznik on master

    add deprecation notice (compare)

  • Jan 06 2022 01:46

    ninabreznik on master

    Update package.json (compare)

  • Jan 06 2022 01:37

    ninabreznik on master

    Update package.json (compare)

  • Dec 28 2021 21:52

    ninabreznik on master

    Update readme.md (compare)

  • Dec 28 2021 21:51

    ninabreznik on master

    Update readme.md (compare)

  • Dec 28 2021 21:49

    ninabreznik on master

    Update README.md (compare)

  • Dec 22 2021 23:06

    ninabreznik on master

    Update readme.md (compare)

  • Dec 22 2021 22:36

    ninabreznik on master

    Update readme.md (compare)

  • Dec 21 2021 18:01

    ninabreznik on master

    make old website work fix links add link to new website and 1 more (compare)

  • Dec 21 2021 18:01
    ninabreznik closed #58
  • Dec 21 2021 18:01
    ninabreznik opened #58
  • Apr 10 2021 03:54
    JamesTheAwesomeDude commented #92
  • Apr 10 2021 03:25
    JamesTheAwesomeDude edited #92
  • Apr 10 2021 03:09
    JamesTheAwesomeDude opened #92
  • Apr 10 2021 03:04
    JamesTheAwesomeDude commented #88
  • Apr 04 2021 06:01
    congruentsquare opened #91
dat-bot
@dat-bot
caniuse greetings datchat
caniuse i come with questions about interop
caniuse you have heterogeneous data
caniuse it comes from technically unsophisticated researchers who are assumed to know little or nothing in general about their local FS, file encodings, what have you
caniuse much of this must go to a cloud data lake
dat-bot
@dat-bot
caniuse you'd like to expose, to the fullest extent possible, the contents of this data lake over IPFS and dat and bittorrent.
caniuse how to do this sanely?
dat-bot
@dat-bot
Vito` mutability is an issue. you can update a dat, but you can't update ipfs content without using ipns (and that's really just a pointer update, right?), and you can't update a bittorrent torrent. if it's going in and its immutable, that makes it easier
dat-bot
@dat-bot
caniuse in practice i'm sure there are a number of issues
caniuse iirc at least the dat<->bittorrent discussion came up during the climate data crisis period, but i'm not seeing anything written up about it from cursory search
dat-bot
@dat-bot
Vito` I mean, if you're treating it as a lake, then you're not manipulating the data at all. If you're getting a bunch of files in arbitrary formats in, and you're treating that as a blob of objects in a collection, it seems like you should be able to generate a dat and a torrent for it, and call it a day? it's not on you to make it more accessible than it was provided to you, then it wouldn't be a data lake.
Vito` *as an immutable blob of objects in a collection
dat-bot
@dat-bot
Vito` for a single data set that I'm currently mirroring over multiple protocols, I'm generating the dat and the zeronet content.json against the original files, and I'm not trying to use the same "directory" for both
Vito` I'm actually duplicating the content to do it easily, but if I were doing this at a large scale, I'd look at symlinks or hardlinks, or do what digital archives do and maintain an independent manifest of what was included, and have some sort of proxy which surfaces them to the hosting protocols
dat-bot
@dat-bot
caniuse hm
dat-bot
@dat-bot
caniuse can you elaborate on "digital archives" here?
dat-bot
@dat-bot
Vito` caniuse: the collection management systems that libraries, archives, museums and galleries use to intake (accession), catalogue, and provide access to their digital artifacts
Vito` commercial digital asset management systems, like those used for video games, film, and other kinds of media production, probably also do similar things
caniuse ah ok, good old-fashioned sidecar metadata
caniuse the current status of warc records on IPFS is hackier than that, to my knowledge. they have to be split.
dat-bot
@dat-bot
lachenmayer pfrazee: just saw datprotocol/DEPs#32 - really great idea!
konobi_ ollo... don't suppose any folks know of there is a hypercore/hyperdrive C/C++ library in the works somewhere?
lachenmayer i remember mafintosh & i were talking about how to open files as append-only in hyperdrive at p2p web berlin, this would actually be a perfect solution for that
lachenmayer konobi_: i personally don't know of a c/c++ implementation but the rust implementation is picking up steam at the moment :) https://github.com/datrs
konobi_ yeah, I've been keeping an eye on it, though rust isn't well documented around using FFI smoothly yet (though I have some docs on a reading list to check out)
konobi_ go might be a decent alternative, though not seen a port there as of yet either
dat-bot
@dat-bot
konobi_ wanting to experiment/research using hyperdrive/dat as a plugin option for a pre-existing C++ project, so hands are somewhat tied with that
mafintosh lachenmayer: oh yea good point!
lachenmayer would be super sweet to just symlink/mount a hypercore!
dat-bot
@dat-bot
konobi_ jimpick: waves
dat-bot
@dat-bot
sknebel Does the dat CLI have a equivalent to curl - putting a file on stdout without putting it on disk?
dat-bot
@dat-bot
yoshuawuyts Hypercore 0.5.0 is out! - can now copy data locally between feeds :D https://github.com/datrs/hypercore
yoshuawuyts going to be working next on making it work over the network!
dat-bot
@dat-bot
mafintosh yoshuawuyts: wow!
dat-bot
@dat-bot
pfrazee lachenmayer: glad you like it!
pfrazee yoshuawuyts: nice
dat-bot
@dat-bot
lachenmayer yoshuawuyts: awesome!
lachenmayer (i read "vaporware API" as "vaporwave API" on first glance...)
lachenmayer seems slightly weird to me that the feed itself is an iterator over the network events rather than the feed items!
dat-bot
@dat-bot
lachenmayer pattern matching makes this so so nice...
dat-bot
@dat-bot
jimpick waves at konobi_
jimpick yoshuawuyts: huge milestone!
dat-bot
@dat-bot
bret Wow nice!
dat-bot
@dat-bot
misuba tstx
misuba o hai
matrixbot
@matrixbot
rabbit Does discovery-swarm do NAT traversal? (Do Beaker and dat CLI work when both sides are behind NATs?)
dat-bot
@dat-bot
millette wonders if the matrixbot could talk directly to #dat
millette rabbit: it should work for most cases
matrixbot
@matrixbot
rabbit millette: I should have searched first before asking, but just found this issue about NAT traversal not working -- mafintosh/discovery-swarm#16
dat-bot
@dat-bot
millette hmm, did you also try "dat doctor" ?