by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • May 20 05:04

    ocramz on gh-pages

    Add `sampling` (compare)

  • May 19 09:03

    ocramz on gh-pages

    Add kdt, Supervised Learning se… (compare)

  • Apr 14 01:32
    tonyday567 removed as member
  • Jan 30 07:37

    ocramz on gh-pages

    Add arrayfire (compare)

  • Jan 02 12:51

    ocramz on gh-pages

    add inliterate (compare)

  • Jan 02 12:43

    ocramz on gh-pages

    update hvega entry (compare)

  • Jul 01 2019 09:43
    dmvianna added as member
  • Jun 15 2019 04:55

    ocramz on gh-pages

    Add pcg-random (compare)

  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz opened #42
  • Jun 14 2019 16:08
    ocramz opened #42
  • Jun 06 2019 18:21

    ocramz on gh-pages

    Fix graphite link Merge pull request #41 from alx… (compare)

  • Jun 06 2019 18:21
    ocramz closed #41
  • Jun 06 2019 18:21
    ocramz closed #41
  • Jun 06 2019 17:32
    alx741 opened #41
and this one: https://nextjournal.com/
both interesting approaches

iodide is based on webassembly
nextjournal has some functional programming ideas behind:

The good news is that I believe that it is possible to fix computational reproducibility by applying a principle of functional programming at the systems level: immutability (which is what we're doing at Nextjournal). I will show how applying immutability to code, data and the computational environment gives us a much better chance of keeping things runnable in a follow-up post.

Yves Parès
@YPares
"In Nextjournal, you can use multiple programming language runtimes together in a single notebook. Values can be exchanged between runtimes using files."
Files?? C'mon...
^^
show some love
Compl Yue
@complyue
I've not been using arrayfire, but love the idea, and appreciate their effort to make it viable.
Compl Yue
@complyue
for Haskell, I'd think a GHC backend spitting CUDA C would be even more sexy, but not seeing a clue it will come into being.
Bogdan Penkovsky
@masterdezign
Marco Z
@ocramz
@complyue that's what accelerate does, more or less
Compl Yue
@complyue
@ocramz thanks! this place is full of surprises. the only accelerate I knew before now is https://developer.apple.com/documentation/accelerate , now I know acceleratehs, too cool :D
Marco Z
@ocramz
@complyue :) yeah sorry for not elaborating earlier, I was on my mobile. http://hackage.haskell.org/package/accelerate does really a few things and I'm not too qualified for describing them in detail, but one of these used to be rewriting high-level Haskell array programs in terms of predefined Cuda C splices, which are then executed on the GPU. Nowadays IIUC this is subsumed by compiling to LLVM intermediate representation : https://hackage.haskell.org/package/accelerate-llvm-ptx
there are some actual experts lurking around here, such as the main author @tmcdonell and one of the core LLVM-Hs contributors @cocreature
there's also a whole gitter channel dedicated to AccelerateHS : https://gitter.im/AccelerateHS/Lobby
Austin Huang
@austinvhuang
@dmjio very nice! Have been interested to see how arrayfire was coming along.
Marco Z
@ocramz
@dmjio speaking of, I was looking at the API docs, and was puzzled by the use of unsafePerformIO in the wrapper functions e.g. : https://hackage.haskell.org/package/arrayfire-0.1.0.0/docs/src/ArrayFire.FFI.html#op3 ; wouldn't it be better to catch the FFI error codes and convert them into a Haskell sum type?
sure, it's possible to catch an AFException, but I think the "pure" return types in the main API are misleading
Doug Burke
@DougBurke
@complyue (and other people interested in large-scale data visualization in the browser); I just saw mention of https://github.com/uwdata/falcon from one of the Vega folks
Austin Huang
@austinvhuang

@DougBurke awesome! "initially loads reduced interactive resolutions, then progressively improves them" seems right.

if this can be abstracted and reused for arbitrary backend data + frontend consumers that would be quite useful.

Compl Yue
@complyue
@DougBurke @ocramz thanks for the info, I've suffered much behind the GFW for a few days, even with several vpn like solutions, networking to major sites barely connects. our govenor is insane to ban hard even tech sites, sigh!
Compl Yue
@complyue

looked at falcon, about the data size it handled:

10M flights in the browser and ~180M flights or ~1.7B stars when connected to OmniSciDB (formerly known as MapD)

make me remember that at a time about months ago, I'd had to increase chrome's heap size to around 12GB to visualize one of my dataset (with BokehJS frontend and golang backend), as even the 64-bit version of chrome has a default heap size limit around 3.5GB:

performance.memory.jsHeapSizeLimit/1024/1024/1024
3.501772880554199

seems they haven't hit this limit, while Bokeh already exceeded.

Yves Parès
@YPares
Hi guys, I and a few people started a room for pro/semi-pro Haskellers to discuss architecture of purely functional programs, mostly how to deal with effect composition frameworks (be it via raw monad stacks, free monads/applicatives, mtl, extensible-effects, polysemy, etc) which one is the best and interoperate between different libs written in different frameworks.
Its goal is to be "Effect composition for the rest of us": we want to have a focus on practical intermediate to advanced stuff (ie. remain accessible for those who don't know/want to know about coyoneda lemma or right-kan adjustments)
Ideal scenario: we determine the best effect composition pattern to rule them all and take over the pure FP world
Good enough scenario: we produce insights, use cases and material (or just discussions) about which way to best address effect composition in such specific scenarios and how to deal with interop between frameworks
Yves Parès
@YPares
You can join the public community room https://gitter.im/pure-fp-architects/community if you are interested, and just drop a line if you are interested. The actual room is invite only
Yves Parès
@YPares
(by "which one is the best" I meant "which one seems to be the most suited in specific contexts", I'm not intending to solve what the Haskell community as a whole has been struggling with for 20 years ^^, don't worry)
Austin Huang
@austinvhuang
@YPares do you do much ghc hacking or deeper dives into the RTS? or know anyone that might be useful to ask about the RTS?
Torsten Scholak
@tscholak
Hi, didn’t know about this channel, I see lots of familiar faces!
Tim Pierson
@o1lo01ol1o
:wave:
Marco Z
@ocramz
Hi @tscholak , welcome !
Austin Huang
@austinvhuang

Hi @tscholak!

Indeed... upside and downside of doing data science + machine learning in Haskell, you know everyone after about five minutes!

that's alright though, there's a strong selection bias for interesting people :)
Yves Parès
@YPares
@austinvhuang For my part, I never dabbed with GHC internals, but I think we have people at Tweag who did work on the RTS. I can ask around
Austin Huang
@austinvhuang
Thanks @YPares !
Compl Yue
@complyue
I almost succeeded in distributing custom GHC by source with Nix, but met an annoying problem, any tip is appreciated: NixOS/nixpkgs#73443
David Johnson
@dmjio
hey
data haskell community
I was talking with the author of massiv https://github.com/lehins about making some benchmarks for every Haskell array library (CPU + GPU). It seems you guys have done that already here: https://github.com/DataHaskell/numeric-libs-benchmarks
We don't know where to house a repo like this, and were wondering if we could contribute / work with people here to make a repo like this (even if that means contributing to the existing repo).
David Johnson
@dmjio
maybe this conversation would be best had on github
but like, I was gonna make all these nix scripts to build accelerate, massiv, hmatrix, arrayfire into one giant kahuna repo, then run the benchmarks on AWS, scp the results to some s3 bucket
David Johnson
@dmjio
Marco Z
@ocramz
hey @dmjio , when it comes to low-level array functions there's this : https://github.com/haskell-perf/sequences
the numeric-libs-benchmarks repo is very incomplete wrt fastest-matrices
Shane Mulligan
@mullikine
Hey guys. does anyone connect to this chat room using IRC? I am connected to irc.gitter.im but when I join #dataHaskell, I get an empty room
I worked it out. I had to join #dataHaskell/Lobby.
Isaac Shapira
@fresheyeball_gitlab
I am looking for some to do a small CV contract