Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • Jan 30 07:37

    ocramz on gh-pages

    Add arrayfire (compare)

  • Jan 02 12:51

    ocramz on gh-pages

    add inliterate (compare)

  • Jan 02 12:43

    ocramz on gh-pages

    update hvega entry (compare)

  • Jul 01 2019 09:43
    dmvianna added as member
  • Jun 15 2019 04:55

    ocramz on gh-pages

    Add pcg-random (compare)

  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz labeled #42
  • Jun 14 2019 16:08
    ocramz opened #42
  • Jun 14 2019 16:08
    ocramz opened #42
  • Jun 06 2019 18:21

    ocramz on gh-pages

    Fix graphite link Merge pull request #41 from alx… (compare)

  • Jun 06 2019 18:21
    ocramz closed #41
  • Jun 06 2019 18:21
    ocramz closed #41
  • Jun 06 2019 17:32
    alx741 opened #41
  • Jun 06 2019 17:32
    alx741 opened #41
  • Jun 06 2019 16:46

    ocramz on gh-pages

    Add graphite Merge pull request #40 from alx… (compare)

  • Jun 06 2019 16:46
    ocramz closed #40
Compl Yue
@complyue
@ocramz thanks! this place is full of surprises. the only accelerate I knew before now is https://developer.apple.com/documentation/accelerate , now I know acceleratehs, too cool :D
Marco Z
@ocramz
@complyue :) yeah sorry for not elaborating earlier, I was on my mobile. http://hackage.haskell.org/package/accelerate does really a few things and I'm not too qualified for describing them in detail, but one of these used to be rewriting high-level Haskell array programs in terms of predefined Cuda C splices, which are then executed on the GPU. Nowadays IIUC this is subsumed by compiling to LLVM intermediate representation : https://hackage.haskell.org/package/accelerate-llvm-ptx
there are some actual experts lurking around here, such as the main author @tmcdonell and one of the core LLVM-Hs contributors @cocreature
there's also a whole gitter channel dedicated to AccelerateHS : https://gitter.im/AccelerateHS/Lobby
Austin Huang
@austinvhuang
@dmjio very nice! Have been interested to see how arrayfire was coming along.
Marco Z
@ocramz
@dmjio speaking of, I was looking at the API docs, and was puzzled by the use of unsafePerformIO in the wrapper functions e.g. : https://hackage.haskell.org/package/arrayfire-0.1.0.0/docs/src/ArrayFire.FFI.html#op3 ; wouldn't it be better to catch the FFI error codes and convert them into a Haskell sum type?
sure, it's possible to catch an AFException, but I think the "pure" return types in the main API are misleading
Doug Burke
@DougBurke
@complyue (and other people interested in large-scale data visualization in the browser); I just saw mention of https://github.com/uwdata/falcon from one of the Vega folks
Austin Huang
@austinvhuang

@DougBurke awesome! "initially loads reduced interactive resolutions, then progressively improves them" seems right.

if this can be abstracted and reused for arbitrary backend data + frontend consumers that would be quite useful.

Compl Yue
@complyue
@DougBurke @ocramz thanks for the info, I've suffered much behind the GFW for a few days, even with several vpn like solutions, networking to major sites barely connects. our govenor is insane to ban hard even tech sites, sigh!
Compl Yue
@complyue

looked at falcon, about the data size it handled:

10M flights in the browser and ~180M flights or ~1.7B stars when connected to OmniSciDB (formerly known as MapD)

make me remember that at a time about months ago, I'd had to increase chrome's heap size to around 12GB to visualize one of my dataset (with BokehJS frontend and golang backend), as even the 64-bit version of chrome has a default heap size limit around 3.5GB:

performance.memory.jsHeapSizeLimit/1024/1024/1024
3.501772880554199

seems they haven't hit this limit, while Bokeh already exceeded.

Yves Parès
@YPares
Hi guys, I and a few people started a room for pro/semi-pro Haskellers to discuss architecture of purely functional programs, mostly how to deal with effect composition frameworks (be it via raw monad stacks, free monads/applicatives, mtl, extensible-effects, polysemy, etc) which one is the best and interoperate between different libs written in different frameworks.
Its goal is to be "Effect composition for the rest of us": we want to have a focus on practical intermediate to advanced stuff (ie. remain accessible for those who don't know/want to know about coyoneda lemma or right-kan adjustments)
Ideal scenario: we determine the best effect composition pattern to rule them all and take over the pure FP world
Good enough scenario: we produce insights, use cases and material (or just discussions) about which way to best address effect composition in such specific scenarios and how to deal with interop between frameworks
Yves Parès
@YPares
You can join the public community room https://gitter.im/pure-fp-architects/community if you are interested, and just drop a line if you are interested. The actual room is invite only
Yves Parès
@YPares
(by "which one is the best" I meant "which one seems to be the most suited in specific contexts", I'm not intending to solve what the Haskell community as a whole has been struggling with for 20 years ^^, don't worry)
Austin Huang
@austinvhuang
@YPares do you do much ghc hacking or deeper dives into the RTS? or know anyone that might be useful to ask about the RTS?
Torsten Scholak
@tscholak
Hi, didn’t know about this channel, I see lots of familiar faces!
Tim Pierson
@o1lo01ol1o
:wave:
Marco Z
@ocramz
Hi @tscholak , welcome !
Austin Huang
@austinvhuang

Hi @tscholak!

Indeed... upside and downside of doing data science + machine learning in Haskell, you know everyone after about five minutes!

that's alright though, there's a strong selection bias for interesting people :)
Yves Parès
@YPares
@austinvhuang For my part, I never dabbed with GHC internals, but I think we have people at Tweag who did work on the RTS. I can ask around
Austin Huang
@austinvhuang
Thanks @YPares !
Compl Yue
@complyue
I almost succeeded in distributing custom GHC by source with Nix, but met an annoying problem, any tip is appreciated: NixOS/nixpkgs#73443
David Johnson
@dmjio
hey
data haskell community
I was talking with the author of massiv https://github.com/lehins about making some benchmarks for every Haskell array library (CPU + GPU). It seems you guys have done that already here: https://github.com/DataHaskell/numeric-libs-benchmarks
We don't know where to house a repo like this, and were wondering if we could contribute / work with people here to make a repo like this (even if that means contributing to the existing repo).
David Johnson
@dmjio
maybe this conversation would be best had on github
but like, I was gonna make all these nix scripts to build accelerate, massiv, hmatrix, arrayfire into one giant kahuna repo, then run the benchmarks on AWS, scp the results to some s3 bucket
David Johnson
@dmjio
Marco Z
@ocramz
hey @dmjio , when it comes to low-level array functions there's this : https://github.com/haskell-perf/sequences
the numeric-libs-benchmarks repo is very incomplete wrt fastest-matrices
Shane Mulligan
@mullikine
Hey guys. does anyone connect to this chat room using IRC? I am connected to irc.gitter.im but when I join #dataHaskell, I get an empty room
I worked it out. I had to join #dataHaskell/Lobby.
Isaac Shapira
@fresheyeball_gitlab
I am looking for some to do a small CV contract
anyone interested?
Marco Z
@ocramz
@fresheyeball_gitlab CV?
Isaac Shapira
@fresheyeball_gitlab
@ocramz Computer Vision
I need object detection trained, and I have a labelled data set. I have done some ML, but not any Vision stuff. Looking for a contractor to either do the work, or hold my hand.
Asking this room because long term this would be a Haskell project.
Stefan Dresselhaus
@Drezil
what do you mean by "small contract"? A thing you could do in 2-3 days? Or more like 3-4 weeks?
Compl Yue
@complyue
it's been a pleasure to learn Nix around, and I finally made it to do auto sdist install of GHC, so
comes the first unregistered release of Hadui. I'm quite satisfied with the approach I discovered, to define a package merely with github release tarballs, that directly importable by nix-shell
/
nix-env -iA. this is quite easy way to do decentralized software distribution based off nixpkgs, even without registration to its central registry, should apply equally well to internal distribution of private packages.
Compl Yue
@complyue
the 3 flavored scaffold repositories demo this technique: https://github.com/complyue/hadui/blob/master/README.md#quick-start
Orfeas Agis Karachalios
@orpheusgame
hi people, i was curious if someone has considered doing number-crunching in Julia and implement some sort of foreign calls using the LLVM IR
chessai
@chessai
Is there a library which makes the following clean: