Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Dec 16 2019 21:51
    eisterman commented #66
  • Feb 08 2019 10:36
    Ploppz opened #66
  • Jul 23 2017 06:17
    quadrupleslap opened #65
  • Aug 21 2016 19:04
    Maplicant edited #64
  • Aug 21 2016 19:03
    Maplicant opened #64
  • Jun 04 2016 23:42
    SomeKittens commented #55
  • May 13 2016 18:14
    phdoerfler commented #46
  • May 02 2016 12:14
    alexandermorozov commented #37
  • May 02 2016 11:25
    alexandermorozov opened #63
  • May 01 2016 12:42
    alexandermorozov commented #37
  • Apr 30 2016 21:49
    alexandermorozov commented #33
  • Apr 30 2016 05:04
    bklooste commented #61
  • Apr 25 2016 12:35
    gallexme commented #61
  • Apr 23 2016 16:46
    alexandermorozov synchronize #62
  • Apr 23 2016 13:20
    alexandermorozov synchronize #62
  • Apr 19 2016 22:04
    alexandermorozov synchronize #62
  • Apr 19 2016 21:09
    alexandermorozov opened #62
  • Apr 17 2016 17:34
    alexandermorozov commented #37
  • Apr 17 2016 10:34
    MichaelHirn commented #37
  • Apr 14 2016 22:14
    alexandermorozov commented #37
Marco Z
@ocramz
Hi all ! I've just learnt about Autumn/Collenchyma. Really nice ! I do have a couple questions of general character (getting lost among all those Framework/Plugins/Hardware/Backend terminology in the guide): how exacly do you abstract over hardware? I mean, there has to be a separate implementation for each computation backend, amirite?
at first I thought there'd be some sort of virtualization but I must have misunderstood
Geordon Worley
@vadixidav
@hobofan Thanks for telling me. I am thinking I may publish it to crates.io only with genetic algorithms. At some point I may add this though.
Marco Z
@ocramz
Anyway, didn't mean to sound negative or confrontational, but I'd love if someone could provide a simple explanation of the interface between let's say the BLAS implementation and the user (especially what it's meant by "swapping the backend at runtime")
Maximilian Goisser
@hobofan
@ocramz Yes there has to be a seperate implementation for each backend
However we try to offload as much of the frameworks specifics as possible into the core of collenchyma so that plugins are as easy to write as possible and should look very similar between different backends
Maximilian Goisser
@hobofan
With "swapping the backend at runtime" we mean that you don't have to decide on the backend at compile time and can decide which backend to run on at runtime, depending on e.g. user input
Marco Z
@ocramz
Ok, now I'm getting it, thank you :)
bklooste
@bklooste
ok i see a big improvement in the way layers work. I think there is enough reason to switch now. Will comment on leaf gitter.
Maximilian Goisser
@hobofan
@bklooste Glad to hear that ;)
Jonathan Reem
@reem
Is this the right place to ask code questions about the collenchyma codebase?
Michael Hirn (MJ)
@MichaelHirn
Yes :)
Richard Diamond
@DiamondLovesYou
Hey guys, FYI I've found the cause to autumnai/collenchyma-nn#45 and fixed it (in addition to another issue with the tests) locally. I've got homework I've got to do first, but after that I'll create a PR for the fix.
Michael Hirn (MJ)
@MichaelHirn
That's awesome. Looking forward to the PR :+1:
Richard Diamond
@DiamondLovesYou
I've also created n-dimensional conv code for native. Finished it last weekend, but the tests incorrectly expected different results, so I had to borrow a friends desktop (which has an nVidia GPU) check what cuDNN generates. I've thus discovered my code was correct. Anyway, I decided to refactor the tests, and thus need to retest on my friends computer, which I can't do till Monday.
Michael Hirn (MJ)
@MichaelHirn
Yaaay! I was looking into conv for native a few days ago, but felt like it needed an interface for slicing to receive the proper spatial dimensions. So I thought we first had to implement the native memory of the SharedTensor via ndarray.
Really looking forward to see how you did it :clap:
Richard Diamond
@DiamondLovesYou
Thanks! W.r.t. slicing: such an interface would be a good idea anyway, having to manually handle strides was kinda annoying. I've haven't used ndarray, but taking a quick look, I'd say that would be a good direction to take as it provides the features I would have liked to have when I wrote it.
Richard Diamond
@DiamondLovesYou
Crap. I refactored the conv use generic types instead of copy pasted code for each type (I've fixed the native framework to be generic, at least w.r.t. convolutions), but in my infinite wisdom, I've forgotten about Cuda's backend.
bklooste
@bklooste
@DiamondLovesYou Richared did this PR make it into 2.1 ?
Michael Hirn (MJ)
@MichaelHirn
No it didn't. We didn't manage to review it, yet. But thanks for reminding me. I am on it.
Philipp Dörfler
@phdoerfler
I just wrote that into an issue but only afterwards realised there is a chat here. What do I have to do to get this to run on OSX? There is a pull request which has been merged on April 10th. Is that in 0.0.8 yet?
Bernhard Schuster
@drahnr
@DiamondLovesYou do have time for a chat?
you did some pretty great work there with the conv fixup
Richard Diamond
@DiamondLovesYou
@drahnr Hey, sure! And thanks!
(Sorry just saw this!)
Bernhard Schuster
@drahnr
@DiamondLovesYou no worries
I would like to have a quick chat with you about collemchyma this week if you are interested :)
mostly about design decisions that were made and if you are interested in further pushing it
bright-star
@bright-star
Hi all, are there any FPGA-specific backend plugins implemented or under development?
If not, I am interested in putting one together
bright-star
@bright-star
I see in https://github.com/autumnai/collenchyma-nn/blob/master/README.md#provided-operations none of the OpenCL operations are not implemented. Would that be a good place to start?
Bernhard Schuster
@drahnr
I also did some cleanup work there
and yes, starting to implement the features in OpenCL kernels would be a great start!
one hint would be looking into dual numbers for differentiation to make that as painfree as possible, but not necessarily
what ever you want to start with, I'd be pleased to review pull requests
Bernhard Schuster
@drahnr
also don't hesitate to ask questions and discuss stuff
bright-star
@bright-star
Awesome, thanks!
subversive-owl
@subversive-owl
Oh wow there is OpenCL interest
that's actually what i'm here to ask about :)
I have a virtex 5 here I can't get to show up with https://github.com/cogciprocate/ocl 's API, but if I can get it talking, I was interested in trying autumn on it
Bernhard Schuster
@drahnr
@subversive-owl the OpenCL implementation is just being started, there is still way to go
subversive-owl
@subversive-owl
I'm interested in helping! if I can get this FPGA working to test with
Bernhard Schuster
@drahnr
cool :)
I am currently investigating / experimenting on how to get automatic differentiation on board
if you feel like implementing layers that would be awesome :)
subversive-owl
@subversive-owl
sounds good! I haven't done much openCL but I've written parallelized linalg code before, so I can figure it out
Bernhard Schuster
@drahnr
sweet :)
don't hesitate to ask if you are stuck