I see that there is a
juice.capnp file
Thanks for the help!
@aurelien-m - I've got an example for adding a layer in these files
https://github.com/spearow/juice/compare/add-nlp-embedding#diff-102add05aef62c4dd8eecbaa3ca47ec34bdbfa5d72f3d76a03434817e2146c5c
https://github.com/spearow/juice/compare/add-nlp-embedding#diff-65ebf90745a2d796049c25336cb0c4c32e9e64a319f8f17e4e420439a2a5ebb7
https://github.com/spearow/juice/compare/add-nlp-embedding#diff-bc2df2356fa1fb82ee7480532dafffa4f2fb281522f8475afbd463aebcab848c
Which includes the layers.capnp file and layers.rs7
In spearow.github.io - I have been trying to find the repository in the Juice repository and on spearow's Github page, but I could not find it :(
@kdonthi under
juice/doc/book is the github documentation
the remaining part is generated by rust doc comments
A new patch release will be out within the next few days, so people can use the released versions from crates io
if there are any pending issues that are not tracked just yet, it'd be great if you could /all file an issue :) much appreciated!
/all
Hey @drahnr I'm blocked on not having a gpu that supports cuda, but I was lucky to get a 1080ti for cheap and it's supposed to arrive tuesday. So I won't be active until then, but should probably be pretty active after that :)
Just keep that in mind.
Once you did a few Para we also have a sharable GPU which also runs the CI checks.
*PRs
But it's mostly there for compat + low end tests
Thanks for letting me know! And no problem! I expect this to be a somewhat high latency process and to be slow going at least at first. I’m used to working with people on the other side of the world from me and people having limited internet :)
I’m planning on trying to implement one of the super resolution GAN models from https://github.com/cszn/KAIR
BatchNormalization2d is the first layer that it uses
So once I follow the process you outlined for adding a new layer to juice and go through the PR and review process I plan on moving through the remainder of the layers that that model uses from pytorch and adding them from rcudnn-sys in juice
Obviously I will do each as a separate PR and follow proper git commit practice
Would you also like me to raise a corresponding issue for each layer before submitting the PR? Or is just the PR sufficient?
I ended up having quite a hectic week with IRL appointments and commitments. So I’ll finally be setting up my desktop with the 1080ti and new power supply tomorrow (Saturday) morning and should be on my way on the code shortly thereafter if all the cuDNN installation etc goes well
Everything is installed and the examples compile! So I’m all set to start now... well I’ll start working on juice tomorrow actually :)
The spearow.io link on the github repo errors with 502 bad gateway. Are you already aware of this?
I guess the default should be the book, or use a subdomain, I have to figure if github can handle this - before I had custom infra which I started to scale down a bit.
What is spearow?
It's a mix of spearou (a Belgian comic) and sparrow (bird)
Cool! Is it meant to be the name of an organization for machine learning?
I like the name a lot!
I started the task of implementing BatchNormalization in rcudnn last night and a thought occurred to me. Might it be easier to auto generate all of the ParamaterNotSupported error strings by parsing them per function from the cuDNN API reference pdf?