These are chat archives for deeplearning4j/deeplearning4j/earlyadopters

10th
Apr 2016
Paul Dubs
@treo
Apr 10 2016 18:42
@agibsonccc this looks wrong to me: https://github.com/deeplearning4j/libnd4j/blob/master/include/reduce.h#L518 as this updates ret at every iteration, I don't think it can actually be parallel
Adam Gibson
@agibsonccc
Apr 10 2016 19:10
@treo since I like messing with windows users I added a define for ND4j_EXPORTS
basically its an empty macro on systems that aren't windows
problems?
Paul Dubs
@treo
Apr 10 2016 19:11
https://github.com/deeplearning4j/libnd4j/blob/master/include/dll.h it already was an empty macro for non windows users
Adam Gibson
@agibsonccc
Apr 10 2016 19:12
for some reason this didn't work for clion :(
hm
Paul Dubs
@treo
Apr 10 2016 19:13
maybe it doesn't like the somewhat indent look of it?
Adam Gibson
@agibsonccc
Apr 10 2016 19:13
so I put dll.h at the bottom
clion is still happy
but it will still end up the right value
Paul Dubs
@treo
Apr 10 2016 19:15
you should add a comment why there is this weird construct
Adam Gibson
@agibsonccc
Apr 10 2016 19:15
about to
Paul Dubs
@treo
Apr 10 2016 19:15
But I would actually try to unindent dll.h first, maybe that trips up clions parser?
Adam Gibson
@agibsonccc
Apr 10 2016 19:16
done
hmm
appears to be related to the include paths not being setup right..
I'll come back to it later
I'm just trying to get @kaimast integrated in to the java side
Paul Dubs
@treo
Apr 10 2016 19:18
ok, could you still take a quick look at https://github.com/deeplearning4j/libnd4j/blob/master/include/reduce.h#L518 that looks wrong to me
Adam Gibson
@agibsonccc
Apr 10 2016 19:18
more than likely a mistake
Kai Mast
@kaimast
Apr 10 2016 19:21
thanks1
Mikhail Zyatin
@Sitin
Apr 10 2016 19:58
Hi, everybody! I am trying to use nd4j-jcublas-7.5 (0.4-rc3.9-SNAPSHOT) but after I’ve build cuda preset for javacpp (1.2-SNAPSHOT) I still have the error:
https://gist.github.com/Sitin/e7c53cb0f8e39bb009e27eac76771bb7
Adam Gibson
@agibsonccc
Apr 10 2016 19:58
@Sitin the new dep is nd4j-cuda-7.5
Also - fwiw GPUs are about 80% done
they are galaxy's away from being usable yet
unless you're trying to help us debug it's 100 % useless to even try it right now
most of the tests are passing for the new kernels but there's not much else you can do wih it atm
Mikhail Zyatin
@Sitin
Apr 10 2016 20:02
Thank you, @agibsonccc. There are a lot of artifacts in maven related to cuda… Maybe I’ll simply try to run it and then postpone it until ready)
Adam Gibson
@agibsonccc
Apr 10 2016 20:02
don't use maven central for libnd4j
I think I already said we need to solve the distribution problem with the binaries before snapshots will work again
raver119
@raver119
Apr 10 2016 20:03
@Sitin you can run it only by building it manually, using provided instructions
Mikhail Zyatin
@Sitin
Apr 10 2016 20:03
Do you suggest to build nd4j locally?
Adam Gibson
@agibsonccc
Apr 10 2016 20:03
It's mandatory
raver119
@raver119
Apr 10 2016 20:03
but it’s not worth it yet. 99% of tests are passing, but from performance point of view it’s not quite ready
Adam Gibson
@agibsonccc
Apr 10 2016 20:03
there's different builds for different Oses
raver119
@raver119
Apr 10 2016 20:11
however, in day or two i hope we’ll start profiling cuda too
Mikhail Zyatin
@Sitin
Apr 10 2016 20:12

Actually I’ve tried cuda since I've got strange errors with nd4j-x86 at constructions like

ret2.reshape(shape).permute(2, 0, 1)

fail with java.lang.IllegalArgumentException: Shapes do not match: x.shape=[1, 196608], y.shape=[3, 256, 256]
as if permute operates on unchanged ret2.

Adam Gibson
@agibsonccc
Apr 10 2016 20:12
use nd4j-native
not nd4j-x86
x86 is old
I got rid of it
this is for rc-3.9-SNAPSHOT
again anything to do anything on maven central with the snapshots is bad
Mikhail Zyatin
@Sitin
Apr 10 2016 20:14
Thanks! I will check that everything is built locally and report if the error will reproduce)
raver119
@raver119
Apr 10 2016 20:16
sure, but it won’t :) 7 tests are failing for cuda, out of 573, and i know all those tests and why exactly they are failing :)
the issue you’re referring is not one of them
Mikhail Zyatin
@Sitin
Apr 10 2016 20:28

Hmm… Now I am trying to build nd4j but instead:

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:1.4.1:enforce (libnd4j-checks) on project nd4j-native: Some Enforcer rules have failed. Look above for specific messages explaining why the rule failed. -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:1.4.1:enforce (libnd4j-checks) on project nd4j-native: Some Enforcer rules have failed. Look above for specific messages explaining why the rule failed.
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)

Am I missing something?

raver119
@raver119
Apr 10 2016 20:29
yes
libnd4j
Paul Dubs
@treo
Apr 10 2016 20:29
the actual error message that tells you that you have to set LIBND4J_HOME
Mikhail Zyatin
@Sitin
Apr 10 2016 20:30
So, just build libnd4j?
raver119
@raver119
Apr 10 2016 20:30
yes
but read readme there before building
Mikhail Zyatin
@Sitin
Apr 10 2016 20:31
Thank you)
Mikhail Zyatin
@Sitin
Apr 10 2016 20:44
@raver119, well… now I have libnd4j/include/reduce3.h:17:10: fatal error: 'omp.h' file not found trying to build the libnd4j. What is missing now?
Adam Gibson
@agibsonccc
Apr 10 2016 20:44
@Sitin osx?
Mikhail Zyatin
@Sitin
Apr 10 2016 20:44
yes
Adam Gibson
@agibsonccc
Apr 10 2016 20:44
make sure you run ./setuposx.sh
Mikhail Zyatin
@Sitin
Apr 10 2016 20:46
I did: Warning: clang-omp-2015-04-01 already installed
Adam Gibson
@agibsonccc
Apr 10 2016 20:47
honestly not sure.. not an osx user
Paul Dubs
@treo
Apr 10 2016 20:47
So you probably have the same problem as @sadatanwer had: deeplearning4j/libnd4j#79
The issue isn't resolved, but you can try setting these exports: https://gist.github.com/eraly/5c1369ed7fdf31adeeab2179632c4a3f
Susan Eraly
@eraly
Apr 10 2016 20:49
@Sitin I remember having similar issues. @treo beat me to the punch :smile:
Paul Dubs
@treo
Apr 10 2016 20:50
@eraly it's even your gist from the last time :D
Susan Eraly
@eraly
Apr 10 2016 20:50
@treo Lol. I know. @Sitin The other thing for me was a really old version of xcode and an outdated os version
Mikhail Zyatin
@Sitin
Apr 10 2016 20:52
Nop(
$ clang --version
Apple LLVM version 7.3.0 (clang-703.0.29)
Target: x86_64-apple-darwin15.3.0
Thread model: posix
InstalledDir: /Applications/Xcode-7.3.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin
Mikhail Zyatin
@Sitin
Apr 10 2016 22:07
@treo, @eraly, after fixing paths I still have a problem: https://gist.github.com/Sitin/340d7e8851716af7e06929a6b5bea1b5
Sadat Anwar
@SadatAnwar
Apr 10 2016 22:22
@Sitin well, @treo rightly said that I too am facing issues building libnd4j, unfortunately I still dont have a solution, but your problem looks different plus I only get an error at linking time, yours look like compile error. Interesting... I never got compile errors...
Adam Gibson
@agibsonccc
Apr 10 2016 22:34
I'll work on simulating this with @eraly tomorrow
Right now the codebase is a bit in flux, I'd likely revert it a bit
Mikhail Zyatin
@Sitin
Apr 10 2016 23:51
Thank you, @agibsonccc, and good night!