These are chat archives for deeplearning4j/deeplearning4j/earlyadopters

11th
Apr 2016
Alex Black
@AlexDBlack
Apr 11 2016 01:57
hm, getting libnd4j cpu build failures on windows: https://gist.github.com/AlexDBlack/665fdfaa27d0d4db0dfa87bdc46ac13b
@agibsonccc
Adam Gibson
@agibsonccc
Apr 11 2016 02:04
@AlexDBlack those are fixed but I'm still seeing some stuff with javacpp
looking at now
Adam Gibson
@agibsonccc
Apr 11 2016 02:23
Hey guys - everything should be building again
Adam Gibson
@agibsonccc
Apr 11 2016 02:33
@kaimast I would look over thi sagain
We had to revert some of your changes
Try to tackle some of these PRs in bits next time
One thing I'd recco looking at if you'd like to do the opnum stuff is the java side of it as well as the c++ side though
we'd also need you looking at cuda as well
peyman faratin
@montyhall
Apr 11 2016 04:28
hi.. i am trying to re-compile libnd4j and nd4j usign mvn clean install -DskipTests -Dmaven.javadoc.skip=true -pl '!org.nd4j:nd4j-cuda-7.5,!org.nd4j:nd4j-tests'
however, i am seeing this compile error [ERROR] Failed to execute goal org.bytedeco:javacpp:1.2-SNAPSHOT:build (process-classes) on project nd4j-native: Unable to parse configuration of mojo org.bytedeco:javacpp:1.2-SNAPSHOT:build for parameter compilerOptions: Cannot assign configuration entry 'compilerOptions' with value '-std=c++11' of type java.lang.String to property of type java.lang.String[] -> [Help 1]
i have followed the instructions at https://github.com/deeplearning4j/libnd4j and https://github.com/deeplearning4j/nd4j to install nd4j natively
Adam Gibson
@agibsonccc
Apr 11 2016 05:18
huh
@montyhall git pull and try again
Thomas
@tomdev55
Apr 11 2016 06:53
hi, can you give me any info about this exception (libnd4j, nd4j-native):
https://gist.github.com/Railer/981f0f4334ea6b388eaef9800d1b0acc
raver119
@raver119
Apr 11 2016 06:54
@Railer when you post exception, please include log file that was generated
that hs_err_pidXXXX.log
Alex Black
@AlexDBlack
Apr 11 2016 06:55
also if you can give us a reproducible test case that we run (or, at least tell us what you were doing), that can help a lot too
Paul Dubs
@treo
Apr 11 2016 06:59
and if possible also on what revision (git commit) of both nd4j and libnd4j you are
Thomas
@tomdev55
Apr 11 2016 07:16
@raver119, Here it is, https://gist.github.com/Railer/270e3ed3c009eac2cd1d7d31ecbcc190
@AlexDBlack , Sorry but I can't provide an exact test case since it is a part of a system that is being by 4 people using nd4j and the stack trace doesn't have any info about where in the code it happened, and I only reproduce it when I run something from a Website running on a Fedora Server. When I try to reproduce the error in my Windows PC I get no errors. Hope this helps.
@treo , if I got that right (nd4j: e0a23d2d0b2c04513abcdc3c33f63666a991650d, libnd4j: 2c240326a8a62e65624a3daefe412ef0c5066145)
raver119
@raver119
Apr 11 2016 07:20
execReduceScalarFloat
on cpu
strack trace have that info
there it is
Thomas
@tomdev55
Apr 11 2016 07:39
hmm thanks! I checked the code and didn't find anything wrong (). could it be that I messed up somehow the installation of native-nd4j in fedora?
raver119
@raver119
Apr 11 2016 07:43
no, but we definitely need issue filled on this crash
with maximum details on what you've been doing
Thomas
@tomdev55
Apr 11 2016 07:47
ok, I will try to add as much, but since the code belong to the company I work for I don't know if I am able to post everything
raver119
@raver119
Apr 11 2016 07:47
find that out
you don't need your data
Mikhail Zyatin
@Sitin
Apr 11 2016 07:59

Hi, friends, I have an error building libnd4j (OS X):

/usr/local/cuda/include/math_functions.h(9406): error: __lazy_enable_if is not a template

1 error detected in the compilation of "/var/folders/nf/77c17zn14v556chcvzkg989c0000gp/T//tmpxft_00008fab_00000000-22_NativeOps.compute_52.cpp1.ii".
-- Removing /Users/sitin/Documents/Workspace/dlf4/libnd4j/blas/CMakeFiles/nd4j.dir/cuda/./nd4j_generated_NativeOps.cu.o
/usr/local/Cellar/cmake/3.5.1/bin/cmake -E remove /Users/sitin/Documents/Workspace/dlf4/libnd4j/blas/CMakeFiles/nd4j.dir/cuda/./nd4j_generated_NativeOps.cu.o
CMake Error at nd4j_generated_NativeOps.cu.o.cmake:257 (message):
  Error generating file
  /Users/sitin/Documents/Workspace/dlf4/libnd4j/blas/CMakeFiles/nd4j.dir/cuda/./nd4j_generated_NativeOps.cu.o

Actually this is a last remaning error from ~30 I had yesterday at the evening and which have recently been fixed)

raver119
@raver119
Apr 11 2016 08:06
hm.
that's definitely not libnd4j
and compile error in cuda headers looks suspicious
Mikhail Zyatin
@Sitin
Apr 11 2016 08:17
My CUDA is:
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2015 NVIDIA Corporation
Built on Thu_Sep_24_00:26:39_CDT_2015
Cuda compilation tools, release 7.5, V7.5.19
$ clang --version
Apple LLVM version 7.0.2 (clang-700.1.81)
Target: x86_64-apple-darwin15.3.0
Thread model: posix
raver119
@raver119
Apr 11 2016 08:17
give me full output from compiler
raver119
@raver119
Apr 11 2016 08:21
nono
full one
and this is definitely not full
raver119
@raver119
Apr 11 2016 08:32
i'm sorry, but that's not full log too.
Mikhail Zyatin
@Sitin
Apr 11 2016 08:32
This is for the las nvcc with --verbose
raver119
@raver119
Apr 11 2016 08:32
dumb question here: how exactly you're building libnd4j?
Mikhail Zyatin
@Sitin
Apr 11 2016 08:33
No, It’s a good question)
raver119
@raver119
Apr 11 2016 08:33
so, where's my good answer then?
:)
Mikhail Zyatin
@Sitin
Apr 11 2016 08:33
$ ./setuposx.sh
$ make all
raver119
@raver119
Apr 11 2016 08:33
nice.
please
Mikhail Zyatin
@Sitin
Apr 11 2016 08:33
This message was deleted
raver119
@raver119
Apr 11 2016 08:33
read the readme plz
and use command provided there

Set a LIBND4J_HOME as an environment variable. This is required for building nd4j as well.

For cpu followed by gpu run:

./buildnativeoperations.sh blas cpu ./buildnativeoperations.sh blas cuda

raver119
@raver119
Apr 11 2016 08:39
@treo are you still here?
Mikhail Zyatin
@Sitin
Apr 11 2016 08:40
Yes I have:
RUNNING COMMAND cmake
ADDING BLAS
Using apple
-- Try OpenMP C flag = [ ]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Failed
-- Try OpenMP C flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Failed
BTW, where should point LIBND4J_HOME? Repository root or some arbitrary build path?
raver119
@raver119
Apr 11 2016 08:44
repo root
Mikhail Zyatin
@Sitin
Apr 11 2016 08:49
Right
Mikhail Zyatin
@Sitin
Apr 11 2016 09:01
After some workaround with paths:
$ ./buildnativeoperations.sh blas cpu ./buildnativeoperations.sh blas cuda
LIBND4J_HOME IS /Users/sitin/Documents/Workspace/dlf4/libnd4j
eval cmake
RUNNING OSX CLANG
Running blas
RUNNING COMMAND cmake
dyld: Symbol not found: ___cxa_bad_typeid
  Referenced from: /usr/lib/libicucore.A.dylib
  Expected in: /usr/local/Cellar/clang-omp/2015-04-01/libexec/lib/libc++.1.dylib
 in /usr/lib/libicucore.A.dylib
./buildnativeoperations.sh: line 142: 39152 Trace/BPT trap: 5       cmake -DCPU_BLAS=true -DBLAS=TRUE ../..
make: *** No targets specified and no makefile found.  Stop.
FINISHING BUILD
raver119
@raver119
Apr 11 2016 09:07
@Sitin are you sure you really need to compile manually?
./buildnativeoperations.sh blas cpu ./buildnativeoperations.sh blas cuda
this is WRONG
you can't execute it in that way
that's two separate comands
Mikhail Zyatin
@Sitin
Apr 11 2016 09:09
Ah, yes. But ./buildnativeoperations.sh blas cpu && ./buildnativeoperations.sh blas cuda returns the same(
raver119
@raver119
Apr 11 2016 09:09
please
run commands one by one
and give me something i can read
"returns the same" gives me nothing
run blas cpu compilation
if it goes wrong - give me full output
Mikhail Zyatin
@Sitin
Apr 11 2016 09:11
$ ./buildnativeoperations.sh blas cpu
LIBND4J_HOME IS /Users/sitin/Documents/Workspace/dlf4/libnd4j
eval cmake
RUNNING OSX CLANG
Running blas
RUNNING COMMAND cmake
dyld: Symbol not found: ___cxa_bad_typeid
  Referenced from: /usr/lib/libicucore.A.dylib
  Expected in: /usr/local/Cellar/clang-omp/2015-04-01/libexec/lib/libc++.1.dylib
 in /usr/lib/libicucore.A.dylib
./buildnativeoperations.sh: line 147: 40864 Trace/BPT trap: 5       cmake -DCPU_BLAS=true -DBLAS=TRUE ../..
make: *** No targets specified and no makefile found.  Stop.
FINISHING BUILD
Is it possible to get more verbose output?
raver119
@raver119
Apr 11 2016 09:12
hm.
what's your mac os, xcode and clang-omp versions?
Mikhail Zyatin
@Sitin
Apr 11 2016 09:19

clang-omp:

$ clang-omp++ --version
clang version 3.5.0
Target: x86_64-apple-darwin15.3.0
Thread model: posix

XCode:

 clang --version
Apple LLVM version 7.0.2 (clang-700.1.81)
Target: x86_64-apple-darwin15.3.0
Thread model: posix

OS X:

$ sw_vers
ProductName:    Mac OS X
ProductVersion:    10.11.3
BuildVersion:    15D21
Well, I think I've found the possible reason:
Referenced from: /usr/lib/libicucore.A.dylib but: clang-omp implies hombrew's library from /usr/local/opt/icu4c/:
This formula is keg-only, which means it was not symlinked into /usr/local.

OS X provides libicucore.dylib (but nothing else).

Generally there are no consequences of this for you. If you build your
own software and it requires this formula, you'll need to add to your
build variables:

    LDFLAGS:  -L/usr/local/opt/icu4c/lib
    CPPFLAGS: -I/usr/local/opt/icu4c/include
Mikhail Zyatin
@Sitin
Apr 11 2016 09:54
No. Fixing the latter still doesn’t work since the last one doesn’t include libicucore but only some extensions.
peyman faratin
@montyhall
Apr 11 2016 12:14
@agibsonccc worked.. thankyou
Adam Gibson
@agibsonccc
Apr 11 2016 14:29
@Sitin would you mind adding to deeplearning4j/libnd4j#79
Sadat Anwar
@SadatAnwar
Apr 11 2016 14:57

guys, today I am trying to build libNd4J on windows, and I am looking at the instruction for windows, it says clone the repo and runbash ./buildnativeoperations.sh blas cpu

should I run this on cmd or the recently installed Msys2 ? thanks

okay, so @agibsonccc I use it in Msys2, right? If I do a ls -l in the root of the Msys shell, I see only stuff inside the Msys2 folder, should I move the checked out code in there? or? can I navigate to my C: drive? sorry this is a totally noob question
never mind, i figured it out
woooh!! I think i did it here! that was fairly simple! :D wish it was like this on my mac :(
Sadat Anwar
@SadatAnwar
Apr 11 2016 15:23
okay, so I did all the libNd4J parts
and now am trying to build the nd4j
but the mvn install is failing at nd4j Native
any idea?
Adam Gibson
@agibsonccc
Apr 11 2016 15:24
I didn't see any useful information from yuo
you*
You should know how this goes by now :P
Did you look at windows.md?
This is pretty well trodden territory at this point
Sadat Anwar
@SadatAnwar
Apr 11 2016 15:26
sorry! Yes, I am looking at that and following the instructions there... maybe I am missing some thing, one sec, Ill just get a gist. I am so swamped with everything I am losing my mind
never mind @agibsonccc sorry, I figured it out!
thanks! :D
Adam Gibson
@agibsonccc
Apr 11 2016 15:29
cool
Sadat Anwar
@SadatAnwar
Apr 11 2016 15:29
so now its done, I can now use the latest from snapshot?
Adam Gibson
@agibsonccc
Apr 11 2016 15:41
You need to switch your artifact id to nd4j-native
Sadat Anwar
@SadatAnwar
Apr 11 2016 15:43
aaaa! Damn! Told you I am losing it! thanks! that is all I needed, its working now! Yippee!!! :) (on windows)
@agibsonccc one question, once you release this version, will we have to build libNd4j and Nd4j everytime there is a new version? or will we be able to get it as a maven dependency? does the question make sense?
Adam Gibson
@agibsonccc
Apr 11 2016 15:46
no
We are just working on the distribution setup for this
We just haven't done it yet
Sadat Anwar
@SadatAnwar
Apr 11 2016 15:46
question doesn't make sense?
Adam Gibson
@agibsonccc
Apr 11 2016 15:46
It does
Sadat Anwar
@SadatAnwar
Apr 11 2016 15:46
oh as in no, wont need to build
Adam Gibson
@agibsonccc
Apr 11 2016 15:46
right
Sadat Anwar
@SadatAnwar
Apr 11 2016 15:46
ah that would be awesome! :D
good luck! I hope it all works great!
wutzebaer
@wutzebaer
Apr 11 2016 17:34
hi i created an issue deeplearning4j/deeplearning4j#1382 i's impossible for me to save/load and continue training with a RNN with the current snapshot, could anybody paste the code on the end of the issue and tell me if it crashes for you too?
Sadat Anwar
@SadatAnwar
Apr 11 2016 22:23
@Sitin did you manage to get it working for you on mac osx?
Mikhail Zyatin
@Sitin
Apr 11 2016 23:30
@sadatanwer, nop. I still have this problem:
$ ./buildnativeoperations.sh blas cpu
LIBND4J_HOME IS /Users/sitin/Documents/Workspace/dlf4/libnd4j
eval cmake
RUNNING OSX CLANG
Running blas
RUNNING COMMAND cmake
dyld: Symbol not found: ___cxa_bad_typeid
  Referenced from: /usr/lib/libicucore.A.dylib
  Expected in: /usr/local/Cellar/clang-omp/2015-04-01/libexec/lib/libc++.1.dylib
 in /usr/lib/libicucore.A.dylib
./buildnativeoperations.sh: line 144:  7095 Trace/BPT trap: 5       cmake -DCPU_BLAS=true -DBLAS=TRUE ../..
make: *** No targets specified and no makefile found.  Stop.
FINISHING BUILD