Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • 01:54

    AlexDBlack on ab_horschi_modelserializer

    (compare)

  • 01:54

    AlexDBlack on master

    restoreMultiLayerNetwork() need… Merge branch 'master' of https:… API fix + try with resources (c… and 3 more (compare)

  • 01:54
    AlexDBlack closed #8815
  • 01:54
    AlexDBlack closed #8735
  • 01:53
    agibsonccc review_requested #8815
  • Mar 31 18:28
    strolling-coder edited #8818
  • Mar 31 18:18
    strolling-coder opened #8818
  • Mar 31 17:28
    fxbronk commented #8192
  • Mar 31 15:28
    horschi commented #8739
  • Mar 31 12:55
    AlexDBlack milestoned #8817
  • Mar 31 12:55
    AlexDBlack labeled #8817
  • Mar 31 12:55
    AlexDBlack opened #8817
  • Mar 31 12:26
    AlexDBlack closed #8684
  • Mar 31 12:16
    AlexDBlack commented #8684
  • Mar 31 12:00
    AlexDBlack assigned #8755
  • Mar 31 11:13
    AlexDBlack commented #8592
  • Mar 31 11:11
    AlexDBlack assigned #8690
  • Mar 31 10:26
    atuzhykov closed #8816
  • Mar 31 10:23
    atuzhykov opened #8816
  • Mar 31 10:17
    AlexDBlack closed #8760
conquer66666
@conquer66666
hi ,where to find out the import org.deeplearning4j.examples.download.DownloaderUtility in the example code?
conquer66666
@conquer66666
I cannot find this class
conquer66666
@conquer66666
I find it under the shared-utilities
thomas-trendsoft
@thomas-trendsoft
i try get an iterator for some rnn computation graph the csv needs to be split in to vectors like: .addInput("myReader",0,2).addInput("myReader",3,8) from RecordReaderMultiDataSetIterator is there anything like this on the class: SequenceRecordReaderDataSetIterator
Raul Feresteanu
@rferesteanu
How do I get the row and column indices out of INDArray.argMax for a 2D array?
Barney Stinson
@Barney_Stinson_gitlab
any c# programmer here...?
Daniel Mårtensson
@DanielMartensson
@Barney_Stinson_gitlab Only Java ;)
Raul Feresteanu
@rferesteanu
From what I understand argMax/argMin seems to return indices along rows/columns but I'd like to know if I can get it to return the row and column indices of the element in question
Raul Feresteanu
@rferesteanu
Nevermind, I wrote my own helper. Would still be a nice addition to the API
tintinxue1
@tintinxue1
@fortuneNext try Nd4j.setDefaultDataTypes(DataType.DOUBLE,DataType.DOUBLE); put this at the begining of main
tintinxue1
@tintinxue1
I have a question, i tried to import a keras model. the keras model has masking layer plus lstm(64) and dense layers. taking input the padded sequence of one-hot encoded vectors. After importing, i can see it's maskzerolayer then lstm dense layer. Checked each layer weights, the lstm layer weights don't match up, all others match up with python version. The LSTM in dl4j has timestep and features in a swap position compared to python version. The input has been modified accordingly. But it just won't give same result with python verion, any help please?
conquer66666
@conquer66666
I run the example code of UIExample,when i go to http://localhost:9000/train, it shows Resource not found,and i search the project ,only two files(log4j ,logback configure file) under the resource folder,where are the needed resource ?
conquer66666
@conquer66666
lemair
@lemair
Hi, I'm trying to build regression but have next Exception https://gist.github.com/lemair/2e44f16a3b232019dbf3983db42a22ac
Ilya
@Eljah
Hello! I'm trying to play around https://github.com/wmeddie/dl4j-gans and to add UIServer server there to observe metrics of the GAN network. But still getting troubles,. First, I got the missing class exceptin, after updating to beta6 I just don't see any localhost:9000 starts for the UI Server, while the calculation is going forward fine
and the second question is how it is designed to use only part of the large jpeg image (2000x3000, 3 chanels) while I instantiate the ImageRecordReader(100, 100, 1). Not clear should I prepare the image by myself in order to use imageRecorderReader correctly: https://stackoverflow.com/questions/60198054/correct-initialization-of-imagerecordreaderlong-height-long-width-long-channe
MOKHEE LEE
@spaceking7_twitter
Hi! I am dl4j begginer, I have a question about scope . Is there some dl4j example for scope of data ?
For example, I teach the A.I below data.
"from 1 to 10 =>legend 1, from 11 to 20 => legend 2, from 21 to 30 => legend 3, from 31 to 40 => legend 4, ... "
Then I can give the scope (a legend) him if a customer input a data.
I am sorry My English is not perfect. I hope you understand it that i want to do.
Dineshdinu16
@Dineshdinu16
Hi,
I have been using computation graph with LSTM layers. But the dependency jars of these have been around 35 jars for linux which sums up to 125 MB. Is there any way to reduce the size by removing the unwanted files from the jar? Most of the jar size where occupied by ".so" files.
AmirLand
@AmirLand6_twitter
Hi, I hope you are all well. I followed the quick start instruction. however, I got an error that the shared utility dependency couldn't resolve. is there any help or recommendation?
MOKHEE LEE
@spaceking7_twitter
if you use eclipse , then you have to import "shared-utilities" project also in your eclipse Package Explorer. I fixed by it.
deeplearning4j-examples-master/shared-utilities
MOKHEE LEE
@spaceking7_twitter
or you can refer "eclipse/deeplearning4j#8307"
git clone https://github.com/eclipse/deeplearning4j-examples
cd shared-utilities
mvn install
cd ../dl4j-examples
mvn install
edoardobassett
@edoardobassett
Hello. I am trying to train a MultiLayerNetwork using the fit method. I first tried to create an INDArrayDataSetIterator, where I passed the first INDArray as a feature matrix (64 rows and 6 columns) and an INDArray for the label prediction (64 rows and 2 columns).
However, it didn't seem to train correctly as I was constantly getting the same values. I then tried to do it wihtout a dataset iterator but nothing changed.
Any ideas on what i'm doing wrong? I don't think it is related to the network configuration or the learning rate.. Only one parameter of the network output seems to change
Amlesh Sivanantham
@zamlz
hey guys, I'm having some trouble running valgrind to test my java class running some dl4j code. I was following the guide on the old nd4j wiki but the output is not what I expect. They create a script called valgrindJava which essentially wraps the java process into valgrind. I tried running it with my actual arguments, through maven, and standalone without the script. In all cases, it seems that valgrind gives its summary before the java process even runs. Yet in the valgrind logs, I do see the full java command being printed so it is getting it. Hoping someone here understands what the issue could be. Here is the wiki page I was referring to, https://github.com/deeplearning4j/libnd4j/wiki/Debugging-libnd4j
Amlesh Sivanantham
@zamlz
Hey all identified the issue. My java in my path was actually a shell script that then forwarded the call to the actually java binary. Once I passed that in, its correctly being scaned by valgrind
Yuniel Acosta Pérez
@yuniel-acosta
I can in the process of transforming my dataset convert a column that contains text into a Vector using Word2Vec. If so, can someone explain to me how
Yuniel Acosta Pérez
@yuniel-acosta
I need help please.
Artsakenos
@artsakenos
@yuniel-acosta You can, see the example in https://deeplearning4j.org/docs/latest/deeplearning4j-nlp-word2vec you the you just need to input the information from your file instead of raw_sentences.txt
Anybody can suggest some good tutorial on how to setup a simple reinforcement learning environment in DL4J? Examples require frameworks, the toy sample is not documented and object involved are not immediate to understand event diving in the code.
sskmaestro
@sskmaestro
Hi
new to DL4J
trying to do the serup
setup*
getting below exception when i try to run the CSVExample.java in IntelliJ
i completed the Maven clean install
any help plz?
Artsakenos
@artsakenos
@sskmaestro As you can see, the files on the azure cloud where they are supposed to be hosted are no longer available, so the link is broken. I solved searching those files and caching myself in my local folders. e.g., C:\Users\myself\dl4j-examples-data\dl4j-examples\nlp\raw_sentences.txt
You can find the local path of IrisData.zip in project "shared-utilities*/.../DownloaderUtility.java, in this case:
IRISDATA("IrisData.zip", "datavec-examples", "bb49e38bb91089634d7ef37ad8e430b8", "1KB"),
so it would be:
C:\Users\<youruserfolder>\dl4j-examples-data\dl4j-examples\datavec-examples\IrisData.zip
Unfortunately I can't find the mirror I used.
sskmaestro
@sskmaestro
@artsakenos I dont see the IrisData.zip under \dl4j-examples-data\dl4j-examples\datavec-examples\
Manish Patel
@manni_patel_twitter
Hi, is there a way for ImageRecordReader to autodetect the correct number of channels, e.g. from the first image in the data set?
Artsakenos
@artsakenos

@sskmaestro Yes, what I meant you have to cache it by yourself on that folder, i.e., download it and put it there. For example this link should have an iris data folder: https://archive.ics.uci.edu/ml/datasets/Iris

I'm so sad Java Developers and tools for Machine Learning always seem just like they're being abandoned.

tc64
@tc64

Hi, I'm debugging an application where physical memory usage grows indefinitely, resulting in OutOfMemory errors. The Errors may occur in a few places, but the ultimate result is "Physical memory usage is too high: physicalBytes(40238M) > maxPhysicalBytes(40050m). It usually takes around 1 million requests to a tomcat app where the ComputationGraphs and DataSetIterator live.

I cannot debug the above application on a linux machine where I can easily change code and iterate quickly. I have created a toy app based on one of the dl4j examples. There is no tomcat, it just loads the net built in CnnSentenceClassificationExample (I used the same training code there), then loops over the DataISetIterator and call net.output on each batch.

I noticed that if logging Pointer.physicalBytes(), in the toy app it goes up until a certain point. Then there is a few second pause, and the totalBytes number drops. Once I see this happen, I see that it happens each time the value gets to a certain max value.

In the tomcat app logs, I don't see the value ever go down. I wasn't logging physical bytes when I saw the OOM, and will do more tests. But, I'm currently trying to pin down where in the dl4j, nd4j, javacpp code is running during this pause (which appears to be garbage collection for native memory). I'd like to find that to see if for some reason that same code segment is being skipped in my tomcat app. Any advice here would be appreciated, thanks.

The OutOfMemory errors generally occur in <init>FloatPointer
Samuel Audet
@saudet
@tc64 It's possible that garbage collection is taking more time with Tomcat because of other applications running in the container. Try to increase the number of retries to System.gc(): http://bytedeco.org/javacpp/apidocs/org/bytedeco/javacpp/Pointer.html#maxRetries
lemair
@lemair
Hello, How to change model in interface? Example: