A general forum for machine learning and deep learining questions, focused on DL4J/ND4J
it work
Thanks
Hey There just wanted to share references for open source projects i share on twitter to the community here , check my github profile at github.com/aah20 and my twitter at https://twitter.com/Ahmed_Hassan_73
Hi all, I am new to ML and I am learning it by creating a project. I want to create a handwritten app, and for fun I want to do it for others language than english, I chose French and Arabic as I speak both> I am wondering how to create a dataset ? all the steps and how many sentences or words should I collect ? Thanks for you advices
so im trying to mvn clean install it, but i dont see there is any pom.xml in dl4j-examples folder
1 reply
is there something that i missed?
im following tutorial here -> deeplearning4j.konduit.ai
Your problem isn't really clear. Your problem could be anything ranging from "how do I use maven and intellij" to "I want to build from source" the home page doesn't have anything specific on it. As dl4j is a library and not a desktop application you don't "install it" you "include it as a library in your favorite IDE or project"
Hi all, I am a little new to dl4j. So I had been trying to run a unet model. After the line computaional_graph.fit() I get the following error
Exception in thread "main" java.lang.RuntimeException: std::bad_alloc
at org.nd4j.nativeblas.Nd4jCpu.mallocHost(Native Method)
at org.nd4j.linalg.cpu.nativecpu.CpuMemoryManager.allocate(CpuMemoryManager.java:48)
at org.nd4j.linalg.api.memory.abstracts.Nd4jWorkspace.alloc(Nd4jWorkspace.java:421)
at org.nd4j.linalg.api.memory.abstracts.Nd4jWorkspace.alloc(Nd4jWorkspace.java:320)
at org.nd4j.linalg.cpu.nativecpu.buffer.BaseCpuDataBuffer.<init>(BaseCpuDataBuffer.java:492)
at org.nd4j.linalg.cpu.nativecpu.buffer.FloatBuffer.<init>(FloatBuffer.java:68)
at org.nd4j.linalg.cpu.nativecpu.buffer.DefaultDataBufferFactory.create(DefaultDataBufferFactory.java:329)
at org.nd4j.linalg.factory.Nd4j.createBuffer(Nd4j.java:1467)
at org.nd4j.linalg.api.ndarray.BaseNDArray.<init>(BaseNDArray.java:324)
at org.nd4j.linalg.cpu.nativecpu.NDArray.<init>(NDArray.java:191)
at org.nd4j.linalg.cpu.nativecpu.CpuNDArrayFactory.createUninitialized(CpuNDArrayFactory.java:226)
at org.nd4j.linalg.factory.Nd4j.createUninitialized(Nd4j.java:4364)
at org.deeplearning4j.nn.layers.convolution.ConvolutionLayer.preOutput(ConvolutionLayer.java:442)
at org.deeplearning4j.nn.layers.convolution.ConvolutionLayer.activate(ConvolutionLayer.java:505)
at org.deeplearning4j.nn.graph.vertex.impl.LayerVertex.doForward(LayerVertex.java:110)
at org.deeplearning4j.nn.graph.ComputationGraph.ffToLayerActivationsInWS(ComputationGraph.java:2135)
at org.deeplearning4j.nn.graph.ComputationGraph.computeGradientAndScore(ComputationGraph.java:1372)
at org.deeplearning4j.nn.graph.ComputationGraph.computeGradientAndScore(ComputationGraph.java:1341)
at org.deeplearning4j.optimize.solvers.BaseOptimizer.gradientAndScore(BaseOptimizer.java:174)
at org.deeplearning4j.optimize.solvers.StochasticGradientDescent.optimize(StochasticGradientDescent.java:61)
at org.deeplearning4j.optimize.Solver.optimize(Solver.java:52)
at org.deeplearning4j.nn.graph.ComputationGraph.fitHelper(ComputationGraph.java:1165)
at org.deeplearning4j.nn.graph.ComputationGraph.fit(ComputationGraph.java:1115)
at org.deeplearning4j.nn.graph.ComputationGraph.fit(ComputationGraph.java:1082)
at org.deeplearning4j.nn.graph.ComputationGraph.fit(ComputationGraph.java:1018)
at org.deeplearning4j.nn.graph.ComputationGraph.fit(ComputationGraph.java:1006)
at activeSegmentation.deepLearning.UNet1.run(UNet1.java:111)
at activeSegmentation.deepLearning.UNet1.main(UNet1.java:287)I guess it is the memory error right? Is there any way to solve it or is it limited by the laptop configurations
@Purva-Chaudhari can you please migrate your questions to the community forum? https://community.konduit.ai/ at first guess it's an out of memory.
All, I am excited to invite you to the Joint OGC OSGeo ASF Virtual Code Sprint that is taking place 7:00am - 5:30pm EST from March 8th to 10th. The code sprint will focus on open standards and open source software. This will be a great opportunity to engage with software developers that might be interested in integrating Deeplearning4J into their Java-based software projects. The extended deadline for registration is 7:00am EST on March 8th. Please register at https://portal.ogc.org/public_ogc/register/220225asf_codesprint.php
I want config a multi-LSTM net with attentions like:
NeuralNetConfiguration.ListBuilder listBuilder = nncBuilder.list();
int nIn = featuresCount;
for (int i = 0; i < this.rnnNeurons.length; ++i) {
listBuilder.layer(i, new LSTM.Builder().activation(Activation.SOFTSIGN).nIn(nIn).nOut(rnnNeurons[i]).build());
nIn = rnnNeurons[i];
int nhead=8;
listBuilder.layer(i, new RecurrentAttentionLayer.Builder().activation(Activation.SOFTSIGN).nIn(nIn).nOut(nIn).nHeads(nhead).projectInput(true).build());
}how should I set the param: setInputType(InputType.recurrent(size))?
Hi everyone, is it possible to import PyTorch model with Deeplearning4j? I can only find examples for Tensorflow/Keras https://github.com/eclipse/deeplearning4j-examples/tree/master/tensorflow-keras-import-examples . If it's possible, could you show me some instructions, thank you in advance!
Hi!
I'm trying to run nd4j on my linux machine but I'm getting this error:
UnsatisfiedLinkError
/home/webapp/.javacpp/cache/nd4j-native-1.0.0-M2.1-linux-x86_64.jar/org/nd4j/linalg/cpu/nativecpu/bindings/linux-x86_64/libjnind4jcpu.so: /lib64/libm.so.6: version `GLIBC_2.27' not found (required by /home/webapp/.javacpp/cache/nd4j-native-1.0.0-M2.1-linux-x86_64.jar/org/nd4j/linalg/cpu/nativecpu/bindings/linux-x86_64/libnd4jcpu.so)With these imports
// DeepLearning4j
api("org.datavec:datavec-api:1.0.0-M2.1")
implementation("org.nd4j:nd4j-native-platform:1.0.0-M2.1")
implementation("org.deeplearning4j:deeplearning4j-core:1.0.0-M2.1")
implementation("org.deeplearning4j:deeplearning4j-nlp:1.0.0-M2.1")Anybody seen this before and any idea what's up
@RoytenBerge the forums at https://community.konduit.ai/ are a better choice to ask questions, as we don't monitor the channel regularly anymore. And there you'd have found this thread: https://community.konduit.ai/t/version-glibc-2-23-not-found-when-using-dl4j-cuda/1943 it is about a slightly older glibc, but the conclusion is the same: You are using a too old OS, and need to either update, or use the compat version
hello all,
I am trying to run my CPU C4 large instance with details :
NAME="Amazon Linux AMI"
VERSION="2018.03"
ID="amzn"
ID_LIKE="rhel fedora"
VERSION_ID="2018.03"
PRETTY_NAME="Amazon Linux AMI 2018.03"
ANSI_COLOR="0;33"
CPE_NAME="cpe:/o:amazon:linux:2018.03:ga"
HOME_URL="http://aws.amazon.com/amazon-linux-ami/"
Everthing is ok but still I am getting no backend available error.
org.nd4j.linalg.factory.Nd4jBackend$NoAvailableBackendException: Please ensure that you have an nd4j backend on your classpath. Please see: http://nd4j.org/getstarted.html
at org.nd4j.linalg.factory.Nd4jBackend.load(Nd4jBackend.java:213)
at org.nd4j.linalg.factory.Nd4jBackend.load(Nd4jBackend.java:222)
at dl4jTest.main(dl4jTest.java:30)
Done with pom file edit.
Stuck on it from long time.
Please can anyone help.
error occur emr-4.9.6
Amazon 2.7.3
Amazon 2.7.3
@20150094 I'll say it again: please move discussion over to the forums. We don't do support on this channel anymore. Chat applications don't allow people to benefit from the discussion.