the error was probably due to trying on a dirty tree
I reset before running
No problem. :-)
In order to make mxnet.rb ractor compatible, it seems that we'll require numo/narray to be ractor compatible too.
nevermind, this doesn't extend into numo/narray
mxnet.rb: mrkn/mxnet.rb#51 I've looked through the set of C code, and there is no obvious code that looks like interference to cause errors. -fPIC is enabled during compilation (which is normal for ruby extensions), this is the only thing that comes to mind that could possibly cause the error I am receiving for the code change, as the symptoms of the error are similar.
PIC flag would only be a problem if there is memory dependent code - and I believe there is not memory dependent code (hence this flag should not cause any problems). I only mention it for the similar symptoms
@tjad What the version of MXNet are you using currently for mxnet.rb?
Please tell me also the version of ruby. I want to check the behavior on the same environment as yours.
I am trying to figure out how to use the compute functions from red-arrow but don't know how to even start. Can anyone get me started? thanks
I am trying to run unique function on an array
arr = Arrow::Array.new([0,1,1,1,1,2,3,4,2,6,7])
fun = Arrow::Function.find('unique') returns a function but I am not sure how to run it. I tried fun.execute(arr) but get TypeError: no implicit conversion of Arrow::UInt8Array into Array
I hope that we improve the API until the next release!
thank you. I will try it out. AlsoIs it possible to use the compute functions on a Arrow::ChunkedArray as well as an array? I noticed that Arrow::Array has instance methods with some of the compute functions but ChunkedArray doesn't.
Some of compute functions don't support ChunkedArray yet.
We can use them by concatenating Arrow::Arrays in ChunkedArray as workaround. (This causes overhead.)
Right way is implementing ChunkedArray support in Apache Arrow C++.
We need to implement Arrow::ChunkedArray#combine or something to concatenate Arrow::Arrays.
I'll do it until the next release.
I already had submitted a JIRA issue for ChunkedArray combine_chunks. I was trying to see if I could do a faster groupby in ruby using the compute kernels but it would be better if this done in Arrow C++. Thanks for all your work