These are chat archives for dereneaton/ipyrad

10th
Mar 2016
Isaac Overcast
@isaacovercast
Mar 10 2016 17:00
did you push the fix for step 6? i want to run it on glenn's data.
Deren Eaton
@dereneaton
Mar 10 2016 18:08
Not yet, testing it on a
Bid
Big data set now
Deren Eaton
@dereneaton
Mar 10 2016 18:18
we should put in the docs somewhere our thoughts on memory limitations and when they'll arise. It will depend on the size of their data and the number of cores. I think we try to avoid high mem throughout the code pretty well. The biggest mem use is by vsearch in step6, which I believe is approximately the size of <name>_catcons.tmp * Ncores. So if that file is 1GB and you use 30 cores then it will use 30GB RAM. We could set an upper limit on Nthreads for vsearch to limit the max mem.
Deren Eaton
@dereneaton
Mar 10 2016 18:33
well, my test is gonna take a while... little too big of data set. I'll just push it to git so you can test too.
It's working on sim data.
Deren Eaton
@dereneaton
Mar 10 2016 19:02
pushed to git without a new tag.
Deren Eaton
@dereneaton
Mar 10 2016 21:58
nvm, still broken