These are chat archives for conda/kapsel
conda kapsel initon an existing project, but it is taking ages...
pstreeshows the following tree:
conda───conda-kapsel───git. But this isn't a big project...
output = subprocess.check_output( ['git', 'ls-files', '--others', '--ignored', '--exclude-standard'], cwd=project_directory)
.gitignorehas the line
notebooks/*/**. which is supposed to ignore all temporary data produced by the notebooks.
notebooks/B.ipynb, etc..., and notebook temporary files in the corresponding subfolders:
But this repository is an exception. I tried
$ time (git ls-files --others --ignored --exclude-standard > /dev/null) real 1m29.819s user 0m2.632s sys 0m7.884s
conda kapsel initin several other repositories, and they all finished in < 10 seconds.
conda kapsel initwas running for several minutes even after
So this definitely is an edge case
$ git ls-files --others --ignored --exclude-standard | wc -l 708151
conda kapsel init?
Sure, thank you very much for your help!
I did a quick test with:
import sys import conda.cli import cProfile sys.argv = ['conda', 'kapsel', 'init'] cProfile.run('conda.cli.main()')
but it just told be that all the time was spent in
subprocess.py, which I don't think is right.
conda-kapsellooks great! It's exactly what I was looking for to manage my data processing pipelines :).