Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Dante Tsang
    @dantetwc
    keep0 and keep1 is only local resolvable on the machine itself
    Michael R. Crusoe
    @mr-c
    @dantetwc I have no experience here, but I wanted to confirm that you've seen https://doc.arvados.org/install/arvados-on-kubernetes.html
    Dante Tsang
    @dantetwc
    yes
    but the charts provided dont fit our use case and that's why I am creating my own docker image
    Michael R. Crusoe
    @mr-c
    Yeah
    Peter Amstutz
    @tetron
    @dantetwc it's really confusing but you probably need to make sure X-External-Client gets set properly, see the documentation about configuring nginx on these pages: https://doc.arvados.org/v1.4/install/install-api-server.html https://doc.arvados.org/v1.4/install/install-controller.html
    Dante Tsang
    @dantetwc
    Thanks @tetron
    It works
    Now I am trying to install workbench2
    For the playground version, it seems the api server can respond with the config api call (https://c97qk.arvadosapi.com/arvados/v1/config?nocache=1575273270975)
    But when I switch the API HOST to my server, it is not working as my server just return 404 for that api
    wonder is there any setting to enable it?
    Dante Tsang
    @dantetwc
    Traceback (most recent call last):
      File "/Users/Dante/Library/Python/2.7/bin/arvados-cwl-runner", line 8, in <module>
        from arvados_cwl import main
      File "/Users/Dante/Library/Python/2.7/lib/python/site-packages/arvados_cwl/__init__.py", line 19, in <module>
        from schema_salad.sourceline import SourceLine
      File "/usr/local/lib/python2.7/site-packages/schema_salad/__init__.py", line 10, in <module>
        from .utils import onWindows
      File "/usr/local/lib/python2.7/site-packages/schema_salad/utils.py", line 8, in <module>
        from typing_extensions import Text  # pylint: disable=unused-import
      File "/usr/local/lib/python2.7/site-packages/typing_extensions.py", line 3, in <module>
        from typing import (  # noqa
    ImportError: cannot import name Final
    Strange error for fresh installation
    Eric Biagiotti
    @ericBiagiotti
    @dantetwc the playground is running a newer version of arvados. The 1.4.* version of workbench2 shouldn't be requesting the config api.
    These are the install docs we recently created. https://doc.arvados.org/master/install/install-workbench2-app.html These are for a future release, so not tested explicitly against 1.4.
    Dante Tsang
    @dantetwc
    Thanks @ericBiagiotti, I got the workbench 2 working now
    but it seems the WebDav address is incorrect
    is there any configuration to change that
    Dante Tsang
    @dantetwc
    Ok, found the settings file - config.yml
    Solved by adding ExternalURL for keep-web
    however, it respond with 404 under workbench 2
    PROPFIND https://collections.arv01.cogenesis.ai/c=arv01-4zz18-fa4zhmdbc0igftm 404 (Not Found)
    and nothing listed under Files
    But if switching back to old workbench, it can show files successfully
    https://ff5f4f3bed2be80ea11517e4ca04c7b2-120.collections.arv01.cogenesis.ai/_/bwa-mem.cwl?disposition=inline
    so I think keep-web should be working fine in my case
    both *.collections.arv01.cogenesis.ai and collections.arv01.cogenesis.ai pointed to same server
    Dante Tsang
    @dantetwc
    On the other hands, I am trying to run cloud-dispatch and it can create instance on AWS successfully. But for running task, it requires a tool called 'crunch-run' on the new instance and there is no such package in the arvados repo at the moment. Should I compile from the source and place the binary into instance image?
    thanks
    zhangxiongfei2012
    @zhangxiongfei2012
        Hi Guys
        I'm new to Arvados. I was trying to upload a file to arvados playground using Java SDK V2 and got an Exception.
        I tried to google it, but still no clue. 
        Is this the right place to ask for help?
    this is my code:
    ArvadosFacade facade = new ArvadosFacade(conf);
    File file= new File("D:\Downloads\FILE.exe");
    Collection newCollection = facade.upload(file) ;
    Exception:
    Exception in thread "main" org.arvados.client.exception.ArvadosApiException: Error code 403 with messages: [#<ArvadosModel::PermissionDeniedError: ArvadosModel::PermissionDeniedError>]
    Peter Amstutz
    @tetron
    @zhangxiongfei2012 perhaps you didn't supply a valid API token?
    @dantetwc are you doing your installation from the 1.4 release, from dev packages, or from source? the install documentation is pretty out of date, I am in the process of updating it now for the next release
    Dante Tsang
    @dantetwc
    @tetron using ubuntu apt repo now
    Dante Tsang
    @dantetwc
    @tetron meanwhile, which package should I install in the AMI in order to make cloud dispatching work?
    Dante Tsang
    @dantetwc
    2019-12-04 17:05:15{"Address":"10.0.3.132","IdleBehavior":"run","IdleDuration":69.971379,"Instance":"i-01a093aa6c529e9ee","InstanceType":"t3medium","PID":23,"State":"idle","level":"info","msg":"shutdown worker","time":"2019-12-04T09:05:15.587732089Z"}
    2019-12-04 17:04:11{"Address":"10.0.3.132","ContainerUUID":"arv01-dz642-xj44tu5oa5l4nsf","Instance":"i-01a093aa6c529e9ee","InstanceType":"t3medium","PID":23,"level":"info","msg":"crunch-run process ended","time":"2019-12-04T09:04:11.606123992Z"}
    2019-12-04 17:04:11{"Address":"10.0.3.132","ContainerUUID":"arv01-dz642-xj44tu5oa5l4nsf","Instance":"i-01a093aa6c529e9ee","InstanceType":"t3medium","PID":23,"Signal":15,"level":"info","msg":"sending signal","time":"2019-12-04T09:04:11.592334935Z"}
    2019-12-04 17:04:06{"Address":"10.0.3.132","ContainerUUID":"arv01-dz642-xj44tu5oa5l4nsf","Instance":"i-01a093aa6c529e9ee","InstanceType":"t3medium","PID":23,"Reason":"state=Cancelled","level":"info","msg":"killing crunch-run process","time":"2019-12-04T09:04:06.592138100Z"}
    2019-12-04 17:04:05{"Address":"10.0.3.132","ContainerUUID":"arv01-dz642-xj44tu5oa5l4nsf","Instance":"i-01a093aa6c529e9ee","InstanceType":"t3medium","PID":23,"level":"info","msg":"crunch-run process started","time":"2019-12-04T09:04:05.616285309Z"}
    Okay, I have compiled the crunch-run and placed into AMI. For now, if I start a process, it got automatically shutdown without any error
    Peter Amstutz
    @tetron
    @dantetwc you also need Docker installed on the compute images
    @dantetwc it doesn't help you right now, but I'm in the middle of a major rewrite of the install documentation for the next release which will cover how to set all this up in a lot more detail
    Peter Amstutz
    @tetron
    @dantetwc there should be a package called crunch-run
    Dante Tsang
    @dantetwc
    Screenshot 2019-12-05 at 12.13.34 PM.png
    finally can make it work
    Peter Amstutz
    @tetron
    @dantetwc that's great!
    Peter Amstutz
    @tetron
    @ericBiagiotti ping
    Eric Biagiotti
    @ericBiagiotti
    @tetron Hey Peter
    Peter Amstutz
    @tetron
    do you think you'll be making any open source contributions to Arvados?
    @/all we are migrating this channel to https://gitter.im/arvados/community
    Tom Morris
    @tfmorris
    Aren't all contributions to the Arvados project open source by definition?
    Peter Amstutz
    @tetron
    yes
    @ericBiagiotti what I really meant is do you think you'll be able to contribute the branch you were working on