These are chat archives for nextflow-io/nextflow

2nd
Aug 2017
Michael Halagan
@mhalagan-nmdp
Aug 02 2017 16:11 UTC

I'm having trouble getting my workflow to run on a nextflow cloud cluster. The nextflow script seems to be running fine and looks to be accessing the nodes, but it's not running anything on them. Any thoughts on what might be going on? Any help would be greatly appreciated.

master node log:
https://pastebin.com/raw/SfBzEqeX

child node log:
https://pastebin.com/raw/x9XgXi8f

Paolo Di Tommaso
@pditommaso
Aug 02 2017 16:18 UTC
it's a two nodes cluster, right ?
Aug-01 18:09:46.228 [main] DEBUG nextflow.scheduler.Scheduler - +++ Initial cluster topology:
- nodeId=07d19c17-d3a2-430f-a6a8-167a60621817; hostname=ip-10-0-0-110; instance-id: i-0b12834716de23c51; boot-time=01-Aug-2017 17:42; tot-res:[cpus=4; mem=15.7 GB; disk=293.3 GB]; idle=-
- nodeId=fd0667b3-5537-494d-a2b0-26765c8eff8a; hostname=ip-10-0-0-88; instance-id: i-0be2ea5d331f59981; boot-time=01-Aug-2017 17:43; tot-res:[cpus=4; mem=15.7 GB; disk=293.3 GB]; idle=-
Caused by:
  java.nio.file.NoSuchFileException: /home/ec2-user/work/ec/9665737d9d5df5954acf788b18fc00/.command.sh
you are using the local home as shared work dir, hence the remote node can't access the data
Use EFS or a S3 bucket as work dir
Félix C. Morency
@fmorency
Aug 02 2017 17:40 UTC
@pditommaso any nextflow stickers planned?
Paolo Di Tommaso
@pditommaso
Aug 02 2017 18:12 UTC
only for very selected users :)
Félix C. Morency
@fmorency
Aug 02 2017 18:13 UTC
lol