I'm having trouble getting my workflow to run on a nextflow cloud cluster. The nextflow script seems to be running fine and looks to be accessing the nodes, but it's not running anything on them. Any thoughts on what might be going on? Any help would be greatly appreciated.
master node log:
https://pastebin.com/raw/SfBzEqeX
child node log:
https://pastebin.com/raw/x9XgXi8f
it's a two nodes cluster, right ?
Aug-01 18:09:46.228 [main] DEBUG nextflow.scheduler.Scheduler - +++ Initial cluster topology:
- nodeId=07d19c17-d3a2-430f-a6a8-167a60621817; hostname=ip-10-0-0-110; instance-id: i-0b12834716de23c51; boot-time=01-Aug-2017 17:42; tot-res:[cpus=4; mem=15.7 GB; disk=293.3 GB]; idle=-
- nodeId=fd0667b3-5537-494d-a2b0-26765c8eff8a; hostname=ip-10-0-0-88; instance-id: i-0be2ea5d331f59981; boot-time=01-Aug-2017 17:43; tot-res:[cpus=4; mem=15.7 GB; disk=293.3 GB]; idle=-Caused by:
java.nio.file.NoSuchFileException: /home/ec2-user/work/ec/9665737d9d5df5954acf788b18fc00/.command.sh
you are using the local home as shared work dir, hence the remote node can't access the data
Use EFS or a S3 bucket as work dir
@pditommaso any nextflow stickers planned?
only for very selected users :)
lol