Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    Björn Grüning
    @bgruening
    PRs are coming in
    martenson
    @martenson:matrix.org
    [m]
    watching it, nice
    martenson
    @martenson:matrix.org
    [m]
    the monitor skips the repo in question, I'll dig in the logs later, now I'm going to bed
    all vampires called Björn should follow the suit, thanks for help mate!
    Björn Grüning
    @bgruening
    Sleep well!
    martenson
    @martenson:matrix.org
    [m]
    so fingers crossed for the next planemo monitor cycle
    Jiaqi
    @ZeroDesigner
    Screen Shot 2021-06-20 at 10.20.33 PM.png
    in the command line is not same with the input value ? How can I fix it?
    Björn Grüning
    @bgruening
    Answered that one in the other channel
    @ZeroDesigner please avoid cross postings
    Jiaqi
    @ZeroDesigner

    Answered that one in the other channel

    Sorry, I will pay attention next time.

    Maiken Pedersen
    @maikenp
    Can a galaxy username instead of email be used as the unique identifier for a galaxy user? It would be very convenient since then one could add a group of users say student-oslo-001 student-oslo-002. This way the admin could easily identify what users should go in what group. Lets say we have 100 students from a school using galaxy one week, and another 100 students from another school the next week. Or is email the only way currently?
    Nicola Soranzo
    @nsoranzo:matrix.org
    [m]
    @maikenp: Both are unique identifiers and cannot be empty, but you can use fake email addresses if you are pre-creating these accounts.
    Maiken Pedersen
    @maikenp
    Very good, thanks. So that means that the username can be used to assign users to a group/role?
    Maiken Pedersen
    @maikenp
    And if we use fake email addresses, then we can not have that galaxy instance enforcing real email addresses I suppose?
    Nicola Soranzo
    @nsoranzo:matrix.org
    [m]
    The username can be used to login but not for admin tasks like group/role assignment.
    What do you mean with "enforcing real email addresses" ?
    Maiken Pedersen
    @maikenp
    Ok I see about the admin tasks, thanks. Then we better go for fake email addresses. I meant - is there not a setting in galaxy to confirm email address? If we set that, then the email must be real?
    Nicola Soranzo
    @nsoranzo:matrix.org
    [m]
    I don't use that setting (internal server), but I believe that doesn't kick in for users added by an admin.
    Maiken Pedersen
    @maikenp
    ok, thanks, guess we will find out :)
    Martin Cech
    @martenson
    Hi folks, I am setting up Pulsar with MQ. I have pycurl installed and available but Pulsar insists on using poster instead thus failing every job.
    There is no poster installed in the venv. I cannot even install it on python3, except some ancient version, and that fails on import poster anyways.
    Martin Cech
    @martenson
    resolved by @gmauro and @Slugger70 - pycurl has to be installed at the time of pulsar installation to be treated as the preferred connection
    Jennifer Hillman-Jackson
    @jennaj
    Ghelp questions about "rebuilding" an accidentally deleted tool_conf.xml file. Not sure if that is permanent or if could be rebuilt somehow. Advice appreciated: https://help.galaxyproject.org/t/i-accidentally-deleted-tool-conf-xml/6259
    ^^ Never mind for now, have help
    Matt Chambers
    @chambm
    Has anybody made a script that syncs a data library with a local filesystem path? I want symbolic links, and it's ok if it's only 1 way sync and ignoring deletes (i.e. if something gets deleted on the filesystem, it won't get deleted from the import library, and if it gets deleted from the import library but it's still on the filesystem, it'll get uploaded again).
    Helena Rasche
    @hexylena:matrix.org
    [m]
    I'd love it if that existed. I really wish data libraries could easily be distributed over e.g. CVMFS. It'd make life so much easier.
    Lcornet
    @Lcornet

    Dear all,

    I am trying to launch a slurm job with pulsar using CLI (instead of drmaa)
    The pulsar playbook below pass without problem but the analyses are still run out of slurm (bypass the scheduler).
    What did I miss?

    # Put your Galaxy server's fully qualified domain name (FQDN) (or the FQDN of the RabbitMQ server) above.
    
    pulsar_root: /opt/pulsar
    
    pulsar_pip_install: true
    pulsar_pycurl_ssl_library: openssl
    pulsar_systemd: true
    pulsar_systemd_runner: webless
    
    pulsar_create_user: false
    pulsar_user: {name: pulsar, shell: /bin/bash}
    
    pulsar_optional_dependencies:
      - pyOpenSSL
      # For remote transfers initiated on the Pulsar end rather than the Galaxy end
      - pycurl
      # drmaa required if connecting to an external DRM using it.
      - drmaa
      # kombu needed if using a message queue
      - kombu
      # amqp 5.0.3 changes behaviour in an unexpected way, pin for now.
      - 'amqp==5.0.2'
      # psutil and pylockfile are optional dependencies but can make Pulsar
      # more robust in small ways.
      - psutil
    
    pulsar_yaml_config:
      conda_auto_init: True
      conda_auto_install: True
      staging_directory: "{{ pulsar_staging_dir }}"
      persistence_directory: "{{ pulsar_persistence_dir }}"
      tool_dependency_dir: "{{ pulsar_dependencies_dir }}"
      # The following are the settings for the pulsar server to contact the message queue with related timeouts etc.
      message_queue_url: "pyamqp://galaxy_au:{{ rabbitmq_password_galaxy_au }}@{{ galaxy_server_url }}:5671//pulsar/galaxy_au?ssl=1"
      managers:
        _default_:
          type: queued_cli
          job_plugin: slurm
          native_specification: "-p batch --tasks=1 --cpus-per-task=2 --mem-per-cpu=1000 -t 10:00"
          min_polling_interval: 0.5
          amqp_publish_retry: True
          amqp_publish_retry_max_retries: 5
          amqp_publish_retry_interval_start: 10
          amqp_publish_retry_interval_step: 10
          amqp_publish_retry_interval_max: 60
    
    # We also need to create the dependency resolver file so pulsar knows how to
    # find and install dependencies for the tools we ask it to run. The simplest
    # method which covers 99% of the use cases is to use conda auto installs similar
    # to how Galaxy works.
    pulsar_dependency_resolvers:
      - name: conda
        args:
          - name: auto_init
            value: true
    Arnold Knijn
    @aknijn
    Hello I am Arnold Knijn, at the moment I am following the GCC2021 Galaxy Admin course and at my Institute I the admin of two local Galaxy cluster installations, a public one ARIES and a private one which is used as the compute engine for an IRIDA instance.
    Matt Chambers
    @chambm
    Have there been significant performance improvements in data libraries from local paths since 19.09? The GUI to browse the import dir seems to enumerate everything twice. In my case of 24k files it takes ~40 seconds to get the file list (remote_files request) and it does it twice for some reason. I'm not able to view the 24k item library at all, the 'contents' request times out at 60 seconds. So I'm trying a smaller subset now.
    Jiaqi
    @ZeroDesigner
    What should I do if galaxy shut down itself and show the following message ?
    galaxy.util.task DEBUG 2021-06-27 06:55:53,852 [pN:main.web.1,p:21179,w:1,m:0,tN:HistoryAuditTablePruneTask] Executed periodic task HistoryAuditTablePruneTask (73.014 ms)
    Gracefully killing worker 1 (pid: 21179)…
    Curtis Ross
    @cross12tamu

    My apologies for the lengthy-ish post. But I am getting to a wit's end, and need some sage advice from y'all in regards to what to try next.

    The error:
    A 500 redirect error that crashes first at the Galaxy level. Then, it cascades down the entirety of our services (ie rancher goes down, then everything goes down).

    Our (the CPT) services have been intermittently dropping over the past few weeks due to some space issues on our head node. I've been resolving it by finding old, large files/dirs on our head node, removing it, and rebooting our head node. Our services will come up, and everything works until space gets eaten up again. Note the df -h command below; it has a fair amount of GB worth of space available but shows far less than what I would think is available and is saying it's 100% used.

    A way to initiate the problem:
    We have a head node that works with 4 other nodes for compute services for galaxy (and some other web services). When I run a docker container (new web service) on another node, it'll work for like 10 minutes, then everything starts cascading to failure. Since the most recent problem, I've just shut that web service down. Perhaps log files are thick.

    A new problem emerges:
    We have a problem with condor not connecting to all of our compute nodes, and it's likely due to the space issues of ONE of our compute nodes (see the compute-2 df -h readout). The past few days I have just had to manually go in and run the condor_master command on each node. It gets it back up. But then, it'll just drop eventually; and now it's not even connecting (which, I'm NOT a condor wizard :grimacing: )

    What I have done:

    • Clean out large/old files. Deleted or moved to our file server for emergency backup
    • Pruned unused docker images. This has cleaned GB worth of space on the two fussy nodes.

    I'm starting to pull my hair out since this issue keeps creeping up. And we're getting different issues now, which I'm not certain are separate OR together.

    See thread for readouts (THANKS IN ADVANCE FOR READING AND THINKING ABOUT THIS <3)

    5 replies
    quacksawbones
    @quacksawbones

    Hi folks, I have been trying to install several tools (in this example, bam_to_bigwig v0.2.0) in our Galaxy instance (20.01 on CentOS 7, built from source). The tool starts to install package dependencies, but then gets to a point where it dumps the following:

    install_environment.STDOUT DEBUG 2021-06-28 16:48:05,682 [p:36595,w:1,m:0] [Thread-9] b''
    install_environment.STDOUT DEBUG 2021-06-28 16:48:05,685 [p:36595,w:1,m:0] [Thread-9] b''
    install_environment.STDOUT DEBUG 2021-06-28 16:48:05,686 [p:36595,w:1,m:0] [Thread-9] b''

    This can only be resolved by restarting Galaxy. While ideally, we would like to move to the latest version of Galaxy using Ansible (and then not have to deal with these kind of tool dependency problems), we're not in a position to upgrade yet.

    While it seems very similar to this issue (galaxyproject/galaxy#9328), the fixes were implemented, so don't know where the problem lies.

    Any thoughts on how to attack this? Happy to provide any details from log files. Thanks all

    Nate Coraor
    @natefoo:matrix.org
    [m]
    @quacksawbones: that was backported to 19.09, my only guess would be that you are running a version of 20.01 from before this fix was applied. I'd suggest updating to the latest 20.01 (just git pull if you're on release_20.01), or check your Galaxy installation to see if the changes shown in https://github.com/galaxyproject/galaxy/pull/9424/files have been applied.
    shwetasmart16
    @shwetasmart16
    Hi , How can I add OpenSeadragon plugin in visualize ?
    1 reply
    dannon
    @dannon:matrix.org
    [m]
    Unless I misunderstand, you don't want a new viz, you just want the existing one to show up?
    1 reply
    (there exists an openseadragon viewer plugin already)
    Nate Coraor
    @natefoo:matrix.org
    [m]
    (oh, whoops, didn't realize that, thanks dannon )
    dannon
    @dannon:matrix.org
    [m]
    Well that's what we have to debug :) It should work out of the box, so I suppose we'll have to dig into what's going wrong here.
    When you go here, to "Create Visualization", it's not in the list, correct?
    (if you want to check what it should look like, this is currently working fine on usegalaxy.org)
    shwetasmart16
    @shwetasmart16
    It is not in the list
    dannon
    @dannon:matrix.org
    [m]
    What version of Galaxy are you running?
    shwetasmart16
    @shwetasmart16
    Its the old version . Is it only available in the latest version?
    dannon
    @dannon:matrix.org
    [m]
    I think it was added in 21.01, but let me verify which version you need.
    1 reply
    Yes, that's correct. Here's the PR in question (galaxyproject/galaxy#10756), you'll need galaxy 21.01 or higher.
    shwetasmart16
    @shwetasmart16
    Is it possible to add it to the older version ?