Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Wei Ouyang
    @oeway

    A step back, even if we can use all the memory and all the CPU power on the host computer, they won't be enough anyway as we are dealing with massive dataset and heavy compute workloads.

    My view on this regard is that we should think about a more scalable architecture to further separate UI with the compute part, to make it distributed, e.g. UI in browser, compute in ImageJ-server running remotely, and connecting them with RPC over flexible transport layer.

    Jan Eglinger
    @imagejan

    @ctrueden thanks for merging imagej/imagej-legacy#256 so quickly! In the travis build of imagej-legacy, I see this now (presumably caused by the bump to pom-scijava-29.2.1):

    [ERROR] Cannot create plugin: class='io.scif.convert.FileToDatasetConverter', priority=1.0, enabled=true, pluginType=Converter

    … whenever we look for any Converter plugins.
    Any idea what caused this?

    Curtis Rueden
    @ctrueden
    @imagejan I'm not sure. I pushed imagej/imagej-legacy@51fbe09 to hopefully enable debug mode, which should print a stack trace for each of those. I don't know if the extra information will shed light, but we'll see.
    Jan Eglinger
    @imagejan
    (I’m also seeing these errors locally, they don’t block the maven build.)
    Curtis Rueden
    @ctrueden
    Oh, OK. I'll also try to reproduce locally, then.
    Jan Eglinger
    @imagejan
    Sorry, I just noticed them after submitting the PR.
    Ah, DatasetIOService is missing in the test context.
    Is that something that should be improved on the SCIFIO side? I.e. in the converter, make the service required=false, and then return false on supports when the service is missing?
    Curtis Rueden
    @ctrueden
    We could do that, sure. I feel this is a fundamental design limitation of SciJava's application containe, when a plugin depends on a missing service... but I don't have a good idea for how to fix it surgically. To do it "right" we'd have to load all plugin classes on context creation to scan their service dependencies and add those into the service index, which would be pretty aggressive. Or perhaps better, silently exclude plugins that depend on missing services. I dunno.
    But yeah, your idea would fix this particular instance of the messages.
    Jan Eglinger
    @imagejan
    😄 with debug mode: The job exceeded the maximum log length, and has been terminated.
    Curtis Rueden
    @ctrueden
    I'm going to roll back the imagej-legacy commit.
    I'm not shocked. :laughing:
    Jan Eglinger
    @imagejan
    :+1:
    That converter needs a fix anyhow: scifio/scifio#434 I’m on it.
    Curtis Rueden
    @ctrueden
    Thank you!
    Jan Eglinger
    @imagejan
    (Can’t assign myself however in the scifio org.)
    Curtis Rueden
    @ctrueden
    Invited.
    Jan Eglinger
    @imagejan
    Thanks!
    Curtis Rueden
    @ctrueden
    I also invited you to imglib as a member. (Didn't make you an owner there since that's up to the maintainers.)
    Deborah Schmidt
    @frauzufall
    DatasetView in net.imagej:imagej-common has the getScreenImage() method returning ARGBScreenImage, which depends on AWT. how is that supposed to work for non-AWT UIs?
    Curtis Rueden
    @ctrueden
    @frauzufall Yeah! That's the failure point! But I made an interface on the ImgLib2 side to avoid that.
    Unfortunately, I think more work would be needed on the ImgLib2 side to fully avoid the problem.
    But it's been a long time since I've looked at that. I remember punting on it long ago, because I didn't have a compelling urgent need to fight that battle further.
    Deborah Schmidt
    @frauzufall
    ok. good to know. for a simple image display test I can avoid it.
    Curtis Rueden
    @ctrueden
    @hinerm Update 1: my super-old Fiji installation on Windows 7 was able to update successfully after a couple of rounds, thanks to @frauzufall's hard work on the HTTP/HTTPS logic. My Java there is 1.8.0_66, too old for HTTPS with our infrastructure, and everything still works. I then enabled the Launcher-6-test update site, updated and restarted, and Fiji still works! :tada:
    Curtis Rueden
    @ctrueden
    @hinerm Update 2: my Windows 7 Fiji installation works with the latest Zulu 8 JFX bundle as-is, and the FLIMJ site also works. :confetti_ball:
    Mark Hiner
    @hinerm
    :heart:
    Jan Eglinger
    @imagejan
    @ctrueden @frauzufall I have a problem uploading to our own ftp update site: imagej/imagej-updater#95
    Curtis Rueden
    @ctrueden
    @imagejan You say FTP, but it's SFTP, right?
    Jan Eglinger
    @imagejan
    I tried using an older imagej-updater to test, but it won’t let me because it always updates the updater first, before allowing any changes.
    Curtis Rueden
    @ctrueden
    Can you SFTP to the box from the command line on that machine? You're using an SSH keypair?
    Jan Eglinger
    @imagejan
    yes, sftp it is, I believe.
    I can ssh on it using user and password credentials
    Curtis Rueden
    @ctrueden
    From the message, it looks like JSch is somehow picking up on a public/private keypair and trying to use that?
    Jan Eglinger
    @imagejan
    And I usually was providing the same credentials in the Fiji updater as well.
    Curtis Rueden
    @ctrueden
    Do you run Pageant (from Putty)?
    Jan Eglinger
    @imagejan
    ok, maybe it’s trying to use that, how can I remove? In my home folder? .ssh?
    Curtis Rueden
    @ctrueden
    Usually Pageant has its own settings where things live, IIRC.
    You could try shutting down Pageant before connecting.
    Also, we should fix that exception message to not print a stringified byte array.
    Jan Eglinger
    @imagejan
    I’m not aware of using Pageant. I’m on Windows btw.
    Curtis Rueden
    @ctrueden
    Yeah, that's why I mentioned Pageant, because it's how I've used SSH keypairs on Windows in the past. There are probably other ways.
    It's possible that JSch is just grabbing it from a file somewhere, possibly ~/.ssh, possibly somewhere else.
    Jan Eglinger
    @imagejan
    I recently changed my way to work with GitHub, using ssh keys from Git Bash. Could it affect how Fiji works with the updater?
    Curtis Rueden
    @ctrueden
    I'd like to make some changes to the imagej-plugins-uploader-ssh to help you out.
    Jan Eglinger
    @imagejan
    I’ll try moving .ssh out of the way then.
    Curtis Rueden
    @ctrueden
    OK, let me know how it goes. There are probably at least two bugs here:
    1. Failure to gracefully proceed from keypairs (when they don't match) to passwords, when the remote allows passwords.
    2. Failure to give a decent error message when keypairs don't work.
    OK, it looks like the plugin only supports id_dsa and id_rsa in the ~/.ssh folder, indeed. Here
    Jan Eglinger
    @imagejan
    :tada: ok, mv .ssh .ssh-backup did the trick, although Fiji wanted to recreate the directory to add an entry to known-hosts then. It also complained that it was successfully creating it and I should check the permissions :-D