SwissDataScienceCenter/renku

A platform for repoducible, reusable and shareable data science

Stan Schymanski

@schymans_gitlab

I just created an issue with more details: SwissDataScienceCenter/renku#1112

Luca Ferrazzini

@LucaFerrazzini_gitlab

Hi,
I got the following problem since roughly a week. When I want to start a new environment on Renku it starts preparing as usual and I can choose the specifications for my node. Then after the environment is pending it just disapears without any error warning...
I would be very happy if someone had the same issue and was able to resolve it.
Thanks a lot!
Best,
Luca

Andreas Bleuler

@ableuler

Hi Luca,
I guess Luis might have told you already, but we managed to resolve your problem yesterday. There was a mismatch on the level of the underlying node between NVIDIA driver and library that we managed to fix. Have fun using Renku again!

Josef Spillner

@josefspillner_gitlab

Hello. I created a small renkulab project and added four files to Git. Apparently it is not possible to create a dataset directly from a Git folder - is this a planned feature? Further, I try to re-add a Zip file with the same files as dataset, but it fails with "internal error" and no additional information. Any idea why? https://renkulab.io/projects/js.zhaw/syn-experiments/files

3 replies

fvanden

@fvanden

Hi! I noticed today that some changes to my project are missing. According to GitLab my last commit was 6 days ago, but I'm quite sure that I committed my changed on Friday as well.. I saw on https://renkulab.statuspage.io/ that there was a major outage on August 21. Could this have something to do with it?

Rok Roškar

@rokroskar

@fvanden did you commit and push? You need to push the changes to have them stored on the server. Did you do this in an interactive environment on renkulab or locally on your machine?

fvanden

@fvanden

@rokroskar, it's always possible that I forgot something, but I've been using this for the past three months (adding, committing and pushing on the interactive environment) without this problem occurring. However, I can't imagine having forgotten to push for four days in a row. Another possibility is that the push failed and I didn't pay attention to it. I was just wondering (hoping) that after the outage on the 21st of August, the system might have been reverted to an older version, and that my latest commits might still exist somewhere.. I guess not then :)

Rok Roškar

@rokroskar

@fvanden can you tell me which project this is?

regarding the 21st of august - no we didn't revert the state of any repositories at that time

Rok Roškar

@rokroskar

if for some reason you forgot to push and your session was closed normally, the system would have created an "auto-save" branch - in gitlab you can see these branches under "Repository --> Branches" on the left-hand side

fvanden

@fvanden

@rokroskar thanks a lot for your help. Unfortunately there's nothing there either. I'll just have to accept the losses. Thanks again!!

Rok Roškar

@rokroskar

Hmm sorry about that @fvanden it would be nice to understand what happened - from our side there's not much that I could imagine happening, we haven't had any data losses during normal operation.

waldorivier

@waldorivier

Hi all, I wanted to launch an environment and receive a gitlab error "https://renkulab.io/gitlab/users/auth/oauth2_generic/omniauth_error?error=Email+has+already+been+taken" when I wanted to reinitialize my gitlab password; any idea what I have to do ? Thanks a lot for support and have a nice day.

Chandrasekhar Ramakrishnan

@ciyer

@waldorivier I have not seen that error, but I think if you are already logged in, I would suggest logging out, logging in, and trying again.

If you really do need to reset your password, you can do so on the login screen (see screenshot above).

waldorivier

@waldorivier

Hi @ciyer,

18 replies

thanks for replying, sure I try the reset as youn mentionned but always receive the error.

rolando

@tcchrist

Hi renku-team.

I'll try to import a dataset from another project, using "renku dataset import <data-set-url>"
The KG is activated, but both projects are private. My user has access to both.
Is this even possible? Or only for public projects?

It fails with 500, cannot access KG....

meschultheiss

@meschultheiss

Hello, I tried to create a data set using the RENKU the UI, on a private project on renku lab. After data loading (3 .csv of ~700MB total), I clicked "create dataset". It did sth and showed internal error. On a second attempt it said dataset already exist. Could you help ?

2 replies

Jelowi

@Jelowi

Hello, we are starting a modeling project with around 300 Gb of input data. Renku would be amazing to use, however the storage seems to work well for a couple of Gb only. Can anybody give us an input on how to deal with our amount of data on the platform? Thanks!

6 replies

waldorivier

@waldorivier

Hello team,

Can we install a java virtual machine ?

4 replies

Thanks for your support and have a nice day!

Rok Roškar

@rokroskar

A bit short-notice, but we are kicking off the next round of Renku Tea Talks today! Topic: streamlit dashboards in renkulab. See details here: https://renku.discourse.group/t/renku-talks-ii-2020/175

pdurbin @pdurbin joins late

Rok Roškar

@rokroskar

@pdurbin there will be a recording somewhere at some point :)

btw, had the pleasure of seeing Mercé give a talk about Dataverse a few days back and she mentioned that some provenance-related work is on-going - would be great to sync on this at some point and see how Renku can fit in that picture!

Philip Durbin

@pdurbin

@rokroskar yes! And for my part I'd still like to see Renku as an "external tool" in Dataverse. This would mean Renku would need to take a DOI as a query parameter to its web interface.

Rok Roškar

@rokroskar

@pdurbin yeah the pieces for that are basically all there now. I think there is still an issue open for that and we can nudge it toward the top of the stack

Philip Durbin

@pdurbin

\o/

🎉

amirrezaie1415

@amirrezaie1415

Hello, I want to use the library "plotly" to interactively visualize my data. Even though I could install the library and also ipywidgets + JupyterLab extensions (according to the official documentation https://plotly.com/python/getting-started/ ), the plots were not visualized in the JupyterLab! Thanks in advance for your help. (I should add that following the provided instructions, I managed to use plotly on my local PC)

9 replies

Philip Durbin

@pdurbin

"I am going to give a look at Renku which seems to suit my case and to be a valid solution. :D" -- https://groups.google.com/g/dataverse-community/c/doWoXPsXsQ0/m/wB00tHgWAwAJ

2 replies

Philip Durbin

@pdurbin

😁

Philip Durbin

@pdurbin

I'm sure that person would be honored if you reach out.

Rok Roškar

@rokroskar

done!

Philip Durbin

@pdurbin

🎉

meschultheiss

@meschultheiss

Hello, I think I lost some work this morning : I tried to commit a file which was too large and then the jupyterlab env started to freeze. I managed to remove the large file from the commit and then push but I had conflicts to solve. Then the jupyterlab was so slow I closed the environment, hoping that renku would have autosaved my work. But after launching a new env, I was back to my work status from yesterday, and no trace of this morning work. What did I miss ? Any chance there is a copy of my notebook I cannot see ?
Also, what are the good practices to push a work with too large files ? e.g. an .html viz that was created for preview

7 replies

Waldo Rivier

@waldorivier_gitlab

Hello Renku's Team

is it possible to keep JupyterLab 's user setting between logoff / logon ?

2 replies

Waldo Rivier

@waldorivier_gitlab

Thanks for your help and have a nice day

waldorivier

@waldorivier

2 replies

Chandrasekhar Ramakrishnan

@ciyer

Hi @waldorivier. It took a little longer than had planned, but I have an example of a project that restores the JupyterLab settings. https://renkulab.io/projects/cramakri/jupyter-preferences

9 replies

meschultheiss

@meschultheiss

Hello renku team! I have an issue when building the docker image and therefore cannot start my environment. I have a warning "the docker image build failed".
I think the problem comes from the geopandas package installation. The same issue appears independently of pip or conda.

The logs are the following:

Running with gitlab-runner 13.3.1 (738bbe5a)
on renkulab-runner-2-1TB S25j9XrP
Preparing the "docker" executor
00:05
Using Docker executor with image docker:stable ...
Using locally found image version due to if-not-present pull policy
Using docker image sha256:6972c414f322dfa40324df3c503d4b217ccdec6d576e408ed10437f508f4181b for docker:stable ...
Preparing environment
00:02
Running on runner-s25XXX58-concurrent-0 via 6fabf7a874d3...
Getting source from Git repository
02:03
Fetching changes with git depth set to 50...
Reinitialized existing Git repository in /builds/gitlab/marc-edouard.schultheiss/mobis2019_activityspace/.git/
error: RPC failed; curl 52 Empty reply from server
fatal: the remote end hung up unexpectedly
ERROR: Job failed: exit code 1

5 replies

Rok Roškar

@rokroskar

Hi all: tomorrow we will have another "renku tea-time talk" - this time by @pameladelgado on the topic of deploying renku on your own infrastructure. Details on discourse: https://renku.discourse.group/t/renku-talks-ii-2020/175/2

Melvin Wong

@mwong009

hi, i have a question regarding renku dataset add command

renku dataset add command automatically sets the name of the data to the last part of the url.

how do I add data to the dataset while also having the option to rename the file?

lets say the url to the data is: drive.switch.ch/index.php/s/abcdefg/download,
i run the command renku dataset add -eo my_dataset drive.switch.ch/index.php/s/abcdefg/download
the name of the link on the repo will be displayed as: data/my_dataset/download

how can i set the label of my data in the dataset to a specific name that i want?

do we have an option like renku dataset add --label custom_data_label my_dataset url://of_my/data?

Where communities thrive

People

Repo info

Activity