OpenRefine/OpenRefine

Welcome! Note that OpenRefine will NOT participate in GSoC or Outreachy this year.

Joe Montibello

@firstweet_twitter

Hi @shivjyotigarai - I'm on a mac too. I am not a power user of openrefine, but I had the same issue last week. I think what was causing it was having multiple versions of Java installed. I got past it by specifying the environment variable JAVA_HOME, like this:

export JAVA_HOME=`/usr/libexec/java_home -v 1.8`

(sorry, took a few tries to get the backticks to show up right)

Joe Montibello

@firstweet_twitter

I have a question of my own: I'm working with a dataset that's about 1.7 million rows, and maybe 20ish columns. Because doing operations against that whole dataset was going pretty slowly, I created a smaller set with only 10 lines of data in it, so I could figure out all the transforms I wanted to do. Once I got the transforms set up the way I wanted, I extracted them from the smaller set, opened the bigger set, and applied the transforms to the bigger set. That was maybe an hour ago, and it still says "Working..."

Is there any way to know if/when it will complete the transforms? I'm on a Mac, using OpenRefine 3.1. I already ensured that I was using Java 8 and I allocated 10 gigs of memory to OpenRefine.

I'm just not sure if this is something that I should let run for hours and hours, or if I should assume that something's broken and start trying to figure that out. Any thoughts are welcome!

Ritika

@ritika4554244

Screenshot 2021-02-02 at 10.43.06 PM.png

1 reply

facing problem how to proceed further ?

sakshi-1604

@sakshi-1604

is open refine participating in gsoc 2021??

1 reply

Mukul Agrawal

@mukul2310

Hello everyone! I am Mukul Agrawal, third year student from Narsee Monjee . I am excited to contribute to Community and I am comfortable with HTML, CSS, JavaScript, Android, Java and Spring boot and I am new to open source. Please guide me the resources to get started. Really appreciate your help.

1 reply

Renuka Sanjeev Bhure

@renuka142

Hello Everyone,
My name is Renuka Bhure , currently in 3rd year from Yeshwantrao Chavan College Of Engineering, Nagpur.

I am new to open source community.
I am familiar with HTML,CSS,JS and Node.js.

I am new to this community , would you please help me with my query - from where should i start

Hoping for a positive reply!

1 reply

Akshad Kolhatkar

@AkshadK7

Hey Guys, had a quick Question !

How to Run this Repo on a Localhost with VSCode?
https://github.com/OpenRefine/openrefine.github.com/

*P.S: I can't find any Documentation for that Repository

1 reply

Kush Trivedi

@kushthedude

Setup jekyll on your local machine and run jekyll serve

gitonthescene

@gitonthescene

Is there any performance testing done regularly? Might it be a good idea to get an open source license for YourKit?

3 replies

I was testing out a new reconciliation service and was surprised that most of the time was not taken by the fuzzy search but by the processing of the results. This got me thinking along these lines.

22 replies

Shubham dubey

@Inert-one

Hello Everyone! I am Shubham. I am Familiar with Front-End dev with HTML, CSS, Javascript, and learning React.Js. I am willing to contribute to this organization and learn along the way, also I am new at open source and looking forward to exploring it ahead. Also interested in GSoC'21. Any kind of contribution regarding what I can do will be highly appreciated. Glad to be Onboard!!!

1 reply

mayank kumar

@mayank0508

Hi Everyone! I am Familiar with Front-End dev with HTML, CSS, Javascript. I am willing to contribute to this organization. I am new to this community, Please guide me the resources to get started. Really appreciate your help.

Matias Garcia Isaia

@mgarciaisaia

Hi there!
Is anyone around able to use the Google Drive/Sheets integration using a GSuite/Workplace account?

Utkarsh Nagar

@Utkarshn10

Hi! I am working on this issue OpenRefine/OpenRefine#3575 and I want to know, how can I see the changes made in the Document in the local branch. Could anybody help me with this?

Kush Trivedi

@kushthedude

Please read this https://github.com/OpenRefine/OpenRefine/tree/master/docs

Govind Tomar

@govindtomariiit

Hi everyone! I'm Govind. I'm good in HTML, CSS, JS, nodejs, react, and java. I'm new to open source community. I've read the readMe files and set the project on my local environment. I've checked for "good first issues" and "beginner-friendly issues", but they're mostly assigned or to be reviewed. Please guide me!!

1 reply

Tom Morris

@tfmorris

If anyone else would like to help with issue triage, either to categorize those that "Need Review", or to help identify "Good First Issue", "Good Second Issue", candidates, the assistance would be welcome.

Mohamed Metwalli

@MohamedMetwalli5

Hello everyone!
I'm a 3rd-year undergraduate computer engineering student at the Faculty of Engineering at Alexandria University, Egypt.
I am excited to contribute to the community.
I have a good experience in Java, Python, HTML, CSS, JavaScript, Vue.js, C/C++, CP, and problem solving using java and C++.
I am new to open source communities and i would like to participate in this community.
can you guide me to the resources to get started? I really appreciate your help.
Best Regards!

4 replies

Govind Tomar

@govindtomariiit

Hey everybody, I'm new to the open source community. I've read the readme files. I'm not able to understand the codebase of the project. How can I understand it?

2 replies

Dennis Priskorn

@priskorn_gitlab

Hi. I installed openrefine on Arch from AUR. I choose jre11. I get an internal server error 500 for every kind of export.
Also I cannot upload to WD.
Anyone here who have similar issues?

3 replies

Dennis Priskorn

@priskorn_gitlab

I get errors related to login. I don't understand why because OR tells me in the interface that I am logged in.
"22:30:25.622 [..ting.EditBatchProcessor] MediaWiki error while editing [assertuserfailed]: You are no longer logged in, so the action could not be completed. (80857ms)"
Bug?

som0910

@som0910

Hello,

I'm a first year CSE(with specialization in IoT and Cyber Security) undergraduate at IEM, Kolkata, West Bengal, India.

I have seen that OpenRefine uses Java and JavaScript. Though I'm yet to learn JS, I've worked with Java before and am quite confident in it.

I would love to contribute to your projects. Can you please suggest me how to begin?

1 reply

Henk Laloli

@hekl

Hello, I am trying to get data from a database in Open Refine. The connection to myslq works, but I never get results from a query. It hangs. I found this in the error log: Failed to batch recon with load:
{"q0":{"query":"Slijter","type":"","limit":3,"type_strict":"should"},"q1":{"query":"Afhaal","type":"","limit":3,"type_strict":"should"},"q2":{"query":"Lompen","type":"","limit":3,"type_strict":"should"},"q3":{"query":"Vis","type":"","limit":3,"type_strict":"should"},"q4":{"query":"Telecommunicatie","type":"","limit":3,"type_strict":"should"}.

4 replies

Avinesh Tripathi

@helloCodingEra

hello everyone I am using windows where i cloned the open Refine after forking i have done ./refine clean and now doing build where the program has stuck at a point and no further actions are happening there I m new into contribution so can anybody help me out

9 replies

please dm if anybody wishes to help that would be really appreciated

Magnus Sälgö

@salgo60

Anyone who has an easy way to check that a picture P18 in a Wikidata object has on WIkicommons depict ro the same Wikidata object

Prerna Sidana

@prernasidana12

Hi everyone, I am a CSE undergraduate specialising under cyber security, stream CSE. I am into web development and have hands on skills in HTML and Javascript. I have also started Flutter for my college project. I would like to contribute to this organisation this year. Connect with me through linkedin : https://www.linkedin.com/in/prernasidana/

gitonthescene

@gitonthescene

Hello, I'm new to Eclipse and was hoping to follow my nose from these instructions, but I'm having trouble following the bread crumbs. I've downloaded Eclipse IDE for Enterprise Java Developers version 2020-12 (4.18.0) and when I right click to "Run configurations..." my screen looks different than those in the instructions. I chose Java Application, but there is no option for Goals.

Screen Shot 2021-03-10 at 4.45.24 PM.png

Screen Shot 2021-03-10 at 4.48.49 PM.png

When I run with this setup the console says the following:

16:38:16.799 [            refine_server] Starting Server bound to '127.0.0.1:3333' (0ms)
16:38:16.811 [            refine_server] Warning: Failed to find web application at '/Users/this user/OpenRefine/github.upstream/OpenRefine/server/webapp' (12ms)

It feels like I might not have the CLASSPATH fully setup. Any pointers would be appreciated. Even pointers on getting started with Eclipse would be welcome.

5 replies

iomicifikko

@iomicifikko

Hello, I'm trying to use the "cross" function in OpenRefine 3.4.1 with extended functionality according to the documentation ("... If you omit projectName and columnName, they will default to the current project and index column..."). What's wrong with my code? Thanks!.

2 replies

Antonin Delpeuch

@wetneb

Hi all, our application to the Wikimedia Foundation to develop an integration with Wikimedia Commons is out. Feedback welcome! https://meta.wikimedia.org/wiki/Grants:Project/Structured_Data_on_Wikimedia_Commons_functionalities_in_OpenRefine

1 reply

MetricT

@MetricT

Is there any way to do clustering across two or more columns? I'm working on some local political data, and we have candidates donating money to themselves. Problem is, they often use a simpler preferred name when running for office/accepting contributions (Tony Smith), vs their actual legal name when giving contributions (Anthony Smith). It would be useful to standardize names in both Recipient and Contributor columns.

4 replies

rafael

@rafale_gitlab

dockerfile

Launching OpenRefine from within an Ubuntu container I get the following warning messages. Is there anything to worry about? What does this mean? :

WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.python.core.PySystemState (file:/home/openrefine/webapp/extensions/jython/module/MOD-INF/lib/jython-standalone-2.7.1.jar) to method java.io.Console.encoding()
WARNING: Please consider reporting this to the maintainers of org.python.core.PySystemState
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
19:28:51.110 [ refine] Sorry, some error prevented us from launching the browser for you.

Point your browser to http://127.0.0.1:3333/ to start using Refine. (69818ms)

Thad Guidry

@thadg:matrix.org

[m]

The illegal reflection happens because you have Java 9 or greater being used in the container which is fine and you can ignore the error. But you will not get the error with Java 8.

gitonthescene

@gitonthescene

More here: https://stackoverflow.com/questions/50251798/what-is-an-illegal-reflective-access

gitonthescene

@gitonthescene

@rafale_gitlab - As @thadg:matrix.org said, this shouldn’t prevent you from using OpenRefine. Have you exposed that port from your container to the outside and pointed your browser to the exposed port?

rafael

@rafale_gitlab

Thank you Thad. Yes, I exposed port 3333 in the dockerfile; and have the guest/host port mapped ( -p3333:3333), but after starting OpenRefine, cannot see it on the host at http://127.0.0.1:3333 ...

rafael

@rafale_gitlab

The message from Firefox is: "
The connection to the server was reset while the page was loading.

The site could be temporarily unavailable or too busy. Try again in a few moments.

rafael

@rafale_gitlab

SOLVED: All error messages, all warning messages, and all access problems have been resolved. SOLUTION: Downgraded from OpenJDK 11 to OpenJDK 8 (jdk 1.8). LESSONS FOR ALL: DO NOT USE JAVA 9 OR LATER IF YOU WANT TO RUN IT IN A DOCKER CONTAINER.

USE JAVA 8 (OpenJDK 1.8)

Thank you for the tip, THad

Dharmalingam Dhayananth

@dhayanthdharma_gitlab

Hello all. I am currently trying to configure OpenRefine to my local wikibase instance. I have configured a reconciliation service to my wikibase. However, I can see Wikibase entities and properties only in reconciliation tab. when I editing the schema (adding statements), the autocomplete text shows only wikidata items and properties. Also, there is no option to upload the edits to my wikibase (in the top right corner dropdown). It should be possible to upload the edits to my wikibase.
I can see in the chat , there is a manifest configuration required. Highly appreciated if anyone can help me to figure out this problem. Thank you all

Where communities thrive

People

Repo info

Activity