commonsense/conceptnet5

Filip Ilievski

@filievski

Also, is there a dump download option for 5.8?

palaxy9

@palaxy9

Hello, we are running our own EC2 copy of concept but still having the rate limit of 6000/h, how can we remove the rate limiter?

liuxinglan

@liuxinglan

Hi. How do I retrieve all edges for big languages using Python local API?
I've tried to write:
assertion_finder.lookup("/c/lt", limit=None, offset=offset)
But it returns an empty list if offset > 10000.

Same here with requests.get(). When below 10000, all is good. when above 10000 (e.g. &offset=10000&limit=1000), returns empty edge list...

Also, is there a dump download option for 5.8?

There's one dataset collected from conceptnet5, OMCS only. probably you already found it? Just in case: https://ttic.uchicago.edu/~kgimpel/commonsense.html

Xiajing

@xiajing10

Hi! I'm using conceptnet numberbatch on my task. If I need to fine tune it, could I use free-text data or I should use data like conceptnet (with onotogies and links). Besides, how could I do with oov? Thanks!

asya tabdili

@syanow_twitter

Hi! I am using conceptnet5 as a writer. Probably an anomaly here. Was wondering is a search bar on the site in the makings to be able to look up words?

amirouche

@amirouche

Eureka!

I guess, I think I successfully found a hash that preserve similarity and that is easy to query

look at https://groups.google.com/forum/#!topic/conceptnet-users/4rbhgF5wEFA

topwasu

@topwasu

Hi! I'm wondering which version of ConceptNet Numberbatch is the web API using?

Ritesh17

@Ritesh17

Hi, I was using the web API of ConceptNet and while going through edges, I see for every edge that the start attribute has two keys @id and @term. Although I understand them individually I wanted to know what is the difference between them? And which one is to be used when?

Ritesh17

@Ritesh17

After trying a few more examples I understand that @id is the id to the disambiguated word sense form of the word, whereas @term is the text of the word.

Akash Gosai

@akashgosai

Hey Guys. I am currently working on something for which I am using conceptnet5. Basically I have large dump database of words and I have to find the subset of it which lies in conceptnet5. So currently I am running a loop over my dataset and doing api calls to conceptnet5 but this process seems to be slow (expected time is around 40 days). So is there any way I can achieve this faster?

Akash Tyagi

@Akashtyagi08

@akashgosai Some modification at dataset level will help here.

Try creating groups with similar words (criteria of similar might differ) and then search for it using API. This will result in much more condensed way of lookup.
Also you can make aysnc calls on this groups at the same time, reducing total time.
TRIE data-structure can also be suitable here

anupaalex

@anupaalex

Hey guys, I would like to build a conceptnet with my own data and the relations used in conceptnet. Is that possible to do using this library? Thank you.

Robyn Speer

@rspeer

I see there's a lot to catch up on now, but in particular, the site has started giving server errors. Looking into it.

Robyn Speer

@rspeer

the server's a bit overloaded, at a level before where rate limiting helps. I restarted the process and maybe whatever code out there keeps hitting the rate limit so hard has backed off a bit? Going to look for a better solution.

Deven

@deven13j

Any help is most appreciate..
I would like to know, is it possible to build KG using conceptnet only for wiki documnets ?
If it is, please guide me for the same as I am new to ConceptNet

Alexandros Vassiliades

@valexande

Hello, guys I get an internal server error this morning, is there some sort of maintenance?

Alexandros Vassiliades

@valexande

Guys do we know if the issue with the server error, will be solved soon? I need the CN api for a research project that we have to present a demo? :)

mikehatch

@mikehatch

Found out about this resource from Neo4j Connections event yesterday (Aug. 25), unfortunately it seems that you are broken. Search returns 500 errors (see Alexandros comment above).

Alexandros Vassiliades

@valexande

Can anybody answer me how much will the servers be down?? its 3 days now!!

Alexandros Vassiliades

@valexande

Its fixed, its fixed :) :) :) :')

amirouche

@amirouche

It is somewhat off-topic, but I figured that I would find some power users of search engines around here! I am working on a survey about search engines users and uses. I put together some questions at https://bimestriel.framapad.org/p/6phzfohmhs-9iot?lang=en

MaximDobrolinsky

@MaximDobrolinsky

Hey guys! I have a question, I'm trying to find ConceptNet 5.6.0 image 2 in Community AMIs and connot found, why is happnes?

amirouche

@amirouche

It is somewhat off-topic, but I figured that I would find some power users of search engines around here! I am working on a survey about search engines users and uses. I put together some questions at https://bimestriel.framapad.org/p/6phzfohmhs-9iot?lang=en

Please add relevant questions / topics you would like to see answered :)

Anastasiia

@anastasiia_kai_twitter

Hello!
I am working on a project where I am using ConceptNet database. I have a question. In the database, near the word in the brackets, there is a pos and a term. For example, Boston (n, location). Where can I find this relation (Boston is a location) in the ConceptNet database? I have looked at IsA relation and it is not the same.

amirouche

@amirouche

Look into AtLocation e.g. https://github.com/commonsense/conceptnet5/wiki/Relations

Anastasiia

@anastasiia_kai_twitter

That's a little bit different what I mean. For many words there are descriptions like that: armchair(n,artifact), tiger(n,animal) etc.

I was asking about this relation between the term and its area where it belongs in the brackets next to it.

amirouche

@amirouche

ok, I get it. You can infer from A -> AtLocation -> B that B is a location.

it is not perfec, tho

You will have better data using wikidata.

amirouche

@amirouche

@anastasiia_kai_twitter ^

Robyn Speer

@rspeer

@MaximDobrolinsky The most likely reason you'd fail to find the AMI is that you're looking in a region besides us-east-1

but on that note: the AMI for ConceptNet 5.8.1 is published, with some updated directions! See https://github.com/commonsense/conceptnet5/wiki/Running-your-own-copy

The build instructions (https://github.com/commonsense/conceptnet5/wiki/Build-process) are also updated, and one alternative is to use the new conceptnet-deployment (https://github.com/commonsense/conceptnet-deployment ) repository, which sets up ConceptNet using Puppet 5

Stanislav Shelemekh

@szelemeh

Hey! On the conceptnet.io you can find such UI component

Where does the "communication" part come from?

Robyn Speer

@rspeer

When sources like WordNet and Wiktionary give us disambiguating information, we attempt to preserve it

In the API this appears like http://api.conceptnet.io/c/en/word/n/wn/communication

a custom script in building ConceptNet decides how to assign WordNet senses to human-readable categories like "communication". It comes from the WordNet properties called "domain_category" and "lexical_domain"

Stanislav Shelemekh

@szelemeh

Okay, thank you so much, what about the big CSV file in the Downloads ( https://github.com/commonsense/conceptnet5/wiki/Downloads )? Does it have any "domain_category" or "lexical_domain" info? I was trying to find any such cases but didn't succeed :(

amirouche

@amirouche

I do not know the answer, but a way to tell where communication come from is to look at the python code of the given page

Pranav Pawar

@pranav16_gitlab

Hi, I am new to conceptnet; Have set up the Amazon AMI, following instructions from here https://github.com/commonsense/conceptnet5/wiki/Running-your-own-copy

And as mentioned here, there is a timeout error issue with using AMI; though I tried out the solution for this problem, as mentioned in the documentation

Here's a command to warm up the entire disk, by accessing every byte of data on the disk:

sudo dd if=/dev/xvda of=/dev/null bs=16M

But it doesn't seem to work, facing issue of missing /dev/xvda directory

Can somebody help me out resolving this? Or any other solution for the timeout issue is welcome!

Zhang Cheng

@HeroadZ

Hi, everyone! I'm new to ConceptNet. And I want to know how to calculate the relatedness based on the NumberBtach. Is it just cosine similarity or dot product?

Zhang Cheng

@HeroadZ

s = a 1 · a 2 + b 1 · b 2 + w 1 (b 2 − a 2 ) · (b 1 − a 1 ) + w 2 (b 2 − b 1 ) · (a 2 − a 1 )

Is this the formula for relatedness? While w 1 = 0.2 and w 2 = 0.6 is for NumberBatch 16.09, the weight for latest NumberBatch(19.08) is what?

christat13

@christat13

Hi, Wondering if anyone would be so kind to assist in installing ConceptNet with the database on a machine. I've spent a week on it using virtual machines, configuring puppet, resetting my machine, etc. and pulling my hair out...super frustrated. :-(

Where communities thrive

People

Repo info

Activity