ckan/chat

The Open Source platform for Open Data: https://ckan.org | *NOT* related to Kerbal Space Program | Come to our dev meetings: https://github.com/ckan/ckan/wiki/Weekly-Developer-Meetings

Adrià Mercader

@amercader

dev meeting :pushpin: https://us02web.zoom.us/j/82188246864?pwd=bkl2dUcwblZ5dk9ZTHFxWHVqMFlvdz09

Simson Garfinkel ☕

@xchatty_twitter

Hello.

Max

@MaxLynam

hey there everyone - new to the community, but long-time #techforgood hacker !!!

we're looking to use CKAN as a base for isgood.ai front-end (our backend ds stuff done)
with extensions and such, meets our base requirements and more really cool stuff too :)
BUT
the front-end viz seems to not be that snazzy compared to other data-viz tools (see alts here: https://tech.datopian.com/data-explorer/design/#research)

I wonder if there's some ways to give the front-end dashboards some visualisation super-powers (and make them interact and look a bit more "modern") .. a bit more like superset, metabase, mapbox, etc look of things ... or plugins I just haven't seen yet that add them over the top or something?

Thanks in advance for any advice in this area ... loving getting into the ckan functionality and #dataforgood work being done here <3

5 replies

Simson Garfinkel ☕

@xchatty_twitter

Is there a theory-of-operation or system specification for CKAN that will tell me what's what? In particular, I am looking to find out if CKAN is using DCATv1, DCATv1.1, DCATv2, and if it can use DDI.

1 reply

Toni

@t-book

@xchatty_twitter as far as I know dcat is provided by https://github.com/ckan/ckanext-dcat the readme shoukd answer you question?

MD ARQUM FAROOQUI

@ArqumFarooqui-NEC

Hi all, I'm updating CKAN to v2.9.3( with docker image).
PostgreSQL version: 9.6
currently I'm facing below error:

sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) could not translate host name "psql-ckan" to address: Name or service not known.

please suggest why this error is occurring or how can I resolve this:)
It will help me alot:)

4estone

@4estone

Installing CKAN on CentOs, following doc
Get an error for zope requirement

    Running setup.py install for zope.interface ... error
    ERROR: Command errored out with exit status 1:
     command: /usr/lib/ckan/default/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"'; __file__='"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1i3vl1zu/install-record.txt --single-version-externally-managed --compile --install-headers /usr/lib/ckan/default/include/site/python3.6/zope.interface
         cwd: /tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/
    Complete output (5 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py", line 26, in <module>
        from setuptools import setup, Extension, Feature
    ImportError: cannot import name 'Feature'
    ----------------------------------------
ERROR: Command errored out with exit status 1: /usr/lib/ckan/default/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"'; __file__='"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1i3vl1zu/install-record.txt --single-version-externally-managed --compile --install-headers /usr/lib/ckan/default/include/site/python3.6/zope.interface Check the logs for full command output.

Any hints?

4estone

@4estone

Docs is not up-to-date:

I have to update setuptools
‘pip3 install setuptools==45‘
Instead of
‘pip3 install setuptools==44.1.0‘

Yoana Popova

@popovayoana

[CKAN Monthly Live]
🔴 We are going LIVE in 10 mins!

👉 Join us on Zoom → bit.ly/3zv3iBc
Meeting ID: 861 8088 9272
Passcode: 563309

1 reply

Adrià Mercader

@amercader

:tada:

Mackenzie Nichols

@mackeynichols

Hi there! Are scheming 's output_validators meant to fire when SOLR is queried (like on a /package_search call)? The docs say they fire when a package "is retrieved from the database" I haven't seen mine fire after /package_search, but I wanted to ask here, just in case. Thanks!

Adrià Mercader

@amercader

@mackeynichols no, they are fired when the dataset is transformed from a database object to a python dict that will be returned in the API. This means that they are only fired when the dataset is retrieved to get indexed in Solr, not on each individual Solr query

1 reply

Federico Oldani

@FedericOldani

Hi there! I adapted ckanext-oauth extension to get it working with ckan 2.9 . It runs perfectly but I have a problem with the restore of the db backup. After the backup restore, in the table of the users of organization, each username is substituted by its id. I attach a screen below (the real usernames have been added after the db restore). I checked the db dump file and there exists the user table [id, name] so I don't understand why it is not fully restored. Hope someone can help me, it is annoying to manually add all the users everytime.

Yaser Alashloo

@yalashloo

Hello everyone,
I have a question regarding having different metadata schemas in one CKAN platform. Each department in our university needs a specific metadata schema. Hence, I would like to ask whether it is possible that the admin create a few data schemas in a CKAN platform so that users can choose the most relevant one when they are creating and uploading their dataset?
It would be great if there is such a plugin.
Cheers,
Yaser

6 replies

Adrià Mercader

@amercader

dev meeting :saxophone: https://us02web.zoom.us/j/82188246864?pwd=bkl2dUcwblZ5dk9ZTHFxWHVqMFlvdz09

Marko Bocevski

@mbocevski

Seeing this extension is no longer maintained -> https://github.com/ckan/ckanext-issues, can someone on core provide a link to our fork that we maintain - https://github.com/keitaroinc/ckanext-issues ?

3 replies

MD ARQUM FAROOQUI

@ArqumFarooqui-NEC

Hi all, I have updated CKAN to 2.9.3 with docker image.
Now I'm trying to add ckanext-oauth2 extension(0.7.0). I have installed ckanext-oauth2 but when I'm adding oauth2 plugin in the producition.ini, it is giving below error:

ModuleNotFoundError: No module named 'urlparse'

I have resolved the above error by updating the file /usr/lib/ckan/venv/src/ckan/ckanext-oauth2/ckanext/oauth2/plugin.py from from urlparse import urlparse to from urllib.parse import urlparse.

But after that I'm getting another error i.e.:

AttributeError: module 'oauth2' has no attribute 'OAuth2Helper'

how can I resolve the above error?
And can anyone please suggest why so many errors are occurring? Any suggestion will be appreciable, Thank you:)

Gauravp-NEC

@Gauravp-NEC

Hi, how user login and logout session is maintained in CKAN?

MD ARQUM FAROOQUI

@ArqumFarooqui-NEC

Apologies I should have included the Traceback: here it is:

Traceback (most recent call last):
  File "/usr/lib/ckan/default/lib/python3.6/site-packages/flask/app.py", line 1949, in full_dispatch_request
    rv = self.dispatch_request()
  File "/usr/lib/ckan/default/lib/python3.6/site-packages/flask/app.py", line 1935, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/usr/lib/ckan/default/lib/python3.6/site-packages/flask_multistatic.py", line 96, in send_static_file
    raise NotFound()
werkzeug.exceptions.NotFound: 404 Not Found: The requested URL was not found on the server. If you entered the URL manually please check your spelling and try again.

Hi @ryangermann-gov-on-ca
Can you please suggest, How you have resolved this error?

1 reply

Toni

@t-book

Hi, it's quite easy to override the home template in 2.9.X and get 10 latest datasets.

{% snippet 'snippets/package_list.html', packages=c.datasets[:10], item_class="data_set_item" %}

But how could I query the 10 latest ordered by last updated?

2 replies

Toni

@t-book

Hi, is there some config to enable autocomplete against the title in the index big search? https://demo.ckan.org/de/
If not I guess I would just add it in my custom template against the v2 api? https://demo.ckan.org/api/2/util/dataset/autocomplete?incomplete=Sample

4 replies

Carlo Cancellieri

@ccancellieri

Hello!
I'm going on with my proposal study, currently I'm checking solr index and the spatial plugin (to better integrate STAC catalog+OGC API)
Looking at the spatial plugin it seems that we have some view, a package spatial index and harvester.
I'm using all of them but to go ahead I'd love to better understand the spatial plugin.
Q: Apparently (looking at the code) if I load a GeoJson resource I can have a preview (the geoview) but the resource itself is NOT indexed, only a package containing the extra bbox field (geojson snippet) is indexed.
Q: Would be interesting to have ALSO an index for each of the attached resource of type geojson (and gml, wkb, etc), is there something available?
Q: is there a way (out of the box) to calculate the extent of all the resources to obtain the envelope (bbox) of the containing package?
thanks a lot!

Andra Meedun

@irev

hello!
I have a question about Extending ckanext-pages schema
I am trying to follow this step and I am confused in this part
https://github.com/ckan/ckanext-pages#extending-ckanext-pages-schema
where i apply this code

import ckan.plugins as plugins
import ckan.plugins.toolkit as toolkit
from ckanext.pages.interfaces import IPagesSchema

class MyextPlugin(plugins.SingletonPlugin):
    plugins.implements(IPagesSchema)

    #IPagesSchema
    def update_pages_schema(self, schema):
        schema.update({
            'new_field': [
                toolkit.get_validator('not_empty'),
                toolkit.get_validator('boolean_validator')]
            })
        return schema

I've been looking and can't find it

2 replies

Max

@MaxLynam

:( looks like demo.ckan.org has been abandoned for a while (two years??), which makes it super-hards to test/check on functionality, and play to see what is possible ... can't register account ... others have posted issues:

ckan/ckan#5022
ckan/ckan#5220
Q: wonder if there is another "demo" site that we just don't know about, that we could use instead?

4 replies

Muhammad Akbar Fauzi

@m-akbarfauzi

import ckantoolkit as toolkit
ImportError: No module named ckantoolkit

after the above error appears, I pip install ckantoolkit but error not solved

how to use and install plugins for Geojson?

Vitaly Sem

@Vir2S

The same trouble on Ubuntu 20.04

Installing CKAN on CentOs, following doc
Get an error for zope requirement

    Running setup.py install for zope.interface ... error
    ERROR: Command errored out with exit status 1:
     command: /usr/lib/ckan/default/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"'; __file__='"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1i3vl1zu/install-record.txt --single-version-externally-managed --compile --install-headers /usr/lib/ckan/default/include/site/python3.6/zope.interface
         cwd: /tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/
    Complete output (5 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py", line 26, in <module>
        from setuptools import setup, Extension, Feature
    ImportError: cannot import name 'Feature'
    ----------------------------------------
ERROR: Command errored out with exit status 1: /usr/lib/ckan/default/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"'; __file__='"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1i3vl1zu/install-record.txt --single-version-externally-managed --compile --install-headers /usr/lib/ckan/default/include/site/python3.6/zope.interface Check the logs for full command output.

Any hints?

the same trouble on Ubuntu 20.04

Adrià Mercader

@amercader

dev meeting :gem: https://us02web.zoom.us/j/82188246864?pwd=bkl2dUcwblZ5dk9ZTHFxWHVqMFlvdz09

Adrià Mercader

@amercader

just realized that Thursday is a bank holiday here so I won't be around for the dev meeting

Ian Ward

@wardi

your banks get holidays?

Adrià Mercader

@amercader

lol it might be a UK term

sanamart

@sanamart

Hi, is there a way to remove from the main page the "Welcome to CKAN" block? I can not find the right HTML file.

1 reply

Vitaly Sem

@Vir2S

The same trouble on Ubuntu 20.04

Fixed :)

kangmoesss

@kangmoesss

Hai. is it possible to configure the ckan harvest page to be inaccessible except for authorized users?? example: if we access https://data123.gov/harvest it will redirect to https://data123.gov/user/login?came_from=https%3A%2F%2Fdata123.gov%2Fharvest

Bozena611

@Bozena611

Hi all, I am trying to send a welcome email when someone registers on CKAN but I keep on receiving pure code in the email, I would like to add and image that works as a link but what ever I have tried I just keep on receiving HTML code. I've tried with .txt and .html file but the same happens, is there something extra I need to add to the code for the HTML to work in the email?

4 replies

Adrià Mercader

@amercader

:rotating_light: [Announcement] :rotating_light:

Patch releases for 2.9, 2.8. 2.7 available now. Please upgrade for the latest bug and security fixes. More info here: https://groups.google.com/a/ckan.org/g/ckan-dev/c/c1jgnA7NeVk

Upgrade your CKANs! it only takes a moment and will save you trouble down the line

MD ARQUM FAROOQUI

@ArqumFarooqui-NEC

Hi all,
I want to use CKAN 2.8.4 for CKAN setup.
But when I'm trying to pull the image by:

docker pull ckan/ckan:2.8.4

It show Not found error.
And when we are doing git clone from CKAN 2.8.4 tag

git clone https://github.com/ckan/ckan.git

It is downloading latest source code.
Can anyone please help how to get CKAN 2.8.4 image?

Adrià Mercader

@amercader

@ArqumFarooqui-NEC you should not use 2.8.4. You should use the latest 2.8 patch version, which is 2.8.9 as of today

After cloning the repository you can get the 2.8.9 version by checking out the tag:

git checkout ckan-2.8.9

MD ARQUM FAROOQUI

@ArqumFarooqui-NEC

Thanks @amercader
git checkout tags/ckan-2.8.9 worked:)

MD ARQUM FAROOQUI

@ArqumFarooqui-NEC

@ArqumFarooqui-NEC you should not use 2.8.4. You should use the latest 2.8 patch version, which is 2.8.9 as of today

Hi @amercader
I'm getting below error while building the image from 2.8.9 code:

Error response from daemon: manifest for ckan/ckan:2.8.9 not found

Can you please suggest what is going wrong?
Or can I get direct image of CKAN-2.8.9?

Lochanie

@Lochanie

Hi, I am trying to add new button near to about button in home page. I changed the code in header.html. But once we click the button, how can we initialize the next page that we want to navigate. I have created a new folder inside template folder and save my html file there and instead of 'home.about' I put my foldername.html pagename. but it was unsuccessful. How can I ensure this.

Gauravp-NEC

@Gauravp-NEC

Hi, What is resource aliases in CKAN?

Jari Voutilainen

@Zharktas

fyi: ckanext-report (https://github.com/ckan/ckanext-report) should be py3 compatible now

Carlo Cancellieri

@ccancellieri

Dear all, I'm looking for the easiest (but correct) way to cache some custom endpoint:
from flask import Blueprint
MY_CUSTOM = Blueprint(constants.TYPE, name)

I know there are flask cache extensions and other libraries providing a good caching support but I was wondering if there's already something to reuse in ckan 2.8 and 2.9
I've seen some old pylon related stuff and I'm not sure if the cache support over flask is provided by ckan.
Should I install and use https://flask-caching.readthedocs.io/en/latest/ inside my extension or there's an abstraction provided by ckan that we can use?
Thanks as usual

Where communities thrive

People

Repo info

Activity