Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • 13:12
    smotornyuk assigned #6418
  • 13:11
    smotornyuk assigned #6419
  • 13:05
    smotornyuk assigned #6422
  • 12:00
    TomeCirun synchronize #461
  • 11:36
    Gauravp-NEC commented #5801
  • 10:57
    sim-pml commented #6422
  • 10:57
    sim-pml commented #6422
  • 08:07
    sim-pml opened #6422
  • Sep 22 17:50
    avdata99 converted_to_draft #6421
  • Sep 22 16:45
    avdata99 synchronize #6421
  • Sep 22 16:38
    avdata99 synchronize #6421
  • Sep 22 16:23
    avdata99 edited #6421
  • Sep 22 16:21
    avdata99 edited #6421
  • Sep 22 16:20
    avdata99 opened #6421
  • Sep 22 14:31
    TomeCirun opened #461
  • Sep 22 14:28
    TomeCirun opened #460
  • Sep 22 14:25

    Zharktas on upgrade_cypress_and_axe

    Update cypress, cypress-axe and… (compare)

  • Sep 22 13:24
    Zharktas closed #6393
  • Sep 22 13:24
    Zharktas commented #6393
  • Sep 22 13:24
    Zharktas closed #455
Adrià Mercader
@amercader
Simson Garfinkel ☕
@xchatty_twitter
Hello.
Max
@MaxLynam

hey there everyone - new to the community, but long-time #techforgood hacker !!!

  • we're looking to use CKAN as a base for isgood.ai front-end (our backend ds stuff done)
  • with extensions and such, meets our base requirements and more really cool stuff too :)
    BUT
  • the front-end viz seems to not be that snazzy compared to other data-viz tools (see alts here: https://tech.datopian.com/data-explorer/design/#research)

I wonder if there's some ways to give the front-end dashboards some visualisation super-powers (and make them interact and look a bit more "modern") .. a bit more like superset, metabase, mapbox, etc look of things ... or plugins I just haven't seen yet that add them over the top or something?

Thanks in advance for any advice in this area ... loving getting into the ckan functionality and #dataforgood work being done here <3

5 replies
Simson Garfinkel ☕
@xchatty_twitter
Is there a theory-of-operation or system specification for CKAN that will tell me what's what? In particular, I am looking to find out if CKAN is using DCATv1, DCATv1.1, DCATv2, and if it can use DDI.
1 reply
Toni
@t-book
@xchatty_twitter as far as I know dcat is provided by https://github.com/ckan/ckanext-dcat the readme shoukd answer you question?
MD ARQUM FAROOQUI
@ArqumFarooqui-NEC

Hi all, I'm updating CKAN to v2.9.3( with docker image).
PostgreSQL version: 9.6
currently I'm facing below error:

sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) could not translate host name "psql-ckan" to address: Name or service not known.

please suggest why this error is occurring or how can I resolve this:)
It will help me alot:)

4estone
@4estone

Installing CKAN on CentOs, following doc
Get an error for zope requirement

    Running setup.py install for zope.interface ... error
    ERROR: Command errored out with exit status 1:
     command: /usr/lib/ckan/default/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"'; __file__='"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1i3vl1zu/install-record.txt --single-version-externally-managed --compile --install-headers /usr/lib/ckan/default/include/site/python3.6/zope.interface
         cwd: /tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/
    Complete output (5 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py", line 26, in <module>
        from setuptools import setup, Extension, Feature
    ImportError: cannot import name 'Feature'
    ----------------------------------------
ERROR: Command errored out with exit status 1: /usr/lib/ckan/default/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"'; __file__='"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1i3vl1zu/install-record.txt --single-version-externally-managed --compile --install-headers /usr/lib/ckan/default/include/site/python3.6/zope.interface Check the logs for full command output.

Any hints?

4estone
@4estone
Docs is not up-to-date:
I have to update setuptools
‘pip3 install setuptools==45‘
Instead of
‘pip3 install setuptools==44.1.0‘
Yoana Popova
@popovayoana

[CKAN Monthly Live]
🔴 We are going LIVE in 10 mins!

👉 Join us on Zoom → bit.ly/3zv3iBc
Meeting ID: 861 8088 9272
Passcode: 563309

1 reply
Adrià Mercader
@amercader
:tada:
Mackenzie Nichols
@mackeynichols
Hi there! Are scheming 's output_validators meant to fire when SOLR is queried (like on a /package_search call)? The docs say they fire when a package "is retrieved from the database" I haven't seen mine fire after /package_search, but I wanted to ask here, just in case. Thanks!
Adrià Mercader
@amercader
@mackeynichols no, they are fired when the dataset is transformed from a database object to a python dict that will be returned in the API. This means that they are only fired when the dataset is retrieved to get indexed in Solr, not on each individual Solr query
1 reply
Federico Oldani
@FedericOldani
Hi there! I adapted ckanext-oauth extension to get it working with ckan 2.9 . It runs perfectly but I have a problem with the restore of the db backup. After the backup restore, in the table of the users of organization, each username is substituted by its id. I attach a screen below (the real usernames have been added after the db restore). I checked the db dump file and there exists the user table [id, name] so I don't understand why it is not fully restored. Hope someone can help me, it is annoying to manually add all the users everytime.
image.png
Yaser Alashloo
@yalashloo
Hello everyone,
I have a question regarding having different metadata schemas in one CKAN platform. Each department in our university needs a specific metadata schema. Hence, I would like to ask whether it is possible that the admin create a few data schemas in a CKAN platform so that users can choose the most relevant one when they are creating and uploading their dataset?
It would be great if there is such a plugin.
Cheers,
Yaser
6 replies
Adrià Mercader
@amercader
Marko Bocevski
@mbocevski
Seeing this extension is no longer maintained -> https://github.com/ckan/ckanext-issues, can someone on core provide a link to our fork that we maintain - https://github.com/keitaroinc/ckanext-issues ?
3 replies
MD ARQUM FAROOQUI
@ArqumFarooqui-NEC

Hi all, I have updated CKAN to 2.9.3 with docker image.
Now I'm trying to add ckanext-oauth2 extension(0.7.0). I have installed ckanext-oauth2 but when I'm adding oauth2 plugin in the producition.ini, it is giving below error:

ModuleNotFoundError: No module named 'urlparse'

I have resolved the above error by updating the file /usr/lib/ckan/venv/src/ckan/ckanext-oauth2/ckanext/oauth2/plugin.py from from urlparse import urlparse to from urllib.parse import urlparse.

But after that I'm getting another error i.e.:

AttributeError: module 'oauth2' has no attribute 'OAuth2Helper'

how can I resolve the above error?
And can anyone please suggest why so many errors are occurring? Any suggestion will be appreciable, Thank you:)

Gauravp-NEC
@Gauravp-NEC
Hi, how user login and logout session is maintained in CKAN?
MD ARQUM FAROOQUI
@ArqumFarooqui-NEC

Apologies I should have included the Traceback: here it is:

Traceback (most recent call last):
  File "/usr/lib/ckan/default/lib/python3.6/site-packages/flask/app.py", line 1949, in full_dispatch_request
    rv = self.dispatch_request()
  File "/usr/lib/ckan/default/lib/python3.6/site-packages/flask/app.py", line 1935, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/usr/lib/ckan/default/lib/python3.6/site-packages/flask_multistatic.py", line 96, in send_static_file
    raise NotFound()
werkzeug.exceptions.NotFound: 404 Not Found: The requested URL was not found on the server. If you entered the URL manually please check your spelling and try again.

Hi @ryangermann-gov-on-ca
Can you please suggest, How you have resolved this error?

1 reply
Toni
@t-book

Hi, it's quite easy to override the home template in 2.9.X and get 10 latest datasets.

{% snippet 'snippets/package_list.html', packages=c.datasets[:10], item_class="data_set_item" %}

But how could I query the 10 latest ordered by last updated?

2 replies
Toni
@t-book
Hi, is there some config to enable autocomplete against the title in the index big search? https://demo.ckan.org/de/
If not I guess I would just add it in my custom template against the v2 api? https://demo.ckan.org/api/2/util/dataset/autocomplete?incomplete=Sample
4 replies
Carlo Cancellieri
@ccancellieri
Hello!
I'm going on with my proposal study, currently I'm checking solr index and the spatial plugin (to better integrate STAC catalog+OGC API)
Looking at the spatial plugin it seems that we have some view, a package spatial index and harvester.
I'm using all of them but to go ahead I'd love to better understand the spatial plugin.
Q: Apparently (looking at the code) if I load a GeoJson resource I can have a preview (the geoview) but the resource itself is NOT indexed, only a package containing the extra bbox field (geojson snippet) is indexed.
Q: Would be interesting to have ALSO an index for each of the attached resource of type geojson (and gml, wkb, etc), is there something available?
Q: is there a way (out of the box) to calculate the extent of all the resources to obtain the envelope (bbox) of the containing package?
thanks a lot!
Andra Meedun
@irev

hello!
I have a question about Extending ckanext-pages schema
I am trying to follow this step and I am confused in this part
https://github.com/ckan/ckanext-pages#extending-ckanext-pages-schema
where i apply this code

import ckan.plugins as plugins
import ckan.plugins.toolkit as toolkit
from ckanext.pages.interfaces import IPagesSchema

class MyextPlugin(plugins.SingletonPlugin):
    plugins.implements(IPagesSchema)

    #IPagesSchema
    def update_pages_schema(self, schema):
        schema.update({
            'new_field': [
                toolkit.get_validator('not_empty'),
                toolkit.get_validator('boolean_validator')]
            })
        return schema

I've been looking and can't find it

2 replies
Max
@MaxLynam
:( looks like demo.ckan.org has been abandoned for a while (two years??), which makes it super-hards to test/check on functionality, and play to see what is possible ... can't register account ... others have posted issues:
4 replies
Muhammad Akbar Fauzi
@m-akbarfauzi

import ckantoolkit as toolkit
ImportError: No module named ckantoolkit

after the above error appears, I pip install ckantoolkit but error not solved

how to use and install plugins for Geojson?
Vitaly Sem
@Vir2S
The same trouble on Ubuntu 20.04

Installing CKAN on CentOs, following doc
Get an error for zope requirement

    Running setup.py install for zope.interface ... error
    ERROR: Command errored out with exit status 1:
     command: /usr/lib/ckan/default/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"'; __file__='"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1i3vl1zu/install-record.txt --single-version-externally-managed --compile --install-headers /usr/lib/ckan/default/include/site/python3.6/zope.interface
         cwd: /tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/
    Complete output (5 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py", line 26, in <module>
        from setuptools import setup, Extension, Feature
    ImportError: cannot import name 'Feature'
    ----------------------------------------
ERROR: Command errored out with exit status 1: /usr/lib/ckan/default/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"'; __file__='"'"'/tmp/pip-install-k3rzaoup/zope-interface_2cf763c975914a25ad0c836998a18727/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1i3vl1zu/install-record.txt --single-version-externally-managed --compile --install-headers /usr/lib/ckan/default/include/site/python3.6/zope.interface Check the logs for full command output.

Any hints?

the same trouble on Ubuntu 20.04

Adrià Mercader
@amercader
just realized that Thursday is a bank holiday here so I won't be around for the dev meeting
Ian Ward
@wardi
your banks get holidays?
Adrià Mercader
@amercader
lol it might be a UK term
sanamart
@sanamart
Hi, is there a way to remove from the main page the "Welcome to CKAN" block? I can not find the right HTML file.
1 reply
Vitaly Sem
@Vir2S

The same trouble on Ubuntu 20.04

Fixed :)

kangmoesss
@kangmoesss
Hai. is it possible to configure the ckan harvest page to be inaccessible except for authorized users?? example: if we access https://data123.gov/harvest it will redirect to https://data123.gov/user/login?came_from=https%3A%2F%2Fdata123.gov%2Fharvest
Bozena611
@Bozena611
Hi all, I am trying to send a welcome email when someone registers on CKAN but I keep on receiving pure code in the email, I would like to add and image that works as a link but what ever I have tried I just keep on receiving HTML code. I've tried with .txt and .html file but the same happens, is there something extra I need to add to the code for the HTML to work in the email?
4 replies
Adrià Mercader
@amercader

:rotating_light: [Announcement] :rotating_light:

Patch releases for 2.9, 2.8. 2.7 available now. Please upgrade for the latest bug and security fixes. More info here: https://groups.google.com/a/ckan.org/g/ckan-dev/c/c1jgnA7NeVk

Upgrade your CKANs! it only takes a moment and will save you trouble down the line
MD ARQUM FAROOQUI
@ArqumFarooqui-NEC

Hi all,
I want to use CKAN 2.8.4 for CKAN setup.
But when I'm trying to pull the image by:

docker pull ckan/ckan:2.8.4

It show Not found error.
And when we are doing git clone from CKAN 2.8.4 tag

git clone https://github.com/ckan/ckan.git

It is downloading latest source code.
Can anyone please help how to get CKAN 2.8.4 image?

Adrià Mercader
@amercader
@ArqumFarooqui-NEC you should not use 2.8.4. You should use the latest 2.8 patch version, which is 2.8.9 as of today
After cloning the repository you can get the 2.8.9 version by checking out the tag:
git checkout ckan-2.8.9
MD ARQUM FAROOQUI
@ArqumFarooqui-NEC
Thanks @amercader
git checkout tags/ckan-2.8.9 worked:)
MD ARQUM FAROOQUI
@ArqumFarooqui-NEC

@ArqumFarooqui-NEC you should not use 2.8.4. You should use the latest 2.8 patch version, which is 2.8.9 as of today

Hi @amercader
I'm getting below error while building the image from 2.8.9 code:

Error response from daemon: manifest for ckan/ckan:2.8.9 not found

Can you please suggest what is going wrong?
Or can I get direct image of CKAN-2.8.9?

Lochanie
@Lochanie
Hi, I am trying to add new button near to about button in home page. I changed the code in header.html. But once we click the button, how can we initialize the next page that we want to navigate. I have created a new folder inside template folder and save my html file there and instead of 'home.about' I put my foldername.html pagename. but it was unsuccessful. How can I ensure this.
image.png
Gauravp-NEC
@Gauravp-NEC
Hi, What is resource aliases in CKAN?
Jari Voutilainen
@Zharktas
fyi: ckanext-report (https://github.com/ckan/ckanext-report) should be py3 compatible now
Carlo Cancellieri
@ccancellieri

Dear all, I'm looking for the easiest (but correct) way to cache some custom endpoint:
from flask import Blueprint
MY_CUSTOM = Blueprint(constants.TYPE, name)

I know there are flask cache extensions and other libraries providing a good caching support but I was wondering if there's already something to reuse in ckan 2.8 and 2.9
I've seen some old pylon related stuff and I'm not sure if the cache support over flask is provided by ckan.
Should I install and use https://flask-caching.readthedocs.io/en/latest/ inside my extension or there's an abstraction provided by ckan that we can use?
Thanks as usual