Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • May 23 17:52
    TomeCirun synchronize #6863
  • May 23 17:43
    TomeCirun synchronize #6863
  • May 23 17:18
    TomeCirun synchronize #6560
  • May 23 16:40
    TomeCirun synchronize #6560
  • May 23 16:20
    TomeCirun edited #6560
  • May 23 16:16
    TomeCirun synchronize #6560
  • May 23 16:14
    TomeCirun synchronize #6560
  • May 23 15:36
    TomeCirun synchronize #6439
  • May 23 13:50
    amercader labeled #6868
  • May 23 13:50
    amercader labeled #6868
  • May 23 13:50

    amercader on master

    ckan_config test mark works wit… Merge pull request #6868 from c… (compare)

  • May 23 13:50

    amercader on 6841-ckan_config-mark-with-request-context

    (compare)

  • May 23 13:50
    amercader closed #6841
  • May 23 13:50
    amercader closed #6868
  • May 23 13:50
    amercader commented #6868
  • May 23 10:42
    smotornyuk commented #6790
  • May 23 10:16
    amercader commented #6790
  • May 23 10:15

    amercader on master

    Add plugin Update test durations Oooops and 11 more (compare)

  • May 23 10:15

    amercader on activity-extension

    (compare)

  • May 23 10:15
    amercader closed #6790
Teemu Erkkola
@bzar
Hello, we're using ckanext-spatial with CKAN 2.9.5 and I'm having some issues with the assets. The plugin defines a public and resource directory as the same directory, ckanext/spatial/public, which seems to work for Pylons, but breaks webassets. It would be possible to just not define the public directory since all css/js are handled using webassets, which does fix styles. However, some of the urls referred to in the CSS files are relative, like "../img/pencil.png", which of course break without the public directory. I've reworked some of our own extensions to have entirely separate assets and public directories to fix this, but it's not always obvious how it should be done, especially if the relative references are inside external libraries with bundled js/css/images all referring to each other. Is there a common solution for this?
Madhulika01Singh
@Madhulika01Singh
I have been trying to figure this out for some time to bring ckan UI on browser from a docker running the server. Have you had any success in terms of how to do this?
3 replies
Adrià Mercader
@amercader
yuvalgimmunai
@yuvalgimmunai

Hi guys, i have some questions about the UI capabilities that I thought some of you may be able to help with.
I'm working at a bio project and I'm integrating CKAN to hold experiments datasets etc. and I want to create a "data discovery page" similar to the human cell atlas:
https://data.humancellatlas.org/explore/projects?filter=%5B%7B%22facetName%22:%22specimenOrgan%22,%22terms%22:%5B%22blood%22%5D%7D%5D

Meaning that I have many datasets and I want to allow searching for them and filtering them in a tabular manner.

So far I had found the following plugins (only read about them didn't install them yet):
ckanext-tableview to view the dataset itself as a table https://github.com/justicehub-in/ckanext-tableview
multiedit which seemed relevant for my cause but not quite there https://extensions.ckan.org/extension/multiedit/
DataTables View which again helps view the dataset itself as a table https://dathere.com/2021/08/datatables-view/

But they didn't seem to be such a good fit

I'd be glad to hear if anybody thinks it's possible
Thanks!

1 reply
Francesco Frassinelli
@frafra_gitlab
is it possible to remove deleted datasets with ckanext-harvest?
3 replies
categulario
@categulario:matrix.org
[m]
Is there a way to do role-based permissions on the datasets? Something like having a role upload datasets but not publish and a different role to make them public
1 reply
Knud Möller
@knudmoeller
There is usually an authorization function in logic/auth for each action function in logic/action. However, for some action functions, there is no authorization function. That makes is quite difficult to implement custom authorization for those actions in a plugin. One example is status_show, for which I already opened an issue and submitted a pull request (ckan/ckan#6833), but now I realize there are many more such missing auth functions. Is there a specific reason for the missing auth functions? Here is the list of all missing functions: https://github.com/ckan/ckan/blob/1bb3387e5b8f95266435d68b69e0d48ad2c64178/ckan/tests/test_coding_standards.py#L308
5 replies
Adrià Mercader
@amercader
sanamart
@sanamart
Hello, what could be the fastest way to install locally ckan-cygnus?
foosi morris
@morris54
Hello i installed ckan 2.9.5 from docker ckan site 127.0.0.1:5000 its working well, but redis and postgresql & datapusher is’nt working. Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address Foreign Address
State
tcp 0 0 0.0.0.0:5000 0.0.0.0:
LISTEN
tcp 0 0 localhost:redis 0.0.0.0:

LISTEN
tcp 0 0 localhost:45259 0.0.0.0:
LISTEN
tcp 0 0 0.0.0.0:8800 0.0.0.0:

LISTEN
tcp 0 0 localhost:ipp 0.0.0.0:
LISTEN
tcp 0 0 localhost:domain 0.0.0.0:

LISTEN
tcp 0 0 localhost:postgresql 0.0.0.0:*
1 reply
Robin
@robin-NEC

Hi all,
I'm using ckan 2.9.5 and trying to make some changes in the less files, when I'm trying to compile them I'm getting the following errors :

``` compile fuchsia.css

npm ERR! code ENOENT
npm ERR! syscall open
npm ERR! path /etc/ckan/default/package.json
npm ERR! errno -2
npm ERR! enoent ENOENT: no such file or directory, open '/etc/ckan/default/package.json'
npm ERR! enoent This is related to npm not being able to find a file.
npm ERR! enoent

npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2022-05-10T06_17_18_353Z-debug.log

compile green.css

npm ERR! code ENOENT
npm ERR! syscall open
npm ERR! path /etc/ckan/default/package.json
npm ERR! errno -2
npm ERR! enoent ENOENT: no such file or directory, open '/etc/ckan/default/package.json'
npm ERR! enoent This is related to npm not being able to find a file.
npm ERR! enoent

npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2022-05-10T06_17_18_861Z-debug.log

compile red.css

npm ERR! code ENOENT
npm ERR! syscall open
npm ERR! path /etc/ckan/default/package.json
npm ERR! errno -2
npm ERR! enoent ENOENT: no such file or directory, open '/etc/ckan/default/package.json'
npm ERR! enoent This is related to npm not being able to find a file.
npm ERR! enoent

npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2022-05-10T06_17_19_351Z-debug.log

compile maroon.css

npm ERR! code ENOENT
npm ERR! syscall open
npm ERR! path /etc/ckan/default/package.json
npm ERR! errno -2
npm ERR! enoent ENOENT: no such file or directory, open '/etc/ckan/default/package.json'
npm ERR! enoent This is related to npm not being able to find a file.
npm ERR! enoent

npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2022-05-10T06_17_19_873Z-debug.log

compile main.css

npm ERR! code ENOENT
npm ERR! syscall open
npm ERR! path /etc/ckan/default/package.json
npm ERR! errno -2
npm ERR! enoent ENOENT: no such file or directory, open '/etc/ckan/default/package.json'
npm ERR! enoent This is related to npm not being able to find a file.
npm ERR! enoent

npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2022-05-10T06_17_20_498Z-debug.log
```
How do i fix it?

6 replies
categulario
@categulario:matrix.org
[m]
Does anyone know what plugin they use in data.gov.sg to show "similar datasets" ?
dennisrpnw
@dennisrpnw
Hi, anybody any idea why at /dashboard/organizations it correctly show "7 datasets" for an organization but at /organization it says "0 datasets"?
2 replies
SorrowAvailable
@SorrowAvailable
Hello, I am in charge to evaluate the potential of CKAN without any positive outcome so far when it comes to harvesting. Are there people able to publish appropriate documentation I can follow to have a working harvesting campaign ? Regards,
Michael Polidori
@mpolidori

I'm working on migrating an extension to python 3 and CKAN 2.9.5 (deadoralive), and I'm getting this error:

AttributeError: 'response' not found in plugins toolkit

I confirmed that response is still in CKAN toolkit.py and all other toolkit functions I call are found. Any ideas would be helpful. This is the line in the extension where it's failing:

toolkit.response.headers['Content-Type'] = 'application/json'

Imported at the top:

import ckan.plugins.toolkit as toolkit
6 replies
Michael Speth
@Conzar
image.png
Does anyone have any experience with the ckanext-geoview plugin? For every resource type I tried (wms, wfs, wmts) I only get a basemap (which is the basemap configured for the ckanext-spatial plugin) and I do not get any layers (even using the examples from the ckanext-geoview readme). There is a distorted icon at the top right and when I hover over there is an empty list:
Any idea?
Nisha-1212
@Nisha-1212
Is any one using ckanext-right_time_context plugin?
Nisha-1212
@Nisha-1212
I am facing the below error while adding resource the Ckan UI.
Noah Danros
@mentallyinspired
Following documentation for "Installing CKAN with Docker Compose" But i keep getting:
ADD failed: file not found in build context or excluded by .dockerignore: stat ckan/config/solr/schema.xml: file does not exist
ERROR: Service 'solr' failed to build : Build failed
The file is there, I've checked
I've not done any changes to any file
Noah Danros
@mentallyinspired
Using: ckan-2.9.5
Noah Danros
@mentallyinspired
Problem was solved with running "docker compose" instead of "docker-compose"
MD ARQUM FAROOQUI
@ArqamFarooqui110719

Hi all,
Is any one using ckanext-right_time_context plugin?
I have configured the "right_time_context" plugin in ckan.ini file and followed the link "https://github.com/conwetlab/ckanext-right_time_context". On adding the resource from CKAN UI, I am getting below error.

HTTPError: DataPusher received a bad HTTP response when trying to download the data file status=401 url=https://robin.fs.in/orion/v2.0/entities?type=AirQualityObserved response=<ams:fault xmlns:ams="http://wso2.org/apimanager/security"><ams:code>900902</ams:code><ams:message>Missing Credentials</ams:message><ams:description>Required OAuth credentials not provided. Make sure your API invocation call has a header: "Authorization: Bearer ACCESS_TOKEN"</ams:description></ams:fault>

Can anyone suggest me, please, How to resolve this error?

ryangermann-gov-on-ca
@ryangermann-gov-on-ca

I'm have set up the MSAL (OAuth2) Plugin to fully authenticate specific users on the allowed domains, but when a user from an allowed domain is not already an established CKAN user, I consider them all to be a single "generic" user that is a Member of all Organizations and can therefore see all the "Private" Datasets. I don't want users signed in as this "generic" user to be messing around with their "Dashboard" I just want them to go to the Home Page and otherwise have no extra capabilities beyond a public user. I have already suppressed the User Toolbar for users apart from those having elevated privileges, there IS a logout button so they can log out of the system, but I just want to redirect them after login to the home page instead of the dashboard.

Would someone be able to tell me which specific bit of code I should be looking at? I really don't want to tamper with the authentication code, I just want to put in the condition "if generic user, go here instead".

Thanks in advance.

6 replies
Yoana Popova
@popovayoana

[CKAN Monthly Live]
Important: We are postponing our CKAN Monthly Live for next Wed - 25th May 2022!

We are going to talk about OGCIO – Public Service Data Catalogue (datacatalogue.gov.ie). The goals of the Public Data Catalogue to improve data sharing and data re-use are aligned with the European goals to enhance the Data Economy and drive innovation.

Tune in to hear more about the project, the challenges and the overall programme of portal enhancement and ecosystem management initiatives. Our speakers will be Derilinx, who, together with the dedicated OGCIO team, worked on building and launcing the Public Service Data Catalogue.

Tomek Sabała
@tomeksabala

Hello. What's the current newest python version supported for CKAN 2.9.5 and to be released 2.10?
I've tried to search around and the only info I've found is "at least python 3.6" from the docs and the circleci job for CKAN is configured to run with 3.7.

We've just upgraded our CKAN project to python 3.8 successfully. It still feels stale with current version 3.10 and 3.11 announced for October.
I though I'd check out with the community before starting internal testing with python 3.10. Thanks in advance for any info and feedback!

2 replies
heartofdarkness799
@heartofdark799_twitter
is it possible to harvest private datasets?
Laeticia D.S.
@letdos
imagen.png

hi!! I'm working with the ckan 2.9.3. When we connect the harvest plugin these mesages appears:

[ckan.lib.helpers] Route name "organizations_index" is deprecated and will be removed. Please update calls to use "organization.index" instead
2022-05-18 07:42:27,835 INFO [ckan.lib.helpers] Route name "organization_read" is deprecated and will be removed. Please update calls to use "organization.read" instead
2022-05-18 07:42:27,836 INFO [ckan.lib.helpers] Route name "harvest_read" is deprecated and will be removed. Please update calls to use "harvest.read" instead
2022-05-18 07:42:27,837 INFO [ckan.lib.helpers] Route name "organizations_index" is deprecated and will be removed. Please update calls to use "organization.index" instead
2022-05-18 07:42:27,837 INFO [ckan.lib.helpers] Route name "organization_read" is deprecated and will be removed. Please update calls to use "organization.read" instead
2022-05-18 07:42:27,838 INFO [ckan.lib.helpers] Route name "harvest_read" is deprecated and will be removed. Please update calls to use "harvest.read" instead
2022-05-18 07:42:27,860 INFO [ckan.lib.helpers] Route name "harvest_job_abort" is deprecated and will be removed. Please update calls to use "harvester.job_abort" instead
2022-05-18 07:42:27,861 INFO [ckan.lib.helpers] Route name "harvest_clear" is deprecated and will be removed. Please update calls to use "harvester.clear" instead
2022-05-18 07:42:27,861 INFO [ckan.lib.helpers] Route name "harvest_read" is deprecated and will be removed. Please update calls to use "harvest.read" instead
2022-05-18 07:42:27,863 INFO [ckan.lib.helpers] Route name "harvest_job_show_last" is deprecated and will be removed. Please update calls to use "harvester.job_show_last" instead

Does anyone know anything about these messages?

hahaduck2000
@atleader0419
Hello, How can I get package name in a situation that I only have package id could use?
Adrià Mercader
@amercader
Sorry, I can't join the Dev meeting today
Steven De Costa
@Starl3n
heya folks - I've drafted some copy that can be used for the CKAN website and/or the docs. I've got the google doc open for public comment if anyone would like to provide feedback. Suggestions for additions or deletions are welcome :)
thanks to @kowh-ai and @amercader for supplying some initial notes for me to work from :)
Alex Gostev 🇺🇦🇳🇴
@thegostev_twitter
Hey! Here's the questionnaire for interviewing that was mentioned earlier this week. Think through potential hypothesis to uncover or CKAN 3.0 strategic possibilities, so we can find out what CKAN users/contributors/sponsors are thinking about them.
Please contribute to questions the questions list as the result: https://docs.google.com/spreadsheets/d/1Edg2b1l8ExJ2GxjeWJOB2wvoswO8DUK37uQu7VyWJHk/edit#gid=0
2 replies
It's Friday ☀️ Have a nice week ending to enjoy the weekend!
Michael Polidori
@mpolidori

Maybe a shot in the dark, but does anyone have an idea of the "t-shirt size" amount of work that it would take to use Elasticsearch instead of Solr? One of our clients is very interested in it, but it's not set in stone. I've found a few older related repos that look promising (the second one might actually be what we're looking for, but since it's built around MongoDB, we'll have to fork it and make it compatible with PostgreSQL):

https://github.com/GovDataOfficial/ckanext-searchindexhook

https://github.com/NaturalHistoryMuseum/ckanext-versioned-datastore

I'm going to investigate further, but I can't tell how much effort would be required to do it and do it right, so I figured I'd ask here!

1 reply
Paul Walsh
@pwalsh

Hi everyone. These days I am working on an open source 311 / Service Request / Workflow Management system for cities. More info here if it interests anyone and feel free to contact me too https://discuss.okfn.org/t/a-new-open-source-311-service-request-management-solution/11158

No CKAN integration yet but still it may be of interest to any CKAN providers working with cities so, now you know :)

Adrià Mercader
@amercader
Hi @pwalsh, great to see you here :) this looks great, congrats!
1 reply
Ralph
@roc
Allo! One for @wardi, just checking in on what the expectation around this comment is: https://github.com/ckan/ckan/pull/6837#pullrequestreview-960832267 I can pull in pkg and set mmod = pkg.metadata_modified.isoformat() if that's what you're saying?
Ralph
@roc
Has anyone come up against this error when trying to run tests?
    from sqlalchemy.orm.session import SessionExtension
ImportError: cannot import name 'SessionExtension' from 'sqlalchemy.orm.session' (/ckan/lib/python3.8/site-packages/sqlalchemy/orm/session.py)
Tom Martin
@tpgmartin

Hey, I'm deploying a source install following these instructions: http://docs.ckan.org/en/2.9/maintaining/installing/deployment.html

I can see that the dev server is running as expected at http://localhost:5000

How do I access this from the browser once the server is setup? So far I’ve only been able to view it by updating port 8080 in /etc/ckan/default/ckan-uwsgi.py and /etc/nginx/sites-available/ckan to port 5000, with only port 80 of my EC2 instance exposed. What would be suitable for a production build?

categulario
@categulario:matrix.org
[m]
You might want to set ckan-uwsgi to listen on port 5000 as usual and configure nginx as reverse proxy. That way you can set up port 443 (https) to map internally to 5000 and serve your instance securely. (And have only ports 80 and 443 exposed, with 80 redirecting to 443)