ckan/chat

The Open Source platform for Open Data: https://ckan.org | *NOT* related to Kerbal Space Program | Come to our dev meetings: https://hack.allmende.io/ckan-meeting

Lin Zhang

@linforestzhang

@mbocevski Amazing work!

Gauravp-NEC

@Gauravp-NEC

Hi, how can I import _ from the toolkit ?

Adrià Mercader

@amercader

Hi, I can't make today's meeting I'm afraid

Jari Voutilainen

@Zharktas

neither can I, conflicting meetings again

Ian Ward

@wardi

let's postpone to next tuesday

Andres Vazquez

@avdata99

I'm getting a "TimeoutError: QueuePool limit of size 5 overflow 10 reached" error while run load tests on CKAN
Is there a way to change the pool size? It's a good idea to do it?
I didn't find a way to set the pool size in CKAN code.
I founded some references but no solution
https://lists-archive.okfn.org/pipermail/ckan-dev/2013-November/006183.html
ckan/ckan#3115

1 reply

Feng Hui-Chun

@foxhoundsk

Does anyone know why I can only reach (through curl) my ckan main page from local? I got connection reset error if trying to reach the ckan main page from public. Is this related to my machine's network setting? Or ckan's config file? Thanks!

1 reply

Feng Hui-Chun

@foxhoundsk

Besides, are there any compatibility issues between ckan 2.9 and solr 8.6.3 except some changes required for the schema file? Thanks!

2 replies

davidtmarc

@davidtmarc

Is there a different process for installing extensions if I did an install from package? I noticed in the documentation I need git to install extensions, but not see further documentation. Thanks!

4 replies

Alex Harding

@hardingalexh

is there any reason why an access function wouldn't work with both @toolkit.chained_auth_function and @toolkit.auth_allow_anonymous_access? when I use both, my actions get 403'd as if the anonymous access decorator wasn't there

I see someone else asked similarly on stackoverflow a while ago with no answer: https://stackoverflow.com/questions/60440694/overriding-ckan-resource-show-auth-function-but-unable-to-add-auth-allow-anonym

Ian Ward

@wardi

you could try putting the @toolkit.auth_allow_anonymous_access first

Alex Harding

@hardingalexh

tried, sadly no luck

if I only include either they work, but using both fails the auth check. is there another way I can specify my function to not reject like that?

Ian Ward

@wardi

sounds like a bug worth fixing

Alex Harding

@hardingalexh

for sure. not one that really makes sense though, all those decorators do is set function attributes to true

Alex Harding

@hardingalexh

ah figured it out, the chained funcs get transformed and the attribute doesn't get persisted. i'll get an issue up and a PR after :)

Gauravp-NEC

@Gauravp-NEC

Hi, I am using ckan 2.9. In my setup dataset preview option is not available when I click on "Explore" .

2 replies

Adrià Mercader

@amercader

@kowh-ai just FYI I tagged a new ckanext-xloader release to be able to point to the 2.9 /py3 support (0.7.0). I didn't push any changes, just the changelog and version number

3 replies

Abed khooli

@abedkhooli

So, is xLoader now ready to use with 2.9x as an alternative to DataPusher?

5 replies

Adrià Mercader

@amercader

Travis ci has become almost unusable since they changed their pricing model. We should work on a github actions / circle ci setup that works well for extensions and set that up as the default (and migrate existing extensions)

1 reply

Does anyone test their ckan extensions with github actions and can share their setup?

Ian Ward

@wardi

IIRC github actions have a hard limit every month for the free offerings

Adrià Mercader

@amercader

I tried to look for this, but couldn't find it here: https://docs.github.com/en/free-pro-team@latest/actions/reference/usage-limits-billing-and-administration

sorry, there are here: https://docs.github.com/en/free-pro-team@latest/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions

Ian Ward

@wardi

so we would get 50 or so CI runs, assuming they still take half an hour, or would that be 12 runs (counting minutes per container)

per month

maybe compare the other options too? gitlab might have something

Adrià Mercader

@amercader

you mean hosting the extension on gitlab? or hosting on github and running the tests on gitlab?

Adrià Mercader

@amercader

I reckon that if we used a pre-built image with ckan and requirements and only had to install the extension the run times would be much smaller

Ian Ward

@wardi

for sure.

would help with core tests too, we spend a lot of time installing system dependencies

Adrià Mercader

@amercader

yeah, all this should be dockerized

Michael Long

@michael-long88

I'm trying to install ckan-googleanalytics with ckan 2.8, but I'm getting a "BackendUnavailable" error during the pip install process. any ideas on what would be causing this / how to fix it?

Paul

@paul-lccc

Using the DataStore API to upload 30MB JSON, are there limits on the size of a JSON object via the API?

8 replies

Jari Voutilainen

@Zharktas

@amercader @wardi apparently github actions are still free for public repositories, so the 2000 minutes / month limit should not affect us

Jari Voutilainen

@Zharktas

i'm gonna be at least late, not sure how long this meeting is goint to take

Adrià Mercader

@amercader

dev https://meet.google.com/coc-naji-vmd

*dev meeting!

@wardi are you around?

David Shumway

@davidshumway

No matter what I try, the logging does not seem to be writing to file

For example:
'''
class MCPlugin(p.SingletonPlugin):
p.implements(p.IConfigurer, inherit=True)
p.implements(p.IResourceView, inherit=True)
p.implements(p.ITemplateHelpers, inherit=True)

#IPackageController
p.implements(p.IPackageController, inherit=True)

import logging
logging.basicConfig(filename='example.log', encoding='utf-8', level=logging.DEBUG)
logging.debug('This message should go to the log file')'''

Joel Natividad

@jqnatividad

@amercader @wardi @Zharktas perhaps one of the "core" users of CKAN can help with travis ci? GSA? EU? Canada? Australia? New Zealand? Singapore? Saudi Arabia? HDX? Several big foundations? If not funding directly, perhaps, by "sharing" their subscription.
IMHO, doesn't hurt to ask :) One of them might say yes!

Shashank Sharma

@shashank-sharma

Hi guys
Right now I have been working with CKAN for a while using 2.6/2.8.4/2.9.1 and I am kind of understanding the roadmap like how project is moving ahead from pylons to Flask completely. During such transition, I am planning to try CKAN as backend, so my question is, how easy it is to accomplish ? I know it's possible as per datopian repos and other repos which I saw.

What I understand is that, CKAN uses sessions and response cookies to make sure user is authenticated and other stuff but I am worried if I use Frontend framework, then things might break like existing controllers not working or for plugins I'll have to rewrite to support frontend request. So do I have to create custom endpoints for this like data_upload flow, authentication etc

Why I am asking is because there is lot going in CKAN internals which I might have missed that's why confirming it here
Any help is much appreciated :)

Jari Voutilainen

@Zharktas

@shashank-sharma the api and authentication remains the same regardless of backend pylons-flask migrations stage. the api actually transitioned to flask in ckan 2.7. You only have to care about the migration stage if you making an extension which should work on various ckan versions and it extends the user interface.

Shashank Sharma

@shashank-sharma

@Zharktas I think I understand that, I also tried creating plugin and I understood difference in IRoutes / Blueprint interfaces which I had to use for python 2.7 / 3.6+ support. But for example let's say for login, we have endpoint /login_generic, which returns html response rather than JSON. In that case, do I have write my own extension to make it possible (I was not able to find any other endpoint for that)? which goes for other endpoints as well which I am not aware of ? Like new_package / add_resource etc

Mandana Moshref

@MandanaMoshref

Hi all,
I have a general question, Is there or has been any activity in implementing ebRIM for/with CKAN? Is there anyone aware of that?

David Shumway

@davidshumway

Where do CKAN log files appear? I've searched through all .log files and don't see any related to CKAN: sudo find / -name "*.log"

David Shumway

@davidshumway

In my plugin, I can get logging to output to the console when running ckan via ckan /etc/ckan/default/ckan.ini run. But this output is not saving to file. The code in my plugin is:


import logging
logging.basicConfig(filename='example.log', encoding='utf-8', level=logging.DEBUG)
logging.debug('This message should go to the log file')
logging.info('So should this')
logging.warning('And this, too')
logging.error('And non-ASCII stuff, too, like Øresund and Malmö')

Where communities thrive

People

Repo info

Activity