The Open Source platform for Open Data: https://ckan.org | *NOT* related to Kerbal Space Program | Come to our dev meetings: https://github.com/ckan/ckan/wiki/Weekly-Developer-Meetings
13 replies
13 replies
Hi, we lost access to our vm server which hosts our ckan due it being outdated, we are in process of moving it to a new server. I've installed latest ckan, and because I have a backup vhd of dead server, i was able to create a pg dump and restored the ckan_default database. This seem to work as i can see it is reading most of the data ( the groups, organization and datasets ) and /var/lib/ckan/default/resources/ folder is also uploaded with files.
However, our dead server is in azure which was setup to have unmanaged disk and a blob storage account and from what I understand, users are uploading the files in the storage account. But I couldn't find any configuration in my ckan that is connecting it to azure storage account so I am wondering if I am missing something to look at.
I've read that it may related to the datastore/datapusher but i'm having some trouble understanding the concept and how it is configured.
I haven't created a dump of the datastore_default from vhd backup disk but I just created a new db. Is it fair to ask that this should also be created from dump and what info does this database have?
Sorry for long post, appreciate any response.
Thank you
8 replies
python datapusher/main.py deployment/datapusher_settings.py, I get Traceback (most recent call last):
File "datapusher/main.py", line 3, in <module>
import ckanserviceprovider.web as web
ModuleNotFoundError: No module named 'ckanserviceprovider'. I followed the instructions on https://github.com/ckan/ckan-service-provider with no success. pytestonly works when I am running terminal from the folder where ckanserviceprovider was installed. There is any suggestion about DataPusher installation I might be missing?
4 replies
14 replies
But when I try to run and build ckan Dockerimage where I predefined all other required extensions for my CKAN application, due to the required dependencies, we can only create a Debian-based image. When I try to run it on a non-Debian based systems, I get various errors related to the requirements. Does anyone know if there is a solution for this issue? Or is there avaliable Debian-based docker image for ckan-spatial extension?
6 replies
I'm trying to install ckanext-blob-storage extension, but I'm getting a error 500 when going to the resource upload page and I can see this exception in the error log: https://pastebin.com/Un9dtqex
I think it's related to the extensions's CSS file
Hi all, first time poster here,
I'm working with the Fjelltopp team (tomeksabala (Tomek Sabała), @jonathansberry and others) on the UNAIDs Data Repository. We've been using a version of ckanext-validation that diverged back in the goodtables days but are looking to bring ourselves back in-line with https://github.com/frictionlessdata/ckanext-validation now that there's been some momentum on moving to the latest frictionless framework.
We have a couple of features in our extension that should be possible with the framework but we can't see how to work them with the latest ckanext and I wondered if anybody was actively working on this or could give us a pointer here. The highest priority for us is foreign key validation and the 'schema_sync' flag, both available in the framework upstream.
If nobody's working on these but we think the community would like to see these features we should be able to spend a little time on getting them implemented - but would be good to get opinions from existing contributors and users first!
Any thoughts welcome,
Thanks - Chas
1 reply
Morning everyone, I am trying to override some flask blueprint methods via the IBlueprint implementation. Which works well, however, I am having troubles specifically with the package and resource blueprints.
Traceback (most recent call last):
File "/srv/app/ckan/registry/bin/ckan", line 11, in <module>
load_entry_point('ckan', 'console_scripts', 'ckan')()
File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 722, in __call__
return self.main(*args, **kwargs)
File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 696, in main
with self.make_context(prog_name, args, **extra) as ctx:
File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 621, in make_context
self.parse_args(ctx, args)
File "/srv/app/ckan/registry/src/ckan/ckan/cli/cli.py", line 115, in parse_args
result = super(ExtendableGroup, self).parse_args(ctx, args)
File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 1018, in parse_args
rest = Command.parse_args(self, ctx, args)
File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 880, in parse_args
value, args = param.handle_parse_result(ctx, opts, args)
File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 1404, in handle_parse_result
self.callback, ctx, self, value)
File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 78, in invoke_param_callback
return callback(ctx, param, value)
File "/srv/app/ckan/registry/src/ckan/ckan/cli/cli.py", line 125, in _init_ckan_config
_add_ctx_object(ctx, value)
File "/srv/app/ckan/registry/src/ckan/ckan/cli/cli.py", line 134, in _add_ctx_object
ctx.obj = CtxObject(path)
File "/srv/app/ckan/registry/src/ckan/ckan/cli/cli.py", line 56, in __init__
self.app = make_app(self.config)
File "/srv/app/ckan/registry/src/ckan/ckan/config/middleware/__init__.py", line 58, in make_app
flask_app = make_flask_stack(conf)
File "/srv/app/ckan/registry/src/ckan/ckan/config/middleware/flask_app.py", line 247, in make_flask_stack
app.register_extension_blueprint(blueprint)
File "/srv/app/ckan/registry/src/ckan/ckan/config/middleware/flask_app.py", line 509, in register_extension_blueprint
self.register_blueprint(blueprint, **kwargs)
File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/app.py", line 98, in wrapper_func
return f(self, *args, **kwargs)
File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/app.py", line 1167, in register_blueprint
blueprint.register(self, options, first_registration)
File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/blueprints.py", line 256, in register
deferred(state)
File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/blueprints.py", line 294, in <lambda>
self.record(lambda s: s.add_url_rule(rule, endpoint, view_func, **options))
File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/blueprints.py", line 86, in add_url_rule
**options
File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/app.py", line 98, in wrapper_func
return f(self, *args, **kwargs)
File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/app.py", line 1283, in add_url_rule
"existing endpoint function: %s" % endpoint
AssertionError: View function mapping is overwriting an existing endpoint function: canada.editI believe this happens because my custom blueprints get loaded here: https://github.com/ckan/ckan/blob/2.9/ckan/config/middleware/flask_app.py#L260
But then afterwards, the package blueprints get loaded here: https://github.com/ckan/ckan/blob/2.9/ckan/config/middleware/flask_app.py#L269
Running CKAN 2.9.7 with py2.
The only way I have been able to actually override these is like such:
def get_blueprint(self):
from flask import request, current_app
from ckanext.myext.view import MyDatasetEditViewClass
dynamic_blueprints = Blueprint(dynamic_blueprints', __name__)
def load_view_overrides():
if request.endpoint == 'dataset.edit' or request.endpoint == 'info.edit':
return current_app.finalize_request(MyDatasetEditViewClass.as_view(str(u'edit'))(**request.view_args))
dynamic_blueprints.before_app_request(load_view_overrides)
return [dynamic_blueprints]But this seems like a big hack/workaround. Is there anyway to actually override the package and resource blueprints? (the group blueprints would also have this issue).
Hello, I'm try to install ckan from docker compose but I found many issues:
- The solr container show many errors like this: [error occurred during error reporting , id 0xb], library initialization failed - unable to allocate file descriptor table - out of memory.
- Which is the password for ckan user in containers? in the doc showed this: sudo vim $VOL_CKAN_CONFIG/production.ini, but the sudo is not instaled in container and the ckan password is not provided.
Please some body help me.
Hello
Installing the plugin https://github.com/dathere/datapusher-plus, after carrying out all the steps, I get the following error:
ckan-datapusher:ckan-datapusher-00 RUNNING pid 1656, uptime 0:00:22
ckan-uwsgi:ckan-uwsgi-00 RUNNING pid 1657, uptime 0:00:22
ckan-worker:ckan-worker-00 RUNNING pid 1658, uptime 0:00:22
datapusher-plus-uwsgi:datapusher-plus-uwsgi-00 FATAL Exited too quickly (process log may have details)
I think the problem is that I have to stop the datapusher that comes with ckan, but is it correct? If so, how to stop it?
4 replies
myurl.com/dataset/<id>/resource/<resource_id>/edit, but the nav icon will not have the active class, despite that the nav icon was built with:{{ h.build_nav_icon(pkg.type ~ '_resource.edit', _('Edit resource'), id=pkg.name, resource_id=res.id, icon='pencil-square-o') }}
Could not load view: DataProxy returned an error (Request Error: Backend did not respond after 10 seconds)
curl -X GET "http://127.0.0.1:5000/api/3/action/datastore_search?resource_id=_table_metadata" this
Hello, my CKAN frequently becomes unreachable from browser. When I remote into the server and run docker compose logs -f ckan I see the error telling about IOError: [Errno 104] Connection reset by peer. What could be the cause of this error and how to resolve it?
This is currently a staging website and I haven't yet configure the SSL. I will need to restart CKAN instance to have this running again.
Hi, I am still struggling with the migration of my extension from CKAN 2.7 to CKAN 2.9. Does anyone have an example of an extension that has been migrated so I can compare the extension written in old and then migrated in new CKAN?
What is the best and easiest way to migrate the functions and to have ti working in CKAN 2.9 (or CKAN 2.10)?
Does anyone know how to define a button that is a response to an action of a defined function?