Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • 10:05
    smotornyuk labeled #7381
  • 10:05
    smotornyuk labeled #7381
  • 10:05
    smotornyuk assigned #7381
  • 10:05
    smotornyuk opened #7381
  • 10:03

    smotornyuk on fix-organization-and-sysadmin-fixtures

    Fix names of organization and s… (compare)

  • 05:24
    kowh-ai edited #7380
  • 05:24
    kowh-ai edited #7380
  • Feb 05 20:07
    Gauravp-NEC commented #7380
  • Feb 05 16:19
    rukshn commented #7376
  • Feb 05 16:18
    rukshn closed #7376
  • Feb 05 16:17
    Gauravp-NEC commented #7376
  • Feb 04 19:58
    rukshn edited #7380
  • Feb 04 19:57
    rukshn opened #7380
  • Feb 03 19:30
    kuhlaid commented #6763
  • Feb 03 10:54
    pvgenuchten commented #23
  • Feb 02 20:24

    wardi on master

    Do not auto-register prefixed r… Added changelog file; Rename 7374.fix to 7374.feature and 3 more (compare)

  • Feb 02 20:24
    wardi closed #7374
  • Feb 02 20:23
    wardi labeled #7374
  • Feb 02 20:23
    wardi labeled #7374
  • Feb 02 17:46
    rukshn commented #7376
Timothy Rowland
@TimothyRowland
Hello. I'm currently utilizing CKAN 2.9.7 and conducted all of the steps in the documentation located at https://docs.ckan.org/en/2.9/maintaining/configuration.html?highlight=login_form_url under the ckan.root_path section. I've additionally searched for other locations to see if any other changes need to be made and have been unsuccessful so far. Currently I have my ckan.site_url set to "http://localhost:5000" and my ckan.root_path set to /ckan. Whenever I go to localhost/ckan it gives me a 404 error. Does something besides production.ini and who.ini need to be changed in order to make ckan work besides on just localhost:5000
13 replies
DreamDelerium
@DreamDelerium
I noticed that in CKAN, when I am looking at a Data page with a list of files (i.e https://catalog.data.gov/dataset/electric-vehicle-population-data) , if I click "download" button for a file, it doesn't actually download the file. It just opens it into a new tab. Is there a way to force a download? Is this something that can be configured?
13 replies
Vivek Kumar
@kumarvivek1752
my ckan version is 2.9.7 how i downgrade to 2.9.5?
sanamart
@sanamart
hi, one question. how can i disable debug log mode?
1 reply
DreamDelerium
@DreamDelerium
Hello. Is there any documentation on how to create seed data in CKAN? I am using this extension for organizations: https://github.com/ckan/ckanext-hierarchy I would like to seed CKAN with a preset list of organizations. But, I would need the ID of the root organization to be returned, so that I can add it to child organizations. Unless, you can specify the ID and it is not autogenerated? I would also like to have the seed data external to the core of the application, so I can easily edit the list, if possible?
Ian Ward
@wardi
you can specify the ids when you create them using the api
crstn-aiw
@crstn-aiw

Hi, we lost access to our vm server which hosts our ckan due it being outdated, we are in process of moving it to a new server. I've installed latest ckan, and because I have a backup vhd of dead server, i was able to create a pg dump and restored the ckan_default database. This seem to work as i can see it is reading most of the data ( the groups, organization and datasets ) and /var/lib/ckan/default/resources/ folder is also uploaded with files.

However, our dead server is in azure which was setup to have unmanaged disk and a blob storage account and from what I understand, users are uploading the files in the storage account. But I couldn't find any configuration in my ckan that is connecting it to azure storage account so I am wondering if I am missing something to look at.

I've read that it may related to the datastore/datapusher but i'm having some trouble understanding the concept and how it is configured.

I haven't created a dump of the datastore_default from vhd backup disk but I just created a new db. Is it fair to ask that this should also be created from dump and what info does this database have?

Sorry for long post, appreciate any response.
Thank you

8 replies
Diego Villacreses
@DiegoDVillacreses
Hi all! Sorry to bother you with an apparently obvious problem. I am unable to install DataPusher. I am using Ubuntu 20.04, already carefully installed CKAN following https://docs.ckan.org/en/2.9/maintaining/installing/install-from-source.html. When I upload a resource to a Dataset using the CKAN-GUI (located at http://localhost) and a link for a csv file and that resource works fine with DataStore. But when I use FileStore to upload a resource (csv data file) from a local folder DataStore does not recognize it. I figure that the problem is that I don't have DataPusher installed. I carefully installed the development and the production DataPusher (using two different Ubuntu machines) following https://github.com/ckan/datapusher . But in bot cases I got tons of errors. In the development case when running python datapusher/main.py deployment/datapusher_settings.py, I get Traceback (most recent call last): File "datapusher/main.py", line 3, in <module> import ckanserviceprovider.web as web ModuleNotFoundError: No module named 'ckanserviceprovider'. I followed the instructions on https://github.com/ckan/ckan-service-provider with no success. pytestonly works when I am running terminal from the folder where ckanserviceprovider was installed. There is any suggestion about DataPusher installation I might be missing?
4 replies
dikshant2023
@dikshant2023
Hi, I am unable to install cloud_connector extension because it it throwing an error for a specific module. I tried installing this module but that is supported in python2 but we are working on python3. Any solution?
dikshant2023
@dikshant2023
Hi, I am unable to install cloud_connector extension because it it throwing an error for a specific module. I tried installing this module but that is supported in python2 but we are working on python3. Any solution? the error for module is "ModuleNotFoundError: No module named 'xmlrpclib'
14 replies
robsteranium
@robsteranium:matrix.org
[m]
Hello. Exciting news about CKAN 3! It's perhaps a bit early to ask this but I wonder if there are already any commitments for how long CKAN 2 will continue to be supported?
Marija
@MarijaKnezevic
Hi, we are facing some problems with installing ckan-spatial extension. I have seen that the new spatial-extension version v2.0.0 supports CKAN >2.9 and that there is predefined Solr Dockerfile.
But when I try to run and build ckan Dockerimage where I predefined all other required extensions for my CKAN application, due to the required dependencies, we can only create a Debian-based image. When I try to run it on a non-Debian based systems, I get various errors related to the requirements. Does anyone know if there is a solution for this issue? Or is there avaliable Debian-based docker image for ckan-spatial extension?
6 replies
kimse
@ipimpat

I'm trying to install ckanext-blob-storage extension, but I'm getting a error 500 when going to the resource upload page and I can see this exception in the error log: https://pastebin.com/Un9dtqex

I think it's related to the extensions's CSS file

Chas Nelson
@chasnelson1990:matrix.org
[m]

Hi all, first time poster here,
I'm working with the Fjelltopp team (tomeksabala (Tomek Sabała), @jonathansberry and others) on the UNAIDs Data Repository. We've been using a version of ckanext-validation that diverged back in the goodtables days but are looking to bring ourselves back in-line with https://github.com/frictionlessdata/ckanext-validation now that there's been some momentum on moving to the latest frictionless framework.

We have a couple of features in our extension that should be possible with the framework but we can't see how to work them with the latest ckanext and I wondered if anybody was actively working on this or could give us a pointer here. The highest priority for us is foreign key validation and the 'schema_sync' flag, both available in the framework upstream.

If nobody's working on these but we think the community would like to see these features we should be able to spend a little time on getting them implemented - but would be good to get opinions from existing contributors and users first!
Any thoughts welcome,
Thanks - Chas

1 reply
Benjamin Adams
@benjwadams

Two questions -- is it possible to disable registration of new accounts to the general public?

Can I make harvesting job status and previous runs viewable to any user, or to users not logged in?

2 replies
Benjamin Adams
@benjwadams
Does the PyCSW tooling in ckanext-spatial still work with CKAN 2.9.7? I keep getting errors when attempting to sync the records.
Benjamin Adams
@benjwadams
Specifically, there's no three option ConfigParser.get
Patricio Del Boca
@pdelboca
Hello there! Last day of January! Dev Meeting :jack_o_lantern: https://us02web.zoom.us/j/82188246864?pwd=bkl2dUcwblZ5dk9ZTHFxWHVqMFlvdz09#success
Jesse Vickery
@JVickery-TBS

Morning everyone, I am trying to override some flask blueprint methods via the IBlueprint implementation. Which works well, however, I am having troubles specifically with the package and resource blueprints.

Traceback (most recent call last):
  File "/srv/app/ckan/registry/bin/ckan", line 11, in <module>
    load_entry_point('ckan', 'console_scripts', 'ckan')()
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 696, in main
    with self.make_context(prog_name, args, **extra) as ctx:
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 621, in make_context
    self.parse_args(ctx, args)
  File "/srv/app/ckan/registry/src/ckan/ckan/cli/cli.py", line 115, in parse_args
    result = super(ExtendableGroup, self).parse_args(ctx, args)
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 1018, in parse_args
    rest = Command.parse_args(self, ctx, args)
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 880, in parse_args
    value, args = param.handle_parse_result(ctx, opts, args)
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 1404, in handle_parse_result
    self.callback, ctx, self, value)
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/click/core.py", line 78, in invoke_param_callback
    return callback(ctx, param, value)
  File "/srv/app/ckan/registry/src/ckan/ckan/cli/cli.py", line 125, in _init_ckan_config
    _add_ctx_object(ctx, value)
  File "/srv/app/ckan/registry/src/ckan/ckan/cli/cli.py", line 134, in _add_ctx_object
    ctx.obj = CtxObject(path)
  File "/srv/app/ckan/registry/src/ckan/ckan/cli/cli.py", line 56, in __init__
    self.app = make_app(self.config)
  File "/srv/app/ckan/registry/src/ckan/ckan/config/middleware/__init__.py", line 58, in make_app
    flask_app = make_flask_stack(conf)
  File "/srv/app/ckan/registry/src/ckan/ckan/config/middleware/flask_app.py", line 247, in make_flask_stack
    app.register_extension_blueprint(blueprint)
  File "/srv/app/ckan/registry/src/ckan/ckan/config/middleware/flask_app.py", line 509, in register_extension_blueprint
    self.register_blueprint(blueprint, **kwargs)
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/app.py", line 98, in wrapper_func
    return f(self, *args, **kwargs)
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/app.py", line 1167, in register_blueprint
    blueprint.register(self, options, first_registration)
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/blueprints.py", line 256, in register
    deferred(state)
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/blueprints.py", line 294, in <lambda>
    self.record(lambda s: s.add_url_rule(rule, endpoint, view_func, **options))
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/blueprints.py", line 86, in add_url_rule
    **options
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/app.py", line 98, in wrapper_func
    return f(self, *args, **kwargs)
  File "/srv/app/ckan/registry/lib/python2.7/site-packages/flask/app.py", line 1283, in add_url_rule
    "existing endpoint function: %s" % endpoint
AssertionError: View function mapping is overwriting an existing endpoint function: canada.edit

I believe this happens because my custom blueprints get loaded here: https://github.com/ckan/ckan/blob/2.9/ckan/config/middleware/flask_app.py#L260

But then afterwards, the package blueprints get loaded here: https://github.com/ckan/ckan/blob/2.9/ckan/config/middleware/flask_app.py#L269

Running CKAN 2.9.7 with py2.

Jesse Vickery
@JVickery-TBS

The only way I have been able to actually override these is like such:

def get_blueprint(self):
    from flask import request, current_app
    from ckanext.myext.view import MyDatasetEditViewClass

    dynamic_blueprints = Blueprint(dynamic_blueprints', __name__)

    def load_view_overrides():
        if request.endpoint == 'dataset.edit' or request.endpoint == 'info.edit':
                return current_app.finalize_request(MyDatasetEditViewClass.as_view(str(u'edit'))(**request.view_args))

    dynamic_blueprints.before_app_request(load_view_overrides)

    return [dynamic_blueprints]

But this seems like a big hack/workaround. Is there anyway to actually override the package and resource blueprints? (the group blueprints would also have this issue).

Ian Ward
@wardi
IDatasetForm plugins should be able to define all the dataset-like blueprints without causing conflicts
3 replies
IBlueprint IIUC only lets you define new routes
Alberto Manuel
@maochoa31415

Hello, I'm try to install ckan from docker compose but I found many issues:

  • The solr container show many errors like this: [error occurred during error reporting , id 0xb], library initialization failed - unable to allocate file descriptor table - out of memory.
  • Which is the password for ckan user in containers? in the doc showed this: sudo vim $VOL_CKAN_CONFIG/production.ini, but the sudo is not instaled in container and the ckan password is not provided.

Please some body help me.

Benjamin Adams
@benjwadams
how can I drop into a shell with common CKAN imports defined in CKAN 2.9? I used to be able to do ckan-paster --plugin=ckan -c <config_file> shell
7 replies
Diego Villacreses
@DiegoDVillacreses
Hi all! Sorry to bother you with a perhaps obvious question. But, would any of you have a recommendation to implement Plotly (Python Plotly, I see there is an extension but uses JS Plotly) graphs in CKAN?
Joel Rivera
@joelriverac

Hello
Installing the plugin https://github.com/dathere/datapusher-plus, after carrying out all the steps, I get the following error:

ckan-datapusher:ckan-datapusher-00 RUNNING pid 1656, uptime 0:00:22
ckan-uwsgi:ckan-uwsgi-00 RUNNING pid 1657, uptime 0:00:22
ckan-worker:ckan-worker-00 RUNNING pid 1658, uptime 0:00:22
datapusher-plus-uwsgi:datapusher-plus-uwsgi-00 FATAL Exited too quickly (process log may have details)

I think the problem is that I have to stop the datapusher that comes with ckan, but is it correct? If so, how to stop it?

4 replies
Jesse Vickery
@JVickery-TBS
Hey, does anyone have any issues with the build_nav_icon helper in ckan 2.9.7? It works, but does not always give the active class.
E.g. I will be on myurl.com/dataset/<id>/resource/<resource_id>/edit, but the nav icon will not have the active class, despite that the nav icon was built with:
{{ h.build_nav_icon(pkg.type ~ '_resource.edit', _('Edit resource'), id=pkg.name, resource_id=res.id, icon='pencil-square-o') }}
Jesse Vickery
@JVickery-TBS
Seems like this is an issue in core, new github issue has been made for it: ckan/ckan#7372
Filip.mihajlovski
@Filip3mac
Hello I am using ckan2.7 and i can see that its using a lot of ram 1.4gigs while idle when in use it goes up to 8-9 gigs, i wanted to know if there are any memory leaks in this version of ckan?
2 replies
amercader
@amercader:matrix.org
[m]
I can't make the Dev meeting today
Rukshan Ranatunge
@rukshn
I just installed CKAN and datastore but i can't seem to preview files I'm getting the following error
Could not load view: DataProxy returned an error (Request Error: Backend did not respond after 10 seconds)
How can I fix this? thank you so much
Rukshan Ranatunge
@rukshn
Do i have to configure data pusher as well?
Rukshan Ranatunge
@rukshn
i tried giving a curl to the http://127.0.0.1:8800 and the response i get is an internal server error
Jari Voutilainen
@Zharktas
@rukshn you don't need datapusher for datastore to work, it just pushes data to datastore more or less automatically
but your dataproxy error happens because you are not using datastore for resource previews
Rukshan Ranatunge
@rukshn
how can i enable datastore for resource previews? @Zharktas
What should I configure additionally? @Zharktas
Jari Voutilainen
@Zharktas
Rukshan Ranatunge
@rukshn
@Zharktas yes i've gone through all the steps
and I installed datastore correctly
testing the api does not give me any errors
curl -X GET "http://127.0.0.1:5000/api/3/action/datastore_search?resource_id=_table_metadata" this
Sam An Mardy
@S-mardii

Hello, my CKAN frequently becomes unreachable from browser. When I remote into the server and run docker compose logs -f ckan I see the error telling about IOError: [Errno 104] Connection reset by peer. What could be the cause of this error and how to resolve it?

This is currently a staging website and I haven't yet configure the SSL. I will need to restart CKAN instance to have this running again.

Marija
@MarijaKnezevic

Hi, I am still struggling with the migration of my extension from CKAN 2.7 to CKAN 2.9. Does anyone have an example of an extension that has been migrated so I can compare the extension written in old and then migrated in new CKAN?
What is the best and easiest way to migrate the functions and to have ti working in CKAN 2.9 (or CKAN 2.10)?

Does anyone know how to define a button that is a response to an action of a defined function?