Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • 12:26
    smotornyuk closed #4990
  • 12:25
    smotornyuk commented #4990
  • 10:36

    amercader on dev-v2.8

    Revert "[#6006] Fix auth error … [#6006] Better fix (compare)

  • 10:35

    amercader on dev-v2.7

    Revert "[#6006] Fix auth error … [#6006] Better fix (compare)

  • 10:35

    amercader on dev-v2.9

    [#6006] Remove redundant redire… Sanitize user image url, add he… (compare)

  • 09:48
    amercader synchronize #6076
  • 09:48

    amercader on 6006-auht-err-when-deleting-group

    [#6006] Remove redundant redire… (compare)

  • 09:23
    Gauravp-NEC synchronize #6081
  • 09:02
    Gauravp-NEC commented #5690
  • 09:01
    Gauravp-NEC commented #5690
  • 08:56
    Gauravp-NEC opened #6081
  • 08:33
    Sunny-NEC commented #5888
  • 08:11
    mbocevski commented #228
  • 06:21
    Gauravp-NEC commented #6037
  • 06:19
    Gauravp-NEC commented #6037
  • 05:48
    ThrawnCA commented #5717
  • 05:06
    Zharktas closed #6073
  • 05:06
    Zharktas commented #6073
  • May 10 21:55
    GitYepper edited #6078
  • May 10 21:54
    GitYepper edited #6078
reedv
@reedv
Is it safe to delete users from the ckan backend PostgreSQL DB table user if their status is state=deleted?
3 replies
gallexme
@gallexme
how do i recreate the jobs table of the datapusher?
i cant even find a line mentioning the sqlite file in the github D:
Exception on /job/52ac3647-4930-4b0f-b837-3d597d2df456 [GET]
Traceback (most recent call last):
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/flask/app.py", line 2446, in wsgi_app
    response = self.full_dispatch_request()
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/flask/app.py", line 1951, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/flask/app.py", line 1820, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/flask/app.py", line 1949, in full_dispatch_request
    rv = self.dispatch_request()
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/flask/app.py", line 1935, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/ckanserviceprovider/web.py", line 442, in job_status
    job_dict = db.get_job(job_id, limit=limit)
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/ckanserviceprovider/db.py", line 158, in get_job
    JOBS_TABLE.select().where(JOBS_TABLE.c.job_id == job_id)).first()
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 2235, in execute
    return connection.execute(statement, *multiparams, **params)
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1011, in execute
    return meth(self, multiparams, params)
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1130, in _execute_clauseelement
    distilled_params,
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1317, in _execute_context
    e, statement, parameters, cursor, context
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1511, in _handle_dbapi_exception
    sqlalchemy_exception, with_traceback=exc_info[2], from_=e
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1277, in _execute_context
    cursor, statement, parameters, context
  File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute
    cursor.execute(statement, parameters)
OperationalError: (sqlite3.OperationalError) no such table: jobs
[SQL: SELECT jobs.job_id, jobs.job_type, jobs.status, jobs.data, jobs.error, jobs.requested_timestamp, jobs.finished_timestamp, jobs.sent_data, jobs.result_url, jobs.api_key, jobs.job_key
FROM jobs
WHERE jobs.job_id = ?]
[parameters: ('52ac3647-4930-4b0f-b837-3d597d2df456',)]
(Background on this error at: http://sqlalche.me/e/13/e3q8)
gallexme
@gallexme
welp fixed it by deleting the sqlite file again
Process completed but unable to post to result_url
:confused:
had a 401, so i changed nginx config to allow local connections n checked it with curl, but the status of the job just went to "completed" instead of retrying
well more like the job is stuck at "Process completed but unable to post to result_url"
gallexme
@gallexme
how do i restart the datapusher jobs?
tried deleting the jobs sqlite file, and restarting datapusher
image.png
now its there
curl localhost:8800
{"help":"\n Get help at:\n http://ckan-service-provider.readthedocs.org/."}
:confused:
where does the error come from
[pid: 28521|app: 0|req: 9/9] 127.0.0.1 () {36 vars in 540 bytes} [Mon Apr 12 12:48:29 2021] GET /job/52ac3647-4930-4b0f-b837-3d597d2df456 => generated 29 bytes in 1 msecs (HTTP/1.1 404) 2 headers in 78 bytes (1 switches on core 0)

`
the request hits datapusher
ckan --config /etc/ckan/default/ckan.ini jobs clear
also does not clean the job( i think the job is just missing on datapusher and it can actually connect to it just thinks "404" means its not the datapusher service??)
Gauravp-NEC
@Gauravp-NEC
Hi, What is Schema in CKAN?
1 reply
Feng Hui-Chun
@foxhoundsk

Hi, is there any way that might cause native extension (e.g. stats, text_view, etc.) unable to load? What I mean unable to load is:

ckan.plugins.core.PluginNotFoundException: stats

Thanks!

1 reply
reedv
@reedv
Anyone know what part of the CKAN code controls the Bulk Edit tool of organization admin users and how it is related (or does not relate) to the schemas and validators of package create/updates (specifically the private field of the schema)?
3 replies
4estone
@4estone
What about CKAN on CentOS?
Does anybody experience installing CKAN on CentOS? I have to proove staying on Ubuntu is more efficient than
8 replies
Sivan Grünberg
@sivang
hi all
Sivan Grünberg
@sivang
I'm experiencing some behavior from SOLR , for instance, to find a dataset one must search for the entire dataset name rather than just a part of it, or when a dataset author is in the name of an organization, all of its datasets are returned when searching for that name even though there's 0 datasets that this person has authored, a combination of letters and numbers is automatically broken down, and thus returns most of the datasets on disk when searched for etc, etc. Is there a central place in CKAN where the SOLR configuration lives so I can try and modify it to see if I can come with a human friendly search interface? :)
11 replies
gallexme
@gallexme
quick question any easy way to have dataset search not have "covid19" interpreted as covid OR 19?
3 replies
Lalitha Prasad Ch
@LalithaPrasadC1_twitter
any way to assign sysadminapitoken during the installation?
9 replies
gallexme
@gallexme
is it normal that after a template error every refresh of the page errors on
"StatementError: (sqlalchemy.exc.InvalidRequestError) Can't reconnect until invalid transaction is rolled back
[SQL: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
FROM system_info
WHERE system_info.key = %(key_1)s
LIMIT %(param_1)s]
[parameters: [{}]]"
File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 463, in _revalidate_connection
"Can't reconnect until invalid "
Adrià Mercader
@amercader
Sorry, I can't attend the dev meeting today
Gauravp-NEC
@Gauravp-NEC
Hi, How many APIs are their in CKAN? Is their any count of it.
Konstantin Sivakov
@tino097
https://github.com/ckan/ckan/blob/master/ckan/lib/cli.py#L141 What is this for in the old CLI and do we migrated it to 2.9 ?
dawnh223
@dawnh223
hi, using ckan 2.9 now. should we be able to use fq with resource fields when we do a package search?
Gauravp-NEC
@Gauravp-NEC
Hi, I want to know how to install plugins?
gallexme
@gallexme

Hi, How many APIs are their in CKAN? Is their any count of it.

what do you define as api?, everything past /api, as one?

Hi, I want to know how to install plugins?

@Gauravp-NEC usually its described in the plugin, for most its basically enter the virtualenv, then install it with pip, add plugin name to ckan config, restart ckan

gallexme
@gallexme
2021-04-19 13:08:06,868 DEBUG [werkzeug] Initializing Flask-DebugToolbar log handler
Traceback (most recent call last):
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/flask/app.py", line 2449, in wsgi_app
    response = self.handle_exception(e)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/flask/app.py", line 1866, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/flask/app.py", line 2446, in wsgi_app
    response = self.full_dispatch_request()
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/flask/app.py", line 1951, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/flask/app.py", line 1820, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/flask/app.py", line 1947, in full_dispatch_request
    rv = self.preprocess_request()
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/flask/app.py", line 2241, in preprocess_request
    rv = func()
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/ckan/config/middleware/flask_app.py", line 369, in ckan_before_request
    app_globals.app_globals._check_uptodate()
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/ckan/lib/app_globals.py", line 199, in _check_uptodate
    value = model.get_system_info('ckan.config_update')
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/ckan/model/system_info.py", line 47, in get_system_info
    obj = meta.Session.query(SystemInfo).filter_by(key=key).first()
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 3222, in first
    ret = list(self[0:1])
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 3012, in __getitem__
    return list(res)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 3324, in __iter__
    return self._execute_and_instances(context)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 3349, in _execute_and_instances
    result = conn.execute(querycontext.statement, self._params)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 988, in execute
    return meth(self, multiparams, params)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/sql/elements.py", line 287, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1107, in _execute_clauseelement
    distilled_params,
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1248, in _execute_context
    e, statement, parameters, cursor, context
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1466, in _handle_dbapi_exception
    util.raise_from_cause(sqlalchemy_exception, exc_info)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 399, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1244, in _execute_context
    cursor, statement, parameters, context
  File "/usr/lib/ckan/default/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 550, in do_execute
    cursor.execute(statement, parameters)
OperationalError: (psycopg2.OperationalError) SSL error: decryption failed or bad record mac
any ideas? only happens sometimes
smells like a regression of ckan/ckan#3243
Mandana Moshref
@MandanaMoshref
Hi all, what is the reason API package_show() does not show the tracking summary?
https://github.com/ckan/ckan/blob/abfda8b401ec370c9c74fc67678dcb38f8c72a26/ckan/logic/action/get.py#L989
Is there any reason that include_tracking is set to False and it is not possible to expose it via a configuration attribute?
gallexme
@gallexme
@MandanaMoshref u can add tracking by adding to the api call include_tracking=true
10 replies
gallexme
@gallexme
ckan/ckan#5673 seemst o be a known bug
1 reply
@MandanaMoshref
Feng Hui-Chun
@foxhoundsk

Hi, I'm dealing with locale stuff. After putting the newly compiled ckan.mo (compiled with poedit) to corresponding path of my locale (ckan/i18n/zh_TW/LC_MESSAGES/ckan.mo), and have the locale settings in the config file settled (ckan.locale_default = zh_TW and ckan.locales_offered = en zh_TW), I still can't get proper translated CKAN page (<SITE_URL>/zh_TW/), i.e. the page is still in English.

Is there anything I've missed?

However, locales like ko_KR which I've never compiled before can be used directly by visiting <SITE_URL>/ko_KR/.

Thanks!

Ian Ward
@wardi
@foxhoundsk ckan/ckan#6008 seems related
Feng Hui-Chun
@foxhoundsk

@wardi Thank you! I can now visit Chinese page normally. Just curious, after done cp-ing the mentioned directories (zh_CN -> zh_Hans_CN and zh_TW -> zh_Hant_TW) and pip install . in the ckan dir., I got following error:

File "/usr/lib/ckan/default/lib/python3.8/site-packages/ckan/lib/i18n.py", line 354, in _build_js_translation
    with open(dest_filename, u'w') as f:
PermissionError: [Errno 13] Permission denied: '/usr/lib/ckan/default/lib/python3.8/site-packages/ckan/public/base/i18n/zh_Hans_CN.js'

I get this fixed by simply copy the zh_CN.js (which was in the same directory) to zh_Hans_CN.js (so does the TW one).

Is there a way to generate these .js files properly?

Thanks!

Jari Voutilainen
@Zharktas
@foxhoundsk that has been a long stading issue that .js translation directories are on wrong permissions
you can fix it by giving write permissions or changing the owner of that directory to web server user
Ian Ward
@wardi
js translations are being sent to the wrong directory, we shouldn't be generating files at run time that write into source directories. We should use a directory that we use for uploaded files instead