These are chat archives for getredash/redash

29th
Jul 2015
Bryan HUANG
@bryan-huangyan
Jul 29 2015 01:42
Hi ALL! any solution for using spark sql as data source? thanks
Arik Fraimovich
@arikfr
Jul 29 2015 05:19
@jcox92 do you want this to avoid the need for managing another set of credentials, or each user has its own permissions for Redshift? If it's the first, it should be quite easy to implement. If it's the later, then it's more complex, because currently all users have the same level of access to the datasources.
@eschultze I'm using PushBullet mainly to mirror notifications from my phone to my computer. I'm hoping to make the alert destination pluggable, so people can use different types of services (like HipChat, Slack & Pushbullet), but don't have design in mind. As a temporary solution, we can implement webhooks in re:dash, and then the bridge to PushBullet can be a webhook recipient.
@bryan-huangyan currently it's not supported, but if there are python bindings for Spark, it shouldn't be too complicated to implement.
j0t3x
@j0t3x
Jul 29 2015 06:46
@arikfr the queries are stuck on query in queue message
Arik Fraimovich
@arikfr
Jul 29 2015 06:47
@j0t3x and it's only some of the queries, not all of them, right?
j0t3x
@j0t3x
Jul 29 2015 06:48
I think now is all of them
Arik Fraimovich
@arikfr
Jul 29 2015 06:49
I see. Can you try the following:
  1. Stop celery: sudo supervisorctl stop redash_celery (celery might take some time to stop, if it’s in the middle of running a query)
  2. Flush redis: redis-cli flushdb
  3. Start celery: sudo supervisorctl start redash_celery
j0t3x
@j0t3x
Jul 29 2015 06:54
Same result all queries in queue
Arik Fraimovich
@arikfr
Jul 29 2015 06:54
do you have scheduled queries?
j0t3x
@j0t3x
Jul 29 2015 06:56
yes
Arik Fraimovich
@arikfr
Jul 29 2015 06:57
maybe now they're being executed and your queries in fact in queue? can you share a screenshot of /admin/status?
j0t3x
@j0t3x
Jul 29 2015 07:02
This message was deleted
but this behavior has 1 week or more
blob
Arik Fraimovich
@arikfr
Jul 29 2015 07:06
remind me: only the bigquery queries get stuck? the mongodb ones work?
or now all of them not working?
j0t3x
@j0t3x
Jul 29 2015 07:10
Only big query , just confirmed it
Arik Fraimovich
@arikfr
Jul 29 2015 07:10
can you check the celery log (/opt/redash/logs/celery_error.log) and see if there is anything related there?
j0t3x
@j0t3x
Jul 29 2015 07:24
It says theres an error with a query very recently
Arik Fraimovich
@arikfr
Jul 29 2015 07:26
what's the error?
j0t3x
@j0t3x
Jul 29 2015 07:27
[2015-07-29 06:53:18,868: ERROR/MainProcess] Task redash.tasks.execute_query[377e84d3-8b26-41db-b969-5289d5005374] raised unexpected: Exception('{\n "error": {\n  "error$
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/celery/app/trace.py", line 240, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/opt/redash/redash.0.6.4.b926/redash/tasks.py", line 23, in __call__
    return super(BaseTask, self).__call__(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/celery/app/trace.py", line 437, in __protected_call__
    return self.run(*args, **kwargs)
  File "/opt/redash/redash.0.6.4.b926/redash/tasks.py", line 276, in execute_query
    raise Exception(error)
Exception: {
 "error": {
  "errors": [
   {
    "domain": "global",
    "reason": "invalidQuery",
    "message": "Field 'thing' not found.",
    "locationType": "other",
    "location": "query"
   }
  ],
  "code": 400,
  "message": "Field 'thing' not found."
 }
}
Arik Fraimovich
@arikfr
Jul 29 2015 07:28
did you query for something with "thing"?
j0t3x
@j0t3x
Jul 29 2015 07:29
yeah
Arik Fraimovich
@arikfr
Jul 29 2015 07:29
and did you get an error message in the UI or it's still "query in queue"?
j0t3x
@j0t3x
Jul 29 2015 07:29
just query in queue
hmmmmmm @arikfr it seems that everything is working now
Arik Fraimovich
@arikfr
Jul 29 2015 07:35
maybe after the restart and flush, your workers been busy with running scheduled queries
depends on your load, and instance size, you might want to change number of workers
Bryan HUANG
@bryan-huangyan
Jul 29 2015 08:22
@arikfr thanks a lot, will try python
Josh Cox
@jcox92
Jul 29 2015 13:56
@arikfr primarily the first one for the time being
Arik Fraimovich
@arikfr
Jul 29 2015 14:46
@jcox92 in that case it shouldn't be more than a few hours of work to add authentication against redshift. although if you're using google apps, it should be really easy to use it too (unless you don't want everyone to be able to login to redash).