These are chat archives for getredash/redash

29th
Aug 2016
HenroRitchie
@HenroRitchie
Aug 29 2016 11:18
Hi All. I am getting this error: Error running query: unknown error occurred. Please try again later. every hour or so and restarting the server seems to be the only solution.
I will be looking at the log files to troubleshoot in the mean time.
Alex Aslanoglou
@AlexAslan
Aug 29 2016 12:36
Hi to all. At version 0.10.1+b1836 (installed from bitnami image in a gce) after having scheduled almost 60+ queries when I try to update them manually nothing is sent to the DB for execution. I` ve done a FLUSHDB in redis some days ago in order to clear some stuck queries in the queue. Any ideas?
Arik Fraimovich
@arikfr
Aug 29 2016 12:39
@HenroRitchie where/when are you getting this? in the logs? ui?
@AlexAslan when you try to run them, you get "query in queue..."?
Alex Aslanoglou
@AlexAslan
Aug 29 2016 12:51
I get the classic query in queue and the time counter but in the system status view (as well as the db logs) the query is not sent
Arik Fraimovich
@arikfr
Aug 29 2016 12:59
it's probably "locked", but it shouldn't happen often or to all queries. what kind of database do you connect to?
Alex Aslanoglou
@AlexAslan
Aug 29 2016 13:00
Heroku Postgres...Yes it doesn't seem to happen to every query...I`ve tried restarting the worker, scheduler and redis (as well as flush redis)...Is there anything else I could try?
Arik Fraimovich
@arikfr
Aug 29 2016 13:22
can you run redis-cli keys "query_hash_job*"? how many results do you get?
Alex Aslanoglou
@AlexAslan
Aug 29 2016 13:33
It returns an empty list
Arik Fraimovich
@arikfr
Aug 29 2016 13:35
and redis-cli -n 1 keys "query_hash_job*"?
Alex Aslanoglou
@AlexAslan
Aug 29 2016 13:36
same thing
Arik Fraimovich
@arikfr
Aug 29 2016 13:37
that's weird
Alex Aslanoglou
@AlexAslan
Aug 29 2016 13:38
should I try a clean install and migrate the local db?
Arik Fraimovich
@arikfr
Aug 29 2016 13:38
if you run a random query like select 4484does it go into queue as well?
HenroRitchie
@HenroRitchie
Aug 29 2016 13:38
@arikfr In the dashboard when I refresh the widget
and when I refresh a bit later in then displays the graph again
Arik Fraimovich
@arikfr
Aug 29 2016 13:46
@HenroRitchie iirc, this message means it has a connection problem to your server (network issue or anything else).
Alex Aslanoglou
@AlexAslan
Aug 29 2016 13:47
@arikfr for some queries I get a result but for some others I dont...A random query will return a result, but a saved one will not update. I cant replicate in for which cases it happens and for which is not
HenroRitchie
@HenroRitchie
Aug 29 2016 13:48
could something with redis be a problem? I am using the standard redash image deployed to aws
Arik Fraimovich
@arikfr
Aug 29 2016 13:49
@HenroRitchie next time it happens open the browser console and check the error message there.
HenroRitchie
@HenroRitchie
Aug 29 2016 13:49
ok will do.
Arik Fraimovich
@arikfr
Aug 29 2016 13:49
@AlexAslan is there any query you don't get results at the moment?
Alex Aslanoglou
@AlexAslan
Aug 29 2016 14:11
@arikfr I figured it out finally...We had updated some rules in cloudflare so most of the queries the api/query_results POST request were considered as sql injection. So a "SELECT 1;" was ok but a more complicated one could not pass the waf rule...Thanks for the support ;)
Arik Fraimovich
@arikfr
Aug 29 2016 14:12
oh, wow. nice catch!
HenroRitchie
@HenroRitchie
Aug 29 2016 15:34
@arikfr I get the following error in the console. 500 (INTERNAL SERVER ERROR)(anonymous function) @ plugins.978f5b30.js:5m @ plugins.978f5b30.js:5l @ plugins.978f5b30.js:5c @ plugins.978f5b30.js:5c @ plugins.978f5b30.js:5(anonymous function) @ plugins.978f5b30.js:5$eval @ plugins.978f5b30.js:5$digest @ plugins.978f5b30.js:5$apply @ plugins.978f5b30.js:5(anonymous function) @ plugins.978f5b30.js:7dispatch @ plugins.978f5b30.js:2v.handle @ plugins.978f5b30.js:2
Arik Fraimovich
@arikfr
Aug 29 2016 15:35
@HenroRitchie now check /opt/redash/logs/api_error.log for why you got the 500 error.
HenroRitchie
@HenroRitchie
Aug 29 2016 15:38
MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk. Commands that may modify the data set are disabled. Please check Redis logs for details about the error.
going to Redis logs :smile:
Arik Fraimovich
@arikfr
Aug 29 2016 15:39
:) might be related to this: getredash/redash#1257
are you running low on memory?
HenroRitchie
@HenroRitchie
Aug 29 2016 15:41
Looks exactly like issue 1257
Do you use flask as the framework
Arik Fraimovich
@arikfr
Aug 29 2016 15:42
if I understand correctly what you mean, then yes
HenroRitchie
@HenroRitchie
Aug 29 2016 15:43
ok, I noticed flask references in the log files
Arik Fraimovich
@arikfr
Aug 29 2016 15:43
?
HenroRitchie
@HenroRitchie
Aug 29 2016 15:45
I am asking if you use flask as the framework because the log file references /flask/app.py in the error
Arik Fraimovich
@arikfr
Aug 29 2016 15:46
then yes
HenroRitchie
@HenroRitchie
Aug 29 2016 15:46
:smile:
Arik Fraimovich
@arikfr
Aug 29 2016 15:51
I'll be happy to know if the solution suggested in #1257 helps your situation.
HenroRitchie
@HenroRitchie
Aug 29 2016 15:53
I will feedback if I solve it
the redis log file gave the following hint - WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
so I am implementing and testing now
Arik Fraimovich
@arikfr
Aug 29 2016 15:54
:+1:
HenroRitchie
@HenroRitchie
Aug 29 2016 16:10
@arikfr is the auto refresh on when the button on the dashboard is blue?
Arik Fraimovich
@arikfr
Aug 29 2016 16:10
Yes.
HenroRitchie
@HenroRitchie
Aug 29 2016 16:10
:+1:
I have auto refresh set to 1min in the query and then enabled the auto refresh on the dashboard, but it does not seem to work. Is there anything else I need to look at?
Arik Fraimovich
@arikfr
Aug 29 2016 16:12
oh, right - there is a bug with this feature in the recent release :-( I fixed it but didn't push the fix yet
HenroRitchie
@HenroRitchie
Aug 29 2016 16:14
Ok, no worries. I'll wait for the next release. Are you now self employed working on the SaaS solution?
Arik Fraimovich
@arikfr
Aug 29 2016 16:15
yes :)
HenroRitchie
@HenroRitchie
Aug 29 2016 16:15
And are you succeeding in starting/running a successful setup?
Arik Fraimovich
@arikfr
Aug 29 2016 16:16
what do you mean by successful setup?
HenroRitchie
@HenroRitchie
Aug 29 2016 16:17
making a living and earning a salary? I've started my own startup May last year, and life's not always easy...
Arik Fraimovich
@arikfr
Aug 29 2016 16:20

oh, well it's definitely not easy and didn't go as planned (although I didn't expect it to). I started working on this full time in December (2015), in May I started paying myself minimum wage and in July I paid myself salary equivalent to ~35% of my previous salary... so starting from July I'm almost not using my savings anymore, which is nice.

Not all of the income is from the SaaS though, but most of it is.

HenroRitchie
@HenroRitchie
Aug 29 2016 16:22
I am feeling your pain... but you have a great product which should pay some nice dividends in future
Arik Fraimovich
@arikfr
Aug 29 2016 16:23
I sure hope so! Sometimes it's frustrating to know that huge companies use the product, while you barely make a living. But I managed to stay optimistic, and I definitely starting to see "the light" .
HenroRitchie
@HenroRitchie
Aug 29 2016 16:25
I can imagine. I think there is also a lot space to grow this in the Internet of Things arena, where dashboards are the way to go. We can have another chat 'offline' if you'd like some inputs
Arik Fraimovich
@arikfr
Aug 29 2016 16:26
I'm not sure Redash is a good fit for this kind of users, but we can definitely talk about it.
HenroRitchie
@HenroRitchie
Aug 29 2016 16:34
how do I contact you?
Arik Fraimovich
@arikfr
Aug 29 2016 16:34
@HenroRitchie arik at redash .io
HenroRitchie
@HenroRitchie
Aug 29 2016 16:36
Ok
Just by the way, it looks like the change redis advised is working
but I will test some more and confirm tomorrow
Arik Fraimovich
@arikfr
Aug 29 2016 16:37
:+1: