Distributed Works/dkron

amitdaalwal

@amitdaalwal

Thanks Victor, fopina. By default i see one server and agent is up. I tried to run "docker-compose up --scale dkron-server=3" when refresh the dashboard still there is single server and single agent. I would like to spin up more nodes or server when there is more load. Not on K8.

amitdaalwal

@amitdaalwal

ok got it i added dkron along with dkron server, dkron agent in my compose. now i can scale. Is there any options i can create Jobs under PROJECT A , PROJECT B for quick filter

Victor Castell

@vcastellm

@amitdaalwal there is no concept of projects in Dkron, I usually use prefixes to the jobs project1-job1

amitdaalwal

@amitdaalwal

Will use as mentioned. Thanks Victor

amitdaalwal

@amitdaalwal

at present i got a singlevm with two dkron servers in docker. I have cronjobs 100 for downloads files with cpu intensive tasks. Is it best to run this inside dkron dockr agent or in vm as systemd dkron agent. Dont see any option to autoscale based on cpu unless shell script. Any suggestions.

amitdaalwal

@amitdaalwal

Hi i have a volume mount in compose. when i do compose down loosing all jobs. on latest version. saw this issues but dont find the issue here.

amitdaalwal

@amitdaalwal

my compose file, what i am missing here. loosing all jobs when doing down. https://privatebin.net/?72f7e679a5ef28d4#iSAfBMRnhxhCmPpCHJfsmUWvuciJBgdRBAu673SkEPg

Victor Castell

@vcastellm

New React admin based UI released in v3.1.0, let me know if you like it

Filipe Pina

@fopina

Tried to pull the image yesterday on my swarm, but it wasn’t available, seems it still isn’t :/

Victor Castell

@vcastellm

@fopina The release build failed at the docker build step for some reason, I'm building and pushing by hand

done

Filipe Pina

@fopina

@victorcoder funny thing: running test runForElection on my Mac (not docker) kills it and requires reboot!

Victor Castell

@vcastellm

wtf! that is really weird

Charlie

@zhouchunli

hi, is there anybody tell me how to deploy dkron in k8s?

Charlie

@zhouchunli

could dkron support broadcast?

Victor Castell

@vcastellm

@zhouchunli for using Kubernetes you could try using something provided here distribworks/dkron#704

@zhouchunli what do you mean "broadcast"?

amitdaalwal

@amitdaalwal

Hi i have setup a job for downloads hourly i see the next same job is starting before completing the current one. its causing the rest of same jobs to keep running in queue. Is there any example config i can use to schedule the next hourly job only after sucessful execution of previous one

Filipe Pina

@fopina

you can “hack” around by using the API to update the job itself but maybe if you disable allow_concurrent it will behave as you’d like (if new schedule comes while the other is still running, it’s ignored)

Ariel Orozco

@arielcr

Hi! Is it possible to add a Dkron installation on my own docker-compose.yml file? Will this work?

  dkron:
    container_name: dkron
    image: dkron:latest
    ports:
      - 8086:8086
    command: dkron agent --server --log-level=debug --bootstrap-expect=1
    networks:
      - mynetwork

RyanHuang1102

@RyanHuang1102

anyone can check this issue? please git me a hint
distribworks/dkron#940

Victor Castell

@vcastellm

@arielcr take a look to the included compose file in the repo https://github.com/distribworks/dkron/blob/master/docker-compose.yml#L13-L21, but for single node it looks like it will work

@RyanHuang1102 I will respond in GH

amitdaalwal

@amitdaalwal

Hi
i am using dkron 3.0.x. Got dkron server on VM1(docker), dkron agent on VM1(dkron service), dkron agent on VM2(dkron service). I have two issues i came across.

whenever my vm1 reboots - dkron server , agent on VM1 comes back online with leader, but my dkron agent on VM2 dont display in dkron dashboard unless i restart the dkron service on vm2. Ip address of dkron server is static always.
Monitoring: I have enabled prometheus on all dkrons servers agents. How can i monitor if any of the agent or leader is down?
I dont see any specific filed in metrics saying leader or agent in prometheus metrics.

Any suggestions please. Thanks

amitdaalwal

@amitdaalwal

@victorcoder can you please suggest what i am missing here. Thanks

Filipe Pina

@fopina

@victorcoder just saw that shell executor is becoming built in in v4, awesome! when can we expect that release?:)

1 reply

Joshua Shubakar Noel

@joshshn

@victorcoder does dkron basic support email/webhook notifications? The basic configuration.yaml mentions this but I dont seem to get it to work. Does it require the email/slack processor provided by Dkron Pro?

# webhook-url: https://hooks.slack.com/services/XXXXXX/XXXXXXX/XXXXXXXXXXXXXXXXXXXX
# webhook-payload: "payload={\"text\": \"{{.Report}}\", \"channel\": \"#foo\"}"
# webhook-headers: Content-Type:application/x-www-form-urlencoded
# mail-host: email-smtp.eu-west-1.amazonaws.com
# mail-port: 25
# mail-username": mailuser
# mail-password": mailpassword
# mail-from": cron@example.com
# mail-subject_prefix: [Dkron]

7 replies

Sergii Ivannikov

@mcsa2003

Hello.
Can somebody help me.
I try to use query string to filter output api call of executions(like this /v1/jobs/mysql_hourly_bck/executions?_end=25&_order=DESC&_sort=id&_start=0), but it not work
No matter what I set _end=25 or _end=1, I am always get all data.

7 replies

Sergii Ivannikov

@mcsa2003

is there any way to get job name from the running job?
is there any way to send some data to job, when executing it throw api post call (/jobs/{job_name})?

smullins3000

@smullins3000

I have a dumb newbie question. I'm running dkron on localhost from the docker image (version 3.1.8).
I can hit the API but how do I hit the swagger UI on the localhost? I've tried a number of things (e.g. http://localhost:8080/v1/swagger.json) but all I get is a 404. @victorcoder

1 reply

Akash Ashok

@thehellmaker

Hi Guys, I have a few questions regarding what dkron supports. I am planning to install dkron for an iot schedule where users will set schedules saying at 6:00 AM turn on light etc... One of the main requirements of this is lets say there is a schdule at 6:00 PM GMT everyday abd for some unforseen circunstances dkron service is down (could be EC2 got replaced or dkron itself had a downtime because of upgrade etc....) then 6:00PM trigger got missed. Does dkron as a service keep track of missed schedules and execute them when the service comes up ?

Filipe Pina

@fopina

@thehellmaker if you have server split from agents and only agents are down, server will log the jobs that failed to start during agents down time (but not restart them). If the server itself is down then nothing is scheduling jobs.

I guess its possible to go through jobs, check their last execution and schedule and see which ones missed it but executing those jobs when server/agents are available again without review wouldnt make much sense in a generic approach.. ie: turn lights on at 9PM fails and servers come back next day at 8AM, lights no longer need to be turned on..

1 reply

Filipe Pina

@fopina

One thing i only started to use recently @thehellmaker was retries and it was pretty well for instant downtime (such as updating agents with running jobs), as the new attempt will land on a new agent. I guess those jobs do need to be atomic or reentrant though (turn on light is)

Long

@Lunarhalos

Why not initialize the reconcileCh channel?

Nir

@nirbd

Hi ,
I cannot find how to change the UI port from 8080 ... please advise... Much appreciated

Nir

@nirbd

Never mind. found it --http-addr=':8081'

Nir

@nirbd

Hi.
Couple of questions:
I've set up Dkron in aws env using sudo dkron agent --tag my_role=role1 --retry-join "provider=aws region=eu-west-1 access_key_id=XXX secret_access_key=YYY tag_key=dkron tag_value=join"

It seems to work but when the dkron server instance is terminated and a new one starts the jobs are lost. I thought the jobs data is kept in nodes so it should recover them?
If not - how can I save the jobs in db to make sure it continues them if the dkron node dies?
Where are the logs of cron results kept? Is it stored in local storage? I need to make sure it wont eat disk space and finally fill the instance storage. Is there some contron on how much data is kept ?

5 replies

Nir

@nirbd

Hi,
I started working with Dkron but whenever I try to save edits to jobs it doesnt update them or partially update.
Foe example I try to add item to json of executer such as 'shell'=>true
It is added in the UI. And when saving it says element updated but when checking back it didnt update.
I'm running two server nodes

zen3456

@zen3456:matrix.org

[m]

I am trying to create my first job in Dkron and when i save, it save internal server error and does not give much details. can anyone help me?

1 reply

Mlungisi Jali

@msincuba:matrix.org

[m]

Hi I'm trying to deploy dkron to Azure App Service but getting error: Failed to load container logs: Resource containerlog of type text not found

Kevin Knoepp

@kevink

Hi, brand new user and I have a few questions:

In a cluster does dkron do any load balancing or will it just randomly pick one node to run a job on?
Is there are way to clear the Success Count, Error Count, Last Success and Last Error values?
I set up a test cluster with three nodes in HA mode. When I run a test job it will pick one node and run three times on that node. Any idea why?

7 replies

Ariel Orozco

@arielcr

Hi, I'm running 3 dkron nodes using docker-compose like this:

dkron:
    container_name: teamprovement_dkron
    image: dkron/dkron:v3.1.10
    ports:
      - 8083:8080
      - 8946
      - 6868
    environment:
      - GODEBUG=netdns=go
    volumes:
      - ./volumes/dkron/:/dkron.data
    command: agent --server --log-level=debug --bootstrap-expect=1 --data-dir=/dkron.data --node-name=avantrack
    networks:
      - avantracker

  dkron-server:
    container_name: teamprovement_dkron_server
    image: dkron/dkron:v3.1.10
    ports:
      - 8080
      - 8946
      - 6868
    environment:
      - GODEBUG=netdns=go
    command: agent --server --retry-join=dkron:8946 --log-level=debug --bootstrap-expect=3 --node-name=avantrack-server
    networks:
      - avantracker

  dkron-agent:
    container_name: teamprovement_dkron_agent
    image: dkron/dkron:v3.1.10
    ports:
      - 8946
      - 6868
    environment:
      - GODEBUG=netdns=go
    command: agent --retry-join=dkron:8946 --log-level=debug --tag agent=true --node-name=avantrack-agent
    networks:
      - avantracker

All of them start fine, but after a couple of hours I get level=fatal msg="dkron: failed to establish leadership" error="cron is already configured, can not start scheduler" Any help please?

linuxer91

@linuxer91:matrix.org

[m]

Hi, I use dkron for 6 month, but I have question how to create schedule for every server boot/reboot. Usualy on crontab I use is “@reboot”. How to use at dkron?

1 reply

linuxer91

@linuxer91:matrix.org

[m]

so how to use @reboot instead of in dkron ?
so dkron still doesn't support job schedule @reboot ?

1 reply

Nir

@nirbd