Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • 21:51
    ShaheedHaque commented #7925
  • 19:20

    thedrow on master

    Added integration test: test_al… (compare)

  • 19:19
    thedrow closed #7931
  • 17:27
    Nusnus commented #7932
  • 17:25
    Nusnus closed #7932
  • 17:25
    Nusnus commented #7932
  • 17:23
    Nusnus opened #7932
  • 16:51
    codecov[bot] commented #7931
  • 16:49
    codecov[bot] commented #7931
  • 16:47
    codecov[bot] commented #7931
  • 16:46
    codecov[bot] commented #7931
  • 16:46
    codecov[bot] commented #7931
  • 16:44
    codecov[bot] commented #7931
  • 16:44
    codecov[bot] commented #7931
  • 16:43
    codecov[bot] commented #7931
  • 16:43
    codecov[bot] commented #7931
  • 16:42
    codecov[bot] commented #7931
  • 16:41
    codecov[bot] commented #7931
  • 16:39
    codecov[bot] commented #7931
  • 16:39
    codecov[bot] commented #7931
AnselmoCampanas
@AnselmoCampanas:libera.chat
[m]
in the example from the docs does not import any "app": https://docs.celeryq.dev/en/latest/userguide/tasks.html
AnselmoCampanas
@AnselmoCampanas:libera.chat
[m]
ok, I figured it out
Coop56
@Coop56:libera.chat
[m]
Hello. I'm trying to integrate Celery with SQS using ElasticMQ locally. I have everything setup and I am posting messages to my local SQS server via Postman. Celery is picking those tasks up, but erroring out. (https://gist.github.com/Coop56/461c7eea2c14c6316f6ca0d872df42dc) I've tried adding Content-Type header but that isn't solving the issue. Any ideas?
Coop56
@Coop56:libera.chat
[m]
Scratch that I think I might see the issue.
Coop56
@Coop56:libera.chat
[m]
Yeah, I had to add content-type and content-encoding directly into the body of the message I was posting not as a header.
diego_castro
@diego_castro:libera.chat
[m]
Hi everyone! I see the last change of the django-celery-beat project was 20 days ago. I'm specially interested in a couple of pull requests so I was wondering myself how bussy are you to check them out
najtsirk
@najtsirk:libera.chat
[m]
Hi, i have a chord: a_chord = chord(a.s(i) for i in range(100))(b.s()). I store the a_chord id to db. Chord is long runnning. How can i terminate tasks based on a a_chord.id? I tried instantiating AsyncResult and GroupResult but no success
AnselmoCampanas
@AnselmoCampanas:libera.chat
[m]
I can't connect celery with rabbitmq, the following error occurs: "ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672/myvhost: [Errno 61] Connection refused."
hi everyone!
I'm running rabbitmq from a docker container
what an idiot, I was not exposing the ports in the docker container
SpAwN_gUy
@SpAwN_gUy:libera.chat
[m]
hello. i have a question about current state of celery 5:) we are on celery4 with celery_pool_asyncio to run some async/await code in the background (it is combined with fastapi and all the async goodies). i started reading about Trio and how it is asyncio-ish. but it is a lot of reading or testing. my question is: can someone describe the
current status of running async code/tasks with celery5?
will it be a "simple" migration or will we need to rewrite a lot of code?
stc
@stc:libera.chat
[m]
hi!
I'm trying to get periodic working. I start celery worker and celery beat, then celery shell and try to add a task: current_app.add_periodic_task(10.0, hello.s())
worker and beat log level are set to DEBUG, but I see no info related to my periodic task
stc
@stc:libera.chat
[m]
is there something I can try to debug?
Dejan
@Dejan:libera.chat
[m]
I wonder are there people/companies would would pay for the improvements in Celery needed to support latest AMQP, so that we can finally use AWS AMQ for an example as broker...
mikenerone
@mikenerone:matrix.org
[m]
Just to follow up: I eventually realized that there is no need for revocation because each chained task is actually not even scheduled until the previous task has finished. At least now I have a better understanding.
mar77i
@mar77i:libera.chat
[m]
ugm
we have this rather elaborate status checking thing to prove that our systems are all up and ready. for celery workers, we use the app.control.ping() mechanism. A couple of minutes ago I discovered that somehow our web worker would get an empty reply [], and when I opened a python prompt and called app.control.ping(), the expected pong was there. is there a way I can make sure there's a viable connection from my web worker process?
Hassan01
@Hassan01:libera.chat
[m]
hey
I'm running celery like this : celery -A c_train worker --max-tasks-per-child=20 --pool=prefork --concurrency=4 --loglevel=info
but for whatever reason sometimes I can run tasks and sometimes I get Received unregistered task of type 'c_train.train_project'.
same task, sometimes it works, sometimes it doesn't
I'm using redis broker if that helps : app = Celery('c_train', broker='redis://localhost')
coolacid
@coolacid:libera.chat
[m]
Hey group. With RabbitMQ, I'm creating a dynamic queue using the add_consumer control with a custom queue. This creates the exchange/queue and attaches workers to the queue as expected. Once tasks are done, I call the cancel_consumer and the worker drops as a consumer. This has worked wonders for months. However, this leaves a number of exchanges/queues dangling and looking for suggestions to clean that up.
Note: Setting auto_delete in the options to add_consumer attempts to create the exchange/queue, but there is a miss-match for auto_delete between the two and doesn't work.
Hassan01
@Hassan01:libera.chat
[m]
hey, anyone around?
Hassan01
@Hassan01:libera.chat
[m]
ah nvm the docker container started two celery processes
frague
@frague:libera.chat
[m]
Hi guys - I've a shared_task in my django app which does not start - NotRegistered(<my_task>) - I've tryed to use the CLI, with same result
I've other tasks registered the same way which works great, but I'm stuck with this one
Have you any ideas ?
I'm using celery 4.4.7 + django 2.2.28 + django-celery-beat 1.6.0 + django-celery-results 1.2.1
François GUÉRIN
@frague59_gitlab
I'm using Redis as broker (if relevant)
Guest624
@Guest624:libera.chat
[m]
oli oli oli oi oi oi
stu
@stu:libera.chat
[m]
Hi all, when I run celery inspect conf I get KeyError('No such transport: https') any idea what could be up ?
broker_url is set to redis://0.0.0.0:6379/1
captain_morgan
@captain_morgan:libera.chat
[m]
stu two things.... at a guess, that error and URL are unrelated, error complains of https: and the config clearly has redis: second; 0.0.0.0 isn't a valid address to connect to, 0.0.0.0 tell a service to listen on all available addresses
I'd fix the second part first, it could be confusing celery so bad it throws that seemingly unrelated error
url_broker should be more like redis://127.0.0.1:6379/1
assuming celery and redis are running on the same system
Baochr_
@Baochr_:libera.chat
[m]
Good morning, everyone! There's a problem I can't solve. Can you help me?
I use redis as a broker, after running for a while the number of clients connections to redis will exceed 10000 max, and the task is not automatically disconnected after completion?
lxsameer
@lxsameer:libera.chat
[m]
hey folks, is it possible to print out the stack trace of an exception in celery?
Asif Saif Uddin
@auvipy
Rishab Sanyal
@rishsanyal

Hey team, I had a question about building the celery code using docker-compose locally. I keep getting version conflicts while building the container.

    The user requested kombu 5.3.0a1 (from git+https://github.com/celery/kombu.git)
    The user requested kombu 5.3.0a1 (from git+https://github.com/celery/kombu.git)
    The user requested kombu 5.3.0a1 (from git+https://github.com/celery/kombu.git)
    celery 4.4.0 depends on kombu<4.7 and >=4.6.7
To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict
All I'm doing is building the container using `docker-compose build celery`. Could someone tell me what I might be doing wrong?

Also, if this is the wrong area to ask, I apologize in advance. Please point me to the right platform for my question

Rob Percival
@RJPercival
Hi all, I was just looking at the code that handles tasks with rate-limiting and ETAs and had a question for someone that is familiar with this. It appears that the prefetch limit is incremented if the task has an ETA, but not if it is rate-limited - why is that?