Hey guys. Not sure if this is the right place to ask what I suspect is an easy question for those in the know. JUst installed the repo with a view to using it to watch for changes on webpages. But having a struggle working out what to put where in the website agent. Managed the URL but looking to monitor the bulk of the page for changes. This is way out of my usual comfort zone so be gentle ...please :)
Hi guys. Having a good time with Huginn lately but struggling with the IMAP agent. It scans alright and sees how many emails are in the folder, but doesn't seem to pick anything up based on the Conditions (per this one, looking for any containing the word "call" in the subject). I've tried with case sensitive/insensitive tags. Any ideas? Thanks in advance!
I've had glitches where a single formatting agent stopped the entire pipeline, but it seems like now it isnt even running the agentsa
Thanks, I'm realizing that I may be stuck unless I craft a new agent. I do have another question, I have a number coming in from an API request that I'd like to format as a currency/money via liquid. In my tests, it looks like those filters aren't implemented/available? Or am I missing something.
Depending on what you want to do, you can go pretty far with just the
round Liquid tag. Unless you want to do something more complex?
Been plugging away trying to improve my knowledge on this. From a particular site I managed to get ""date": "<td>10/07/2020</td>\n"," using the css "//table[@class='decisionrepeater']/tr/td[1]". Is ther eany way to strip out the tags etc and just leave the date? CAn I do this in the website agent or do I need to use another process before posting the result elsewhere? Thanks.
Also wonderign how I can extract the number after RowOnClick in this "</tr><tr onmouseover="this.tmp = this.style.backgroundColor; this.style.backgroundColor='#cccccc'" onmouseout="this.style.backgroundColor = '#ffffff'" onclick="RowOnClick('11735');" style="cursor: pointer;">". I've tried substring but can't get it to work at all probably as I've little idea s to what I'm doing as you can likely tell!)
I'm deploying huginn with this
version: '2'
services:
huginn:
container_name: huginn
networks:
- main
image: huginn/huginn-single-process
restart: always
env_file:
- ./huginn/mysql.env
- ./huginn/secrets.env
threaded:
image: huginn/huginn-single-process
networks:
- main
command: /scripts/init bin/threaded.rb
restart: always
env_file:
- ./huginn/mysql.env
- ./huginn/secrets.env
depends_on:
- huginn
networks:
main:
driver: bridgeEvery morning at 8am pst tons of resources seems to get used, I logged into the docker images but can't seem to find the logs. What directory is it in?
For all of my agents, I run them at 2am in the middle of the night, but I am noticing in the AgentRunScheduleJob enqueueing things at weird times
[ActiveJob] Enqueued AgentRunScheduleJob (Job ID: 7ca30795-a1b8-41ac-9d2f-b705d20e74b4) to DelayedJob(default) with arguments: "every_2h"
Queuing schedule for 8am
[ActiveJob] Enqueued AgentRunScheduleJob (Job ID: 746f2601-d8f8-4119-abcc-666bad62678a) to DelayedJob(default) with arguments: "8am"
2020-07-21T08:00:08-0700: [Worker(host:c7f63f9e7430 pid:1)] Job AgentRunScheduleJob [3b67878b-557f-413f-8788-d19cc9d43575] from DelayedJob(default) with arguments: ["every_10m"] (id=277248) (queue=default) RUNNING
[ActiveJob] [AgentRunScheduleJob] [3b67878b-557f-413f-8788-d19cc9d43575] Performing AgentRunScheduleJob (Job ID: 3b67878b-557f-413f-8788-d19cc9d43575) from DelayedJob(default) enqueued at 2020-07-21T15:00:02Z with arguments: "every_10m"
[ActiveJob] [AgentRunScheduleJob] [3b67878b-557f-413f-8788-d19cc9d43575] Performed AgentRunScheduleJob (Job ID: 3b67878b-557f-413f-8788-d19cc9d43575) from DelayedJob(default) in 0.96ms
2020-07-21T08:00:08-0700: [Worker(host:c7f63f9e7430 pid:1)] Job AgentRunScheduleJob [3b67878b-557f-413f-8788-d19cc9d43575] from DelayedJob(default) with arguments: ["every_10m"] (id=277248) (queue=default) COMPLETED after 0.0088
2020-07-21T08:00:08-0700: [Worker(host:c7f63f9e7430 pid:1)] Job AgentRunScheduleJob [6560c76b-9d46-4dcd-af29-e5bcfc946955] from DelayedJob(default) with arguments: ["every_30m"] (id=277249) (queue=default) RUNNING
[ActiveJob] [AgentRunScheduleJob] [6560c76b-9d46-4dcd-af29-e5bcfc946955] Performing AgentRunScheduleJob (Job ID: 6560c76b-9d46-4dcd-af29-e5bcfc946955) from DelayedJob(default) enqueued at 2020-07-21T15:00:02Z with arguments: "every_30m"
[ActiveJob] [AgentRunScheduleJob] [6560c76b-9d46-4dcd-af29-e5bcfc946955] Performed AgentRunScheduleJob (Job ID: 6560c76b-9d46-4dcd-af29-e5bcfc946955) from DelayedJob(default) in 1.23ms
2020-07-21T08:00:08-0700: [Worker(host:c7f63f9e7430 pid:1)] Job AgentRunScheduleJob [6560c76b-9d46-4dcd-af29-e5bcfc946
955] from DelayedJob(default) with arguments: ["every_30m"] (id=277249) (queue=default) COMPLETED after 0.0141
2020-07-21T08:00:08-0700: [Worker(host:c7f63f9e7430 pid:1)] Job AgentRunScheduleJob [4b89e30f-8ec6-4064-8e60-a97c5abe232f] from DelayedJob(default) with arguments: ["every_1h"] (id=277250) (queue=default) RUNNING
[ActiveJob] [AgentRunScheduleJob] [4b89e30f-8ec6-4064-8e60-a97c5abe232f] Performing AgentRunScheduleJob (Job ID: 4b89e30f-8ec6-4064-8e60-a97c5abe232f) from DelayedJob(default) enqueued at 2020-07-21T15:00:02Z with arguments: "every_1h"
[ActiveJob] [AgentRunScheduleJob] [4b89e30f-8ec6-4064-8e60-a97c5abe232f] Performed AgentRunScheduleJob (Job ID: 4b89e30f-8ec6-4064-8e60-a97c5abe232f) from DelayedJob(default) in 2.41msIs there any reason why things are being queued at times what I didn't specify in the UI, and why other things are appearing like every_1h, etc?
In my agents, I don't have anything set with args of
every_Xm
1 reply
if it helps, the code I currently have is:
{
"post_url": "https://discordapp.com/api/webhooks/EDITED",
"expected_receive_period_in_days": "1",
"content_type": "json",
"method": "post",
"payload": {
"content": "{{title}}",
"url": "{{url}}"
},
"emit_events": "true",
"no_merge": "true"
}
Can anyone point me to a solution, please! I need to pass some parameters through the WebsiteAgent - e.g. 'URL' and 'title'. But unless I put those into 'extract' they're not passed. And 'extract' requests I use css - but I just want to pass them through!
This code doesn't save - so what do I do?
"expected_update_period_in_days": "1",
"url": "{{content | strip_newlines | regex_replace: '\\<A HREF=\\x22(.+?)\\x22.*','\\1'}}",
"type": "html",
"mode": "all",
"extract": {
"url": {
"value": "{{{url}}}"
},
"title": {
"value": "{{{title}}}"
},
"body_text": {
"css": "body",
"value": "string(.)"
}
}
}
Hmm.
I don't think Delay Agent has that granularity. The fastest an agent can fire is every minute.
That's an interesting use case, though... I wonder how hard it would be to retrofit it into the Delay Agent. Something like, "Every time this agent runs, it will emit one event from its queue every five seconds, and cleanly terminate when its queue is empty or when its runtime is up."
Hi guys, I'm a bit new to Huginn; and I've been able to successfully deploy Huginn on Heroku. I need help with Website Agent; especially scraping HTML/CSS content. I would like to monitor, let's say, the page https://www.python.org/downloads/ and the HTML path that I would like to extract is <a class="button" href="https://www.python.org/ftp/python/3.8.5/python-3.8.5.exe">Download Python 3.8.5</a>
How do I proceed?
Specifically, I would like to monitor when the text 'Download Python 3.8.5' changes to 'Download Python x.x.x'. Could someone please guide me?
Hey all, is there a way to make 'Website Agent' post an HTML copy of a page at a particular location? I've tried a couple of options and I don't seem to be able to do this.
Not a very active dev community and really difficult documentation. Definitely not an IFTTT replacement. I'm calling it quits guys on this.