Hello 👋🏼 may be a long shot as it's awfully quiet in here... I'm looking to either dynamically add urls to be scraped at runtime based on other urls or manipulate the url / filename of a resource in-flight. To give some context. Sites I'm scraping have rss at for example:
https://site.com/author/jim/rss but they are linked to using feedly so teh href looks something like
https://feedly.com/something/https://site.com/author/jim/rss in the pages html. Currently the urlFilter doesn't scrape feedly (which is desired) but I would like to extract that url and add it to the queue of resources to be scraped.
Is there a sane way to achieve this? Plugins for
generateFileName ? 🤔