Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    Mickaël CASSY
    @Micka33
    Hi!
    If you need help getting started with webscrapper or don't understand how to solve a scrapping issue on a website, contact me here or send me a PM!
    Mickaël CASSY
    @Micka33

    info

    Currently working on V2 , bringing the following improvments:
    • ability to run dataworker.js between each iteration of scrapper.js
    • performance improvement when scrapping hundreds of pages
    • ability to schedule projects to run
    • new format for URLS.json
      {
      "https://my/url/": [
       ...jsondata...,
       ...jsondata...,
      ],
      ...
      }
      //here "https://my/url/" will be run twice with ...jsondata... directly passed to scrapper.js
    Mickaël CASSY
    @Micka33

    info

    V2.0.1 is under review by the Chrome Web Store, It fixes a critical bug present only in V2 projects. This bug prevented V2 projects to run at all.
    Mickaël CASSY
    @Micka33

    info

    V2.0.1 is approved by the Chrome Web Store.
    PavitKaur05
    @PavitKaur05
    Hello My name is Pavit Kaur and I have no experience with webscraping but I am interested to learn. So can I get a suggestion regarding beginning with web scraping and what new ideas or project I can work upon?
    Mickaël CASSY
    @Micka33
    Hi @PavitKaur05, A good way to get started is to try scrapping a product website.
    Just choose an e-commerce website and I can help you get started.
    @PavitKaur05 just PM me.