NickJS was great but it's over now π We recommend you use Puppeteer or Playwright instead
Are these messages important for your use-case or you just want to check?
and i think these message are useful for me in the future
Hello, is it easy to occurrence Man-machine verification when I use in google crawl
?
@Solr007 then go into the windows settings for environment variables like explained here https://www.computerhope.com/issues/ch000549.htm
@paps @Solr007 There's a little quirk when setting the env variable in Windows. You need to open a new command window for it to be recognized -- weird that. Found that answer at https://superuser.com/a/832962
hi i have tried nickjs but example always give error timeout, Something went wrong: Error: injection of script "http://code.jquery.com/jquery-3.2.1.min.js" timed out after 11036ms
A more general question, I'm trying to call tab.open() while passing in a header. I'm examining the request in Fiddler but I don't see my header being added to it. Here's the call I'm making:
var options = {headers: {"Accept-Language": "en-US,en;q=0.9"}}
await tab.open("https://www.google.com/", options)
var options = {headers: {"Accept-Language": "en-US,en;q=0.9"}}
await tab.open("https://www.google.com/", options)
Hey @argenisleon not a tutorial per se but you can try our Scraping Challenges. It starts easy and ramps up in difficulty, you have the answers available to you if you don't manage to solve a challenge too. Check it out here: http://scraping-challenges.phantombuster.com/
What is the best way to wait for certain text on a page?
Seems like not possible with a Selector?
@crimsonsoccer55 no, to do that you can use
await tab.driver.client.Page.addScriptToEvaluateOnNewDocument, see here https://chromedevtools.github.io/devtools-protocol/tot/Page#method-addScriptToEvaluateOnNewDocument