These are chat archives for rosshinkley/nightmare

11th
Sep 2016
Eirik Brandtzæg
@eirikb
Sep 11 2016 08:47
Hi. First off, nigthmare is awesome!
I'm having a bit of trouble with this old ASP site, it seems it requires Referer to be set when reloading or going "back", is it possible to force this?
Eirik Brandtzæg
@eirikb
Sep 11 2016 08:53
When I click reload in Chrome the Referer is set (same with location.reload()), not sure what does this, it doesn't seem to do the same in nightmare. If I click on the address bar and hit enter in Chrome the referer is missing and that fails as well (since the server seems to require it to be set)
Eirik Brandtzæg
@eirikb
Sep 11 2016 09:22
This might be related: electron/electron#2445
Eirik Brandtzæg
@eirikb
Sep 11 2016 18:58
Solved by using nightmare-webrequest-addon, it seems the site I'm scraping don't care about what the Referer is, as long as it contains the sites host name, so I can just hard code it to always be included in all requests (using that module)