Where communities thrive

  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
Repo info
    Vikram Bankar
    Hello Everyone,
    Does anyone have a working code sample where all cookies are retained by splash?
    1. lua script and 2. Scrapy code.
      Its getting really harder for us, and we are on a tight deadline.
      Please Help.
    Vikram Bankar
    Just like a regular browser, sites replace old cookies with new ones and delete the ones that need to be changed.
    Is this even possible with splash?
    Muhammad Saad Ali
    Hey ,
    can somebody please help with an issue I am trying to scroll pages using lua script but the scroll doesn't get updated ,please refer to this issue .
    Any help would be greatly appreciated .
    Bosh Ng
    Hi, I have problem on looping the SplashRequest using scrapy_splash in PyCharm. It is running fine if I run for one url, however, it does not work fine if I put the Splash Request in a for loop. Appreciate if there is any help. Regards.
    Vishesh Mangla
    someone here?
    Danish Khan
    hi i have a problem https request is not allowed or handled? what is this problem?
    hello i'm working on python. i want to click a button on my page to show more content. i know how to do it with a lua script that i can pass to SplashRequest, however the number of times i want to execute this script (or click on this button) depends on the content on the page. so how should i do it ? is there a way to run lua script (or js script to achieve the same result) on demand ? thank you

    I want to send a POST request to the server.

    (GET request works successfully)

    from Perl ro JSON:
    url => "https://xxxx.xxx.gov/",
    body => \@form_data,
    http_method => "POST",
    history => 1,
    proxy => "socks5://50.118.160.xxx:xxxx",
    '_msg' => 'Internal Server Error',
    '_content' => '<html><head><title>Processing Failed</title></head><body><b>Processing Failed</b></body></html>',
    '_protocol' => 'HTTP/1.1',
    '_headers' => bless( {
    'connection' => 'close',
    'client-response-num' => 1,
    'date' => 'Wed, 15 Jul 2020 22:24:40 GMT',
    'client-peer' => '',
    'content-length' => '95',
    '::std_case' => {
    'set-cookie2' => 'Set-Cookie2',
    'client-date' => 'Client-Date',
    'set-cookie' => 'Set-Cookie',
    'client-response-num' => 'Client-Response-Num',
    'title' => 'Title',
    'client-peer' => 'Client-Peer'
    'client-date' => 'Wed, 15 Jul 2020 22:24:40 GMT',
    'content-type' => 'text/html',
    'title' => 'Processing Failed',
    'server' => 'TwistedWeb/19.7.0'
    }, 'HTTP::Headers' ),
    '_rc' => '500',
    '_request' => bless( {
    '_content' => '{"body":{"btnName":"","txtName":"abc","EVENTVALIDATION":"9qKbu7xcvPVnPblTv1EIqHTlMQexw8dx2oT1DlOMWzAws3yb86tdeQSyh4J87JxUVCMGvNt1cCEbSqrHEZA62+1GyuOhnHV4YkHoAxcg2+6MAVMgGtcuE+4YWy9Oo1Z0","VIEWSTATEGENERATOR":"F7812A26","txtNumber":"","__VIEWSTATE":"JfkSYx8S2adXllr41Wq7OzqN5lk9/PxTP4iQJNhnaTOZjNh5rkRDUj/HA5FyNlcqRoMLmJFfFg8v7FR0dEw7Bv2P6O7ICG3Bh5ybogRsnSc=","hidSearchType":"name"},"history":1,"url":"https://xxx.xxx.gov","proxy":"socks5://50.118.160.xxx:xxxx","http_method":"POST"}',
    '_uri' => bless( do{(my $o = 'http://vm70:8050/render.html')}, 'URI::http' ),
    '_headers' => bless( {
    'user-agent' => 'Mozilla/5.0 (X11; U; Linux i686; ja; rv: Gecko/2009032803 Iceweasel/3.0.6 (Debian-3.0.6-1)',
    'accept-charset' => 'utf-8;q=0.7,*;q=0.7',
    'content-type' => 'application/json',
    'accept' => 'application/json',
    'accept-language' => 'q=0.8,en-US;q=0.6,en;q=0.4',
    'accept-encoding' => 'gzip, x-gzip, deflate, x-bzip2, bzip2',
    'content-length' => 516
    }, 'HTTP::Headers' ),
    '_method' => 'POST',
    '_uri_canonical' => $VAR1->{'_request'}{'_uri'}
    }, 'HTTP::Request' )
    }, 'HTTP::Response' );
    I got this error. Can you please advise?
    Tom Bartek
    Hello :)
    Does anybody use logging in the Lua scripts ? I just found that it is possible with simple call: print('Hello from the Lua script.') Is it the way to go ?
    Tom Bartek
    Maybe another question: Can Splash server expose any type of internal metrics ?
    Hi, :wave: very new to splash. Can someone throw some light on why this site is not rendering properly:
    Alex Griggs
    @sushovannits how long of wait do you have?
    Alex Griggs
    using aquarium, with an instance of splash running on 1vcpu/4gb of ram, what would the recommend for # of slots be, the default of 5 or can I push this higher?

    Hello Masters, from the already two weeks unless I sit every day on solutions to problems scraping allegro.pl service.
    Unfortunately, I fail - I tried curl + php, python + scrapy + splash + rotate proxy (proxy free and test paid) + rotate user agent.
    As a result of all this, I came to a page with the words "Please enable JS and disable any ad blocker".
    I would like to know - what comes out of my Splash that allegro.pl reads it as a bot or maybe what this browser does not do, which is recognizable as a bot?
    Is there any website where I could check my request? http://httpbin.org/headers - I've already checked, request looks OK.
    Or maybe someone could check this http://allegro.pl - Polish ebay :-)

    any help would be appreciated, thank you in advance!

    Danish Khan
    Does Scrapy-splash can be used to solve being banned by a website which banned spiders
    edward henry
    Vinyl Moon Coupons code is best code provided by Vinyl Moon . Amazing Discount Offers, Get Vinyl Moon & Promo Codes and save up to 30% on the offer, so get the code helps you to save on Vinyl Moon Coupons and promo codes
    <a href="https://uttercoupons.com/front/store-profile/vinyl-moon-coupons" target="_blank">vinyl moon coupons</a>
    Nora Hazel
    Eaze Coupon Code helps you save on coupon and promo codes Eaze Coupon Is the best coupon to save on Eaze.com, utter coupons provide updated coupons and promo codes on daily basis as Eaze Coupon to help you in saving while enjoying the best facility, you can avail this offer by clicking on the Show Code or Get deal button to use Eaze Coupon and you can also use other codes and promo codes of Eaze Coupon if one may not be working or not accepted. https://uttercoupons.com/front/store-profile/eaze-coupon
    Carters Coupon Code is best code provided by Carter's. Amazing Discount Offers, Get Carter's Coupons & Promo Codes and save up to 50% on the offer, so get the code helps you to save on coupon and promo codes. https://uttercoupons.com/front/store-profile/carters-coupon-codes