Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    mahmoudnabil
    @mnabil
    HI guys ? , is scrapinghub hiring remote software engineers ? :D
    Silvano Cerza
    @Alien1993
    Hey there, has anyone ever had an issue with Splash Docker container crashing with a 139 error code?
    I'm using it with the scrapy-splash plugin and it fails randomly while scraping
    Silvano Cerza
    @Alien1993
    I tried an higher verbosity with -v2 and this is always the last line splash_1 | 2017-10-17 16:06:27.016674 [render] [140648928249504] [lua_runner] send (lua) (b'return', <Lua table at 0x32e1750>)
    Ankit Yadav
    @yadavankit
    hi can anyone help me with a problem? Its quite urgent actually
    Ankit Yadav
    @yadavankit
    Hey there, how can I make sure that the image fully loads (not only just the img tag in DOM)
    Silvano Cerza
    @Alien1993
    @yadavankit have you tried using a lua script to wait?
    function main(splash)
        splash:go("http://example.com")
        splash:wait(0.5)
        return {html=splash:html()}
    end
    Something like this
    Nicolás Ramírez
    @nramirezuy
    Hi, does anyone knows how to fully disable caching? I'm interested on full HARs every time I request a website.
    Trey Saddler
    @tosaddler
    Greetings all. I'm having an issue with the splash docker container. I'm trying to attach a custom module through Docker's volume mounting option and the documentation says that you should run it with the argument "--lua-sandbox-allowed-modules" but Docker is saying that isn't a valid argument. Any ideas? I've disabled sandbox mode for now using the "--disable-lua-sandbox argument" but I'd like to get the other way working.
    Tiago Rodrigues
    @TiagoMRodrigues
    greetings, if you open this website https://istoe.com.br/moodys-faz-relatorio-positivo-sobre-corte-no-compulsorio-de-bancos-brasileiros/ you will notice that the spinner in your browser keeps spinning after the page appear to be full rendered (there is a broken link for an image and the page tries to download it for 90 seconds). but the splash gives timeout anyway, is there a way to render as is at the timeout cut point?
    Avery1012
    @Avery1012
    Hi is it possible to upgrade python version from 3.5.2 in scrapinghub/splash docker image to python 3.6.5 ?
    artndes9
    @artndes9
    Hey all
    artndes9
    @artndes9
    I got a weird problem, whenever i try to scrape a single page splash returns all the items but with multiple it just returns few!
    When scraping single it returns 340 items while with multiple requests it returns 20.
    I have a lua script that scrolls the page 2 time and then click on a button until the button hides. The page loads more items on the button click
    Any ideas what might be happning??
    Rubi
    @codenoid
    XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
    XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
    Swordyjohn
    @Swordyjohn
    Hello, I am having an issue with splash. when running the "docker run -p 5000:5000 -p 5023:5023 scrapinghub/splash" commmand I am getting the "Starting factory <twisted.web.server.Site object at 0x7efc279d97f0>" hang time in my powershell (windows 10), and localhost:8050 shows nothing. in additon, when i run the example script from the docs it returns:"ConnectionError: HTTPConnectionPool(host='localhost', port=8050): Max retries exceeded with url: /run (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x00000209C41382B0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it',))" i cannot locate port 8050 with a netstat search. any ideas on how to fix this?
    wendy
    @jw1992victory
    Hello, Can someone take a look at this question I posted a while ago? scrapinghub/splash#788
    Luciano Perezzini
    @perezzini
    Hello!! I'm using splash and scrapy to crawl multiple pages from a single spider. In my desktop computer (ubuntu) works just fine! But when I clone the repo in a virtual machine, also ubuntu, all items parsed return None. Any feedback...? I't would be great! Thanks! (apparently I has to be that splash can't render pages in time... I'm also using AUTOTHROTTLE)
    Luciano Perezzini
    @perezzini
    Increased 'wait' arg in SplashRequest to 5 secs, and it seems to work... Can some expert in Splash explain relationship between 'wait' argument and Scrapy's AUTOTHROTTLE? Thanks in advance!!
    Matthew Aguirre
    @ZenHarbinger
    If anyone is out there, how do you/can you handle a web page sending an attachment response?
    Vikram Bankar
    @VikramBankar_twitter
    Hello Everyone,
    Does anyone have a working code sample where all cookies are retained by splash?
    1. lua script and 2. Scrapy code.
      Its getting really harder for us, and we are on a tight deadline.
      Please Help.
    Vikram Bankar
    @VikramBankar_twitter
    Just like a regular browser, sites replace old cookies with new ones and delete the ones that need to be changed.
    Is this even possible with splash?
    Muhammad Saad Ali
    @saadali1996
    Hey ,
    can somebody please help with an issue I am trying to scroll pages using lua script but the scroll doesn't get updated ,please refer to this issue .
    scrapinghub/splash#898
    Any help would be greatly appreciated .
    Regards
    Bosh Ng
    @boshng95
    Hi, I have problem on looping the SplashRequest using scrapy_splash in PyCharm. It is running fine if I run for one url, however, it does not work fine if I put the Splash Request in a for loop. Appreciate if there is any help. Regards.
    sjaanus
    @sjaanus
    hi
    Vishesh Mangla
    @Teut2711
    someone here?
    Danish Khan
    @danishkhangithub
    hi i have a problem https request is not allowed or handled? what is this problem?
    jeremfrs
    @jeremfrs
    hello i'm working on python. i want to click a button on my page to show more content. i know how to do it with a lua script that i can pass to SplashRequest, however the number of times i want to execute this script (or click on this button) depends on the content on the page. so how should i do it ? is there a way to run lua script (or js script to achieve the same result) on demand ? thank you
    proftpd66
    @proftpd66
    hello,

    I want to send a POST request to the server.

    (GET request works successfully)

    from Perl ro JSON:
    {
    url => "https://xxxx.xxx.gov/",
    body => \@form_data,
    http_method => "POST",
    history => 1,
    proxy => "socks5://50.118.160.xxx:xxxx",
    }
    {
    '_msg' => 'Internal Server Error',
    '_content' => '<html><head><title>Processing Failed</title></head><body><b>Processing Failed</b></body></html>',
    '_protocol' => 'HTTP/1.1',
    '_headers' => bless( {
    'connection' => 'close',
    'client-response-num' => 1,
    'date' => 'Wed, 15 Jul 2020 22:24:40 GMT',
    'client-peer' => '10.0.1.177:8050',
    'content-length' => '95',
    '::std_case' => {
    'set-cookie2' => 'Set-Cookie2',
    'client-date' => 'Client-Date',
    'set-cookie' => 'Set-Cookie',
    'client-response-num' => 'Client-Response-Num',
    'title' => 'Title',
    'client-peer' => 'Client-Peer'
    },
    'client-date' => 'Wed, 15 Jul 2020 22:24:40 GMT',
    'content-type' => 'text/html',
    'title' => 'Processing Failed',
    'server' => 'TwistedWeb/19.7.0'
    }, 'HTTP::Headers' ),
    '_rc' => '500',
    '_request' => bless( {
    '_content' => '{"body":{"btnName":"","txtName":"abc","EVENTVALIDATION":"9qKbu7xcvPVnPblTv1EIqHTlMQexw8dx2oT1DlOMWzAws3yb86tdeQSyh4J87JxUVCMGvNt1cCEbSqrHEZA62+1GyuOhnHV4YkHoAxcg2+6MAVMgGtcuE+4YWy9Oo1Z0","VIEWSTATEGENERATOR":"F7812A26","txtNumber":"","__VIEWSTATE":"JfkSYx8S2adXllr41Wq7OzqN5lk9/PxTP4iQJNhnaTOZjNh5rkRDUj/HA5FyNlcqRoMLmJFfFg8v7FR0dEw7Bv2P6O7ICG3Bh5ybogRsnSc=","hidSearchType":"name"},"history":1,"url":"https://xxx.xxx.gov","proxy":"socks5://50.118.160.xxx:xxxx","http_method":"POST"}',
    '_uri' => bless( do{(my $o = 'http://vm70:8050/render.html')}, 'URI::http' ),
    '_headers' => bless( {
    'user-agent' => 'Mozilla/5.0 (X11; U; Linux i686; ja; rv:1.9.0.7) Gecko/2009032803 Iceweasel/3.0.6 (Debian-3.0.6-1)',
    'accept-charset' => 'utf-8;q=0.7,*;q=0.7',
    'content-type' => 'application/json',
    'accept' => 'application/json',
    'accept-language' => 'q=0.8,en-US;q=0.6,en;q=0.4',
    'accept-encoding' => 'gzip, x-gzip, deflate, x-bzip2, bzip2',
    'content-length' => 516
    }, 'HTTP::Headers' ),
    '_method' => 'POST',
    '_uri_canonical' => $VAR1->{'_request'}{'_uri'}
    }, 'HTTP::Request' )
    }, 'HTTP::Response' );
    I got this error. Can you please advise?
    Tom Bartek
    @itsx
    Hello :)
    Does anybody use logging in the Lua scripts ? I just found that it is possible with simple call: print('Hello from the Lua script.') Is it the way to go ?
    Tom Bartek
    @itsx
    Maybe another question: Can Splash server expose any type of internal metrics ?
    :)
    Sushovan
    @sushovannits
    Hi, :wave: very new to splash. Can someone throw some light on why this site is not rendering properly:
    https://www.joinhoney.com/trending/stores
    Alex Griggs
    @Doginal
    @sushovannits how long of wait do you have?
    Alex Griggs
    @Doginal
    using aquarium, with an instance of splash running on 1vcpu/4gb of ram, what would the recommend for # of slots be, the default of 5 or can I push this higher?
    jerzyks
    @jerzyks

    Hello Masters, from the already two weeks unless I sit every day on solutions to problems scraping allegro.pl service.
    Unfortunately, I fail - I tried curl + php, python + scrapy + splash + rotate proxy (proxy free and test paid) + rotate user agent.
    As a result of all this, I came to a page with the words "Please enable JS and disable any ad blocker".
    I would like to know - what comes out of my Splash that allegro.pl reads it as a bot or maybe what this browser does not do, which is recognizable as a bot?
    Is there any website where I could check my request? http://httpbin.org/headers - I've already checked, request looks OK.
    Or maybe someone could check this http://allegro.pl - Polish ebay :-)

    any help would be appreciated, thank you in advance!

    Danish Khan
    @danishkhangithub
    Does Scrapy-splash can be used to solve being banned by a website which banned spiders
    edward henry
    @edwardh50638060_twitter
    Vinyl Moon Coupons code is best code provided by Vinyl Moon . Amazing Discount Offers, Get Vinyl Moon & Promo Codes and save up to 30% on the offer, so get the code helps you to save on Vinyl Moon Coupons and promo codes
    https://uttercoupons.com/front/store-profile/vinyl-moon-coupons
    <a href="https://uttercoupons.com/front/store-profile/vinyl-moon-coupons" target="_blank">vinyl moon coupons</a>
    Nora Hazel
    @norahazel56_gitlab
    Eaze Coupon Code helps you save on coupon and promo codes Eaze Coupon Is the best coupon to save on Eaze.com, utter coupons provide updated coupons and promo codes on daily basis as Eaze Coupon to help you in saving while enjoying the best facility, you can avail this offer by clicking on the Show Code or Get deal button to use Eaze Coupon and you can also use other codes and promo codes of Eaze Coupon if one may not be working or not accepted. https://uttercoupons.com/front/store-profile/eaze-coupon
    Carters Coupon Code is best code provided by Carter's. Amazing Discount Offers, Get Carter's Coupons & Promo Codes and save up to 50% on the offer, so get the code helps you to save on coupon and promo codes. https://uttercoupons.com/front/store-profile/carters-coupon-codes