Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    habout632
    @habout632
    Somebody there #
    splash chrome
    The difference between them
    Charles Green
    @charlesgreen
    @habout632 I'm a few days late to reply. Can you give a bit more context? What differences would you like to know? Have you read the docs?
    mahmoudnabil
    @mnabil
    HI guys ? , is scrapinghub hiring remote software engineers ? :D
    Silvano Cerza
    @Alien1993
    Hey there, has anyone ever had an issue with Splash Docker container crashing with a 139 error code?
    I'm using it with the scrapy-splash plugin and it fails randomly while scraping
    Silvano Cerza
    @Alien1993
    I tried an higher verbosity with -v2 and this is always the last line splash_1 | 2017-10-17 16:06:27.016674 [render] [140648928249504] [lua_runner] send (lua) (b'return', <Lua table at 0x32e1750>)
    Ankit Yadav
    @yadavankit
    hi can anyone help me with a problem? Its quite urgent actually
    Ankit Yadav
    @yadavankit
    Hey there, how can I make sure that the image fully loads (not only just the img tag in DOM)
    Silvano Cerza
    @Alien1993
    @yadavankit have you tried using a lua script to wait?
    function main(splash)
        splash:go("http://example.com")
        splash:wait(0.5)
        return {html=splash:html()}
    end
    Something like this
    Nicolás Ramírez
    @nramirezuy
    Hi, does anyone knows how to fully disable caching? I'm interested on full HARs every time I request a website.
    Trey Saddler
    @tosaddler
    Greetings all. I'm having an issue with the splash docker container. I'm trying to attach a custom module through Docker's volume mounting option and the documentation says that you should run it with the argument "--lua-sandbox-allowed-modules" but Docker is saying that isn't a valid argument. Any ideas? I've disabled sandbox mode for now using the "--disable-lua-sandbox argument" but I'd like to get the other way working.
    Tiago Rodrigues
    @TiagoMRodrigues
    greetings, if you open this website https://istoe.com.br/moodys-faz-relatorio-positivo-sobre-corte-no-compulsorio-de-bancos-brasileiros/ you will notice that the spinner in your browser keeps spinning after the page appear to be full rendered (there is a broken link for an image and the page tries to download it for 90 seconds). but the splash gives timeout anyway, is there a way to render as is at the timeout cut point?
    Avery1012
    @Avery1012
    Hi is it possible to upgrade python version from 3.5.2 in scrapinghub/splash docker image to python 3.6.5 ?
    artndes9
    @artndes9
    Hey all
    artndes9
    @artndes9
    I got a weird problem, whenever i try to scrape a single page splash returns all the items but with multiple it just returns few!
    When scraping single it returns 340 items while with multiple requests it returns 20.
    I have a lua script that scrolls the page 2 time and then click on a button until the button hides. The page loads more items on the button click
    Any ideas what might be happning??
    Rubi
    @codenoid
    XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
    XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
    Swordyjohn
    @Swordyjohn
    Hello, I am having an issue with splash. when running the "docker run -p 5000:5000 -p 5023:5023 scrapinghub/splash" commmand I am getting the "Starting factory <twisted.web.server.Site object at 0x7efc279d97f0>" hang time in my powershell (windows 10), and localhost:8050 shows nothing. in additon, when i run the example script from the docs it returns:"ConnectionError: HTTPConnectionPool(host='localhost', port=8050): Max retries exceeded with url: /run (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x00000209C41382B0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it',))" i cannot locate port 8050 with a netstat search. any ideas on how to fix this?
    wendy
    @jw1992victory
    Hello, Can someone take a look at this question I posted a while ago? scrapinghub/splash#788
    Luciano Perezzini
    @perezzini
    Hello!! I'm using splash and scrapy to crawl multiple pages from a single spider. In my desktop computer (ubuntu) works just fine! But when I clone the repo in a virtual machine, also ubuntu, all items parsed return None. Any feedback...? I't would be great! Thanks! (apparently I has to be that splash can't render pages in time... I'm also using AUTOTHROTTLE)
    Luciano Perezzini
    @perezzini
    Increased 'wait' arg in SplashRequest to 5 secs, and it seems to work... Can some expert in Splash explain relationship between 'wait' argument and Scrapy's AUTOTHROTTLE? Thanks in advance!!
    Matthew Aguirre
    @ZenHarbinger
    If anyone is out there, how do you/can you handle a web page sending an attachment response?
    Vikram Bankar
    @VikramBankar_twitter
    Hello Everyone,
    Does anyone have a working code sample where all cookies are retained by splash?
    1. lua script and 2. Scrapy code.
      Its getting really harder for us, and we are on a tight deadline.
      Please Help.
    Vikram Bankar
    @VikramBankar_twitter
    Just like a regular browser, sites replace old cookies with new ones and delete the ones that need to be changed.
    Is this even possible with splash?
    Muhammad Saad Ali
    @saadali1996
    Hey ,
    can somebody please help with an issue I am trying to scroll pages using lua script but the scroll doesn't get updated ,please refer to this issue .
    scrapinghub/splash#898
    Any help would be greatly appreciated .
    Regards
    Bosh Ng
    @boshng95
    Hi, I have problem on looping the SplashRequest using scrapy_splash in PyCharm. It is running fine if I run for one url, however, it does not work fine if I put the Splash Request in a for loop. Appreciate if there is any help. Regards.
    sjaanus
    @sjaanus
    hi
    Vishesh Mangla
    @XtremeGood
    someone here?
    danishkhangithub
    @danishkhangithub
    hi i have a problem https request is not allowed or handled? what is this problem?
    jeremfrs
    @jeremfrs
    hello i'm working on python. i want to click a button on my page to show more content. i know how to do it with a lua script that i can pass to SplashRequest, however the number of times i want to execute this script (or click on this button) depends on the content on the page. so how should i do it ? is there a way to run lua script (or js script to achieve the same result) on demand ? thank you
    proftpd66
    @proftpd66
    hello,

    I want to send a POST request to the server.

    (GET request works successfully)

    from Perl ro JSON:
    {
    url => "https://xxxx.xxx.gov/",
    body => \@form_data,
    http_method => "POST",
    history => 1,
    proxy => "socks5://50.118.160.xxx:xxxx",
    }
    {
    '_msg' => 'Internal Server Error',
    '_content' => '<html><head><title>Processing Failed</title></head><body><b>Processing Failed</b></body></html>',
    '_protocol' => 'HTTP/1.1',
    '_headers' => bless( {
    'connection' => 'close',
    'client-response-num' => 1,
    'date' => 'Wed, 15 Jul 2020 22:24:40 GMT',
    'client-peer' => '10.0.1.177:8050',
    'content-length' => '95',
    '::std_case' => {
    'set-cookie2' => 'Set-Cookie2',
    'client-date' => 'Client-Date',
    'set-cookie' => 'Set-Cookie',
    'client-response-num' => 'Client-Response-Num',
    'title' => 'Title',
    'client-peer' => 'Client-Peer'
    },
    'client-date' => 'Wed, 15 Jul 2020 22:24:40 GMT',
    'content-type' => 'text/html',
    'title' => 'Processing Failed',
    'server' => 'TwistedWeb/19.7.0'
    }, 'HTTP::Headers' ),
    '_rc' => '500',
    '_request' => bless( {
    '_content' => '{"body":{"btnName":"","txtName":"abc","EVENTVALIDATION":"9qKbu7xcvPVnPblTv1EIqHTlMQexw8dx2oT1DlOMWzAws3yb86tdeQSyh4J87JxUVCMGvNt1cCEbSqrHEZA62+1GyuOhnHV4YkHoAxcg2+6MAVMgGtcuE+4YWy9Oo1Z0","VIEWSTATEGENERATOR":"F7812A26","txtNumber":"","__VIEWSTATE":"JfkSYx8S2adXllr41Wq7OzqN5lk9/PxTP4iQJNhnaTOZjNh5rkRDUj/HA5FyNlcqRoMLmJFfFg8v7FR0dEw7Bv2P6O7ICG3Bh5ybogRsnSc=","hidSearchType":"name"},"history":1,"url":"https://xxx.xxx.gov","proxy":"socks5://50.118.160.xxx:xxxx","http_method":"POST"}',
    '_uri' => bless( do{(my $o = 'http://vm70:8050/render.html')}, 'URI::http' ),
    '_headers' => bless( {
    'user-agent' => 'Mozilla/5.0 (X11; U; Linux i686; ja; rv:1.9.0.7) Gecko/2009032803 Iceweasel/3.0.6 (Debian-3.0.6-1)',
    'accept-charset' => 'utf-8;q=0.7,*;q=0.7',
    'content-type' => 'application/json',
    'accept' => 'application/json',
    'accept-language' => 'q=0.8,en-US;q=0.6,en;q=0.4',
    'accept-encoding' => 'gzip, x-gzip, deflate, x-bzip2, bzip2',
    'content-length' => 516
    }, 'HTTP::Headers' ),
    '_method' => 'POST',
    '_uri_canonical' => $VAR1->{'_request'}{'_uri'}
    }, 'HTTP::Request' )
    }, 'HTTP::Response' );
    I got this error. Can you please advise?
    Tom Bartek
    @itsx
    Hello :)
    Does anybody use logging in the Lua scripts ? I just found that it is possible with simple call: print('Hello from the Lua script.') Is it the way to go ?
    Tom Bartek
    @itsx
    Maybe another question: Can Splash server expose any type of internal metrics ?
    :)
    Sushovan
    @sushovannits
    Hi, :wave: very new to splash. Can someone throw some light on why this site is not rendering properly:
    https://www.joinhoney.com/trending/stores
    Alex Griggs
    @Doginal
    @sushovannits how long of wait do you have?
    Alex Griggs
    @Doginal
    using aquarium, with an instance of splash running on 1vcpu/4gb of ram, what would the recommend for # of slots be, the default of 5 or can I push this higher?
    jerzyks
    @jerzyks

    Hello Masters, from the already two weeks unless I sit every day on solutions to problems scraping allegro.pl service.
    Unfortunately, I fail - I tried curl + php, python + scrapy + splash + rotate proxy (proxy free and test paid) + rotate user agent.
    As a result of all this, I came to a page with the words "Please enable JS and disable any ad blocker".
    I would like to know - what comes out of my Splash that allegro.pl reads it as a bot or maybe what this browser does not do, which is recognizable as a bot?
    Is there any website where I could check my request? http://httpbin.org/headers - I've already checked, request looks OK.
    Or maybe someone could check this http://allegro.pl - Polish ebay :-)

    any help would be appreciated, thank you in advance!