Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Mischievous Meerkat
    @jarun
    Thank you! Please leave a star if you find it useful. :)
    Zhiming Wang
    @zmwangx
    @jarun I'm looking at googler's GitHub topics: google-news, google-search, google-site-search, google-terminal and googler-at. googler is the sole project in the last three, and IMO they don't make good topics (topics are for discoverability, they are not really short summaries of the project's capabilities). What about removing the last three (well, maybe google-site-search can be kept, it's a more neutral one), and add "google" to the mix?
    "command-line" could be a good, relevant topic too.
    Mischievous Meerkat
    @jarun
    Done! Retained site search.
    Christian Hänsel
    @chrishaensel
    Hi there
    Christian Hänsel
    @chrishaensel
    Maybe someone can help... I am getting the error "[ERROR] Connection blocked due to unusual activity." And yes, I have been running a few (100+) queries today... Does anybody know what the limit is? Is there a way to set a cutom user agent?
    Mischievous Meerkat
    @jarun
    Google detects tons of automated queries, even when you run them from the browser. The last time we checked it was indeed around 100.
    You can change the user agent in the code, it's Python, so quiet hackable. Just make sure your don't use an Android one, the last time I checked it didn't work... probably because they moved to JS results, but I didn't dive much wither.
    either*
    Zhiming Wang
    @zmwangx
    @jarun I turned on auto cancellation on Travis to save us a few queries when pushing corrections rapidly. https://blog.travis-ci.com/2017-03-22-introducing-auto-cancellation
    Mischievous Meerkat
    @jarun
    :+1:
    Jamsheed Mistri
    @JamsheedMistri

    Hi, I'm having an issue. I'm trying to use googler on my raspberry pi. I've tried it on my mac and it works perfectly, and I recently updated my pi to use python 3.6.0. When I do googler, I get this error:

    Traceback (most recent call last): File "./googler", line 29, in <module> from http.client import HTTPSConnection ImportError: cannot import name 'HTTPSConnection'

    Could anyone help me please?
    Mischievous Meerkat
    @jarun
    This isn't a googler issue. Please take a look at: https://docs.python.org/3/library/http.client.html. Specifically Note HTTPS support is only available if Python was compiled with SSL support (through the ssl module).
    If you are trying to port googler on Raspberry Pi that's nice. But you should be ready to figure out minor import related issues yourself. We can't do that for you.
    Jamsheed Mistri
    @JamsheedMistri
    Cool, thanks
    Jamsheed Mistri
    @JamsheedMistri
    @jarun When I execute googler in PHP, I get this error. How can I fix this?
    stdout encoding 'ascii' detected. googler requires utf-8 to work properly. The wrong encoding may be due to a non-UTF-8 locale or an improper PYTHONIOENCODING. (For the record, your locale language is and locale encoding is ; your PYTHONIOENCODING is not set.) Please set a UTF-8 locale (e.g., en_US.UTF-8) or set PYTHONIOENCODING to utf-8.
    Mischievous Meerkat
    @jarun
    Please set your locale to utf-8. You can refer to https://wiki.archlinux.org/index.php/locale
    Jamsheed Mistri
    @JamsheedMistri
    Thanks!
    steackfrite
    @steackfrite

    @jarun Hi there!
    First, thanks for your work, it's a great idea!

    Now I'm trying to get the same results as the google web version using keywords but i'm quite unlucky so far.

    Here is the google search : site:*.dualthegame.com -site:www.dualthegame.com
    And here is the googler search I made: googler site:*.dualthegame.com site:" -www.dualthegame.com" -n 30 --np --unfilter -l en

    The results are quite different. With the WebUI version I can find several different domain (board, community, etc.) but with googler I can find only 1 domain by search.
    So I need to add a filter after each new search.

    Is there a way to have the same result or at least to be very similar?

    Zhiming Wang
    @zmwangx
    googler "site:*.dualthegame.com -site:www.dualthegame.com"
    exactly the same results
    steackfrite
    @steackfrite
    @zmwangx Ouuuh sir, thank you!
    I did not think I could right it literally like that, it's perfect!
    Naveen Kumar
    @naveenCotha
    Hey @jarun thanks for the googler library. Is there a python sdk ?
    Mischievous Meerkat
    @jarun
    Nope.