Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Jan 21 21:03
    Travis soimort/you-get (develop) broken (2322)
  • Jan 21 21:01
    soimort commented #2762
  • Jan 21 21:00
    soimort closed #2762
  • Jan 21 21:00

    soimort on develop

    [ixigua] fix error 'video_id no… use urllib instead of requests Merge branch 'fix-ixigua-vid' o… (compare)

  • Jan 21 15:20
  • Jan 21 12:26
    ljj038 closed #2768
  • Jan 21 03:27
    ljj038 closed #2769
  • Jan 21 03:23
    ljj038 opened #2769
  • Jan 20 14:11
    Cathy-t commented #2689
  • Jan 20 10:14
    Travis jack-zheng/you-get (develop) still failing (3)
  • Jan 20 10:12
    Travis jack-zheng/you-get (develop) failed (2)
  • Jan 20 10:08
    Travis jack-zheng/you-get (develop) failed (1)
  • Jan 20 04:03
    Cathy-t commented #2689
  • Jan 20 02:46
    out001a commented #2762
  • Jan 19 03:09
    ljj038 commented #2768
  • Jan 19 02:56
    ljj038 commented #2768
  • Jan 18 12:48
    Cathy-t commented #2689
  • Jan 17 14:37
    soimort commented #2768
  • Jan 17 14:16
    ljj038 commented #2768
  • Jan 17 14:07
    soimort labeled #2768
dran1x
@dran1x
yo
Why cant there be a config file and we set the path there...
and how can i change "you-get" to something else.
the "you-get" call command
huanghe2015
@huanghe2015
我最近看到M3U8 downloader利用FFmpeg实现多线程以提升下载速度,不知后期能不能加进来??
huanghe2015
@huanghe2015
@scegg 优酷经常会改的,等等吧。
@vanehsd 反馈加个链接
@100288840 反馈加个链接
@yxd0018 Youtube可能做了修改,等等吧。
@dran1x Please write the output of terminal when having feedback.
Allen Cui
@scegg
bilibili179行错
huanghe2015
@huanghe2015
@scegg 失效视频肯定不能下载啦!!!
Mort Yao
@soimort
@scegg 需要传cookies
ooooo999
@ooooo999
之前提到you-get只调用ffmpeg的aac_adtstoasc,无法支持部分iqiyi视频的eac3音频编码的问题有更新吗? 可以用http://www.iqiyi.com/v_19rsictxqo.html做测试.
qkkas
@qkkas
爱奇艺上某些视频只能下一部分(6分钟)如:https://m.iqiyi.com/v_19rrdurjo8.html?vfrm=2-3-0-1
爱奇艺上某些视频只能下一部分(6分钟)如:https://m.iqiyi.com/v_19rrdurjo8.html?vfrm=2-3-0-1
爱奇艺上某些视频只能下一部分(6分钟)如:https://m.iqiyi.com/v_19rrdurjo8.html?vfrm=2-3-0-1 这该怎么解决?
huanghe2015
@huanghe2015
付费视频要传Cookie @qkkas
如果还不好使的话就要看HTTP头了,那是另外一回事。
静海闲人
@lacafjh
Traceback (most recent call last):
File "c:\users\user\appdata\local\programs\python\python37\lib\urllib\request.py", line 1317, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 1252, in request
self._send_request(method, url, body, headers, encode_chunked)
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 1298, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 1247, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 1026, in _send_output
self.send(msg)
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 966, in send
self.connect()
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 938, in connect
(self.host,self.port), self.timeout, self.source_address)
File "c:\users\user\appdata\local\programs\python\python37\lib\socket.py", line 707, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "c:\users\user\appdata\local\programs\python\python37\lib\socket.py", line 748, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno 11001] getaddrinfo failed
有没有人知道这是什么情况
luckrill
@luckrill
you-get 在Linux 环境 和 FreeBSD环境有差异, FreeBSD 环境不支持 --playlist
luckrill
@luckrill
因为you-get原因,把freebsd服务器切换到了 ubuntu。 you-get应用软件,怎么会涉及到操作系统环境昵?
huanghe2015
@huanghe2015
除了FFmpeg,我是想不出来什么原因了。
@luckrill
luckrill
@luckrill
后续发现了原因,不同环境了,默认探测可下载的文件不同,mp4 或 webm 。 在freebsd环境 不支持 --playlist 相当让我差异,python代码怎么会有这样问题?
一个建议:提供playlist输出功能,显示所有playlist,不做下载;提供部分playlist下载,从 num 到 num 范围下载。这样更加友好,默认全部下载比较冗余。
huanghe2015
@huanghe2015
在不同环境下载的文件不同我个人倾向于UA的原因;playlist部分我是无法解答了。
Wang
@wang0251
爱奇艺使用-c参数传递cookie后还是只能下6分钟视频,已经是付费用户。优酷付费视频传递cookie后可以正常下载。
huanghe2015
@huanghe2015
爱奇艺应该还有别的限制,再看一下HTTP头吧。 @wang0251 g
xyuanmu
@xyuanmu
从昨天开始部分哔哩哔哩视频会报 'h1Title' 以及 'id' 错误,比如这个:https://www.bilibili.com/bangumi/play/ep127625
解决办法如下,修改 you-get/src/you_get/extractors/bilibili.py 第 288 行和 291 行,改成下面这样
            # set video title
            self.title = initial_state['h1Title'] if 'h1Title' in initial_state else '%s %s %s' % (initial_state['mediaInfo']['title'], initial_state['epInfo']['index'], initial_state['epInfo']['index_title'])

            # construct playinfos
            ep_id = initial_state['epInfo']['id'] if 'id' in initial_state['epInfo'] else initial_state['epInfo']['ep_id']
ZeonWang
@scplay
You-get 支持 livestream 下载吗?
Haoran421
@Haoran421
youtube 和 bilibili试了一下,下载下来的文件默认视频和音频是分开的吗?
SFMDI
@SFMDI

Is there anyone who authorized to merge pull request?
I want my pull requests merged quickly
I need merged contributions for personal reasons...

soimort/you-get#2756
soimort/you-get#2757

Mort Yao
@soimort
@Haoran421 请安装ffmpeg
@SFMDI Merged. Thanks for the contribution!
Baiwu (Chris) Zhang
@bwuzhang
请问下有没有在短视频公司做爬虫的,想请教几个问题~
GiGaFotress
@GiGaFotress
you-get -l https://www.bilibili.com/video/av9912938 --debug
[DEBUG] get_content: https://www.bilibili.com/video/av9912938
[DEBUG] get_content: https://www.bilibili.com/video/av9912938
[DEBUG] get_content: https://interface.bilibili.com/v2/playurl?appkey=iVGUTjsxvpLeuDCf&cid=16388185&otype=json&qn=80&quality=80&type=&sign=6bb922f806a00854dafd89cbab9d1902
[DEBUG] get_content: https://interface.bilibili.com/v2/playurl?appkey=iVGUTjsxvpLeuDCf&cid=16388185&otype=json&qn=64&quality=64&type=&sign=c01b7c2b6402229ad8a4ba3205fcb7ce
[DEBUG] get_content: https://interface.bilibili.com/v2/playurl?appkey=iVGUTjsxvpLeuDCf&cid=16388185&otype=json&qn=32&quality=32&type=&sign=8bdb67bd05421df2f701bfa0ee0f3ea8
[DEBUG] get_content: https://api.bilibili.com/x/player/playurl?avid=9912938&cid=16388185&qn=16&type=&otype=json&fnver=0&fnval=16
[DEBUG] get_content: https://interface.bilibili.com/v2/playurl?appkey=iVGUTjsxvpLeuDCf&cid=16388185&otype=json&qn=16&quality=16&type=&sign=9027d765ec32bd2cf82ebf692a7f7a3d
[DEBUG] get_content: http://comment.bilibili.com/16388185.xml
you-get: version 0.4.1388, a tiny downloader that scrapes the web.
you-get: Namespace(URL=['https://www.bilibili.com/video/av9912938'], auto_rename=False, cookies=None, debug=True, extractor_proxy=None, force=False, format=None, help=False, http_proxy=None, info=False, input_file=None, insecure=False, itag=None, json=False, no_caption=False, no_merge=False, no_proxy=False, output_dir='.', output_filename=None, password=None, player=None, playlist=True, skip_existing_file_size_check=False, socks_proxy=None, stream=None, timeout=600, url=False, version=False)
Traceback (most recent call last):
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\runpy.py", line 85, in _run_code
exec(code, run_globals)
File "C:\Users\userss\AppData\Local\Programs\Python\Python37-32\Scripts\you-get.exe__main.py", line 9, in <module>
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\
main__.py", line 92, in main
main(kwargs)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\common.py", line 1766, in main
script_main(any_download, any_download_playlist,
kwargs)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\common.py", line 1654, in script_main
extra
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\common.py", line 1308, in download_main
download_playlist(url,
kwargs)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\common.py", line 1762, in any_download_playlist
m.download_playlist(url, kwargs)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\extractors\bilibili.py", line 632, in download_playlist_by_url
self.download(
kwargs)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\extractor.py", line 209, in download
stream_id = itags[0]
IndexError: list index out of range
b站似乎当视频p太多的时候会出错
-i获取p信息可行,但是下载报错
反馈,linux端可以正常下载,windows端报错如上
zhongnan
@zhongnan1996
斗鱼现在好像不行
[DEBUG] get_content: https://v.douyu.com/show/NbwE7ZBGkVR7n5Zz
[DEBUG] get_content: http://vmobile.douyu.com/video/getInfo?vid=NbwE7ZBGkVR7n5Zz
[DEBUG] HTTP Error with code403
[DEBUG] HTTP Error with code403
[DEBUG] HTTP Error with code403
you-get: version 0.4.1388, a tiny downloader that scrapes the web.
you-get: Namespace(URL=['https://v.douyu.com/show/NbwE7ZBGkVR7n5Zz'], auto_rename=False, cookies=None, debug=True, extractor_proxy=None, force=False, format=None, help=False, http_proxy=None, info=False, input_file=None, insecure=False, itag=None, json=False, no_caption=False, no_merge=False, no_proxy=False, output_dir='.', output_filename=None, password=None, player=None, playlist=False, skip_existing_file_size_check=False, socks_proxy=None, stream=None, timeout=600, url=False, version=False)
Traceback (most recent call last):
File "/usr/local/bin/you-get", line 10, in <module>
sys.exit(main())
File "/usr/local/lib/python3.7/site-packages/you_get/main.py", line 92, in main
main(kwargs)
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 1766, in main
script_main(any_download, any_download_playlist,
kwargs)
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 1654, in script_main
extra
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 1310, in download_main
download(url,
kwargs)
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 1757, in any_download
m.download(url, kwargs)
File "/usr/local/lib/python3.7/site-packages/you_get/extractors/douyutv.py", line 51, in douyutv_download
douyutv_video_download(url, output_dir=output_dir, merge=merge, info_only=info_only,
kwargs)
File "/usr/local/lib/python3.7/site-packages/you_get/extractors/douyutv.py", line 39, in douyutv_video_download
meta = json.loads(get_content(ep + vid))
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 442, in get_content
response = urlopen_with_retry(req)
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 420, in urlopen_with_retry
raise http_error
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 411, in urlopen_with_retry
return request.urlopen(args, **kwargs)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 569, in error
return self._call_chain(
args)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden
yichuan66
@yichuan66
好厉害!
yichuan66
@yichuan66
ha!
duchadong
@duchadong
hi
C:\Users\msi>you-get https://www.iqiyi.com/v_19rw9vcs9s.html
site: 爱奇艺 (Iqiyi)
title: 《嘴强TOP10》121:开30秒就把对面心态打崩了!敌方:6分投!
stream:
- format:        TD
  container:     m3u8
  video-profile: 720p
  m3u8_url:      http://cache.m.iqiyi.com/mus/238745301/8cb8e9e9662036b59bfdc7032dacc1b9/afbe8fd3d73448c9/0/20200121/d8/88/d62982f2c9df286ee1ec1f2e8b8bb3d5.m3u8?qd_originate=tmts_py&tvid=11712756300&bossStatus=0&qd_vip=0&px=&src=3_31_312&prv=&previewType=&previewTime=&from=&qd_time=1579672898481&qd_p=abee1ff5&qd_asc=31eba6718bc8d975c7fe0aef0267a075&qypid=11712756300_04022000001000000000_4&qd_k=aff51671f9b129a2c4589fdbb84a1f62&isdol=0&code=2&ff=f4v&iswb=0&qd_s=otv&vf=1e28ba6949984167a59c9cf34a201273&np_tag=nginx_part_tag
# download-with: you-get --format=TD [URL]