soimort/you-get

:arrow_double_down: A YouTube/Youku/Niconico video downloader written in Python 3

dran1x

@dran1x

Why cant there be a config file and we set the path there...

and how can i change "you-get" to something else.

the "you-get" call command

huanghe2015

@huanghe2015

我最近看到M3U8 downloader利用FFmpeg实现多线程以提升下载速度，不知后期能不能加进来？？

huanghe2015

@huanghe2015

@scegg 优酷经常会改的，等等吧。

@vanehsd 反馈加个链接

@100288840 反馈加个链接

@yxd0018 Youtube可能做了修改，等等吧。

@dran1x Please write the output of terminal when having feedback.

Allen Cui

@scegg

https://www.bilibili.com/video/av14437336 这视频怎么下呢。

bilibili179行错

huanghe2015

@huanghe2015

@scegg 失效视频肯定不能下载啦！！！

Mort Yao

@soimort

@scegg 需要传cookies

huanghe2015

@huanghe2015

以下是M3U8 downloader使用的命令，可供参考：ffmpeg -threads 1 -i "https://tx-safety-video.acfun.cn/mediacloud/acfun/acfun_video/segment/FlZzknZVdHjJACs9em-mPtFfEou_H3AI_eAYP-3weVF8QeG1Ir9_aWxOxYPbigHr.m3u8?pkey=AAJT1BBaD7ngmFBeSscm3ZG3GSoH5qAkkOa_V_M5ds9YsCQg7hpFoD7ujXMnSy2Yb1Q4da4f34IkOpKG9X564ZVlnyYE8VI2r613aIKZvf0GEahYC7X_UyF64hSaMm4S_0CZIV_bO0e8iGG0Ug_fdTg5kGL8h0SAW-2tr7kIan_H9NdL80_AUIjSX4ld3l_8rb8aCbLCKSSnygzIgBQh8A5OXeM1hUzEtPi_qUUM7FLSRQ&safety_id=AALiHMNr8NZQFMcXpIGj-KRo" -c copy -y -bsf:a aac_adtstoasc "D:\迅雷下载\Video\交通事故\Video.mp4"

ooooo999

@ooooo999

之前提到you-get只调用ffmpeg的aac_adtstoasc，无法支持部分iqiyi视频的eac3音频编码的问题有更新吗? 可以用http://www.iqiyi.com/v_19rsictxqo.html做测试.

qkkas

@qkkas

爱奇艺上某些视频只能下一部分（6分钟）如:https://m.iqiyi.com/v_19rrdurjo8.html?vfrm=2-3-0-1

爱奇艺上某些视频只能下一部分（6分钟）如:https://m.iqiyi.com/v_19rrdurjo8.html?vfrm=2-3-0-1 这该怎么解决？

huanghe2015

@huanghe2015

付费视频要传Cookie @qkkas

如果还不好使的话就要看HTTP头了，那是另外一回事。

静海闲人

@lacafjh

Traceback (most recent call last):
File "c:\users\user\appdata\local\programs\python\python37\lib\urllib\request.py", line 1317, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 1252, in request
self._send_request(method, url, body, headers, encode_chunked)
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 1298, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 1247, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 1026, in _send_output
self.send(msg)
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 966, in send
self.connect()
File "c:\users\user\appdata\local\programs\python\python37\lib\http\client.py", line 938, in connect
(self.host,self.port), self.timeout, self.source_address)
File "c:\users\user\appdata\local\programs\python\python37\lib\socket.py", line 707, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "c:\users\user\appdata\local\programs\python\python37\lib\socket.py", line 748, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno 11001] getaddrinfo failed

有没有人知道这是什么情况

luckrill

@luckrill

you-get 在Linux 环境和 FreeBSD环境有差异， FreeBSD 环境不支持 --playlist

luckrill

@luckrill

因为you-get原因，把freebsd服务器切换到了 ubuntu。 you-get应用软件，怎么会涉及到操作系统环境昵？

huanghe2015

@huanghe2015

除了FFmpeg，我是想不出来什么原因了。

@luckrill

luckrill

@luckrill

后续发现了原因，不同环境了，默认探测可下载的文件不同，mp4 或 webm 。在freebsd环境不支持 --playlist 相当让我差异，python代码怎么会有这样问题？

一个建议：提供playlist输出功能，显示所有playlist，不做下载；提供部分playlist下载，从 num 到 num 范围下载。这样更加友好，默认全部下载比较冗余。

huanghe2015

@huanghe2015

在不同环境下载的文件不同我个人倾向于UA的原因；playlist部分我是无法解答了。

Wang

@wang0251

爱奇艺使用-c参数传递cookie后还是只能下6分钟视频，已经是付费用户。优酷付费视频传递cookie后可以正常下载。

huanghe2015

@huanghe2015

爱奇艺应该还有别的限制，再看一下HTTP头吧。 @wang0251 g

xyuanmu

@xyuanmu

从昨天开始部分哔哩哔哩视频会报 'h1Title' 以及 'id' 错误，比如这个：https://www.bilibili.com/bangumi/play/ep127625

解决办法如下，修改 you-get/src/you_get/extractors/bilibili.py 第 288 行和 291 行，改成下面这样

            # set video title
            self.title = initial_state['h1Title'] if 'h1Title' in initial_state else '%s %s %s' % (initial_state['mediaInfo']['title'], initial_state['epInfo']['index'], initial_state['epInfo']['index_title'])

            # construct playinfos
            ep_id = initial_state['epInfo']['id'] if 'id' in initial_state['epInfo'] else initial_state['epInfo']['ep_id']

ZeonWang

@scplay

You-get 支持 livestream 下载吗？

Haoran421

@Haoran421

youtube 和 bilibili试了一下，下载下来的文件默认视频和音频是分开的吗？

SFMDI

@SFMDI

Is there anyone who authorized to merge pull request?
I want my pull requests merged quickly
I need merged contributions for personal reasons...

soimort/you-get#2756
soimort/you-get#2757

Mort Yao

@soimort

@Haoran421 请安装ffmpeg

@SFMDI Merged. Thanks for the contribution!

Baiwu (Chris) Zhang

@bwuzhang

请问下有没有在短视频公司做爬虫的，想请教几个问题～

GiGaFotress

@GiGaFotress

you-get -l https://www.bilibili.com/video/av9912938 --debug
[DEBUG] get_content: https://www.bilibili.com/video/av9912938
[DEBUG] get_content: https://www.bilibili.com/video/av9912938
[DEBUG] get_content: https://interface.bilibili.com/v2/playurl?appkey=iVGUTjsxvpLeuDCf&cid=16388185&otype=json&qn=80&quality=80&type=&sign=6bb922f806a00854dafd89cbab9d1902
[DEBUG] get_content: https://interface.bilibili.com/v2/playurl?appkey=iVGUTjsxvpLeuDCf&cid=16388185&otype=json&qn=64&quality=64&type=&sign=c01b7c2b6402229ad8a4ba3205fcb7ce
[DEBUG] get_content: https://interface.bilibili.com/v2/playurl?appkey=iVGUTjsxvpLeuDCf&cid=16388185&otype=json&qn=32&quality=32&type=&sign=8bdb67bd05421df2f701bfa0ee0f3ea8
[DEBUG] get_content: https://api.bilibili.com/x/player/playurl?avid=9912938&cid=16388185&qn=16&type=&otype=json&fnver=0&fnval=16
[DEBUG] get_content: https://interface.bilibili.com/v2/playurl?appkey=iVGUTjsxvpLeuDCf&cid=16388185&otype=json&qn=16&quality=16&type=&sign=9027d765ec32bd2cf82ebf692a7f7a3d
[DEBUG] get_content: http://comment.bilibili.com/16388185.xml
you-get: version 0.4.1388, a tiny downloader that scrapes the web.
you-get: Namespace(URL=['https://www.bilibili.com/video/av9912938'], auto_rename=False, cookies=None, debug=True, extractor_proxy=None, force=False, format=None, help=False, http_proxy=None, info=False, input_file=None, insecure=False, itag=None, json=False, no_caption=False, no_merge=False, no_proxy=False, output_dir='.', output_filename=None, password=None, player=None, playlist=True, skip_existing_file_size_check=False, socks_proxy=None, stream=None, timeout=600, url=False, version=False)
Traceback (most recent call last):
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\runpy.py", line 85, in _run_code
exec(code, run_globals)
File "C:\Users\userss\AppData\Local\Programs\Python\Python37-32\Scripts\you-get.exe__main.py", line 9, in <module>
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\main__.py", line 92, in main
main(kwargs)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\common.py", line 1766, in main
script_main(any_download, any_download_playlist, kwargs)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\common.py", line 1654, in script_main
extra
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\common.py", line 1308, in download_main
download_playlist(url, kwargs)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\common.py", line 1762, in any_download_playlist
m.download_playlist(url, kwargs)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\extractors\bilibili.py", line 632, in download_playlist_by_url
self.download(kwargs)
File "c:\users\userss\appdata\local\programs\python\python37-32\lib\site-packages\you_get\extractor.py", line 209, in download
stream_id = itags[0]
IndexError: list index out of range

b站似乎当视频p太多的时候会出错

-i获取p信息可行,但是下载报错

反馈,linux端可以正常下载,windows端报错如上

zhongnan

@zhongnan1996

斗鱼现在好像不行

[DEBUG] get_content: https://v.douyu.com/show/NbwE7ZBGkVR7n5Zz
[DEBUG] get_content: http://vmobile.douyu.com/video/getInfo?vid=NbwE7ZBGkVR7n5Zz
[DEBUG] HTTP Error with code403
[DEBUG] HTTP Error with code403
[DEBUG] HTTP Error with code403
you-get: version 0.4.1388, a tiny downloader that scrapes the web.
you-get: Namespace(URL=['https://v.douyu.com/show/NbwE7ZBGkVR7n5Zz'], auto_rename=False, cookies=None, debug=True, extractor_proxy=None, force=False, format=None, help=False, http_proxy=None, info=False, input_file=None, insecure=False, itag=None, json=False, no_caption=False, no_merge=False, no_proxy=False, output_dir='.', output_filename=None, password=None, player=None, playlist=False, skip_existing_file_size_check=False, socks_proxy=None, stream=None, timeout=600, url=False, version=False)
Traceback (most recent call last):
File "/usr/local/bin/you-get", line 10, in <module>
sys.exit(main())
File "/usr/local/lib/python3.7/site-packages/you_get/main.py", line 92, in main
main(kwargs)
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 1766, in main
script_main(any_download, any_download_playlist, kwargs)
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 1654, in script_main
extra
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 1310, in download_main
download(url, kwargs)
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 1757, in any_download
m.download(url, kwargs)
File "/usr/local/lib/python3.7/site-packages/you_get/extractors/douyutv.py", line 51, in douyutv_download
douyutv_video_download(url, output_dir=output_dir, merge=merge, info_only=info_only, kwargs)
File "/usr/local/lib/python3.7/site-packages/you_get/extractors/douyutv.py", line 39, in douyutv_video_download
meta = json.loads(get_content(ep + vid))
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 442, in get_content
response = urlopen_with_retry(req)
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 420, in urlopen_with_retry
raise http_error
File "/usr/local/lib/python3.7/site-packages/you_get/common.py", line 411, in urlopen_with_retry
return request.urlopen(args, **kwargs)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 569, in error
return self._call_chain(args)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

yichuan66

@yichuan66

好厉害！

yichuan66

@yichuan66

ha!

duchadong

@duchadong

C:\Users\msi>you-get https://www.iqiyi.com/v_19rw9vcs9s.html
site: 爱奇艺 (Iqiyi)
title: 《嘴强TOP10》121：开30秒就把对面心态打崩了！敌方：6分投！
stream:

- format:        TD
  container:     m3u8
  video-profile: 720p
  m3u8_url:      http://cache.m.iqiyi.com/mus/238745301/8cb8e9e9662036b59bfdc7032dacc1b9/afbe8fd3d73448c9/0/20200121/d8/88/d62982f2c9df286ee1ec1f2e8b8bb3d5.m3u8?qd_originate=tmts_py&tvid=11712756300&bossStatus=0&qd_vip=0&px=&src=3_31_312&prv=&previewType=&previewTime=&from=&qd_time=1579672898481&qd_p=abee1ff5&qd_asc=31eba6718bc8d975c7fe0aef0267a075&qypid=11712756300_04022000001000000000_4&qd_k=aff51671f9b129a2c4589fdbb84a1f62&isdol=0&code=2&ff=f4v&iswb=0&qd_s=otv&vf=1e28ba6949984167a59c9cf34a201273&np_tag=nginx_part_tag
# download-with: you-get --format=TD [URL]

Where communities thrive

People

Repo info

Activity