0
0
Fork 0
Commit Graph

12561 Commits (2cd668ee591df4f271ed4394ba9b38262ae3c40e)

Author SHA1 Message Date
arza 73498a8921 [ruutu] Add support for supla.fi 2016-10-16 02:31:56 +07:00
Pierre Mdawar 2273e2c530 [postprocessor/ffmpeg] Return correct filepath and ext in updated information in FFmpegExtractAudioPP
Return correct audio's filepath and ext instead of the video's when extracting audio and audio file already exists.
2016-10-16 02:12:03 +07:00
Sergey M․ 4b492e3579
[theoperaplatform] Rename, fix _VALID_URL and fix test 2016-10-16 00:24:06 +07:00
Juanjo Benages 9c4258bcec
[theoperaplatform] Add extractor 2016-10-16 00:21:15 +07:00
Sergey M․ ea8aefd1d7
[lynda] Fix height for prioritized streams 2016-10-16 00:08:46 +07:00
Sergey M․ 6edfc40a0e
[lynda] Add fallback extraction scenario 2016-10-16 00:07:40 +07:00
Sergey M․ 68d9561ca1
[lynda] Switch to https (closes #10916) 2016-10-15 23:56:09 +07:00
Yen Chi Hsuan d32fa0f12c
[huajiao] Coding style 2016-10-15 14:53:53 +08:00
Yen Chi Hsuan a347a0d088
Merge branch 'huajiao' of https://github.com/pyx/youtube-dl into pyx-huajiao 2016-10-15 14:53:05 +08:00
Yen Chi Hsuan 77c5b98dcd
[crunchyroll] Skip an invalid _TEST 2016-10-15 14:36:07 +08:00
Yen Chi Hsuan 88ebefc054
[cmt] Fix mgid extraction (closes #10813)
The example in #10813 requires TV provider authentication in Firefox,
while youtube-dl can download it directly with an US proxy.

I'm not sure whether the mgid fix is cmt-specific or it applies to all
mtv-based sites. I keep it in cmt.py until similar patterns are found in
other websites.
2016-10-15 14:27:15 +08:00
Philip Xu 2e638d7bca Made optional fields optional 2016-10-14 14:12:06 -04:00
Sergey M․ a26b174c61
[safari:course] Add support for techbus.safaribooksonline.com 2016-10-15 00:29:33 +07:00
Sergey M․ 73c801d660
[orf:tvthek] Fix extraction and modernize (closes #10898) 2016-10-14 23:43:09 +07:00
Yen Chi Hsuan 8c3e448e80
[clipfish] Update _TEST; the old one is gone 2016-10-15 00:12:21 +08:00
Yen Chi Hsuan 2ecbd2ad6f
[chirbit:profile] Fix extraction 2016-10-15 00:01:46 +08:00
Yen Chi Hsuan 62a0b86e4f
[carambatv] Fix extraction
The video requested in #9815 now has videomore embeds.
2016-10-14 23:43:18 +08:00
Yen Chi Hsuan 146969e05b
[videomore] Support <iframe> embed videos
Seen in CarambaTVPage
2016-10-14 23:42:11 +08:00
Yen Chi Hsuan e2004ccaf7
[canalplus] Fix video_id and update _TESTS
Some tests are gone, and some redirect to different videos
2016-10-14 20:26:12 +08:00
Yen Chi Hsuan a5f8473145
[cbsinteractive] Fix extraction for cnet.com 2016-10-14 18:20:01 +08:00
Philip Xu b7f59a3bf6 [huajiao] Add new extractor 2016-10-13 21:51:26 -04:00
Yen Chi Hsuan 580d411931
[parliamentliveuk] Recognize lower case URLs
Closes #10912

Seems parliamentliveuk matches URLs case-insentive. For example this URL
also works:
http://parliamentlive.tv/EvEnt/Index/3F24936f-130f-40bf-9a5d-b3d6479da6a4
2016-10-14 00:44:28 +08:00
Sergey M․ 5c4bfd4da5
release 2016.10.12 2016-10-12 21:30:05 +07:00
Sergey M․ bcd6276520
[downloader/common] Remove debug output 2016-10-12 21:22:33 +07:00
Sergey M․ 591e384552
[streamable] Remove debug output 2016-10-12 21:22:12 +07:00
Yen Chi Hsuan 9feb1c9731
[dailymotion] Fix extraction and update _TESTS
Closes #10901

Seems all videos use player V5 syntax now
2016-10-12 21:45:49 +08:00
Yen Chi Hsuan a093cfc78b
[vimeo:review] Fix extraction (#10900)
Now Vimeo Review videos uses React. Thanks @davekaro for analyzing the
problem!
2016-10-12 01:48:06 +08:00
Yen Chi Hsuan cea364f70c
[extractor/common] Support HTML media elements without child nodes 2016-10-12 01:40:28 +08:00
Yen Chi Hsuan 55642487f0
[nhl] Skip invalid m3u8 formats (closes #10713) 2016-10-11 20:50:52 +08:00
Yen Chi Hsuan 3d643f4cec
[hbo] Add HBOEpisodeIE (#10892) 2016-10-11 17:46:52 +08:00
Yen Chi Hsuan c452e69d3d
[footyroom] Fix extraction and update _TESTS (closes #10810) 2016-10-11 17:46:13 +08:00
Yen Chi Hsuan 555787d717
[streamable] Add helper for extracting embedded videos 2016-10-11 17:44:35 +08:00
Yen Chi Hsuan f165ca70eb
[abc.net.au:iview] Fix for non-series videos (closes #10895) 2016-10-11 12:53:27 +08:00
Yen Chi Hsuan 27b8d2ee95
[hbo] Add display_id and another test (#10892) 2016-10-11 12:41:44 +08:00
Yen Chi Hsuan 71cdcb2331
[hbo] Support episode pages (closes #10892) 2016-10-11 12:30:35 +08:00
Yen Chi Hsuan 176006a120
[allocine] Fix for /video/ videos (closes #10860) 2016-10-09 19:42:42 +08:00
Yen Chi Hsuan 65f4c1de3d
[allocine] Fix extraction (closes #10860)
I change the URL of the third test case, because now the original URL
does not contain a video anymore, and there's no easy to get the real
URL from the /film/ one.
2016-10-09 18:58:15 +08:00
Yen Chi Hsuan b0082629a9
[nextmedia] Support action news (動新聞) on Apple Daily 2016-10-09 18:42:15 +08:00
Déstin Reed 2b51dac1f9
[slutload] Fix test and simplify 2016-10-09 01:17:38 +07:00
Sergey M․ f68901e50a
[reverbnation] Eliminate code duplication in thumbnails extraction 2016-10-09 01:02:35 +07:00
Déstin Reed 3adb9d119e
[reverbnation] Modernize 2016-10-09 01:00:38 +07:00
Remita Amine 1dd58e14d8 [lego] improve info extraction and bypass geo restriction(closes #10872) 2016-10-08 08:33:18 +01:00
Sergey M․ dd4291f729
release 2016.10.07 2016-10-07 22:25:30 +07:00
Sergey M․ f475e88121
[vimeo] PEP 8
[ci skip]
2016-10-07 22:15:26 +07:00
Remita Amine 3c6b3bf221 [iprima] detect geo restriction 2016-10-07 15:53:16 +01:00
Yen Chi Hsuan 38588ab977
[facebook] Fix for new handleServerJS syntax (closes #10846)
According to the dump file in #10846, handleServerJS() now accepts
an optional second argument. It's a string from available dump files.
2016-10-07 20:04:49 +08:00
Yen Chi Hsuan 85bcdd081c
[extractors] Add MmsIE 2016-10-07 19:31:26 +08:00
Yen Chi Hsuan 9dcd6fd3aa
[generic,commonprotocols] Move mms suuport from GenericIE
And use _generic_* helpers in those extractors
2016-10-07 19:24:22 +08:00
Yen Chi Hsuan 98763ee354
[extractor/common] Add id and title helpers for generic IEs 2016-10-07 19:20:53 +08:00
Yen Chi Hsuan 3d83a1ae92
[generic] Support direct MMS links (closes #10838) 2016-10-07 17:50:45 +08:00
Sergey M․ 09b9c45e24
[generic] Add support for multiple vimeo embeds (Closes #10862) 2016-10-06 23:22:52 +07:00
Remita Amine 33898fb19c [nzz] Add new extractor(#4407) 2016-10-06 10:45:57 +01:00
Remita Amine 017eb82934 [npo] detect geo restriction 2016-10-05 18:27:02 +01:00
Sergey M․ b1d798887e
[npo] Add support for 2doc.nl (Closes #10842) 2016-10-05 23:43:08 +07:00
Remita Amine 185744f92f [lego] Add new extractor(closes #10369) 2016-10-04 10:30:57 +01:00
Remita Amine 7232e54813 [tonline] Add new extractor(#10376) 2016-10-04 08:00:25 +01:00
Sergey M․ 6eb5503b12
[techtalks] Relax _VALID_URL 2016-10-04 02:54:36 +07:00
Aleksander Nitecki 539c881bfc
[techtalks] Allow URL-s with name part omitted. 2016-10-04 02:52:33 +07:00
Sergey M․ c1b2a0858c
[youtube:live] Extend _VALID_URL (Closes #10839) 2016-10-04 02:10:23 +07:00
Remita Amine 215ff6e0f3 [theweatherchannel] Add new extractor(closes #7188) 2016-10-03 18:20:34 +01:00
Déstin Reed dcdb292fdd
Unify coding cookie 2016-10-03 23:44:29 +07:00
Remita Amine c1084ddb0c [thisoldhouse] Add new extractor(closes #10837) 2016-10-03 15:27:09 +01:00
Sergey M․ ee5de4e38e
[nhl] Add support for wch2016.com (Closes #10833) 2016-10-03 00:54:02 +07:00
Yen Chi Hsuan 25291b979a Merge pull request #10829 from TRox1972/pornoxo_improve
[pornoxo] Use JWPlatform to improve metadata extraction
2016-10-02 20:19:34 +08:00
Déstin Reed 567a5996ca [pornoxo] Use JWPlatform to improve metadata extraction 2016-10-02 13:07:02 +02:00
Sergey M․ 6c152ce20f
release 2016.10.02 2016-10-02 15:58:00 +07:00
Yen Chi Hsuan 703b3afa93
[amcnetworks] Skip a restricted _TEST 2016-10-02 14:25:06 +08:00
Yen Chi Hsuan 99ed78c79e
[jwplatform] Support DASH streams 2016-10-02 14:07:49 +08:00
Yen Chi Hsuan fd15264172
[jwplatform] Support old-style jwplayer playlists 2016-10-02 13:47:06 +08:00
Yen Chi Hsuan bd26441205
[utils] Fix xattr error handling 2016-10-02 03:03:41 +08:00
Yen Chi Hsuan b19e275d99
[__init__] Fix lost xattr if --embed-thumbnail used
Reported at
https://github.com/rg3/youtube-dl/issues/9054#issuecomment-250451823
2016-10-02 02:12:14 +08:00
Sergey M․ f6ba581f89
[byutv:event] Add extractor 2016-10-02 00:50:07 +07:00
Sergey M․ 6d2549fb4f
[byutv] Fix id and display id 2016-10-02 00:44:54 +07:00
Déstin Reed 4da4516973
[byutv] Rely on _match_id and _parse_json 2016-10-02 00:41:18 +07:00
Sergey M․ e1e97c2446
[periscope:user] Fix extraction (Closes #10820) 2016-10-01 22:50:47 +07:00
Yen Chi Hsuan 53a7e3d287
[utils] Support xattr as well as pyxattr
Closes #9054

There are two xattr packages in Python, pyxattr [1] and xattr [2]. They
have different APIs.

In old days pyxattr supports Linux only and xattr supports Linux, Mac,
FreeBSD and Solaris, and pyxattr supports Linux only. Recently pyxattr
adds support for Mac OS X. [3]

An old version of [2] is shipped with Mac OS X. However, some Linux
distributions have pyxattr only, for example PLD-Linux [4] and old Arch
Linux. [5] As a result, supporting both is the way to go.

[1] https://github.com/iustin/pyxattr
[2] https://github.com/xattr/xattr
[3] https://github.com/iustin/pyxattr/pull/9
[4] https://github.com/rg3/youtube-dl/issues/5498
[5] https://git.archlinux.org/svntogit/community.git/commit/?id=427c4c76401e386d865ccddea4fbfdc74df80492
    https://git.archlinux.org/svntogit/community.git/commit/?id=59b40da7b69622a6761d364a8b07909e9cccaa56
    python-xattr is added on 2016/06/29 while pyxattr is there for more
    than 6 years
2016-10-01 20:13:04 +08:00
Yen Chi Hsuan d54739a2e6
[downloader/http] xattr values should be bytes 2016-10-01 19:58:13 +08:00
Yen Chi Hsuan 63e0fd5bcc Merge pull request #10818 from TRox1972/criterion_match_id
[criterion] Rely on _match_id, improve regex and add thumbnail to test
2016-10-01 19:49:18 +08:00
Déstin Reed 9c51a24642 [criterion] Rely on _match_id, improve regex and add thumbnail to test 2016-10-01 13:46:48 +02:00
Yen Chi Hsuan 9bd7bd0b80
[twitch] Skip a 404 test 2016-10-01 16:38:47 +08:00
Yen Chi Hsuan 4a76b73c6c Merge pull request #10817 from TRox1972/clubic_match_id
[clubic] Rely on _match_id and _parse_json
2016-10-01 16:20:12 +08:00
Yen Chi Hsuan e295618f9e
[dctp] Fix extraction (closes #10734) 2016-10-01 15:22:48 +08:00
Yen Chi Hsuan d7753d1948
[downloader/http] Use write_xattr function for --xattr-set-filesize 2016-10-01 14:47:20 +08:00
Déstin Reed eaf9b22f94 [clubic] Rely on _match_id and _parse_json 2016-09-30 20:03:25 +02:00
Sergey M․ a1001f47fc
[instagram] PEP 8 2016-10-01 00:16:08 +07:00
Déstin Reed 1609782258
[Instagram] Extract video dimensions 2016-10-01 00:13:34 +07:00
Sergey M․ de6babf922
[tvland] Extend _VALID_URL (Closes #10812) 2016-09-30 22:30:34 +07:00
Sergey M․ b0582fc806
[vgtv] Add support for tv.aftonbladet.se (Closes #10800) 2016-09-30 00:15:09 +07:00
Sergey M․ af33dd8ee7
[aftonbladet] Remove extractor 2016-09-30 00:13:03 +07:00
Sergey M․ 70d7b323b6
[vk] Improve view count extraction 2016-09-29 23:52:29 +07:00
Sergey M․ a7ee8a00f4
[vk] Extract timestamp (Closes #10760) 2016-09-29 23:52:29 +07:00
Sergey M․ c6eed6b8c0
[utils] Lower priority for rare date formats and add tests 2016-09-29 23:52:29 +07:00
Kacper Michajłow 3aa3953d28
[vk] Fix date and view count extraction. 2016-09-29 23:52:29 +07:00
Yen Chi Hsuan efa97bdcf1
Move write_xattr to utils.py
There are some other places that use xattr functions. It's better to
move it to a common place so that others can use it.
2016-09-30 00:28:32 +08:00
Sergey M․ 475f8a4580
[vk] Add support for running live streams (Closes #10799) 2016-09-29 23:21:39 +07:00
Sergey M․ 93aa0b6318
[vk] Add support for finished live streams (#10799) 2016-09-29 23:04:10 +07:00
Yen Chi Hsuan 0ce26ef228 Merge pull request #10788 from TRox1972/instagram_comments
[Instagram] Extract comments
2016-09-29 21:54:39 +08:00
Yen Chi Hsuan 0d72ff9c51
[leeco] Recognize more Le Sports URLs (#10794) 2016-09-29 21:39:35 +08:00
Déstin Reed a56e74e271 [Instagram] Extract comments 2016-09-28 19:32:40 +02:00
Sergey M․ f533490bb7
[ketnet] Extract mzsource formats (#10770) 2016-09-28 22:58:25 +07:00
Remita Amine 8bfda726c2 [limelight:media] improve http formats extraction 2016-09-28 16:34:27 +01:00
Sergey M․ 8f0cf20ab9
release 2016.09.27 2016-09-27 23:09:46 +07:00
Sergey M․ cdfcc4ce95
[mtv] Improve _VALID_URL 2016-09-27 22:27:10 +07:00
Kacper Michajłow e384552590
[vk] Add support for dailymotion embeds
Fixes #10661
2016-09-27 21:58:14 +07:00
Sergey M․ 1a2fbe322e
[periscope] Treat timed_out state as finished stream 2016-09-27 21:55:51 +07:00
Sergey M․ f9dd86a112
[npo] Clarify IE_NAMEs (Closes #10775) 2016-09-27 21:37:33 +07:00
Remita Amine 2342733f85 fix tests related to 1978540a5122c53012e17a78841f3da0df77fd34(closes #10774) 2016-09-27 15:31:25 +01:00
Remita Amine 93933c9819 [awaan:video] fix test(closes #10773) 2016-09-27 15:31:25 +01:00
Yen Chi Hsuan d75d9e343e
[einthusan] Fix extraction (closes #10714) 2016-09-27 14:38:41 +08:00
Sergey M․ 72c3d02d29
[promptfile] Improve and modernize 2016-09-26 23:39:54 +07:00
Ondřej Bárta d3dbb46330
[promptfile] Fix extraction (Closes #10634) 2016-09-26 23:20:58 +07:00
Sergey M․ fffb9cff94
[kaltura] Speed up embed regexes (#10764) 2016-09-26 22:15:58 +07:00
Sergey M․ 2d5b4af007
[extractors] Add import for anderetijden extractor 2016-09-25 23:30:57 +07:00
Sergey M․ 5742c18bc1
[npo] Add support for anderetijden.nl (Closes #10754) 2016-09-25 22:26:14 +07:00
Sergey M․ ddb19772d5
[vpro] Fix playlist title extraction and update tests 2016-09-25 22:26:06 +07:00
Sergey M․ a3d8b38168
[npo] Generalize playlist extractors 2016-09-25 22:26:00 +07:00
stepshal 2d3d29976b
[youtube] Change test URLs from http to https 2016-09-25 17:45:24 +07:00
Sergey M․ 493353c7fd
[prosiebensat1] Add support for advopedia 2016-09-25 06:25:57 +07:00
Sergey M․ 0a078550b9
[prosiebensat1] Improve _VALID_URL 2016-09-25 06:19:17 +07:00
Sergey M․ f92bb612c6
[mwave] Relax _VALID_URLs (Closes #10735, closes #10748) 2016-09-25 06:14:32 +07:00
Sergey M․ ddde91952f
[prosiebensat1] Fix playlist support (Closes #10745) 2016-09-25 05:36:18 +07:00
Sergey M․ 63c583eb2c
[prosiebensat1] Add support for sat1gold (#10745) 2016-09-25 04:43:10 +07:00
Remita Amine 7fd57de6fb [cbsnews:livevideo] fix extraction and extract m3u8 formats 2016-09-24 22:01:33 +01:00
Remita Amine e71a450956 [common] add hdcore sign to akamai f4m formats 2016-09-24 21:55:53 +01:00
Remita Amine 27e99078d3 [brightcove:new] add support for live streams 2016-09-24 15:39:48 +01:00
Remita Amine 6f126d903f [download/hls] Delegate downloading to ffmpeg for live streams 2016-09-24 15:39:47 +01:00
Sergey M․ 7518a61d41
[soundcloud] Fix typo in playlist base class name 2016-09-24 19:29:49 +07:00
Sergey M․ 8e45e1cc4d
[soundcloud] Generalize playlist entries extraction (#10733) 2016-09-24 19:18:01 +07:00
Yen Chi Hsuan f0bc5a8609
[twitter] Support Periscope embeds (closes #10737)
Also update _TESTS
2016-09-24 20:00:29 +08:00
Remita Amine a54ffb8aa7 [mtv] add common IE_NAME prefix for MTVIE and MTVVideoIE 2016-09-24 10:50:14 +01:00
Remita Amine 8add4bfecb [mtv] add support for new website urls(closes #8169)(closes #9808) 2016-09-24 10:42:20 +01:00
Yen Chi Hsuan 0711995bca
[openload] Support subtitles (closes #10625) 2016-09-24 14:27:08 +08:00
Yen Chi Hsuan 5968d7d2fe
[extractor/common] Improved support for HTML5 subtitles
Ref: #10625

In a strict sense, <track>s with kind=captions are not subtitles. [1]
openload misuses this attribute, and I guess there will be more
examples, so I add it to common.py.

Also allow extracting information for subtitles-only <video> or <audio>
tags, which is the case of openload.

[1] https://www.w3.org/TR/html5/embedded-content-0.html#attr-track-kind
2016-09-24 14:20:42 +08:00
Sergey M․ e6332059ac
release 2016.09.24 2016-09-24 02:16:47 +07:00
Sergey M․ 24628cf7db
[soundcloud:playlist] Provide video id for playlist entries (Closes #10733) 2016-09-24 02:01:01 +07:00
Sergey M․ 71ad00c09f
[prosiebensat1] Add support for kabeleinsdoku (Closes #10732) 2016-09-23 21:08:16 +07:00
Remita Amine 45cae3b021 [cbs] extract info from thunder videoPlayerService(closes #10728) 2016-09-22 19:28:22 +01:00
Yen Chi Hsuan 4ddcb5999d
[openload] Fix extraction (closes #10408, closes #10727)
Thanks to @daniel100097 for providing a working version
2016-09-23 01:47:51 +08:00
Yen Chi Hsuan e3d6bdc8fc
[ustream] Support HLS streams (closes #10698) 2016-09-23 01:11:13 +08:00
Sergey M․ 0a439c5c4c
[udemy] Stringify video id 2016-09-22 21:48:53 +07:00
Remita Amine 1978540a51 [ooyala] extract all hls formats 2016-09-21 21:49:52 +01:00
Sergey M․ 12f211d0cb
[videomore] Fix embed regex 2016-09-21 22:51:36 +07:00
Remita Amine 3a5a18705f [adobepass] add support MSO that depend on watchTVeverywhere(closes #10709) 2016-09-21 15:57:27 +01:00
Remita Amine 1ae0ae5db0 [cartoonnetwork] add support Adobe Pass auth 2016-09-20 18:52:00 +01:00
Sergey M․ f62a77b99a
[soundcloud] Modernize 2016-09-20 21:56:57 +07:00
coolsa 4bfd294e2f
[soundcloud] Extract license metadata 2016-09-20 21:56:57 +07:00
Remita Amine e33a7253b2 [fox] add support for Adobe Pass auth(closes #8584) 2016-09-20 15:52:23 +01:00
Remita Amine c38f06818d add support for Adobe Pass auth in tbs,tnt and trutv extractors(fixes #10642)(closes #10222)(closes #10519) 2016-09-20 11:55:30 +01:00
Sergey M․ cb57386873
release 2016.09.19 2016-09-19 02:58:32 +07:00
Sergey M․ 70b4cf9b1b
[crunchyroll] Check if already logged in (Closes #10700) 2016-09-19 02:50:06 +07:00
Sergey M․ cc764a6da8
[twitch:stream] Remove fallback to profile extraction when stream is offline
Main page does not contain profile videos anymore
2016-09-18 19:10:18 +07:00
Yen Chi Hsuan d8dbf8707d
[thisav] Improve title extraction (closes #10682)
I didn't add a test case as the one in #10682 looks like a copyrighted
product.
2016-09-18 18:35:38 +08:00
Sergey M․ a1da888d0c
[vyborymos] Improve station info extraction 2016-09-18 17:30:55 +07:00
Sergey M․ 3acff9423d
release 2016.09.18 2016-09-18 17:16:55 +07:00
Sergey M․ 14ae11efab
[vyborymos] Add extractor (Closes #10692) 2016-09-18 16:56:40 +07:00
Sergey M․ 190d2027d0
[xfileshare] Add title regex for streamin.to and fallback to video id (Closes #10646) 2016-09-18 07:22:06 +07:00
Sergey M․ 26394d021d
[globo:article] Add support for multiple videos (Closes #10653) 2016-09-17 23:34:10 +07:00
Sergey M․ 30d0b549be
[extractor/common] Add manifest_url for hls and hds formats 2016-09-17 21:33:38 +07:00
Sergey M․ 86f4d14f81
Refactor fragments interface and dash segments downloader
- Eliminate segment_urls and initialization_url
+ Introduce manifest_url (manifest may contain unfragmented data in this case url will be used for direct media URL and manifest_url for manifest itself correspondingly)
* Rewrite dashsegments downloader to use fragments data
* Improve generic mpd extraction
2016-09-17 20:35:22 +07:00
Sergey M․ 21d21b0c72
[svt] Fix DASH formats extraction 2016-09-17 19:25:31 +07:00
Sergey M․ b4c1d6e800
[extractor/common] Expose fragments interface for dashsegments formats 2016-09-17 18:31:18 +07:00
Sergey M․ a0d5077c8d
[extractor/common] Introduce fragments interface 2016-09-17 18:31:09 +07:00
Yen Chi Hsuan 584d6f3457
[thisav] Recognize jwplayers (closes #10447) 2016-09-17 18:46:43 +08:00
Yen Chi Hsuan e14c82bd6b
[jwplatform] Use js_to_json to detect more JWPlayers 2016-09-17 18:45:08 +08:00
Sergey M․ c51a7f0b2f
[franceinter] Fix upload date extraction 2016-09-17 15:44:37 +07:00
Remita Amine d05ef09d9d [mangomolo] fix domain regex 2016-09-17 08:11:01 +01:00
Remita Amine 30d9e20938 [postprocessor/ffmpeg] apply FFmpegFixupM3u8PP only for videos with aac codec(#5591) 2016-09-16 22:06:55 +01:00
Remita Amine fc86d4eed0 [mangomolo] fix typo 2016-09-16 20:10:47 +01:00
Remita Amine 7d273a387a [mangomolo] add support for Mangomolo embeds 2016-09-16 19:31:39 +01:00
Remita Amine 6ad0219556 [common] add helper method for Wowza Streaming Engine format extraction 2016-09-16 19:30:38 +01:00
Remita Amine 98b7506e96 [toutv] add support for authentication(closes #10669) 2016-09-16 17:40:15 +01:00
Sergey M․ 52dc8a9b3f
[franceinter] Fix upload date extraction 2016-09-16 22:02:59 +07:00
Sergey M․ 9d8985a165
[tv4] Fix hls and hds formats (Closes #10659) 2016-09-16 00:54:34 +07:00
Sergey M․ f5e008d134
release 2016.09.15 2016-09-15 23:46:11 +07:00
stepshal 490b755769
Improve some id regexes 2016-09-15 23:12:58 +07:00
Sergey M․ 1dec2c8a0e
[adobepass] Change mvpd cache section name
In order to better emphasize it's relation to Adobe Pass
2016-09-15 22:47:45 +07:00
Sergey M․ dcce092e0a
[extractor/common] Simplify _get_netrc_login_info and carry long lines 2016-09-15 22:35:12 +07:00
Sergey M․ 32443dd346
[extractor/common] Update _get_login_info's comment 2016-09-15 22:34:29 +07:00
Sergey M․ 2133565cec
[extractor/common] Simplify _get_login_info 2016-09-15 22:26:37 +07:00
Sergey M․ 1da50aa34e
[YoutubeDL] Improve Adobe Pass options' wording 2016-09-15 22:24:55 +07:00
Sergey M․ d2522b86ac
[options] Actually print Adobe Pass options sections in --help 2016-09-15 22:18:31 +07:00
Sergey M․ 537f753399
[options] Improve Adobe Pass wording 2016-09-15 22:17:17 +07:00
Sergey M․ c849836854
[utils] Improve _hidden_inputs 2016-09-15 21:54:48 +07:00
Sergey M․ eb5b1fc021
[crunchyroll] Fix authentication (Closes #10655) 2016-09-15 21:53:35 +07:00
Sergey M․ 95be29e1c6
[twitch] Fix api calls (Closes #10654, closes #10660) 2016-09-15 20:58:02 +07:00
Remita Amine c035dba19e [bellmedia] add support for more sites 2016-09-15 08:12:12 +01:00
Remita Amine 87148bb711 [adobepass] rename --ap-mso-list option to --ap-list-mso 2016-09-14 20:21:09 +01:00
Remita Amine 797c636bcb [ap] improve adobe pass names and parse error handling 2016-09-14 18:58:47 +01:00
Sergey M․ 0002962f3f
[franceinter] Improve extraction (Closes #10538) 2016-09-14 23:59:38 +07:00
Sergey M․ 3e4185c396
[utils] Use native french month names 2016-09-14 23:59:38 +07:00
Sergey M․ f6717dec8a
[utils] Improve month_by_name and add tests 2016-09-14 23:59:38 +07:00
renalid a942d6cb48
[utils,franceinter] Add french months' names and fix extraction
Update of the "FranceInter" radio extractor : webpages HTML structure
had changed, the extractor didn't work. So I updated this extractor to
get the mp3 URL and all details.
2016-09-14 23:59:38 +07:00
Yen Chi Hsuan 961516bfd1
[kwuo:song] Improve error detection (closes #10650) 2016-09-15 00:56:15 +08:00
Yen Chi Hsuan 6db354a9f4
[kuwo] Update _TESTS 2016-09-15 00:53:04 +08:00
Remita Amine 353f340e11 [go] fix typo 2016-09-14 17:22:42 +01:00
Remita Amine 014b7e6b25 [go] add support for free full episodes(#10439) 2016-09-14 17:08:25 +01:00
stepshal 925194022c
Improve some _VALID_URLs 2016-09-14 22:47:21 +07:00
Sergey M․ b690ea15eb
[viafree] Fix test 2016-09-14 22:45:23 +07:00
Remita Amine 5712c0f426 [adobepass] remove unnecessary option 2016-09-14 16:37:21 +01:00
Yen Chi Hsuan 86d68f906e
[bilibili] Fix extraction for videos without backup_url (#10647) 2016-09-14 22:11:49 +08:00
Yen Chi Hsuan 4875ff6847
[bilibili] Remove copyrighted test cases
I can't find any English or Chinese material that claims BiliBili has
bought legal redistribution permissions for copyrighted products from
copyrighted holders.

References for removed test cases:
"刀语": https://en.wikipedia.org/wiki/Katanagatari, by White Fox
"哆啦A梦": https://en.wikipedia.org/wiki/Doraemon, by Shin-Ei Animation
"岳父岳母真难当": https://en.wikipedia.org/wiki/Serial_(Bad)_Weddings, by Les films du 24
"混沌武士": https://en.wikipedia.org/wiki/Samurai_Champloo, by Manglobe

I shouldn't have added them to _TESTS
2016-09-14 22:09:43 +08:00
Remita Amine 1b6712ab23 [adobepass] add specific options for adobe pass authentication
- add --ap-username and --ap-password option to specify
TV provider username and password in the cmd line
- add --ap-retries option to limit the number of retries
- add --list-ap-msi-ids to list the supported TV Providers
2016-09-13 22:16:01 +01:00
Sergey M․ 8414c2da31
[adobepass] PEP 8 2016-09-13 23:22:16 +07:00
Sergey M․ 45396dd2ed
[nhk] Fix extraction (Closes #10633) 2016-09-13 23:20:25 +07:00
Remita Amine 7a7309219c [adobepass] add an option to specify mso_id and support for ROGERS TV Provider(closes #10606) 2016-09-12 23:39:35 +01:00
Sergey M․ a6ccc3e518
[safari] Improve ids regexes (#10617) 2016-09-12 23:05:52 +07:00
Sergey M․ 1d16035bb4
[kaltura] Improve audio detection 2016-09-12 22:43:45 +07:00
Sergey M․ e8bcd982cc
[kaltura] Skip chun format 2016-09-12 22:33:00 +07:00
Sergey M․ a5ff05df1a
[extractor/generic] Add vimeo embed that requires Referer passed 2016-09-12 21:49:31 +07:00
Sergey M․ d002e91986
[vimeo:ondemand] Pass Referer along with embed URL (#10624) 2016-09-12 21:48:45 +07:00
Yen Chi Hsuan be45730226
[nbc] Add new extractor for NBC Olympics (#10295, #10361) 2016-09-12 02:55:15 +08:00
Sergey M․ ee7e672eb0
[tube8] Remove proxy settings from test 2016-09-11 23:46:50 +07:00
Sergey M․ 0307d6fba6
release 2016.09.11.1 2016-09-11 23:33:20 +07:00
Sergey M․ 1c81476cbb
release 2016.09.11 2016-09-11 23:20:09 +07:00
Sergey M․ bc9186c882
[tvplay] Remove unused import 2016-09-11 22:51:12 +07:00
Sergey M․ 6599c72527
[tube8] Extract categories and tags (Closes #10579) 2016-09-11 22:50:36 +07:00
Yen Chi Hsuan 6bb05b32a9
[pornhub] Extract categories and tags (closes #10499) 2016-09-11 19:22:51 +08:00
Yen Chi Hsuan fea74acad8
[foxnews] Revert to old extractor names 2016-09-11 18:54:24 +08:00
Yen Chi Hsuan f01115c933 [openload] Temporary fix (#10408) 2016-09-11 18:36:59 +08:00
Yen Chi Hsuan 2cdbc06a1f
[foxnews] Support Fox News Articles (closes #10598) 2016-09-11 18:32:45 +08:00
Sergey M․ 2cb93afcd8
[viafree] Improve video id extraction (Closes #10615) 2016-09-11 14:59:14 +07:00
Yen Chi Hsuan bfcda07a27
[abc:iview] Skip the test. They are removed soon 2016-09-11 04:06:00 +08:00
Yen Chi Hsuan 001a5fd3d7
[iwara] Fix extraction after relaunch
Closes #10462, closes #3215
2016-09-11 03:02:00 +08:00
Remita Amine 1e35999c1e [tfo] Add new extractor 2016-09-10 19:43:31 +01:00
Sergey M․ 2512b17493
[lrt] Fix audio extraction (Closes #10566) 2016-09-11 01:27:20 +07:00
Sergey M․ 56c0ead4d3
[9now] Improve video data extraction (Closes #10561) 2016-09-11 00:42:13 +07:00
Scott Leggett 7324243750
[9now] Fix extraction 2016-09-11 00:16:29 +07:00
Sergey M․ 84a18e9b90
[polskieradio:category] Improve extraction 2016-09-10 22:01:49 +07:00
Sergey M․ b29f842e0e
[canalplus] Add support for c8.fr (Closes #10577) 2016-09-10 20:46:45 +07:00
Sergey M․ f009fcac0d
Merge branch 'master' of github.com:rg3/youtube-dl 2016-09-10 19:21:03 +07:00
Yen Chi Hsuan 6c3affcb18
[newgrounds] Fix uploader extraction
Closes #10584

Also change test URLs to HTTPS, as proposed by
@stepshal in #10593.

Closes #10593
2016-09-10 20:09:09 +08:00
Sergey M․ 1e19ff2984
Merge branch 'polskie-radio-programme' of https://github.com/JakubAdamWieczorek/youtube-dl 2016-09-10 00:42:36 +07:00
Sergey M․ c6129feb7f
[ketnet] Add extractor (Closes #10343) 2016-09-09 23:20:45 +07:00
Sergey M․ bb5ebd4453
[canvas] Add support for een.be (Closes #10605) 2016-09-09 22:16:21 +07:00
Remita Amine cb9cbd84ed [extractors] add import for TeleQuebecIE 2016-09-08 22:55:27 +01:00
Remita Amine 4d5726b0d7 [telequebec] Add new extractor(closes #1999) 2016-09-08 22:53:44 +01:00
Remita Amine 4614ad7b59 [parliamentliveuk] fix extraction(closes #9137) 2016-09-08 20:46:12 +01:00
Sergey M․ b717837190
release 2016.09.08 2016-09-08 23:46:14 +07:00
Sergey M․ ad0e2b3359
[abcotvs] Add support for ABC Owned Television Stations 2016-09-08 23:15:58 +07:00
Sergey M․ 37720844f6
[jwplatform] Extract height from label 2016-09-08 22:53:20 +07:00
Sergey M․ 6cfcb8ac36
[tvnoe] Do not capture unused groups in _VALID_URL 2016-09-08 22:53:20 +07:00
Remita Amine 7a979da8cb [yahoo] Look for Brightcove Legacy Studio embeds(closes #9345) 2016-09-08 16:44:22 +01:00
Sergey M․ 2fdc7b0e04
[viafree] PEP 8 2016-09-08 22:40:02 +07:00
Sergey M․ 010d034fca
[videomore] Fix extraction (Closes #10592) 2016-09-08 22:38:49 +07:00
stepshal 25042f7372 Add missing r prefix for _VALID_URLs 2016-09-08 17:04:57 +07:00
Yen Chi Hsuan 3f612f0767
Fix _VALID_URLs further (#10594) 2016-09-08 17:39:29 +08:00
Yen Chi Hsuan 17bf6e71cc Merge pull request #10594 from stepshal/https_support
Add support for https for rest of the exctractors.
2016-09-08 17:28:46 +08:00
stepshal 89f257d6e5 Add support for https for rest of the exctractors. 2016-09-08 13:52:22 +07:00
Yen Chi Hsuan e78a5428b6
[foxgay] Fix extraction (closes #10480) 2016-09-08 02:01:09 +08:00
Remita Amine 6656a82481 [rmcdecouverte] Add new extractor(closes #9709) 2016-09-07 17:33:22 +01:00
Remita Amine d7e794928d [tlc] fix query string parsing 2016-09-07 17:33:22 +01:00
Yen Chi Hsuan f87feb4b68
[miaopai] Coding style (#10556) 2016-09-08 00:28:33 +08:00
Yen Chi Hsuan 2841bdcebb
Merge branch 'miaopai' of https://github.com/xyb/youtube-dl into xyb-miaopai 2016-09-08 00:08:02 +08:00
Yen Chi Hsuan 84b91dd4e3
[gamestar] Fix metadata extraction (closes #10479) 2016-09-07 23:07:50 +08:00
Yen Chi Hsuan 92c9c2a88b
[moevideo] Skip another removed test (#10474) 2016-09-07 22:21:59 +08:00
Remita Amine 9d54b02bae [puls4] fix extraction(closes #10583) 2016-09-07 14:43:20 +01:00
Remita Amine 846d8b76a0 [cctv] Add new extractor(closes #8153) 2016-09-07 10:11:09 +01:00
Remita Amine 8258f4457c [lci] Add new extractor(closes #10573) 2016-09-06 20:47:42 +01:00
Remita Amine 948cd5b72d [wat] extract dash formats 2016-09-06 20:44:45 +01:00
Jakub Adam Wieczorek 8d3737cda7 [polskieradio] Add support for downloading whole programmes.
This extends the Polskie Radio (the Polish national radio) extractor to
enable the user to download all the broadcasts of a single programme.
2016-09-06 21:34:44 +02:00
Sergey M․ 155bc674c4
[viafree] Improve video id detection (Closes #10569) 2016-09-07 00:41:31 +07:00
Remita Amine c33c962adf [trutv] Add new extractor(#10519) 2016-09-06 15:56:17 +01:00
Remita Amine bdcc046d12 [turner] use android secure hls host and catch token extraction errors 2016-09-06 15:53:03 +01:00
Xie Yanbo a493f10208 using _parse_html5_media_entries to parse video tag 2016-09-05 23:08:33 +08:00
Sergey M․ f3eeaacb4e
[nick] Add test for #10559 2016-09-05 21:42:41 +07:00
Sergey M․ b4d6a85d60
[nick] Add support for nickelodeon.nl (Closes #10559) 2016-09-05 21:33:14 +07:00
Remita Amine 0b36a96212 [abcotvs] extend _VALID_URL and add support for clips.abcotvs.com(closes #9551) 2016-09-05 13:41:21 +01:00
Yen Chi Hsuan 1f85029d82
[bilibili] Simplify 2016-09-05 13:53:58 +08:00
Xie Yanbo 95be19d436 [miaopai] Add new extractor 2016-09-05 13:53:09 +08:00
Yen Chi Hsuan 95843da529
Merge branch 'bilibili' of https://github.com/PeterDing/youtube-dl into PeterDing-bilibili 2016-09-05 13:47:24 +08:00
Yen Chi Hsuan 9127e1533d
[tvnoe] PEP8 and coding style 2016-09-05 13:37:36 +08:00
Matěj Cepl 78e762d23c Add new extractor for TV Noe (Czech Christian TV).
Fixes #10520
2016-09-04 19:06:40 +02:00
Sergey M․ 4809490108
release 2016.09.04.1 2016-09-04 20:58:28 +07:00
Sergey M․ d9606d9b6c
release 2016.09.04 2016-09-04 20:51:48 +07:00
Remita Amine 433af6ad30 [theplatform] fix player regex(closes #10546) 2016-09-04 14:24:41 +01:00
Sergey M․ feaa5ad787
[youtube:playlist] Extend _VALID_URL 2016-09-04 20:12:34 +07:00
Remita Amine 100bd86a68 [rottentomatoes] delegate extraction to InternetVideoArchiveIE 2016-09-04 11:45:29 +01:00
Remita Amine 0def758782 [internetvideoarchive] extract all formats 2016-09-04 11:45:29 +01:00
Yen Chi Hsuan 919cf1a62f
[downloader/dash] Abort if the first segment fails
Closes #10497, Closes #10542
2016-09-04 17:32:29 +08:00
Yen Chi Hsuan b29cd56591
[pornovoisines] Fix extraction (closes #10469) 2016-09-04 17:01:39 +08:00
Yen Chi Hsuan 622638512b
[rottentomatoes] Fix extraction
Closes #10467
2016-09-04 16:25:59 +08:00
Sergey M․ 37c7490ac6
[espn] Extend _VALID_URL (Closes #10549) 2016-09-04 04:59:46 +07:00
Sergey M․ 091624f9da
[vimple] Extend _VALID_URL (Closes #10547) 2016-09-04 03:39:13 +07:00
Sergey M․ 7e5dc339de
[youtube:watchlater] Fix extraction (Closes #10544) 2016-09-04 00:29:01 +07:00
Sergey M․ 4a69fa04e0
[downloader/dash] Abort download immediately after giving up on some fragment 2016-09-03 17:51:48 +07:00
Sergey M․ 2e99cd30c3
[downloader/dash:hls] Report exact fragment error on retry 2016-09-03 17:51:48 +07:00
Sergey M․ 25afc2a783
[downloader/dash:hls] Respect --fragment-retries and --skip-unavailable-fragments (Closes #10165, closes #10448) 2016-09-03 17:51:48 +07:00
Sergey M․ 9603b66012
Introduce --skip-unavailable-fragments 2016-09-03 17:51:48 +07:00
Yen Chi Hsuan 45aab4d30b
[youjizz] Fix extraction. The site has moved to HTML5
Closes #10437
2016-09-03 18:37:36 +08:00
Yen Chi Hsuan ed2bfe93aa
[fc2:embed] Add ie_key 2016-09-03 18:22:00 +08:00
Yen Chi Hsuan cdc783510b
[foxnews:insider] Add new extractor
Closes #10445
2016-09-03 18:16:19 +08:00
Yen Chi Hsuan cf0efe9636
[fc2:embed] New extractor for Flash player URLs
Closes #10512
2016-09-03 17:25:03 +08:00
Christian Pointner dedb177029
Fix parsing of HTML5 media elements
This fixes an error in _parse_html5_media_entries in case
an audio or video tag directly uses a src attribute insted
of <source> elements in it's body.
2016-09-03 16:09:35 +07:00
Sergey M․ 86c3bbbced
release 2016.09.03 2016-09-03 01:46:41 +07:00
Sergey M․ 6496ccb413
[youtube] Add support for rental videos' previews (Closes #10532) 2016-09-03 01:17:15 +07:00
Sergey M․ 3fcce30289
[drtv] Update tests 2016-09-02 23:53:17 +07:00
Sergey M․ c2b2c7e138
[utils] Add quicktime to mimetype2ext 2016-09-02 23:50:42 +07:00
Sergey M․ dacb3a864a
[youtube:playlist] Fallback to video extraction for video/playlist URLs when playlist is broken (Closes #10537) 2016-09-02 23:43:20 +07:00
Sergey M․ 6066d03db0
[drtv] Modernize and make more robust 2016-09-02 23:02:15 +07:00
Sergey M․ 6562d34a8c
[utils] Improve mimetype2ext 2016-09-02 22:57:48 +07:00
Sebastian Blunt 5e9e3d0f6b
[drtv] Add support for dr.dk/nyheder
It's the same video player, the only difference is that the video player
is loaded differently, and certain metadata (title and description) is
not available under dr.dk/mu, so make it by default get that from some
of the html meta tags.

Skip the dr.dk/tv test

dr.dk/tv videos are only available for between 7 and 90 days due to
Danish law, and in certain cases may be readded. Skip this test as it is
no longer available.
2016-09-02 22:20:36 +07:00
Sergey M․ 349fc5c705
[facebook:plugins:video] Add extractor (Closes #10530) 2016-09-02 21:13:50 +07:00
Remita Amine 2c3e0af93e [go] Add new extractor 2016-09-02 09:53:04 +01:00
Remita Amine 6150502e47 [adobepass] check for authz_token expiration(#10527) 2016-09-01 22:29:20 +01:00
Remita Amine b207d5ebd4 [curiositystream] don't cache auth token 2016-09-01 19:46:58 +01:00
Remita Amine 4191779dcd [nytimes] improve extraction 2016-09-01 19:08:29 +01:00
Sergey M․ f97ec8bcb9
[glide] Remove unused import 2016-09-01 23:46:58 +07:00
Sergey M․ 8276d3b87a
[thestar] Fix extraction (Closes #10465) 2016-09-01 23:46:15 +07:00
Sergey M․ af95ee94b4
[glide] Fix extraction (Closes #10478) 2016-09-01 23:38:49 +07:00
Sergey M․ 8fb6af6bba
[exfm] Remove extractor (Closes #10482) 2016-09-01 23:32:28 +07:00
Sergey M․ f6af0f888b
[youporn] Fix categories and tags extraction (Closes #10521) 2016-09-01 23:15:01 +07:00
Sergey M․ e816c9d158
[extractor/common] Simplify _extract_m3u8_formats 2016-09-01 22:18:16 +07:00
Sergey M․ 9250181f37
[extractor/common] Restore NAME usage from EXT-X-MEDIA tag for formats codes in _extract_m3u8_formats (Closes #10522) 2016-09-01 21:37:25 +07:00
Remita Amine f096ec2625 [curiositystream] Add new extractor 2016-09-01 13:37:09 +01:00
Yen Chi Hsuan 4c8ab6fd71
[thvideo] Remove extractor. Website down.
Closes #10464

According to a screenshot in http://tieba.baidu.com/p/4691302183,
thvideo.tv is shut down "temporarily". I see no clues that it will be up
again, so I remove it here.
2016-09-01 17:04:41 +08:00
Yen Chi Hsuan 05d4612947
[movingimage] Adapt to the new domain name and fix extraction
Closes #10466
2016-09-01 16:58:16 +08:00
Yen Chi Hsuan 746a695b36
[myvidster] Update _TESTS (closes #10473) 2016-09-01 16:42:35 +08:00
Yen Chi Hsuan 165c54e97d
[southpark.cc.com:español] Skip geo-restricted _TESTS
Breaks https://travis-ci.org/rg3/youtube-dl/jobs/156728175
2016-09-01 16:28:03 +08:00
Remita Amine 2896dd73bc [cbs] extract once formats(closes #10515) 2016-09-01 08:00:13 +01:00
Remita Amine f8fd510eb4 [limelight] skip ism manifests and reduce requests 2016-08-31 18:32:15 +01:00
Sergey M․ 7a3e849f6e
[porncom] Extract categories and tags (Closes #10510) 2016-08-31 22:23:55 +07:00
Sergey M․ 196c6ba067
[facebook] Extract timestamp (Closes #10508) 2016-08-31 22:12:37 +07:00
Remita Amine 165620e320 [yahoo] extract more and better formats 2016-08-30 21:49:28 +01:00
Sergey M․ 4fd350611c
release 2016.08.31 2016-08-31 02:39:39 +07:00
Sergey M․ a249ab83cb
[pyvideo] Remove debugging code 2016-08-31 01:56:58 +07:00
Sergey M․ f7043ef39c
[soundcloud] Fix _VALID_URL clashes with sets (Closes #10505) 2016-08-31 01:56:15 +07:00
Sergey M․ 64fc49aba0
[bandcamp:album] Fix title extraction (Closes #10455) 2016-08-31 00:29:49 +07:00
Sergey M․ 245023a861
[pyvideo] Fix extraction (Closes #10468) 2016-08-30 23:51:18 +07:00
Remita Amine 3c77a54d5d [turner] keep video id intact 2016-08-30 10:46:48 +01:00
Remita Amine da30a20a4d [turner,cnn] move a check for wrong timestamp to CNNIE 2016-08-29 19:26:53 +01:00
Remita Amine 1fe48afea5 [cnn] update _TEST for CNNBlogsIE and CNNArticleIE(closes #10489) 2016-08-29 18:24:16 +01:00
Remita Amine 42e05be867 [ctv] add support for (tsn,bnn,thecomedynetwork).ca websites(#10016) 2016-08-29 18:24:16 +01:00
Remita Amine fe45b0e060 [9c9media] fix multiple stacks extraction and extract more metadata(#10016) 2016-08-29 18:24:16 +01:00
Sergey M․ a06e1498aa
[kusi] Update test 2016-08-29 22:54:33 +07:00
Sergey M․ 5a80e7b43a
[turner] Skip invalid subtitles' URLs 2016-08-29 22:44:15 +07:00
Sergey M․ 3fb2a23029
[adultswim] Extract video info from onlineOriginals (Closes #10492) 2016-08-29 22:40:35 +07:00
PeterDing 7be15d4097 [bilibili] Support episodes
[extractor/bilibili] add md5 for testing

[extractor/bilibili] remove unnecessary headers

[extractor/bilibili] correct _TESTS; find thumbnail for episode

[extractor/bilibili] [Fix] restore removed tests
2016-08-29 23:31:08 +08:00
Sergey M․ cd10b3ea63
[turner] Extract all formats 2016-08-29 22:13:49 +07:00
Sergey M․ 547993dcd0
[turner] Fix subtitles extraction 2016-08-29 21:52:41 +07:00
Yen Chi Hsuan 6c9b71bc08
[downloader/external] Recommend --hls-prefer-native for SOCKS users
Related: #10490
2016-08-29 19:05:38 +08:00
Remita Amine 93b8404599 [generic,vodplatform] improve embed regex 2016-08-29 07:57:20 +01:00
Sergey M․ 9ba1e1dcc0
[played] Remove extractor (Closes #10470) 2016-08-29 08:26:07 +07:00
Remita Amine b8079a40bc [turner] fix secure m3u8 formats downloading 2016-08-28 17:51:53 +01:00
Remita Amine 5bc8a73af6 [cartoonnetwork] make extraction work for more videos in the website
some videos require `networkName=CN2` to be present in the feed url
2016-08-28 17:08:26 +01:00
Remita Amine b3eaeded12 [tbs] Add new extractor(#10222) 2016-08-28 16:51:09 +01:00
Remita Amine ec65b391cb [cartoonnetwork] Add new extractor(#10110) 2016-08-28 16:51:09 +01:00
Remita Amine 2982514072 [turner,nba,cnn,adultswim] add base extractor to parse cvp feeds 2016-08-28 16:51:09 +01:00
Yen Chi Hsuan 98908bcf7c
[openload] Update algorithm again (#10408) 2016-08-28 22:49:46 +08:00
Yen Chi Hsuan 04b32c8f96
[bilibili] Fix extraction (closes #10375)
Thanks @gdkchan for the algorithm
2016-08-28 22:06:31 +08:00
Yen Chi Hsuan 40eec6b15c
[openload] Fix extraction (closes #10408)
Thanks to @yokrysty again!
2016-08-28 20:27:52 +08:00
Yen Chi Hsuan 39efc6e3e0 [generic] Update some _TESTS 2016-08-28 15:46:11 +08:00
Sergey M․ 1198fe14a1
release 2016.08.28 2016-08-28 07:24:08 +07:00
Sergey M․ 92c27a0dbf
[periscope:user] Fix extraction (Closes #10453) 2016-08-28 02:35:49 +07:00
Yen Chi Hsuan 3b4b82d4ce
[douyutv] Simplify 2016-08-27 01:16:39 +08:00
Yen Chi Hsuan 545ef4f531
Merge branch 'patch-2' of https://github.com/steven7851/youtube-dl into steven7851-patch-2 2016-08-26 22:29:46 +08:00
Yen Chi Hsuan 906b87cf5f
[crackle] Revert to template-based thumbnail extraction
To reduce to number of HTTP requests
2016-08-26 19:58:47 +08:00
steven7851 b281aad2dc [douyutv] Use new api
use lapi for flv info, and html5 api for room info
#10153 #10318
2016-08-26 07:32:54 +08:00
Sergey M․ 6b18a24e6e
[tnaflix] Fix extraction (Closes #10434) 2016-08-26 05:57:52 +07:00
Sergey M․ f9b373afda
[nhk:vod] Improve extraction (Closes #10424) 2016-08-26 04:48:40 +07:00
Aleksander Nitecki 298a120ab7
[nhk] Add extractor for VoD. 2016-08-26 04:15:51 +07:00
Sergey M․ e3faecde30
[trutube] Remove extractor (Closes #10438) 2016-08-26 03:43:13 +07:00
Remita Amine a0f071a50d [usanetwork] Add new extractor 2016-08-25 19:41:31 +01:00
Yen Chi Hsuan 20bad91d76
[downloader/external] Clarify that ffmpeg doesn't support SOCKS
Ref: #10304
2016-08-25 22:38:06 +08:00
Yen Chi Hsuan b54a2da433
[crackle] Fix extraction and update _TESTS (closes #10333) 2016-08-25 22:22:31 +08:00
Yen Chi Hsuan dc2c37f316
[spankbang] Fix description and uploader (closes #10339) 2016-08-25 20:47:35 +08:00
Remita Amine d37708fc86 [YoutubeDL] check only for None Value in thumbnails sorting 2016-08-25 11:53:47 +01:00
Remita Amine 5c13c28566 raise unexpected error when no stream found 2016-08-25 09:55:23 +01:00
Remita Amine f70e9229e6 [discoverygo] detect when video needs authentication(closes #10425) 2016-08-25 09:11:23 +01:00
Remita Amine 30afe4aeb2 [cbc] Add support for watch.cbc.ca 2016-08-25 08:49:44 +01:00
Remita Amine 75fa990dc6 [YoutubeDL] add fallback value for thumbnails values in thumbnails sorting 2016-08-25 08:49:44 +01:00
Remita Amine f39ffc5877 [common] extract formats from #EXT-X-MEDIA tags 2016-08-25 08:49:44 +01:00
Remita Amine 07ea9c9b05 [downloader/hls] fill IV with zeros for IVs shorter than 16-octet 2016-08-25 08:49:44 +01:00
Remita Amine 073ac1225f [utils] add ac-3 to the list of audio codecs in parse_codecs 2016-08-25 08:49:44 +01:00
Yen Chi Hsuan 08773689f3 [kickstarter] Silent the warning for og:description
Closes #10415
2016-08-25 01:29:32 +08:00
Yen Chi Hsuan 0c75abbb7b [mtvservices:embedded] Use another endpoint to get feed URL
Closes #10363

In the original mtvservices:embedded test case, config.xml is still used
to get the feed URL. Some other examples, including test_Generic_40
(http://www.vulture.com/2016/06/new-key-peele-sketches-released.html),
and the video mentioned in #10363, use another endpoint to get the feed
URL. The 'index.html' approach works for the original test case, too. So
I didn't keep the old approach.
2016-08-24 23:58:22 +08:00
Yen Chi Hsuan 97653f81b2 [bilibili] Mark as broken
Bilibili now uses emscripten, which is very difficult for reverse
engineering. I don't expect it to be fixed in near future, so I mark
it as broken.

Ref: #10375
2016-08-24 21:28:00 +08:00
Sergey M․ d38b27dd9b
release 2016.08.24.1 2016-08-24 10:11:04 +07:00
Sergey M․ 30317f4887
[pluralsight] Modernize and make more robust 2016-08-24 08:52:12 +07:00
Sergey M․ 8c3e35dd44
[pluralsight] Add support for subtitles (Closes #9681) 2016-08-24 08:41:52 +07:00
Sergey M․ c86f51ee38
release 2016.08.24 2016-08-24 01:38:46 +07:00
Sergey M․ 05bddcc512
[youtube] Fix authentication (2) (Closes #10392) 2016-08-24 01:29:50 +07:00
Sergey M․ 1212e9972f
[youtube] Fix authentication (#10392) 2016-08-24 00:25:21 +07:00
Remita Amine ccb6570e9e [syfy,bravotv] restrict drupal settings regex 2016-08-23 17:31:35 +01:00
Yen Chi Hsuan 18b6216150
[openload] Fix extraction (closes #10408)
Thanks @yokrysty for the algorithm
2016-08-23 21:55:58 +08:00
Remita Amine fb009b7f53 [bravotv] correct clip info extraction and add support for adobe pass auth(closes #10407) 2016-08-23 10:29:52 +01:00
Sergey M․ 3083e4dc07
[eagleplatform] Improve detection of embedded videos (Closes #10409) 2016-08-23 07:22:14 +07:00
Remita Amine 7367bdef23 [awaan] fix extraction, modernize, rename the extractors and add test for live stream 2016-08-22 23:10:06 +01:00
Remita Amine ad31642584 [nrk,abc:iview] use _extract_akamai_formats 2016-08-22 07:54:08 +01:00
Remita Amine c7c43a93ba [common] add helper method to extract akamai m3u8 and f4m formats 2016-08-22 07:49:34 +01:00
Yen Chi Hsuan 96229e5f95
[mtvservices:embedded] Update config URL
All starts from #10363. The test case in mtvservices:embedded uses
config.xml, while the video from #10363 and the test case in generic.py
is broken. Both uses index.html for fetching the feed URL.
2016-08-22 13:56:09 +08:00
Remita Amine 55d119e2a1 [abc:iview] Add new extractor(closes #6148) 2016-08-22 00:07:17 +01:00
Sergey M․ 6d2679ee26
release 2016.08.22 2016-08-22 04:17:34 +07:00
Sergey M․ 3d897cc791
[ivi] Fix episode number extraction 2016-08-22 03:34:27 +07:00
Sergey M․ cf143c4d97
[ivi] Add support for 720p and 1080p 2016-08-22 03:31:33 +07:00
Yen Chi Hsuan ad120ae1c5
[extractor/common] Change the default m3u8 protocol in HTML5
Helper functions should have consistent default values
2016-08-22 02:26:07 +08:00
Remita Amine d0fa172e5f [firsttv] keep a test videos with multiple formats 2016-08-21 19:13:43 +01:00
Yen Chi Hsuan f97f9f71e5
Merge branch 'TRox1972-charlierose' 2016-08-22 02:11:43 +08:00
Yen Chi Hsuan 526656726b
[charlierose] Simplify and improve 2016-08-22 02:06:47 +08:00
Remita Amine 9b8c554ea7 [firsttv] fix extraction(closes #9249) 2016-08-21 17:56:25 +01:00
Yen Chi Hsuan d13bfc07b7
Merge branch 'charlierose' of https://github.com/TRox1972/youtube-dl into TRox1972-charlierose 2016-08-22 00:48:35 +08:00
Sergey M․ efe470e261
[twitch] Renew authentication 2016-08-21 22:45:50 +07:00
Sergey M․ e3f6b56909
[twitch] Refactor API calls 2016-08-21 22:09:29 +07:00
Sergey M․ b1e676fde8
[twitch] Modernize 2016-08-21 21:28:02 +07:00
Sergey M․ 92d4cfa358
[kaltura] Fallback ext calculation on caption's format 2016-08-21 21:01:01 +07:00
Remita Amine 3d47ee0a9e [zingmp3] fix extraction and add support for video clips(closes #10041) 2016-08-21 14:09:48 +01:00
Déstin Reed db29af6d36 [charlierose] Add new extractor 2016-08-21 11:29:48 +02:00
Sergey M․ 2c6acdfd2d
[kaltura] Add test for #10279 2016-08-21 08:37:01 +07:00
Sergey M․ fddaa76a59
[kaltura] Assume ttml to be default subtitles' extension 2016-08-21 08:28:36 +07:00
Sergey M․ a809446750
[kaltura] Add subtitles support when entry_id is unknown beforehand (Closes #10279) 2016-08-21 08:28:36 +07:00
Sergey M․ d8f30a7e66
[kaltura] Remove unused code 2016-08-21 08:28:36 +07:00
Sergey M․ 5b1d85754e
[YoutubeDL] Autocalculate ext when ext is None 2016-08-21 08:28:36 +07:00
Remita Amine e25586e471 [cultureunplugged] fix extraction(closes #10330) 2016-08-20 20:02:49 +01:00
Remita Amine 292a2301bf [cnn] add support for money.cnn.com videos(closes #2797) 2016-08-20 19:00:25 +01:00
Remita Amine dabe15701b [cbs, cbsnews] fix extraction(fixes #10393) 2016-08-20 13:25:32 +01:00
Sergey M․ 4245f55880
[dotsub] Replace test (Closes #10386) 2016-08-20 06:18:20 +07:00
Déstin Reed 5b9d187cc6
[imdb] Improve title extraction and make thumbnail non-fatal 2016-08-20 04:50:39 +07:00
Yen Chi Hsuan 39e1c4f08c
[litv] Support 'promo' URLs (closes #10385) 2016-08-20 00:52:37 +08:00
Yen Chi Hsuan 19f35402c5
[snotr] Fix extraction (closes #10338) 2016-08-20 00:18:22 +08:00
Yen Chi Hsuan 70852b47ca
[utils] Recognize units with full names in parse_filename
Reference: https://en.wikipedia.org/wiki/Template:Quantities_of_bytes
2016-08-20 00:17:26 +08:00
Yen Chi Hsuan a9a3b4a081
[miomio] Adapt to the new API and update _TESTS
The test case is from #9680
2016-08-20 00:08:23 +08:00
Yen Chi Hsuan ecc90093f9
[vuclip] Adapt to the new API and update _TEST 2016-08-19 23:56:09 +08:00
Yen Chi Hsuan 520251c093
[extractor/common] Recognize m3u8 manifests in HTML5 multimedia tags 2016-08-19 23:53:47 +08:00
Yen Chi Hsuan 55af45fcab
[radiobremen] Update _TEST (closes #10337) 2016-08-19 23:12:30 +08:00
Yen Chi Hsuan b82232036a
[n-tv.de] Fix extraction (closes #10331) 2016-08-19 20:39:28 +08:00
Yen Chi Hsuan e4659b4547
[utils] Correct octal/hexadecimal number detection in js_to_json 2016-08-19 20:37:17 +08:00
Sergey M․ 9e5751b9fe
[globo:article] Relax _VALID_URL and video id regex (Closes #10379) 2016-08-19 01:13:45 +07:00
Sergey M․ bd1bcd3ea0
release 2016.08.19 2016-08-19 00:15:12 +07:00
Sergey M․ 8b2dc4c328
[options] Remove output template description from --help
Same reasons as for --format
2016-08-18 23:59:13 +07:00
Sergey M․ 850837b67a
[porncom] Add extractor (Closes #2251, closes #10251) 2016-08-18 23:52:41 +07:00
Sergey M․ 13585d7682
[utils] Recognize lowercase units in parse_filesize 2016-08-18 23:32:00 +07:00
Sergey M․ fd3ec986a4
[generic] Fix dbtv test (Closes #10364) 2016-08-18 21:35:41 +07:00
Sergey M․ b0d578ff7b
[dbtv] Relax embed regex 2016-08-18 21:30:55 +07:00
Déstin Reed b0c8f2e9c8
[DBTV:generic] Add support for embeds 2016-08-18 21:29:27 +07:00
Sergey M․ 51815886a9
[vk:wallpost] Fix audio extraction 2016-08-18 06:14:05 +07:00
Sergey M․ 08a42f9c74
[vk] Fix authentication on python3 2016-08-18 05:22:23 +07:00
Sergey M․ e15ad9ef09
[keezmovies] PEP 8 2016-08-18 04:39:31 +07:00
Sergey M․ 4e9fee1015
[hgtvcom:show] Add extractor (Closes #10365) 2016-08-18 04:37:14 +07:00
Remita Amine 7273e5849b [discoverygo] extend _VALID_URL to support other networks 2016-08-17 11:03:09 +01:00
Sergey M․ b505e98784
[extremetube] Revert display_id 2016-08-17 07:02:13 +07:00
Sergey M․ 92cd9fd565
[keezmovies] Make display_id optional 2016-08-17 07:01:32 +07:00
Sergey M․ b3d7dce429
release 2016.08.17 2016-08-17 06:21:21 +07:00
Sergey M․ ab19b46b88
[extremetube] Modernize 2016-08-17 06:02:12 +07:00
Sergey M․ 8804f10e6b
[tube8] Modernize 2016-08-17 05:46:45 +07:00
Sergey M․ 6be17c0870
[mofosex] Extract all formats and modernize (Closes #10335) 2016-08-17 05:45:49 +07:00
Sergey M․ 8652770bd2
[keezmovies] Improve and modernize 2016-08-17 05:44:46 +07:00
Sergey M․ 2a1321a272
[vbox7:generic] Add support for vbox7 embeds 2016-08-17 01:02:59 +07:00
Sergey M․ 9c0fa60bf3
[vbox7] Add support for embed URLs 2016-08-17 00:42:02 +07:00
Sergey M․ 502d87c546
[mtg] Improve view count extraction 2016-08-17 00:32:28 +07:00
Sergey M․ b35b0d73d8
[viafree] Add extractor (Closes #10358) 2016-08-17 00:21:30 +07:00
Sergey M․ 6e7e4a6edf
[mtg] Add support for viafree URLs (#10358) 2016-08-17 00:19:43 +07:00
Remita Amine 53fef319f1 [fxnetworks] extend _VALID_URL to support simpsonsworld.com 2016-08-16 16:22:34 +01:00
Remita Amine 2cabee2a7d [amcnetworks] fix typo 2016-08-16 16:22:34 +01:00
Remita Amine 11f502fac1 [theplatform] extract subtitles with multiple formats from the metadata 2016-08-16 16:22:34 +01:00
Sergey M․ 98affc1a48
[xvideos] Fix test 2016-08-16 21:20:15 +07:00
Sergey M․ 70a2829fee
[xvideos] Fix HLS extraction (Closes #10356) 2016-08-16 21:17:52 +07:00
Remita Amine 837e56c8ee [amcnetworks] extract episode metadata 2016-08-16 14:49:32 +01:00
Remita Amine b5ddee8c77 [amcnetworks] Add new extractor 2016-08-16 13:44:01 +01:00
Sergey M․ fb64adcbd3
[adobepass] PEP 8 2016-08-16 04:45:21 +07:00
Sergey M․ 4f640f2890
[bbc:playlist] Fix tests 2016-08-16 04:43:10 +07:00
Sergey M․ 254e64a20a
[bbc:playlist] Add support for pagination (Closes #10349) 2016-08-16 04:36:23 +07:00
Remita Amine 818ac213eb [adobepass] add IE suffix to the extractor and remove duplicate constant 2016-08-15 21:36:34 +01:00
Remita Amine cbef4d5c9f [fxnetworks] add test and check geo restriction 2016-08-15 17:10:45 +01:00
Remita Amine bf90c46790 [fxnetworks] Add new extractor(closes #9462) 2016-08-15 16:34:32 +01:00
Yen Chi Hsuan 69eb4d699f
[cbsnews] Remove invalid tests. CBS Live videos gets deleted soon. 2016-08-15 20:29:22 +08:00
Yen Chi Hsuan 760845ce99
[cbslocal] Adapt to SendtoNewsIE 2016-08-15 13:37:37 +08:00
Yen Chi Hsuan 5c2d087221
[sendtonews] Fix extraction 2016-08-15 13:31:08 +08:00
Yen Chi Hsuan b6c4e36728
[jwplatform] Parse video_id from JWPlayer data
And remove a mysterious comma from 115c65793a
2016-08-15 13:29:01 +08:00
Sergey M․ 1a57b8c18c
[zippcast] Remove extractor (Closes #10332)
ZippCast is shut down
2016-08-15 08:25:24 +07:00
Remita Amine 24eb13b1c6 [uplynk,viceland] update tests and change uplynk extractors names 2016-08-14 22:45:43 +01:00
Remita Amine 525e0316c0 [adobepass] fix check for pendingLogout errors 2016-08-14 21:25:43 +01:00
Remita Amine 7e60ce9cf7 [adobepass] clear cache in case of pendingLogout errors 2016-08-14 21:24:33 +01:00
Remita Amine e811bcf8f8 [viceland] raise ExtractorError for errors other than HTTP 400 2016-08-14 20:13:35 +01:00
Remita Amine 6103f59095 [viceland] remove outdated comment 2016-08-14 19:08:35 +01:00
Remita Amine 9fa5789279 [viceland] fix info extraction(closes #8799) 2016-08-14 19:04:23 +01:00
Remita Amine d2ac04674d [viceland] Add new extractor(#8799) 2016-08-14 18:04:50 +01:00
Remita Amine 1fd6e30988 [adobepass] create separate class for adobe pass authentication 2016-08-14 18:04:50 +01:00
Sergey M․ 884cdb6cd9
[life:embed] Improve extraction 2016-08-14 20:49:11 +07:00
Remita Amine 9771b1f901 [theplatform] use _get_netrc_login_info and fix session expiration check(#10345) 2016-08-14 11:55:28 +01:00
Remita Amine 2118fdd1a9 [common] add separate method for getting netrc ligin info 2016-08-14 11:55:28 +01:00
Sergey M․ 320d597c21
[vgtv] Detect geo restricted videos (#10348) 2016-08-14 16:25:14 +07:00
Remita Amine aaf44a2f47 [uplynk] Add new extractor 2016-08-13 22:53:41 +01:00
phi 097eba019d bug fix for extractor xiami.py
Before applying this patch, when downloading resources from xiami.com, it crashes with these:
Traceback (most recent call last):
  File "/home/phi/.local/bin/youtube-dl", line 11, in <module>
    sys.exit(main())
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/__init__.py", line 433, in main
    _real_main(argv)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/__init__.py", line 423, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 1786, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 691, in extract_info
    ie_result = ie.extract(url)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 347, in extract
    return self._real_extract(url)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/xiami.py", line 116, in _real_extract
    return self._extract_tracks(self._match_id(url))[0]
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/xiami.py", line 43, in _extract_tracks
    '%s/%s%s' % (self._API_BASE_URL, item_id, '/type/%s' % typ if typ else ''), item_id)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 562, in _download_json
    json_string, video_id, transform_source=transform_source, fatal=fatal)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 568, in _parse_json
    return json.loads(json_string)
  File "/usr/lib/python3.5/json/__init__.py", line 312, in loads
    s.__class__.__name__))
TypeError: the JSON object must be str, not 'NoneType'

This patch solves exactly this problem.
2016-08-14 02:18:59 +08:00
Sergey M․ 73a85620ee
release 2016.08.13 2016-08-13 23:17:11 +07:00
Sergey M․ 5ec5461e1a
[pbs] Clarify comment on http formats 2016-08-13 22:50:18 +07:00
Sergey M․ 542130a5d9
[pbs] Fix description extraction and update tests 2016-08-13 21:59:29 +07:00
Sergey M․ 82997dad57
[franceculture] Fix extraction (Closes #10324) 2016-08-13 21:00:34 +07:00
Sergey M․ 647a7bf5e8
[pornotube] Fix extraction (Closes #10322) 2016-08-13 20:49:16 +07:00
Sergey M․ 77afa008dd
[4tube] Fix metadata extraction (Closes #10321) 2016-08-13 19:55:09 +07:00
Yen Chi Hsuan db535435b3
[bigflix] Remove an invalid test
There's no video anymore
2016-08-13 18:02:11 +08:00
Sergey M․ c2a453b461
[imgur] Fix width and height extraction (Closes #10325) 2016-08-13 16:46:07 +07:00
Sergey M․ cd29eaab95
[vbox7] Remove unused imports 2016-08-13 16:45:34 +07:00
Sergey M․ e97c55ee6a
[expotv] Improve extraction and update test 2016-08-13 16:29:05 +07:00
Remita Amine acfccacad5 [downloader/external:curl] Clarify why CurlFD should not capture stderr 2016-08-13 10:26:02 +01:00
Sergey M․ cb55908e51
[vbox7] Fix extraction (Closes #10309) 2016-08-13 15:47:20 +07:00
Yen Chi Hsuan e581224843
[tapely] Remove extractor. It's shut down
Closes #10323
2016-08-13 16:32:07 +08:00
Remita Amine f50365e91c [pbs] add test for videos with undocumented http formats and remove unused import 2016-08-13 09:10:09 +01:00
Sergey M․ c366f8d30a
[24video] Add support for me and xxx TLDs 2016-08-13 14:47:51 +07:00
Sergey M․ 6a26c5f9d5
[muenchentv] Fix extraction (Closes #10313) 2016-08-13 14:28:44 +07:00
Sergey M․ bd6fb007de
[24video] Fix comment count extraction 2016-08-13 14:22:47 +07:00
Sergey M․ b69b2ff736
[sunporno] Add support for embed URLs 2016-08-13 14:13:49 +07:00
Sergey M․ 794e5dcd7e
[sunporno] Fix metadata extraction (Closes #10316) 2016-08-13 14:09:35 +07:00
Remita Amine f0d3669437 [hgtv] Add new extractor(closes #3999) 2016-08-12 18:05:49 +01:00
Remita Amine 98e698f1ff [external/curl] respect more downloader options and display progress 2016-08-12 12:30:02 +01:00
Remita Amine 3cddb8d6a7 [pbs] check all http formats and remove unnecessary request
- some of the quality that not reported in the documentation
are available(4500k, 6500k)
- the videoInfo request doesn't work for a long time
2016-08-12 08:38:06 +01:00
Sergey M․ 990d533ee4
[crunchyroll] Add support for HLS (Closes #10301) 2016-08-12 00:56:16 +07:00
Sergey M․ b0081562d2
release 2016.08.12 2016-08-12 00:22:22 +07:00
Sergey M․ a3be69b7f0
[viu] Remove from extractors 2016-08-12 00:14:51 +07:00
Sergey M․ 0fd1b1624c
[goldenmoustache] Remove extractor (Closes #10298)
Now uses dailymotion
2016-08-11 23:52:17 +07:00
Sergey M․ 367976d49f
[drtuber] Improve title extraction 2016-08-11 23:47:52 +07:00
Sergey M․ 0aef0771f8
[drtuber] Make dislike count optional (Closes #10297) 2016-08-11 23:47:27 +07:00
Sergey M․ 0c070681c5
[chirbit] Fix extraction (Closes #10296) 2016-08-11 23:37:56 +07:00
Sergey M․ 30b25d382d
[francetvinfo] Relax _VALID_URL 2016-08-11 21:42:55 +07:00
Yen Chi Hsuan e2e84aed7e
Merge branch 'lkho-pr/#10268' 2016-08-11 19:09:18 +08:00
Yen Chi Hsuan b1927f4e8a
[YoutubeDL] Disable newline conversion when writing subtitles
By default io.open() convert all '\n' occurrences to '\r\n' when writing
files. If the content already contains '\r\n', it will be converted to
'\r\r\n', breaking some video players.
2016-08-11 19:04:23 +08:00
Yen Chi Hsuan 3b9323d96e
Merge branch 'pr/#10268' of https://github.com/lkho/youtube-dl into lkho-pr/#10268 2016-08-11 19:03:08 +08:00
lkho 7f832413d6 Preserve line endings for downloaded subtitle files 2016-08-10 23:40:50 +08:00
Sergey M․ 7f2ed47595
[rtlnl] Relax _VALID_URL (Closes #10282) 2016-08-10 21:07:43 +07:00
Sergey M․ c3fa77bdef
[formula1] Relax _VALID_URL (Closes #10283) 2016-08-10 21:00:40 +07:00
Remita Amine 57ce8a6d08 [wat] improve extraction(#10281)
add alternative method to extract http formats
works even if the video is geo-restricted or removed
from public access(most of the cases)
2016-08-10 14:20:28 +01:00
Yen Chi Hsuan 69d8eeeec5
[ctsnews] Fix extraction 2016-08-10 11:38:38 +08:00
Yen Chi Hsuan 81c13222c6
[utils] Recognize more formats in unified_timestamp
Used in CtsNews
2016-08-10 11:37:23 +08:00
Sergey M․ b1ce2ba197
release 2016.08.10 2016-08-10 00:20:44 +07:00
Remita Amine 20ef4123b9 [uol] remove unused import 2016-08-09 15:13:15 +01:00
Remita Amine 4e62d26aa2 [uol] Add new extractor(#4263) 2016-08-09 15:09:08 +01:00
Sergey M․ 25dd58ca6a
[metadatafromtitle] Remove unused exception class 2016-08-09 04:01:05 +07:00
nyorain 5e42f8a0ad
Make --metadata-from-title non fatal
Output a warning if the metadata can't be parsed from the title (and don't write any metadata) instead of raising a critical error.
2016-08-09 03:56:22 +07:00
Sergey M․ 1ad6b891b2
Add more checks for --min/max-sleep-interval arguments and use more idiomatic naming 2016-08-09 03:47:56 +07:00
Sergey M․ 7aa589a5e1
Fix --min/max-sleep-interval wording 2016-08-09 03:46:52 +07:00
singh-pratyush96 065bc35489
Add --max-sleep-interval (Closes #9930) 2016-08-09 03:32:42 +07:00
Sergey M․ 3a380766d1
[rbmaradio] Improve, simplify and extract all formats (Closes #10242) 2016-08-09 02:46:29 +07:00
Petr Zvoníček affaea0688
[rbmaradio] Fixed extractor 2016-08-09 02:18:33 +07:00
Sergey M․ 77426a087b
[sonyliv] Improve (Closes #10258) 2016-08-09 02:16:28 +07:00
Sukhbir Singh 8991844ea2
[sonyliv] Add new extractor 2016-08-09 02:09:13 +07:00
Sergey M․ 082395d0a0
[extractor/generic] Add proper default to _search_json_ld call 2016-08-08 22:48:33 +07:00
Sergey M․ e8ed7354e6
[flipagram] Add proper default to _search_json_ld call 2016-08-08 22:46:19 +07:00
Sergey M․ 1e7f602e2a
[condenast] Make _search_json_ld call non fatal 2016-08-08 22:45:49 +07:00
Sergey M․ 522f6c066d
[bbc] Add proper default to _search_json_ld call 2016-08-08 22:44:36 +07:00
Sergey M․ 321b5e082a
[extractor/common] Respect default in _search_json_ld 2016-08-08 22:36:18 +07:00
Sergey M․ 3711fa1eb2
Revert "[flipagram] Make _search_json_ld non fatal"
This reverts commit d34995a9e3.
2016-08-08 21:49:45 +07:00
Sergey M․ 395c74615c
Revert "[extractor/generic] Make _search_json_ld non fatal"
This reverts commit 958849275f.
2016-08-08 21:49:27 +07:00
Yen Chi Hsuan 3dc240e8c6
[sohu] Update _TESTS (closes #10260) 2016-08-08 18:48:21 +08:00
Yen Chi Hsuan a41a6c5094
[chaturbate] Skip the invalid test 2016-08-08 13:06:02 +08:00
Yen Chi Hsuan d71207121d
[biqle] Skip an invalid test 2016-08-08 12:59:55 +08:00
Yen Chi Hsuan b1c6f21c74
[aparat] Fix extraction 2016-08-08 12:59:07 +08:00
Yen Chi Hsuan 412abb8760
[bilibili] Update _TESTS 2016-08-08 12:57:17 +08:00
Yen Chi Hsuan f17d5f6d14
[features.aol.com] Fix _TESTS 2016-08-08 12:52:36 +08:00
Remita Amine 6bb801cfaf [cwtv] extract http formats 2016-08-07 22:58:12 +01:00
Sergey M․ de02d1f4e9
[rozhlas] Fix regexes and improve extraction (Closes #10253) 2016-08-08 04:58:02 +07:00
Petr Zvoníček e1f93a0a76
[rozhlas] Add new extractor 2016-08-08 04:41:45 +07:00
Yen Chi Hsuan b2bd968f4b
[kuwo:singer] Fix extraction 2016-08-07 22:59:34 +08:00
Sergey M․ 4a01befb34
release 2016.08.07 2016-08-07 21:12:41 +07:00
Sergey M․ d92cb46305
[discoverygo] Add extractor (Closes #10245) 2016-08-07 20:57:05 +07:00
Sergey M․ a8795327ca
[utils] Add support TV Parental Guidelines ratings in parse_age_limit 2016-08-07 20:45:18 +07:00
Sergey M․ d34995a9e3
[flipagram] Make _search_json_ld non fatal 2016-08-07 19:06:55 +07:00
Sergey M․ 958849275f
[extractor/generic] Make _search_json_ld non fatal 2016-08-07 19:04:22 +07:00
Sergey M․ 998f094452
[bbc] Remove proxy from test 2016-08-07 18:13:05 +07:00
Sergey M․ aaa42cf0cf
[bbc] PEP 8 2016-08-07 18:05:13 +07:00
Sergey M․ 9fb64c04cd
[bbc] Add support for morph embeds (Closes #10239) 2016-08-07 18:01:50 +07:00
Remita Amine f9622868e7 [bbc] preserve format_id backward compatibility 2016-08-07 11:14:15 +01:00
Remita Amine 37768f9242 [common] correctly lower the preference of m3u8 master manifest format 2016-08-07 10:59:09 +01:00
Sergey M․ a1aadd09a4
[tnaflixnetworkbase] Improve title extraction 2016-08-07 16:00:09 +07:00
Sergey M․ b47a75017b
[tnaflix] Fix metadata extraction (Closes #10249) 2016-08-07 16:00:03 +07:00
Remita Amine e37b54b140 [fox] fix theplatform release url query 2016-08-06 20:53:39 +01:00
Yen Chi Hsuan c1decda58c
[openload] Fix extraction (closes #9706) 2016-08-07 02:44:15 +08:00
Yen Chi Hsuan d3f8e038fe
[utils] Add decode_png for openload (#9706) 2016-08-07 02:42:58 +08:00
Remita Amine ad152e2d95 [bbc] fix test 2016-08-06 19:36:12 +01:00
Remita Amine b0af12154e [bbc] reduce requests and improve format_id 2016-08-06 19:24:59 +01:00
Remita Amine d16b3c6677 [common] extract partOfTVSeries info in json-ld 2016-08-06 18:58:38 +01:00
Remita Amine c57244cdb1 [common] lower the preference of m3u8 master manifest format 2016-08-06 18:55:05 +01:00
Remita Amine a7e5f27412 [bbc] improve extraction
- extract f4m and dash formats
- improve format sorting and listing
- improve extraction of articles with `otherSettings.playlist`
2016-08-06 18:48:09 +01:00
Remita Amine 089a40955c [pokemon] improve _VALID_URL 2016-08-06 12:08:14 +01:00
Remita Amine d73ebac100 [pokemon] Add new extractor(closes #10093) 2016-08-06 11:18:14 +01:00
Remita Amine e563c0d73b [condenast] fallback to loader.js if video.js fail 2016-08-05 21:01:16 +01:00
Sergey M․ 491c42e690
release 2016.08.06 2016-08-06 01:23:48 +07:00
Sergey M․ 8122e79fef
[gamekings] Remove remnants 2016-08-06 00:12:37 +07:00
Sergey M․ fe3ad1d456
[adultswim] Remove superfluous md5 from test 2016-08-06 00:02:05 +07:00
Sergey M․ 038a5e1a65
[adultswim] Add support for trailers (Closes #10235) 2016-08-06 00:00:05 +07:00
Sergey M․ 84bc23b41b
[archiveorg] PEP 8 2016-08-05 23:16:19 +07:00
Sergey M․ 46933a15d6
[extractor/common] Support root JSON-LD lists (Closes #10203) 2016-08-05 23:14:32 +07:00
Sergey M․ 3859ebeee6
[tvplay] Capture and output native error message 2016-08-05 22:50:42 +07:00
Remita Amine d50aca41f8 [archiveorg] improve format extraction(closes #10219) 2016-08-05 16:42:15 +01:00
Remita Amine 0ca057b965 [jwplatform] add support for playlist extraction and relative urls and improve audio detection 2016-08-05 16:42:15 +01:00
Sergey M․ 5ca968d0a6
[tvplay] Extract series metadata 2016-08-05 22:37:38 +07:00
Sergey M․ f0d31c624e
[tvplay] Add support for subtitles (Closes #10194) 2016-08-05 22:17:32 +07:00
Remita Amine 08c655906c [5min] fix _VALID_URL(closes #10228) 2016-08-05 10:22:33 +01:00
Remita Amine 5a993e1692 [natgeo] fix tests(closes #10229) 2016-08-05 10:13:26 +01:00
Remita Amine a7d2953073 [extractors] add tvp:embed import 2016-08-05 10:11:59 +01:00
Remita Amine fdd0b8f8e0 [tvp] extract video id from the webpage(fixes #7799) 2016-08-05 09:44:15 +01:00
Remita Amine f65dc41b72 [naver] extract upload date 2016-08-05 08:12:25 +01:00
Yen Chi Hsuan 962250f7ea
[cbslocal] Fix timestamp parsing (closes #10213) 2016-08-05 11:44:50 +08:00
Yen Chi Hsuan 7dc2a74e0a
[utils] Fix unified_timestamp for formats parsed by parsedate_tz() 2016-08-05 11:41:55 +08:00
Remita Amine b02b960c6b [naver] improve extraction(closes #8096) 2016-08-04 21:42:22 +01:00
Remita Amine 4f427c4be8 [condenast] improve extraction 2016-08-04 18:30:56 +01:00
Sergey M․ 8a00ea567b
[natgeo:episodeguide] Do not shadow url from outer scope 2016-08-04 23:21:04 +07:00
Remita Amine 8895be01fc [5min] fix _VALID_URL 2016-08-04 16:55:12 +01:00
Remita Amine 52e7fcfeb7 [engadget] Relax _VALID_URL 2016-08-04 16:34:47 +01:00
Remita Amine 2396062c74 [5min] delegate extraction to AolIE
recently the 5min SenseHandler request return
HTTP Error 503: Service Unavailable error
2016-08-04 16:21:27 +01:00
Remita Amine 14704aeff6 [kaltura] remove debugging line 2016-08-04 14:54:34 +01:00
Remita Amine 3c2c3af059 [extractors] change imports for national geographic extractors 2016-08-04 12:20:56 +01:00
Remita Amine 1891ea2d76 [nationalgeographic] Add support for National Geographic Episode Guide 2016-08-04 12:18:10 +01:00
Remita Amine 1094074c04 [kaltura] extract subtitles and reduce requests 2016-08-04 09:39:06 +01:00
Remita Amine 217d5ae013 [vodplatform] Add new extractor 2016-08-04 09:39:06 +01:00
Remita Amine 8b40854529 [common] lower proto_preference of rtsp formats
Most of the time the RtspFD fail to download videos but it report
success of the download with this output:
[mpv] 0 bytes
[download] 100% of 0.00B
2016-08-04 09:39:06 +01:00
Sergey M․ 8d3b226b83
[gamekings] Remove extractor
Now covered by generic jwplayer
2016-08-03 22:06:10 +07:00
Remita Amine 42b7a5afe0 [limelight] extract http formats 2016-08-03 13:12:51 +01:00
Sergey M․ 9cb0e65d7e
[ntvru] Fix extraction 2016-08-02 22:56:48 +07:00
Sergey M․ b070564efb
[extractor/common] Support multiple properties in _og_search_property 2016-08-02 22:55:14 +07:00
Philipp Hagemeister 3aa9a73554 [options] Hide --password=secret in verbose output 2016-08-02 17:03:26 +02:00
Philipp Hagemeister 6a9b3b61ea [comedycentral] Re-add shortnames
In cc99d4f826, the shortname feature got deleted by accident. Re-add it as a separate IE.
2016-08-02 14:02:31 +02:00
Sergey M․ 45408eb075
release 2016.08.01 2016-08-01 22:59:23 +07:00
Sergey M․ e03d3e6453
[cwtv] Add support for cwtvpr.com (Closes #10196) 2016-08-01 22:51:01 +07:00
Remita Amine a70e45f80a [limelight] keep videos marked as previewStream
e382b953f0 (commitcomment-18472915)
2016-08-01 16:25:41 +01:00
Sergey M․ 697655a7c0
[safari] Relax url regexes (Closes #10202) 2016-08-01 21:48:48 +07:00
Remita Amine e382b953f0 [limelight] skip preview and drm protected videos 2016-08-01 00:33:30 +01:00
Yen Chi Hsuan 116e7e0d04
[bloomberg] Support BPlayer() players (closes #10187) 2016-07-31 14:47:19 +08:00
Sergey M․ cf03e34ad3
[yandexmusic:track] Fix extraction (Closes #10193) 2016-07-31 07:56:18 +07:00
Sergey M․ 2903137292
release 2016.07.30 2016-07-30 14:45:07 +07:00
Sergey M․ fa9f1d16b8
[dailymotion:playlist] Carry long line 2016-07-29 22:47:34 +07:00
Dave 485fedf6fd
[dailymotion:playlist] Optimize download archive processing 2016-07-29 22:45:41 +07:00
Jaime Marquínez Ferrándiz da0baba5c8 [rtve] Fix extraction for some videos
For example http://www.rtve.es/alacarta/videos/documentos-tv/documentos-tv-descredito/3574098/.
2016-07-29 17:20:27 +02:00
Jaime Marquínez Ferrándiz bb9f3bfedf Revert "[rtve] Fix extraction (#10076)"
This reverts commit c39b2ed990.

Apparently outside of Spain using 'auth/resources' is required (#10097).
2016-07-29 17:14:04 +02:00
Sergey M․ dbc0b39b91
[tv2] Improve extraction 2016-07-29 22:01:34 +07:00
Sergey M․ 481c5c5137
[tv2:article] Fix extraction (Closes #10188) 2016-07-29 21:43:17 +07:00
Sergey M․ 0cacae2807
[twitch:clips] Sort formats 2016-07-29 09:01:53 +07:00
Sergey M․ d9d56deadf
release 2016.07.28 2016-07-28 02:42:57 +07:00
Sergey M․ 74ba450a81
[twitch:clips] Fix extraction (Closes #9767) 2016-07-28 22:30:09 +07:00
Sergey M․ db19df6ca0
[extractor/generic] Add test for #10179 2016-07-28 22:20:08 +07:00
Sergey M․ fbdf8d15d1
[soundcloud] Add _extract_urls (#10179) 2016-07-28 22:16:05 +07:00
Sergey M․ 94aae01548
[extractor/generic] Extract all soundcloud embeds (Closes #10179) 2016-07-28 22:15:15 +07:00
Sergey M․ 39eef54cf0
[ard:mediathek] Skip unavailable test 2016-07-28 21:38:23 +07:00
Sergey M․ 05c8268c81
[shared] Modernize and make more robust 2016-07-27 23:39:02 +07:00
Sergey M․ 289a16b4f3
[shared] Respect redirect URL (Closes #10170) 2016-07-27 23:28:01 +07:00
Sergey M․ dcbb07c35a
release 2016.07.26.2 2016-07-26 23:56:53 +07:00
Sergey M․ 40090e8d51
[extractor/common] Improve is_suitable
In order to fix breakage introduced by a3aa814b77
2016-07-26 23:54:06 +07:00
Sergey M․ 3e050d51d4
[orf:oe1] Relax _VALID_URL 2016-07-26 23:14:04 +07:00
Sergey M․ ced70c8640
[cbc] PEP 8 2016-07-26 23:08:08 +07:00
Sergey M․ 9a700deea4
[instagram] Remove duplicate field in test 2016-07-26 23:07:16 +07:00
Sergey M․ dc35ba0eba
[mgtv] Fix typo 2016-07-26 23:06:21 +07:00
Sergey M․ 88bd486b9a
[cbc] Improve extraction for videos embedded with clipId 2016-07-26 22:58:50 +07:00
Sergey M․ 7f8b92e3cf
[bigflix] Update tests 2016-07-26 21:44:53 +07:00
Yen Chi Hsuan 35f6e0ff36
[mtv.de] Skip 2 geo-restricted tests 2016-07-26 13:19:47 +08:00
Yen Chi Hsuan 326fa4e6e5
[generic] Skip an invalid test 2016-07-26 13:16:04 +08:00
Yen Chi Hsuan c74299a72c
[cmt] Detect unavailable videos and update _TESTS 2016-07-26 13:13:14 +08:00
Yen Chi Hsuan 10a1bb3a78
[mtv] Fix for videos with missing bitrates 2016-07-26 13:12:24 +08:00
Yen Chi Hsuan 4d3e543c73
Update extractors.py 2016-07-26 11:17:28 +08:00
Yen Chi Hsuan 05d1e7aaa9
[generic] Fix an MTV test and another test that breaks nosetests 2016-07-26 11:11:36 +08:00
Yen Chi Hsuan a3aa814b77
Update _TESTS for MTV sites 2016-07-26 11:10:41 +08:00
Yen Chi Hsuan 5c32a77cad
[nextmovie] Remove extractor
This domain name now redirects to mtv.com
2016-07-26 11:08:55 +08:00
Yen Chi Hsuan cc99d4f826
[comedycentral] Remove IEs for *.cc.com except tosh.cc.com
All other subdomains now redirects to cc.com/* URLs
2016-07-26 11:06:50 +08:00
Yen Chi Hsuan 712c7530ff
[mtv] Extract more metadata and more
1. Remove MTVIggyIE. All www.mtviggy.com URLs now redirects to
   www.mtv.com
2. Fix MTVDEIE
3. Return multiple URLs from _transform_rtmp_url. This is for
   tosh.cc.com
2016-07-26 11:03:43 +08:00
Sergey M․ 0a147785e8
[camdemy] Extract duration properly 2016-07-25 23:03:58 +07:00
Sergey M․ 59eaf69e33
[camdemy] Fix camdemy 2016-07-25 23:03:43 +07:00
Sergey M․ e8be2943a7
[smotri] Modernize, make more robust and fix tests 2016-07-24 18:38:18 +07:00
Sergey M․ 8fdc538b46
release 2016.07.24 2016-07-24 11:39:50 +07:00
Sergey M․ 9513c1eb17
[tvp] Update dash format comment 2016-07-24 11:03:39 +07:00
Sergey M․ ae6fff4e64
[onet] Enable dash formats 2016-07-24 10:43:05 +07:00
Sergey M․ 5a65668e25
[dcn] Enable dash formats 2016-07-24 10:35:55 +07:00
Sergey M․ f75e6890db
[telegraaf] Make hls non fatal 2016-07-24 10:29:26 +07:00
Sergey M․ d9cb92c840
[telegraaf] Enable dash formats 2016-07-24 10:29:09 +07:00
Sergey M․ 94c04a3c79
[arkena] Enable dash formats 2016-07-24 10:28:11 +07:00
Sergey M․ f094834857
[extractor/common] Add support for $ in SegmentTemplate in MPD manifests 2016-07-24 10:27:16 +07:00
Déstin Reed 111de00289
[DailyMail] Improve title and description extraction 2016-07-24 05:37:13 +07:00
Sergey M․ b4a131e1a5
[facebook] Relax _VALID_URL (Closes #10151) 2016-07-24 04:36:49 +07:00
Sergey M․ f1991ce928
[arkena] Skip dash formats 2016-07-23 18:07:55 +07:00
Sergey M․ 3a8947650b
[arkenaplay] Remove extractor 2016-07-23 17:57:55 +07:00
Sergey M․ 1979969f91
[extractor/generic] Add support for arkena embeds 2016-07-23 17:56:48 +07:00
Sergey M․ 0673741af3
[extractors] Add imports for arkena and lcp 2016-07-23 17:56:29 +07:00
Sergey M․ c8e170b209
[lcp] Improve extraction 2016-07-23 17:56:11 +07:00
Sergey M․ bbe1f3634a
[arkena] Improve extraction (Closes #8682) 2016-07-23 17:55:54 +07:00
Rob van Bekkum 4671dd41b2
[arkena:lcp] Add extractors 2016-07-23 17:01:09 +07:00
Sergey M․ f164b97123
[utils] Add another f4m mimetype to mimetype2ext 2016-07-23 16:48:59 +07:00
Sergey M․ 5275efe30d
release 2016.07.22 2016-07-22 23:11:28 +07:00
Sergey M․ b13647cf3c
[eporner] Fix extraction (Closes #10139) 2016-07-22 23:04:13 +07:00
Sergey M․ add7d2a0e2
[pornhub] Make error regex less ambiguous (Closes #10138) 2016-07-22 21:24:09 +07:00
Sergey M․ e298d3a08c
[youtube] Fix authentication (Closes #10140) 2016-07-22 21:05:39 +07:00
Sergey M․ fd8c8c7dcd
[youtube:shared] Relax _VALID_URL 2016-07-21 22:58:34 +07:00
Sergey M․ 9158af16cc
[bbc.co.uk:iplayer:playlist] Add support for group URLs 2016-07-21 22:37:36 +07:00
Sergey M․ c6668e4ad1
[bbc.co.uk:iplayer:playlist] Skip unavailable test 2016-07-21 22:34:55 +07:00
Sergey M․ 84e8cca48b
[youjizz] Relax _VALID_URL (Closes #10131) 2016-07-20 22:41:13 +07:00
Sergey M․ 790b06b7d4
[odatv] Improve (Closes #9285) 2016-07-20 21:43:22 +07:00
skacurt 740d7c49c2
[odatv] Add extractor 2016-07-20 21:42:05 +07:00
Sergey M․ 4e51ec5f57
[extractors] Add import for comedycentral.tv 2016-07-19 22:50:37 +07:00
Sergey M․ 05087d1b4c
[bbc] Improve extraction from sxml playlists 2016-07-19 22:49:38 +07:00
Sergey M․ a66a73ee90
[ard] Add test for rbb-online 2016-07-18 02:25:31 +07:00
Sergey M․ 8188b923db
release 2016.07.17 2016-07-17 19:04:29 +07:00
Sergey M․ e8882e7043
[spike] Relax _VALID_URL and improve extraction (Closes #10106) 2016-07-17 18:34:25 +07:00
Sergey M․ 1056821799
[viki] Fix tests (Closes #10098) 2016-07-17 18:13:54 +07:00
Sergey M․ 890e6d3309
[viki] Lower m3u8 preference
http URLs are always provde the same or better quality
2016-07-17 18:12:03 +07:00
Sergey M․ 246080d378
[viki] Override m3u8 formats acodec 2016-07-17 18:10:16 +07:00
Sergey M․ b1ea680270
Revert "[bbc] extract more and better qulities from Unified Streaming Platform m3u8 manifests"
This reverts commit 0385aa6199.
2016-07-17 17:29:36 +07:00
Sergey M․ 45550d1039
[comedycentraltv] Add extractor (Closes #10101) 2016-07-17 16:58:58 +07:00
Sergey M․ 7cdfc4c90f
[mtvservices] Strip description 2016-07-17 16:56:39 +07:00
Sergey M․ af21f56f98
[ard] Add support for rbb-online (Closes #10095) 2016-07-17 03:40:58 +07:00
Sergey M․ 1a8f0773b6
[streamable] Fix title extraction and improve (Closes #9122) 2016-07-17 02:01:00 +07:00
Zach Bruggeman 59cc5bd8bf
[streamable] Add extractor 2016-07-17 01:35:09 +07:00
Sergey M․ 49bc16b95e
[nintendo] Improve playlist extraction (Closes #9986) 2016-07-17 00:01:25 +07:00
TRox1972 a2f9ca1e67
[nintendo] Add extractor 2016-07-16 23:58:53 +07:00
Sergey M․ 371ddb14fe
[extractor/generic] Change twitter:player embeds priority to lowest (Closes #10090) 2016-07-16 15:59:43 +07:00
Yen Chi Hsuan 998895dffa
[cloudy] Drop videoraj.to
videoraj.ch is now a shoe-selling website, and videoraj.to domain name
is gone.
2016-07-16 15:37:54 +08:00
Yen Chi Hsuan aadd3ce21f
[cliphunter] Update _TESTS 2016-07-16 15:37:54 +08:00
Yen Chi Hsuan ae7b846203
[cbsnews] Update _TESTS of CBSNewsLiveVideoIE 2016-07-16 15:37:54 +08:00
Yen Chi Hsuan 21ba7d0981
[cbc] Skip geo-restricted test case 2016-07-16 15:37:54 +08:00
Sergey M․ 691fbe7f98
release 2016.07.16 2016-07-16 02:20:00 +07:00
Sergey M․ 2e221ca3a8
[YoutubeDL] Fix incomplete formats check 2016-07-16 01:18:05 +07:00
Sergey M․ 317f7ab634
[YoutubeDL] Fix format selection with filters (Closes #10083) 2016-07-16 00:55:43 +07:00
Yen Chi Hsuan 23495d6a39
Revert "[ffmpeg] Fix embedding subtitles (#9063)"
This reverts commit ccff2c404d.

Fixes #10081.

The new approach breaks embedding subtitles into video-only or
audio-only files. FFMpeg provides a trick: add '?' after the argument of
'-map' so that a missing stream is ignored. For example:

opts = [
    '-map', '0:v?',
    '-c:v', 'copy',
    '-map', '0:a?',
    '-c:a', 'copy',
    # other options...
]

Unfortunately, such a format is not implemented in avconv, either.
I guess adding '-ignore_unknown' if self.basename == 'ffmpeg' is the
best solution. However, the example mentioned in #9063 no longer serves
problematic files, so I can't test it. I'll reopen #9063 and wait for
another example so that I can test '-ignore_unknown'.
2016-07-15 20:02:36 +08:00
Remita Amine 224db034ab [syfy] fix extraction(closes #9087)(closes #3820)(closes #2388) 2016-07-14 23:59:47 +01:00
Sergey M․ ad27649be3
[3qsdn] Restrict src JS regex 2016-07-15 03:36:50 +07:00
Sergey M․ 84571be645
[orf:tvthek] Remove test md5 2016-07-15 03:17:29 +07:00
Nehal Patel 7b0d333a7e
Fix unit tests for m3u8 and RTSP extractors that require ffmpeg or mplayer 2016-07-15 03:06:23 +07:00
Remita Amine 342f0c3682 [ninenow] correct test url 2016-07-14 14:19:18 +01:00
Remita Amine 38e0f16a94 [ninenow] Add new extractor(closes #5181) 2016-07-14 14:16:11 +01:00
Remita Amine e910fe2fe4 [brightcove] skip ism manifests 2016-07-14 14:13:57 +01:00
Jaime Marquínez Ferrándiz 233b58dec7 Add extractor for rtve.es/television (fixes #10076) 2016-07-13 21:02:34 +02:00
Jaime Marquínez Ferrándiz c39b2ed990 [rtve] Fix extraction (#10076)
For http://www.rtve.es/alacarta/videos/documentos-tv/documentos-tv-revolucion-del-movil/3069778/ using 'auth/resources' fails, and other URLs seem to work fine.
2016-07-13 20:23:27 +02:00
Remita Amine 35ec86689c [bbc] extract only the original Unified Streaming Platform m3u8 manifests
0385aa6199 (commitcomment-18233275)
manifests with higher birate require more time to check formats
2016-07-13 18:01:14 +01:00
Sergey M․ c485959034
release 2016.07.13 2016-07-13 23:58:01 +07:00
Sergey M․ a0560d8ab8
[ellentv] Improve extraction (Closes #10067) 2016-07-13 22:42:53 +07:00
Remita Amine 0385aa6199 [bbc] extract more and better qulities from Unified Streaming Platform m3u8 manifests 2016-07-13 15:58:24 +01:00
Remita Amine 00f4764cb7 [common] extract vbr, abr and fps for Unified Streaming Platform m3u8 manifests 2016-07-13 15:58:24 +01:00
Sergey M․ 51c2cd0b83
[extractors] Add vk:wallpost extractor import 2016-07-13 21:53:23 +07:00
Sergey M․ 5f5a9d6158
[vk] Improve login 2016-07-13 21:52:52 +07:00
Sergey M․ 2d19fb5072
[vk:wallpost] Add extractor 2016-07-13 21:51:44 +07:00
Remita Amine 41aa44259d [shahid] try to bypass geo restriction and extract more metadata(closes #10062) 2016-07-12 23:15:38 +01:00
Sergey M․ 7f29cf545a
[youtube] Add YouTube Red paid video reference test (#10059) 2016-07-12 02:10:35 +07:00
Remita Amine 7d1219f3e0 [tmz] delegate extraction to KalturaIE 2016-07-11 19:08:22 +01:00
Remita Amine f1b4af7d79 [beightcove:new] remove html tags from description 2016-07-11 19:06:50 +01:00
Remita Amine 8a8590a617 [dbtv] delegate extraction to BrightcoveNewIE 2016-07-11 16:30:24 +01:00
Remita Amine 4a7a5e41f7 [tvplay] improve extraction 2016-07-11 14:51:44 +01:00
Yen Chi Hsuan 2a49d01600
[playvid] Update _TESTS
Blocks https://travis-ci.org/rg3/youtube-dl/jobs/143809100
2016-07-11 15:15:28 +08:00
Yen Chi Hsuan b99af8a51c
[biobiochiletv] Fix extraction and update _TESTS 2016-07-11 13:23:57 +08:00
Yen Chi Hsuan 8e7020daef
[rudo] Add new extractor
Used in biobiochile.tv
2016-07-11 13:19:25 +08:00
Sergey M․ a26bcc61c1
release 2016.07.11 2016-07-11 03:17:12 +07:00
Sergey M․ 5c4dcf8172
[vidzi] Add support for embed URLs (Closes #10058) 2016-07-11 03:14:39 +07:00
Sergey M․ e9fb6a4bbe
[youtube] Relax TFA regexes 2016-07-11 03:08:38 +07:00
Yen Chi Hsuan e2dbcaa1bf
[vuclip] Fix extraction 2016-07-11 00:52:25 +08:00
Yen Chi Hsuan ae01850165
[miomio] Fix _TESTS 2016-07-11 00:03:24 +08:00
Yen Chi Hsuan c3baaedfc8
[miomio] Support new 'h5' player (closes #9605)
Depends on #8876
2016-07-10 23:46:48 +08:00
Yen Chi Hsuan 0b68de3cc1 Merge pull request #8876 from remitamine/html5_media
[extractor/common] add helper method to extract html5 media entries
2016-07-10 23:40:45 +08:00
Sergey M․ 865b087224
[roosterteeth] Improve (Closes #9864) 2016-07-10 01:30:12 +07:00
Nehal Patel 3121b25639
[roosterteeth] Add extractor 2016-07-10 01:30:12 +07:00
Sergey M․ 0286b85c79
release 2016.07.09.2 2016-07-09 22:22:24 +07:00
Sergey M․ ab52bb5137
[animeondemand] Fix typo 2016-07-09 22:20:34 +07:00
Sergey M․ 61a98b8623
[lynda] Remove md5 from test (Closes #10047) 2016-07-09 21:29:11 +07:00
Sergey M․ 6daf34a045
[facebook] Fix typo and break when found video_data (Closes #10048) 2016-07-09 21:25:07 +07:00
Yen Chi Hsuan c03adf90bd
[generic] Add the test. Closes #1638 2016-07-09 14:39:01 +08:00
Yen Chi Hsuan 0ece114b7b
[vimeo] Recognize non-standard embeds (#1638) 2016-07-09 14:38:27 +08:00
Yen Chi Hsuan 5b6a74856b Merge pull request #9288 from reyyed/issue#9063fix
[ffmpeg] Fix embedding subtitles (#9063)
2016-07-09 14:29:53 +08:00
Sergey M․ ce43100a01
release 2016.07.09.1 2016-07-09 10:06:40 +07:00
Remita Amine 8cc9b4016d [srmediathek] extend _VALID_URL(closes #9373) 2016-07-09 03:22:09 +01:00
Remita Amine 31eeab9f41 [ard] fix f4m extraction and skip tests with 404 errors 2016-07-09 03:22:09 +01:00
Sergey M․ 9558dcec9c
[youtube:user] Preserve user/c path segment 2016-07-09 08:37:19 +07:00
Sergey M․ 6e6b70d65f
[extractor/generic] Properly comment out a test 2016-07-09 08:37:19 +07:00
Sergey M․ d417fd88d0
release 2016.07.09 2016-07-09 07:16:47 +07:00
Sergey M․ 9e4f5dc1e9
[animeondemand] Pass num for episode based videos 2016-07-09 07:13:32 +07:00
Sergey M․ 1251565ee0
[options] Rollback old behavior for configuratio files' encoding
Until agreed with some solution
2016-07-09 07:12:52 +07:00
Sergey M․ 1f7258a367
[animeondemand] Add support for full length films (Closes #10031) 2016-07-09 06:57:04 +07:00
Sergey M․ 0af985069b
[flipagram] Improve extraction (Closes #9898) 2016-07-09 03:31:17 +07:00
Sergey M․ 0de168f7ed
[extractor/generic] Detect schema.org/VideoObject embeds 2016-07-09 03:29:07 +07:00
Sergey M․ 95b31e266b
[extractor/common] Add expected_type in json ld routines 2016-07-09 03:28:04 +07:00
Sergey M․ 6b3a3098b5
[extractor/common] Extract more metadata for VideoObject in _json_ld 2016-07-09 03:27:11 +07:00
Sergey M․ 2de624fdd5
[extractor/common] Introduce filesize metafield for thumbnails 2016-07-09 03:24:36 +07:00
Déstin Reed 3fee7f636c
[flipagram] Add extractor 2016-07-09 03:23:32 +07:00
Remita Amine 89e2fff2b7 [mgtv] pass geo verification headers for api request 2016-07-08 20:18:25 +01:00
Sergey M․ cedc70b292
[facebook] Fix invalid video being extracted (Closes #9851) 2016-07-09 00:28:07 +07:00
Remita Amine 07d7689f2e [le] extract http formats 2016-07-08 15:35:20 +01:00
Yen Chi Hsuan 2e32ac0b9a
[polskieradio] Fix regex in _TESTS 2016-07-08 19:34:53 +08:00
Yen Chi Hsuan 672f01c370 Merge branch 'polskie-radio' of https://github.com/JakubAdamWieczorek/youtube-dl into JakubAdamWieczorek-polskie-radio 2016-07-08 19:33:28 +08:00
Jakub Adam Wieczorek e2d616dd30 [polskieradio] Add thumbnails. 2016-07-08 13:23:00 +02:00
Yen Chi Hsuan 0ab7f4fe2b
[nick] support nickjr.com (closes #7542) 2016-07-08 15:11:28 +08:00
Sergey M․ 29c4a07776
[lynda] Fix test 2016-07-08 03:33:53 +07:00
Philipp Hagemeister 826e911e41 Merge branch 'master' of github.com:rg3/youtube-dl 2016-07-07 19:42:22 +02:00
Philipp Hagemeister 30d22dae8e [options] Do not decode Unicode on Python 2.x
The configuration file contents are being returned as unicode now, so decoding them is no longer necessary.
(Run python2 with -3 to see the warning before this commit)
2016-07-07 19:41:00 +02:00
Yen Chi Hsuan ec3518725b
[compat] Fix test_cmdline_umlauts on Python 2.6
The original statement raises uncaught UnicodeWarning on Python 2.6
2016-07-07 22:30:58 +08:00
Remita Amine 5f87d845eb [tweakers] fix info extraction(closes #9516) 2016-07-07 12:51:42 +01:00
Yen Chi Hsuan dfe5fa49ae
[compat] Fix compat_shlex_split for non-ASCII input
Closes #9871
2016-07-07 17:37:29 +08:00
Remita Amine 01a0c511eb [radiocanada] extract more formats 2016-07-07 03:46:12 +01:00
remitamine 882af14d7d [toutv] fix info extraction(closes #1792)(closes #2082) 2016-07-07 01:47:28 +01:00
Remita Amine 47335a0efa [telecinco] fix info extraction 2016-07-06 23:09:13 +01:00
Sergey M․ 34bc2d9dfd
release 2016.07.07 2016-07-07 01:54:29 +07:00
Sergey M․ 08c7af4afa
[kamcord] Add extractor (Closes #10001) 2016-07-07 01:50:39 +07:00
Yen Chi Hsuan f7291a0b7c
[daum.net] Fix extraction for specific examples
Closes #9972
2016-07-07 01:26:14 +08:00
Yen Chi Hsuan c65aa4e9e1
[brightcove:legacy] Support 'playlistTabs' and skip a dead test
Closes #9965
2016-07-07 01:13:37 +08:00
Yen Chi Hsuan ad213a1d74
[francetv] Recognize more Dailymotion embedded videos
Closes #9955
2016-07-06 23:37:54 +08:00
Yen Chi Hsuan 43f1e4e41e
[onet] Add MD5 checksum 2016-07-06 20:32:03 +08:00
Yen Chi Hsuan 54b0e909d5
[amp] Fix a typo 2016-07-06 20:10:47 +08:00
Yen Chi Hsuan f8752b86ac
[Onet,ClipRs] Add new extractor for onet.tv and use it for clip.rs
Closes #9950
2016-07-06 20:09:05 +08:00
Yen Chi Hsuan 84c237fb8a
[utils] Add get_element_by_class
For #9950
2016-07-06 20:02:52 +08:00
Remita Amine ab49d7a9fa use mimetype2ext to determine manifest ext in multiple extractors 2016-07-06 09:11:46 +01:00
Remita Amine b4173f1551 [utils] add mimetypes to determine manifest ext(m3u8, f4m, mpd) 2016-07-06 09:06:28 +01:00
Remita Amine 2817b99cf2 [metacafe] fix info extraction(closes #8539)(closes #3253) 2016-07-06 02:19:55 +01:00
Remita Amine 001fffd004 [spiegel:article] update test(closes #10018) 2016-07-06 00:16:41 +01:00
Sergey M․ 0e94b4713d
release 2016.07.06 2016-07-06 00:54:23 +07:00
Sergey M․ a6d3b89feb
[prosiebensat1] Make downloading urls JSON non fatal 2016-07-06 00:52:48 +07:00
Remita Amine 6c26815d63 [onionstudios] fix info extraction 2016-07-05 18:05:07 +01:00
Sergey M․ 73c4ac2c95
[youtube:channel] Improve channel id extraction and detect unavailable channels (Closes #10009) 2016-07-05 23:30:44 +07:00
Remita Amine 84f214d840 [prosiebensat1] extract all formats 2016-07-05 17:11:45 +01:00
Remita Amine e3f88be7a9 [rtvnh] extract all formats 2016-07-05 14:45:39 +01:00
Remita Amine 31af3e35e0 [sandia] remove unused imports 2016-07-05 13:39:24 +01:00
Remita Amine 94a5cff91d [sendia] fix info extraction 2016-07-05 13:37:46 +01:00
Remita Amine 77082c7b9e [slideshare] fix description extraction 2016-07-05 12:01:04 +01:00
Remita Amine 252a1f75d2 [spiegel] improve info extraction 2016-07-05 11:46:25 +01:00
Remita Amine 5abf513cf8 [stitcher] fix episode config extraction 2016-07-05 10:44:16 +01:00
Yen Chi Hsuan c6054e3201
[xuite] Support videos with already encoded media id 2016-07-05 14:26:42 +08:00
Yen Chi Hsuan 4080530624
[youtube:shared] Recognize the new 'shared' URLs
Closes #10007
2016-07-05 13:15:05 +08:00
Sergey M․ c25f1a9b63
release 2016.07.05 2016-07-05 06:32:46 +07:00
Remita Amine d9163ae3b6 [kaltura] fix extraction error for videos from multiple kaltura servers 2016-07-04 21:34:27 +01:00
Remita Amine dafafe7cf1 [la7] extract more info from a kaltura custom server 2016-07-04 17:59:58 +01:00
Remita Amine 81953d1ae5 [kaltura] add support videos stored on custom kaltura servers(closes #5557) 2016-07-04 17:59:58 +01:00
Yen Chi Hsuan 3a212ed62e
[iqiyi] Skip an unstable MD5 checksum 2016-07-04 11:25:46 +08:00
Sergey M․ 195f084542
[pornhub] Detect private videos (Closes #9987) 2016-07-04 03:27:00 +07:00
Sergey M․ 6a4e659c93
[yahoo] Recognize brightcove embed (Closes #9995) 2016-07-03 23:00:36 +07:00
Remita Amine dd801bbe18 [brightcove] improve error detection 2016-07-03 16:37:22 +01:00
Yen Chi Hsuan 38cce791c7
Rename --cn-verfication-proxy to --geo-verification-proxy
And deprecate the former one

Since commit f138873900, this option is
not limited to China websites, so rename it.
2016-07-03 23:29:56 +08:00
Sergey M․ bff98341d5
release 2016.07.03.1 2016-07-03 21:28:55 +07:00
Yen Chi Hsuan 2644e911be
[iqiyi] Fix extraction
See https://github.com/soimort/you-get/issues/1211#issuecomment-229011559
2016-07-03 22:19:56 +08:00
Remita Amine a5f67895d3 [nationalgeographic] restore http formats
there was a misunderstanding about the reason of 403 response
the problem happen only when the user use aria2c as a downloader
a1f6f5c768 (commitcomment-18107559)
2016-07-03 14:10:25 +01:00
Yen Chi Hsuan 15e4b6b758
[rai] Support an alternative form of embedded relinker URL
Closes #8551
2016-07-03 19:52:11 +08:00
Yen Chi Hsuan 2b28b892d8
[rai] Support videos with embedded content item ID (#8551) 2016-07-03 19:52:11 +08:00
Yen Chi Hsuan 477b7a8474
[downloader/f4m] Fix for Rai live streams 2016-07-03 19:26:39 +08:00
Yen Chi Hsuan 034a884957
[rai] Support direct relinker URLs (closes #8552) 2016-07-03 19:26:39 +08:00
Remita Amine 64436cb1a4 [nationalgeographic] skip download for national geographic channel tests(closes #9991) 2016-07-03 10:43:36 +01:00
Yen Chi Hsuan f138873900 [rai] Fix extraction and update _TESTS
Closes #8617
Closes #9157
Closes #9232
2016-07-03 15:49:35 +08:00
Yen Chi Hsuan e793338c88
[buzzfeed] Detect Facebook embed and update _TESTS
Closes #5701
2016-07-03 14:12:02 +08:00
Yen Chi Hsuan 369bb06206
[facebook] Improve embed detection (#5701) 2016-07-03 14:11:29 +08:00
Sergey M․ 2cb31d288e
[history:topic] Relax _VALID_URL 2016-07-03 13:01:04 +07:00
Jaime Marquínez Ferrándiz 4cb13d0d6a [hrti] Don't redefine variable in list comprehension 2016-07-02 23:02:14 +02:00
Remita Amine a1f6f5c768 [nationalgeographic] add support Adobe Pass auth 2016-07-02 21:24:22 +01:00
Remita Amine 05c7feec77 [aenetworks] add support Adobe Pass auth 2016-07-02 21:24:22 +01:00
Remita Amine bf83024826 [theplatform] add basic support for Adobe Pass 2016-07-02 21:24:22 +01:00
Sergey M․ a0cfd82dda
release 2016.07.03 2016-07-03 03:19:22 +07:00
Sergey M․ 1b734adb2d
[xtube] Fix extraction (Closes #9953, closes #9961) 2016-07-03 03:17:35 +07:00
Sergey M․ 9b724d7277
[extractors] Add hrti:playlist import 2016-07-03 02:25:39 +07:00
Sergey M․ e3755a624b
[hrti] Improve and add support for playlists (Closes #9482) 2016-07-03 02:22:14 +07:00
Sergey M․ 95cf60e826
[utils] Add PUTRequest 2016-07-03 02:21:32 +07:00
Aleksandar Topuzovic 6b03e1e25d
[HRTi] Implement extractor for Croatian Radiotelevision 2016-07-03 02:20:41 +07:00
Yen Chi Hsuan 712b0b5b70
[la7.it] Fix the extractor 2016-07-02 23:49:03 +08:00
Yen Chi Hsuan 6a424391d9
[facebook] Make embed detection stricter to prevent false-positives 2016-07-02 23:15:55 +08:00
Yen Chi Hsuan dbf0157a26 [generic] Add MD5 checksums 2016-07-02 21:58:07 +08:00
Yen Chi Hsuan 7deef1ba67 [generic] Support Wordpress "YouTube Video Importer" plugin
Closes #9938
2016-07-02 21:58:07 +08:00
Yen Chi Hsuan fd6ca38262 [facebook] Improve Facebook embedded detection
Related to #9938.

Another example comes from 9834872bf6.
2016-07-02 21:58:07 +08:00
Sergey M․ bdafd88da0
[vk] Extend _VALID_URLs to support new domain (Closes #9981) 2016-07-02 16:43:19 +07:00
Sergey M․ 7a1e71575e
release 2016.07.02 2016-07-02 02:47:42 +07:00
Sergey M․ ac2d8f54d1
[vine] Remove superfluous whitespace 2016-07-02 02:45:00 +07:00
Sergey M․ 14ff6baa0e
[fusion] Improve 2016-07-02 02:44:37 +07:00
TRox1972 bb08101ec4
[Fusion] Add new extractor 2016-07-02 02:37:28 +07:00
Sergey M․ bc4b2d75ba
[pornhub] Add support for thumbzilla (Closes #8696) 2016-07-02 02:11:07 +07:00
Sergey M․ 35fc3021ba
[periscope] Add another fallback source 2016-07-02 01:35:57 +07:00
cant-think-of-a-name 347227237b
[periscope] fix playlist extraction (#9967)
The JSON response changed and the extractor needed to be updated in order to gather the video IDs.
2016-07-02 01:29:11 +07:00
Sergey M․ 564dc3c6e8
[vine] Fix extraction (Closes #9970) 2016-07-02 01:24:57 +07:00