3633d77c0f
Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime'
2013-11-03 15:56:55 +01:00
12ebdd1506
[viddler] Support non-digit IDs ( Fixes #1714 )
2013-11-03 15:49:59 +01:00
1baf9a5938
Merge pull request #1698 from rzhxeo/cinemassacre
...
[CinemassacreIE] Support more embed urls
2013-11-03 05:17:12 -08:00
a56f9de156
Style fixes for extractors: remove spaces around (,),{ and }
2013-11-03 14:06:47 +01:00
fa5d47af4b
Merge pull request #1679 from rzhxeo/mofosex
...
Add support for http://www.mofosex.com
2013-11-03 05:04:14 -08:00
d607038753
Merge pull request #1677 from rzhxeo/xtube
...
Add support for http://www.xtube.com
2013-11-03 03:28:02 -08:00
9ac6a01aaf
Merge pull request #1676 from rzhxeo/extremetube
...
Add support for http://www.extremetube.com
2013-11-03 03:25:46 -08:00
9103bbc5cd
Add the 'webpage_url' field to info_dict
...
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
2013-11-03 12:11:13 +01:00
a3dd924871
Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date.
2013-11-02 22:40:48 -04:00
137bbb3e37
[XTubeIE] Add description to TEST
2013-11-02 22:45:48 +01:00
86ad94bb2e
[ExtremeTubeIE] Set age_limit to 18 and fix uploader extraction
2013-11-02 22:33:49 +01:00
3e56add7c9
Merge pull request #1678 from rzhxeo/keezmovies
...
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
2013-11-02 14:15:52 -07:00
f52f01b5d2
[brightcove] Don't set the extension
...
If the video only has the 'FLVFullLengthURL' key, it can still be an mp4 file.
2013-11-02 21:20:46 +01:00
98d7efb537
[exfm] skip tests
...
The site is down too often.
2013-11-02 20:51:09 +01:00
cf51923545
[youtube] Remove vevo test
...
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
2013-11-02 20:46:26 +01:00
38fcd4597a
Merge remote-tracking branch 'iemejia/master'
2013-11-02 19:56:06 +01:00
165e3bb67a
[bambuser] Add an extractor for channels ( closes #1702 )
2013-11-02 19:50:57 +01:00
38db46794f
Merge branch 'ted_subtitles'
2013-11-02 19:50:45 +01:00
a9a3876d55
[ted] Added support for subtitle download
2013-11-02 19:48:39 +01:00
1f343eaabb
[subtitles] refactor to support websites with subtitle information the
...
webpage.
I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
2013-11-02 19:29:25 +01:00
72a5b4f702
Add an extractor for bambuser.com ( #1702 )
2013-11-02 19:01:01 +01:00
0a43ddf320
[CinemassacreIE] Add live paramter to extracted info as a workaround
2013-11-02 18:08:35 +01:00
8eddf3e91d
[youtube] Encode subtitle track name in request ( Fixes #1700 )
2013-11-02 11:21:05 +01:00
60d142aa8d
Add an extractor for vk.com ( closes #1635 )
2013-11-01 22:34:18 +01:00
66cf3ac342
[metacafe] Fix support for age-restricted videos ( fixes #1696 )
...
The 'Content-Type' header must be set for disabling the family filter.
The 'flashversion' cookie is only needed for AnyClip videos.
Added tests for standard metacafe videos and for age-restricted videos.
Also set the 'age_limit' field.
2013-11-01 11:56:15 +01:00
ab4e151347
[CinemassacreIE] Support more embed urls
2013-11-01 01:24:23 +01:00
ac2547f5ff
[teamcoco] Fix video url extraction for some videos
...
Video url extraction failed for some videos,
e.g. http://teamcoco.com/video/old-time-baseball
The url extracted was also occasionally suboptimal quality,
e.g. http://teamcoco.com/video/louis-ck-interview-george-w-bush
2013-10-31 15:41:14 -04:00
5f1ea943ab
[livestream] fix the extraction of events
...
It now uses a json dictionary from the webpage.
2013-10-31 08:07:26 +01:00
9f1109a564
[dailymotion] Fix support for age-restricted videos ( Fixes #1688 )
2013-10-31 00:20:49 +01:00
72321ead7b
[vevo] Readd support for SMIL ( Fixes #1683 )
2013-10-30 01:14:17 +01:00
b5d0d817bc
Remove superfluous space
2013-10-30 01:09:44 +01:00
b9a836515f
Update the Vimeo test vector md5
...
confirmed that this is indeed the first 10241 (we went off by one with
byte range 0-10240) of the full, playing mp4, so they probably
reencoded or something
2013-10-29 16:44:35 -04:00
21c924f406
[arte] Download the 'Originalversion' version if it's the only one available ( fixes #1682 )
2013-10-29 20:58:49 +01:00
e54fd4b23b
[vevo] Add more format details
2013-10-29 15:10:09 +01:00
912cbf5d4e
[vevo] Fix timestamp handling
...
( / 1000 is implicit float division )
2013-10-29 14:00:23 +01:00
f7ff55aa78
Merge remote-tracking branch 'origin/master'
2013-10-29 06:48:18 +01:00
795f28f871
[youtube] Fix login ( Fixes #1681 )
2013-10-29 06:45:54 +01:00
321a01f971
[mtv] Remove the templates from the mediagen url
2013-10-28 23:37:01 +01:00
2563bcc85c
Add an extractor for MySpace ( closes #1666 )
2013-10-28 22:02:17 +01:00
dcc2a706ef
Add support for http://www.xtube.com
2013-10-28 19:23:48 +01:00
2bc67c35ac
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
2013-10-28 18:22:55 +01:00
77ae65877e
Add support for http://www.mofosex.com
2013-10-28 18:18:58 +01:00
32a35e4418
Add support for http://www.extremetube.com
2013-10-28 17:35:01 +01:00
1003d108d5
[vimeo] Support hash in URL ( Fixes #1669 )
2013-10-28 11:32:22 +01:00
c1002e96e9
Let extractors omit ext in formats
2013-10-28 11:28:02 +01:00
77d0a82fef
[addanime] Use new formats system
2013-10-28 11:24:47 +01:00
ebc14f251c
Merge remote-tracking branch 'origin/master'
2013-10-28 10:44:13 +01:00
d41e6efc85
New debug option --write-pages
2013-10-28 10:44:02 +01:00
8ffa13e03e
[Instagram] get the non-https link, as they are serving Akamai cert from a instagram.com domain
2013-10-28 02:34:29 -04:00
750e9833b8
Add the missing age_limit tags; added a devscript to do a superficial check for porn sites without the age_limit tag in the test
2013-10-28 01:50:17 -04:00
82f0ac657c
Merge pull request #1657 by @rzhxeo
...
[YouPornIE] Extract all encrypted links and remove doubles at the end
2013-10-28 01:45:52 -04:00
eb6a2277a2
Merge pull request #1659 by @rzhxeo
...
Add support for http://www.tube8.com
2013-10-28 01:38:28 -04:00
f8778fb0fa
Merge pull request #1663 by @rzhxeo
...
Add support for http://www.spankwire.com
2013-10-28 01:35:11 -04:00
e2f9de207c
Merge pull request #1664 by @rzhxeo
...
Add support for http://www.keezmovies.com
2013-10-28 01:25:46 -04:00
a93cc0d943
Merge pull request #1661 by @rzhxeo
...
Add support for http://www.pornhub.com
2013-10-28 00:50:39 -04:00
7d8c2e07f2
[Exfm] replace the failing Soundcloud test vector (broken also in browser)
2013-10-28 00:33:43 -04:00
efb4c36b18
Merge pull request #1660 from pyed/master
...
[addanime] try to download HQ before normal
2013-10-27 21:14:19 -07:00
29526d0d2b
Merge pull request #1656 from rzhxeo/xhamster
...
[XHamsterIE] Extract SD and HD video
2013-10-27 10:12:59 -07:00
198e370f23
[addanime] better regex.
2013-10-27 19:48:02 +03:00
c19f7764a5
[generic] Detect bandcamp pages that use custom domains ( closes #1662 )
...
They embed the original url in the 'og:url' property.
2013-10-27 14:40:25 +01:00
bc63d9d329
[rtlnow] Change the test for rtlnitronow
2013-10-27 14:26:19 +01:00
aa929c37d5
[generic] Fix test video's checksum
2013-10-27 14:21:37 +01:00
af4d506eb3
[faz] Use a regex for getting the description
...
The page cannot be parsed in python2.6 with the html parser.
2013-10-27 14:18:55 +01:00
5da0549581
[KeezMoviesIE] Correct return value for embedded videos
2013-10-27 12:48:09 +01:00
749a4fd2fd
[facebook] Don't recommend to report the issue if the video is private.
2013-10-27 12:13:55 +01:00
6f71ef580c
[facebook] Report a more meaningful message if the video cannot be accessed ( closes #1658 )
2013-10-27 12:09:46 +01:00
67874aeffa
[facebook] Fix the login process ( fixes #1244 )
2013-10-27 12:07:58 +01:00
3e6a330d38
[addanime] fix md5sum
2013-10-27 13:51:26 +03:00
aee5e18c8f
[addanime] catch 'RegexNotFoundError'
2013-10-27 13:36:43 +03:00
5b11143d05
Add support for http://www.keezmovies.com
2013-10-27 10:10:28 +01:00
7b2212e954
Add support for http://www.spankwire.com
2013-10-27 01:59:26 +02:00
71865091ab
[Tube8IE] Fix regex for uploader extraction
2013-10-27 01:08:03 +02:00
125cfd78e8
Add support for http://www.pornhub.com
2013-10-27 01:04:22 +02:00
8cb57d9b91
[Tube8IE] Escape dot in regex
2013-10-27 00:21:27 +02:00
14e10b2b6e
[addanime] try to download HQ before normal
2013-10-27 01:19:38 +03:00
6e76104d66
[YouPornIE] Make webpage download more robust
2013-10-26 23:33:32 +02:00
1d45a23b74
Add support for http://www.tube8.com
2013-10-26 23:27:30 +02:00
7df286540f
[YouPornIE] Extract all encrypted links and remove doubles at the end
2013-10-26 21:57:10 +02:00
5d0c97541a
[XHamsterIE] Extract SD and HD video
2013-10-26 20:38:54 +02:00
49a25557b0
[8tracks] Use track count instead of looking at at_last_track property
...
This fixes the error:
$ youtube-dl http://8tracks.com/vladmc/counting-stars
[8tracks] counting-stars: Downloading webpage
[8tracks] counting-stars: Downloading song information 1/4
[8tracks] counting-stars: Downloading song information 2/4
[8tracks] counting-stars: Downloading song information 3/4
[8tracks] counting-stars: Downloading song information 4/4
[8tracks] counting-stars: Downloading song information 5/4
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/phihag/projects/youtube-dl/youtube_dl/__main__.py", line 18, in <module>
youtube_dl.main()
File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 761, in main
_real_main(argv)
File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 714, in _real_main
retcode = ydl.download(all_urls)
File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 701, in download
videos = self.extract_info(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 342, in extract_info
ie_result = ie.extract(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/common.py", line 121, in extract
return self._real_extract(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/eighttracks.py", line 111, in _real_extract
'id': track_data['id'],
KeyError: 'id'
2013-10-25 23:46:19 +02:00
600cc1a4f0
[youtube] Set the format_id field to the itag of the format ( closes #1624 )
2013-10-25 17:17:46 +02:00
ea32fbacc8
Fix the extensions of two tests with youtube videos
...
The best quality is now a mp4 video.
2013-10-25 16:55:37 +02:00
00fe14fc75
[youtube] Also use the 'adaptative_fmts' field from the /get_video_info page ( fixes #1649 )
...
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
2013-10-25 16:52:58 +02:00
fcc28edb2f
[cinemassacre] Simplify
...
* Remove some rtmp parameters that are not needed.
* Remove the md5 checksums, the video is not downloaded.
* Remove the code used before the current format system.
2013-10-23 20:21:41 +02:00
fac6be2dd5
Merge pull request #1632 from rzhxeo/cinemassacre
...
[Cinemassacre] Download video that is shown in flash player
2013-10-23 20:15:39 +02:00
cdec0190c4
[dailymotion] Extract all the available formats ( closes #1028 )
2013-10-23 17:33:38 +02:00
2450bcb28b
[nowvideo] Fix key extraction
...
Extract it from the embed page
2013-10-23 17:00:33 +02:00
93b22c7828
[vimeo] fix the extraction for videos protected with password
...
Added a test video.
2013-10-23 16:31:53 +02:00
55b3e45bba
[vimeo] Fix pro videos and player.vimeo.com urls
...
The old process can still be used for those videos.
Added RegexNotFoundError, which is raised by _search_regex if it can't extract the info.
2013-10-23 14:38:03 +02:00
365bcf6d97
Merge remote-tracking branch 'origin/master'
2013-10-23 11:40:46 +02:00
71907db3ba
[vimeo] Fix normal videos ( Fixes #1642 )
...
Vimeo Pro Videos are still broken
2013-10-23 11:38:53 +02:00
6803655ced
Merge pull request #1622 from rbrito/fix-extension
...
extractor: youtube: Set extension of AAC audio formats to m4a.
2013-10-22 15:16:26 -07:00
b028e96144
[arte.tv:creative] Update the title of the test
2013-10-22 21:06:06 +02:00
ce68b5907c
[nhl:videocenter] Fix playlist title extraction
2013-10-22 21:01:16 +02:00
a6387bfd3c
[vimeo] Implement the new format selection system (closes PR #996 )
...
Rebased and deleted some parts to use the new system instead of copying the one from YoutubeIE
2013-10-21 23:16:11 +02:00
f6a54188c2
[youtube] Use 'node is None' when checking if the video has automatic captions
...
It had stopped working and it reports a FutureWarning
2013-10-21 16:28:55 +02:00
cbbd9a9c69
Fix the duration field for the VideoDetective and InternetVideoArchive tests
...
Also remove the use of the old format system and the comment
2013-10-21 15:07:33 +02:00
685a9cd2f1
[googleplus] Fix upload_date extraction
2013-10-21 15:00:21 +02:00
182a107877
[arte] Set the format_note and the format_id fields ( closes #1628 )
2013-10-21 14:42:30 +02:00
8c51aa6506
The 'format' field now defaults to '{format_id} - {width}x{height}{format_note}'
...
Following the YoutubeIE format. The 'format_note' gives additional info about the format, for example '3D' or 'DASH video'.
2013-10-21 14:42:06 +02:00
f8b45beacc
Merge remote-tracking branch 'rbrito/set-age'
...
Conflicts:
youtube_dl/extractor/xhamster.py
2013-10-19 21:16:14 +02:00
9d92015d43
[xhamster] Add support for age_limit (Instead of #1627 )
2013-10-19 21:09:48 +02:00
50a6150ed9
extractor: Set age limit on some adult-related extractors.
...
More age limit of videos for adult-related sites.
Note that, for redtube, I explicitly left the variable containing the age
limit, since the comment justifying the age limit is a good thing to have.
That being said, I included the age limit field on the test, to better
reflect what the information extractor does (even if it may not break the
automated tests).
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-19 14:19:25 -03:00
b0505eb611
[CinemassacreIE] Fix information extraction
2013-10-19 16:46:17 +02:00
8ed6b34477
extractor: Set age limit on some adult-related extractors.
...
This is similar in spirit to what was done in commit 8e590a117f
2013-10-18 19:32:37 -03:00
f6f1fc9286
extractor: youtube: Fix extension of dash formats.
...
While we are at it, separate the audio formats from the video formats.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 18:53:00 -03:00
8e590a117f
[xnxx] Add age_limit
2013-10-18 23:35:17 +02:00
16f36a6fc9
extractor: youtube: Set extension of AAC audio formats to m4a.
...
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue
Furthermore, one may argue that this is, indeed, the case for correctness's
sake.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 17:50:55 -03:00
53c1d3ef49
Check for embedded YouTube player ( Fixes #1616 )
2013-10-18 11:44:57 +02:00
7c58ef3275
[tudou] Fix title regex ( Fixes #1614 )
2013-10-18 11:16:20 +02:00
416a5efce7
fix typos
2013-10-18 00:49:45 +02:00
d21ab29200
Add an extractor for techtalks.tv ( closes #1606 )
2013-10-17 08:20:58 +02:00
a733eb6c53
[youtube] Do not crash if caption info is missing altogether ( Fixes #1610 )
2013-10-17 02:19:19 +02:00
591454798d
[brightcove] Raise error if playlist is empty ( #1608 )
2013-10-17 01:02:17 +02:00
38604f1a4f
Merge remote-tracking branch 'origin/master'
2013-10-17 00:55:06 +02:00
2d0efe70a6
[brightcove] Fix more broken XML ( #1608 )
2013-10-17 00:46:11 +02:00
bfd14b1b2f
Add an extractor for rutube.ru ( closes #1136 )
...
It downloads with a m3u8 manifest, requires ffmpeg.
2013-10-16 16:57:40 +02:00
10eaae48ff
Merge branch 'master' of github.com:rg3/youtube-dl
2013-10-15 12:05:24 +02:00
9d4660cab1
[generic] Support embedded vimeo videos ( #1602 )
2013-10-15 12:05:13 +02:00
9d74e308f7
[sztvhu] Fix the title extraction
2013-10-15 08:22:59 +02:00
8381a92120
[websurg] Skipt the test
...
It needs login information.
2013-10-15 08:12:30 +02:00
4f41664de8
Merge remote-tracking branch 'Rudloff/websurg'
2013-10-15 02:11:33 +02:00
7cf67fbe29
[sztvhu] Simplify
2013-10-15 01:33:20 +02:00
3ddf1a6d01
Merge remote-tracking branch 'Elbandi/master'
2013-10-15 01:26:34 +02:00
850555c484
Merge remote-tracking branch 'origin/master'
2013-10-15 01:25:47 +02:00
9ed3bdc64d
[tudou] Add support for youku links ( Closes #1571 )
2013-10-15 01:20:04 +02:00
c45aa56080
[gamespot] Fix video extraction ( fixes #1587 )
2013-10-14 16:46:07 +02:00
7394b8db3b
Merge remote-tracking branch 'origin/master'
2013-10-14 16:07:53 +02:00
f9b3d7af47
Add an extractor for Szombathelyi TV
2013-10-14 13:07:47 +02:00
ea62a2da46
add VideoPremium.tv RTMP support
2013-10-14 01:32:47 -04:00
1fb07d10a3
[youtube] Adds #1312 Download annotations
...
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
2013-10-14 16:22:27 +11:00
9378ae6e1d
[youku] Allow shortcut youku:ID and make non-matching groups non-matching ( #1571 )
2013-10-13 15:55:05 +02:00
69a0c470b5
[arte] Add an extractor for future.arte.tv ( closes #1593 )
2013-10-13 14:21:13 +02:00
c40f5cf45c
[arte] add an extractor for creative.arte.tv ( #1593 )
...
The +7 videos now use an independent extractor that is also used for the creative videos
2013-10-13 13:54:31 +02:00
4b7b839f24
Add an extractor for rottentomatoes.com and improve InternetVideoArchiveIE to get the best quality
2013-10-12 22:22:31 +02:00
3d60d33773
Add an extractor for videodetective.com ( closes #262 )
...
It uses the internetvideoarchive.com platform.
2013-10-12 21:36:17 +02:00
d7e66d39a0
Add an extractor for internetvideoarchive.com videos
...
It's used by videodetective.com
2013-10-12 21:34:04 +02:00
f5e54a1fda
add support for NowVideo.ch
2013-10-12 13:11:03 -04:00
3283533149
Fix Brightcove detection when another Flash object is on the page
...
The regex used non-greedy match, but alas it failed on input like this:
<object class="...> ... class="BrightcoveExperience"
It captured two objects and the intervening HTML. This commit fixes this by
not allowing a ">" to appear before BrightcoveExperience.
Video in question: http://www.harpercollinschildrens.com/feature/petethecat/
2013-10-11 21:52:33 -04:00
8032e31f2d
Merge pull request #1558 from rzhxeo/cinemassacre
...
Add support for http://cinemassacre.com
2013-10-11 20:38:26 +02:00
d2f9cdb205
Merge branch 'cinemassacre' of github.com:rzhxeo/youtube-dl into rzhxeo-cinemassacre
2013-10-11 19:53:27 +02:00
3823342d9d
[arte] Prepare for generic format support ( #980 )
2013-10-11 16:33:31 +02:00
91dbaef406
[nhl] Add an extractor for videocenter's categories ( #1586 )
...
It downloads the last 12 videos.
2013-10-11 14:33:26 +02:00
cb354c8f62
[yahoo] Download the info from another page
...
The 'meta' field is not always in the video webpage
2013-10-10 21:01:45 +02:00
1cbb27b151
[gamespot] Mark as broken ( #1587 )
2013-10-10 19:55:52 +02:00
0ab4ff6378
[mtv] Strip the description
...
There were some tabs and newlines added around the string.
2013-10-10 19:53:44 +02:00
63da13e829
Add an extractor for faz.net ( closes #1582 )
2013-10-10 19:37:17 +02:00
2e1fa03bf5
Add an extractor for video.nhl.com ( closes #1586 )
2013-10-10 16:16:49 +02:00
57da92b7df
[youtube] Do not recognize attribution link as user ( Fixes #1573 )
2013-10-09 23:50:38 +02:00
a34c2faae4
[youtube] set the 'name' parameter in the subtitles url ( fixes #1577 )
2013-10-09 16:41:36 +02:00
Philipp Hagemeister
Jaime Marquínez Ferrándiz
Craig Markwardt
rzhxeo
Ismaël Mejía
Alex Van't Hof
Filippo Valsorda
Abdulelah Alfntokh
rzhxeo
Joshua Elsasser
Rogério Brito
Andras Elso
Jai Grimshaw
Joey Adams