96a2daa1ee
[extractor/common] Improve jwplayer subtitles extraction
2017-06-15 23:40:39 +07:00
6a9cb29509
[extractor/common] Fix json dumping with --geo-bypass
...
The line "[debug] Using fake IP %s (%s) as X-Forwarded-For." was printed
to stdout even with -j/-J, which breaks the resultant JSON.
2017-06-15 13:04:36 +08:00
0a268c6e11
[extractor/common] Improve jwplayer formats extraction ( closes #13379 )
2017-06-14 22:02:15 +07:00
1afd0b0da7
[extractor/common] Return unicode string from _match_id
2017-06-09 00:40:03 +07:00
f2e2f0c777
[extractor/common] Fix rtmp and rtsp formats' URLs in _extract_wowza_formats
2017-05-17 22:20:25 +07:00
6f76679804
[extractor/common] Add support for schemeless URLs in _extract_wowza_formats ( closes #13088 , closes #13092 )
2017-05-16 22:11:34 +07:00
76d5a36391
[extractor/common] Respect Width and Height attributes in ISM manifests
2017-05-14 06:11:45 +07:00
ff6f9a6704
[extractor/common] fix typo in _extract_akamai_formats
2017-05-04 16:07:08 +01:00
55949fede6
[common] introduce chapters field
2017-05-02 20:41:48 +01:00
33a81c2c6f
[extractor/common] Extract view count from JSON-LD
2017-04-30 21:45:59 +07:00
c89b49f743
[extractor/common] Add manifest_url for explicit group rendition formats
2017-04-28 03:00:14 +07:00
ff99fe529e
Don't list master m3u8 playlists in format list ( closes #12832 )
2017-04-27 21:53:17 +07:00
ac9c69ace7
[extractor/common] Improve jwplayer regex
2017-04-25 23:46:05 +07:00
3019cb0c99
[extractor/common] Rephrase comment
2017-04-23 11:52:07 +07:00
ddd258f922
[test_InfoExtractor] Add m3u8 parsing test for NAME attribute in EXT-X-STREAM-INF tag
2017-04-23 11:49:57 +07:00
9c99bef704
[extractor/common] Use float for scaled tbr
2017-04-23 11:33:49 +07:00
cb2520802d
[extractor/common] Improve m3u8 extraction ( closes #12211 )
...
* Extract m3u8 parsing to separate method
* Improve rendition groups extraction
* Build stream name according stream GROUP-ID
* Ignore reference to AUDIO group without URI when stream has no CODECS
+ Add test coverage for parsing m3u8 from #11507 , #11995 , #12211 and twitch vod
2017-04-22 07:01:00 +07:00
bae1404893
[extractor/common] Add support for video of WebPage context in _json_ld ( closes #12778 )
2017-04-18 22:21:38 +07:00
bf1b87cd91
[common] Relax JWPlayer regex and remove duplicate urls( #12768 )
2017-04-17 08:48:24 +01:00
40fcba5edb
improve coding style
2017-04-12 20:38:43 +01:00
fd47550885
[extractor/common] Add coding cookie
2017-04-02 04:42:10 +07:00
4457823dda
[extractor/common] Move censorship checks to a separate method and add check for just another ISP
2017-04-02 03:57:44 +07:00
4f06c1c9fc
Merge branch 'master' of github.com-rndusr:rg3/youtube-dl into fix/str-item-assignment
2017-03-25 21:36:59 +01:00
c73e330e7a
_find_jwplayer_data() returns dict or None
...
This simplifies code for callers of `_find_jwplayer_data()` which no longer have
to run `_parse_json()` on the return value.
It also makes sure that `_find_jwplayer_data()` returns either a `dict` or
`None` and nothing else.
2017-03-25 19:38:30 +01:00
46b18f2349
[BostonGlobe] New. Nonstandard version of Brightcove.
...
Has a "data-brightcove-video-id" instead of a "data-video-id," otherwise
pretty much just Brightcove. Except the Globe isn't all Brightcove
videos, so fallback to Generic, too.
Also, abstract playlist_from_matches() from generic.py to common.py, and use
it here.
History of these changes can be found in
51170427d4b1143572a498dedaee61863a5b2c5b.
2017-03-19 20:40:31 +08:00
b51dc9db0e
[extractor/common] Extract SMIL formats from jwplayer
2017-03-16 03:30:53 +07:00
1a2192cb90
[extractor/common] Pass arguments to _parse_jwplayer_formats and PEP8
2017-03-05 23:29:17 +07:00
0236cd0dfd
[extractor/common] Improve height extraction and extract bitrate
2017-03-05 23:25:03 +07:00
ed0cf9b383
[extractor/common] Move jwplayer formats extraction in separate method
2017-03-05 23:22:27 +07:00
eeb0a95684
[extractor/common] Add 'preference' to _parse_html5_media_entries
...
Some websites, like NJPWorld, put different qualities on different
player pages.
2017-02-25 18:40:05 +08:00
eea0716cae
[extractor/common] Print origin country for fake IP
2017-02-21 23:14:33 +07:00
336a76551b
[extractor/common] Do not quit _initialize_geo_bypass on empty countries
2017-02-21 23:09:41 +07:00
dc0a869e5e
[extractor/common] Fix typo
2017-02-21 23:05:31 +07:00
e39b5d4ab8
[extractor/common] Allow calling _initialize_geo_bypass from extractors ( #11970 )
2017-02-21 23:00:43 +07:00
3ccdde8cb7
[extractor/common] Emphasize geo bypass APIs are experimental
2017-02-20 23:21:15 +07:00
4248dad92b
Improve geo bypass mechanism
...
* Rename options to preffixly match with --geo-verification-proxy
* Introduce _GEO_COUNTRIES for extractors
* Implement faking IP right away for sites with known geo restriction
2017-02-19 05:10:08 +08:00
0a840f584c
Rename bypass geo restriction options
2017-02-19 05:10:08 +08:00
0016b84e16
Add faked X-Forwarded-For to formats' HTTP headers
2017-02-19 05:10:08 +08:00
773f291dcb
Add experimental geo restriction bypass mechanism
...
Based on faking X-Forwarded-For HTTP header
2017-02-19 05:10:08 +08:00
a4a554a793
[generic] Try parsing JWPlayer embedded videos ( closes #12030 )
2017-02-16 23:44:03 +08:00
08a00eef79
[extractor/common] skip m3u8 manifests protected with Adobe Flash Access
2017-02-10 17:00:09 +01:00
242a14a1f6
[extractor/common] Fix audio only with audio group in m3u8 ( closes #11995 )
2017-02-07 00:22:16 +07:00
2aec7256ae
[extractor/common] Speed-up media tags regex ( closes #11979 )
2017-02-06 00:20:30 +07:00
45024183ae
[infoq] Add audio only format if available ( #11565 )
...
* [infoq] Add audio only format if available
Refactor cookie code into a function.
Renamed formats to http_video, http_audio, rtmp_video
Renamed extract functions to video instead of videos as they return
one or no video.
* [infoq] Rename to _extract_cookies as it more than one
* [infoq] Remove redundant determine_ext
* [infoq] Add comment about hardcoded URL
* [infoq] Use _hidden_inputs instead of messy regex
* [infoq] Probe if audio URL is valid
Make it possible to pass headers to _is_valid_url
* [infoq] Add audio only test
2017-02-03 12:10:13 +08:00
e228616c6e
[extractor/common] Fix initialization template ( closes #11605 , closes #11825 )
2017-01-29 06:57:39 +07:00
c58c2d63cb
[extractor/common] Document forgotten fragment base and path interfaces
2017-01-29 05:57:53 +07:00
d04621daf4
[extractor/common] Fix duration per dash segment ( closes #11868 )
2017-01-29 05:36:53 +07:00
c4251b9aaa
[common] add possibility to customize akamai manifest host
2017-01-13 10:21:36 +01:00
4606c34e19
[extractor/common] Allow non-lang in subtitles' keys
...
See 264e77c406
2016-12-25 01:50:50 +08:00
a07588369f
[common] improve detection for video only formats and m3u8 manifest( fixes #11507 )
2016-12-22 10:02:56 +01:00
Sergey M․
Yen Chi Hsuan
Remita Amine
Random User
John Hawkinson
Mattias Wadman