[FranceTV] Back-port and update extractors

[dirkf]

Boilerplate: yt-dlp+own code, bug-fix+improvement

Please follow the guide below

• You will be asked some questions, please read them carefully and answer honestly
• Put an x into all the boxes [ ] relevant to your pull request (like that [x])
• Use Preview tab to see how your pull request will actually look like

---

Before submitting a pull request make sure you have:

• Searched the bugtracker for similar pull requests
• Read adding new extractor tutorial
• Read youtube-dl coding conventions and adjusted the code to meet them
• Covered the code with tests (note that PRs without tests will be REJECTED)
• Checked the code with flake8

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

• I am the original author of this code and I am willing to release it under Unlicense, except for code from yt-dlp, for which this or the below has been asserted
• I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

• Bug fix
• Improvement
• New extractor
• New feature

---

Description of your pull request and other information

• FranceTVIE: updated
• FranceTVEmbedIE: update API path
• FranceTVSiteIE: updated
• FranceTVInfoIE: updated, add la1ere, use franceinfo.fr
• FranceTVInfoSportIE: legacy redirect extractor
• FranceTVJeunesseIE: obsolete, not _WORKING
• GenerationWhatIE: obsolete, not _WORKING
• CultureboxIE: legacy redirect extractor

Supersedes, closes #29996
Supersedes, closes #32884
Resolves #25996
Resolves #29956
Resolves #32713

[dirkf]

For posterity and searchability ...

In some early Pythons, the regular expression compiler might raise nothing to repeat if it found a potentially empty expression like .* at the end of a repeatable parenthesised expression, as in (?:whatever.*)?. This is Python bug 18647 aka python/cpython#62847. The over-zealous check was removed from at least Py 3.5 and contemporaneous later 2.7 versions. Perhaps the compiler has been rewritten by now?

In FranceTVEmbedIE, a UUID hex string (without - separators, 32 characters) should be matched in the URL either as the value of the ue query parameter or as the last element of the path. The obvious (?) RE broke in the affected Python versions, basically fixed by changing (?:...)? to (?:|...):

     _VALID_URL = r'''(?x)
         https?://embed\.francetv\.fr(?:/?\?(?:.*&)?(?P<ue>ue)=|/)
-        (?P<id>[\da-f]{32})(?:(?(ue)&|/?[?#]).*)?$
+        (?P<id>[\da-f]{32})(?:|(?(ue)&|/?[?#]).*)$
    '''

[dirkf]

Roll in Lumni.

Suggested change

	return self.playlist_result(entries, playlist_id)
	return self.playlist_result(entries, playlist_id)
	class LumniBaseIE(FranceTVBaseIE):
	_VIDEO_DIV_RE = r'(<div\s[^>]*(?<!-)\bdata-factoryid\s*=\s*(?!""|\'\')\S[^>]*>)'
	class LumniIE(LumniBaseIE):
	_VALID_URL = r'https?://(?:www\.)?lumni\.fr/video/(?P<id>[\w-]+)'
	_TESTS = [{
	'url': 'https://www.lumni.fr/video/l-homme-et-son-environnement-dans-la-revolution-industrielle',
	'add_ie': [FranceTVIE.ie_key()],
	'md5': '84ddbef8fede632091f201eda38192d9',
	'info_dict': {
	'id': 'd2b9a4e5-a526-495b-866c-ab72737e3645',
	'ext': 'mp4',
	'title': "L'homme et son environnement dans la révolution industrielle - L'ère de l'homme",
	'timestamp': 1725372585,
	'upload_date': '20240903',
	'thumbnail': r're:https?:/(?:/[\w.-]+)+\.jpg$',
	'duration': 230,
	},
	'params': {
	'format': 'best/bestvideo',
	'skip_download': 'm3u8',
	},
	}]
	def _real_extract(self, url):
	display_id = self._match_id(url)
	webpage = self._download_webpage(url, display_id)
	video_id = extract_attributes(self._search_regex(
	self._VIDEO_DIV_RE, webpage, 'video id'))['data-factoryid']
	return self._make_url_result(video_id, url=url)
	class LumniPlaylistIE(LumniBaseIE):
	_VALID_URL = r'''(?x)
	https?://
	(?:www\.)?lumni\.fr/
	(?:dossier|programme|serie)/
	(?P<id>[0-9a-z-]+)
	'''
	_TESTS = [{
	'url': 'https://www.lumni.fr/dossier/les-fondamentaux-vocabulaire',
	'add_ie': [FranceTVIE.ie_key()],
	'info_dict': {
	'id': 'les-fondamentaux-vocabulaire',
	'title': 're:(?i)^Les Fondamentaux : Vocabulaire$',
	},
	'playlist_mincount': 9
	}, {
	'url': 'https://www.lumni.fr/programme/the-rich-morning-show',
	'only_matching': True
	}, {
	'url': 'https://www.lumni.fr/serie/la-maison-lumni-college',
	'only_matching': True
	}]
	def _real_extract(self, url):
	playlist_id = self._match_id(url)
	webpage = self._download_webpage(url, playlist_id)
	playlist_title = self._og_search_title(webpage)
	def entries():
	for m in re.finditer(self._VIDEO_DIV_RE, webpage):
	video_id = extract_attributes(m.group(1)).get('data-factoryid')
	if video_id:
	yield self._make_url_result(video_id, url=url)
	return self.playlist_result(
	entries(), playlist_id, playlist_title)

[dirkf]

... I'd be super grateful if you could quickly reply to these two yes/no questions:

1. Does this comment provide suggestions from a dimension you hadn’t considered?

No.

2. Do you find this comment helpful?

The suggestions cover known best practices and/or optimisations that are or would be implemented if appropriate and worthwhile. Item 4 is just wrong to identify video_id as sensitive.

[dirkf]

Support video ID in SvelteKit JS - pt 2:

Suggested change

	join_nonempty,
	join_nonempty,
	js_to_json,

[dirkf]

Support video ID in SvelteKit JS - pt 1:

Suggested change

	player_button = extract_attributes(self._search_regex(
	r'(<button\s[^>]*(?<!-)\bdata-url\s*=\s*["\'][^>]{2,}>)',
	webpage, 'fi player button', default=''))
	if player_button.get('data-url'):
	result = merge_dicts(traverse_obj(player_button, {
	'id': 'data-expression-uuid',
	'timestamp': ('data-start-time', T(int_or_none)),
	'duration': T(lambda x: int(x['data-end-time']) - int(x['data-start-time'])),
	'title': 'data-extract-title',
	'description': 'data-diffusion-title',
	'series': 'data-emission-title',
	'url': ('data-url', T(url_or_none)),
	}), {
	'thumbnail': self._og_search_thumbnail(webpage, default=None),
	})
	if result.get('url'):
	if not result.get('title'):
	result['title'] = self._html_search_regex(
	r'''Retrouvez l'intégralité du\s+(.+)\s*:''',
	webpage, 'Alt title').replace('"', '')
	svelte_js_content = self._search_json(
	r'\bcontent\s*:', webpage, 'svelte content', display_id,
	transform_source=js_to_json, default={})
	result['id'] = traverse_obj(svelte_js_content, ('diffusion', 'videoId', T(str)))
	if not result.get('id'):
	player_button = extract_attributes(self._search_regex(
	r'(<button\s[^>]*(?<!-)\bdata-url\s*=\s*["\'][^>]{2,}>)',
	webpage, 'fi player button', default=''))
	if player_button.get('data-url'):
	result = merge_dicts(traverse_obj(player_button, {
	'id': 'data-expression-uuid',
	'timestamp': ('data-start-time', T(int_or_none)),
	'duration': T(lambda x: int(x['data-end-time']) - int(x['data-start-time'])),
	'title': 'data-extract-title',
	'description': 'data-diffusion-title',
	'series': 'data-emission-title',
	'url': ('data-url', T(url_or_none)),
	}), {
	'thumbnail': self._og_search_thumbnail(webpage, default=None),
	})
	if result.get('url'):
	if not result.get('title'):
	result['title'] = self._html_search_regex(
	r'''Retrouvez l'intégralité du\s+(.+)\s*:''',
	webpage, 'Alt title').replace('"', '')