Markus Heiser 194f222203 [fix] engines: Google-Web & Google-Video (random arc_id) ...

Both enghines have been reported ``TooManyRequests``, additionaly Google-Videos
thumbnails needed a review.

Based on the research from @unixfox [1] this patch generates every hour a new random
``arc_id``.

[1] https://github.com/searxng/searxng/issues/4435#issuecomment-2703279522

Closes:

- https://github.com/searxng/searxng/issues/4435
- https://github.com/searxng/searxng/issues/4431

Related:

- https://github.com/searxng/searxng/discussions/4434
- https://github.com/searxng/searxng/discussions/4429

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>

2025-03-06 15:43:53 +01:00

..

__init__.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

9gag.py

[chore] engines: replace datetime.utcfromtimestamp with datetime.fromtimestamp

2025-02-07 17:19:00 +01:00

360search_videos.py

[feat] add 360search engine for searxng

2025-03-02 13:25:35 +01:00

360search.py

[feat] add 360search engine for searxng

2025-03-02 13:25:35 +01:00

1337x.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

adobe_stock.py

[fix] engine adobe stock videos datetime parsing

2025-02-12 07:05:58 +01:00

ahmia.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

alpinelinux.py

[feat] engine: implementation of alpine linux packages

2024-07-14 17:57:58 +02:00

annas_archive.py

[fix] update_engine_traits.py: annas archive, bing-* and zlibrary engines

2024-12-29 10:12:45 +01:00

apkmirror.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

apple_app_store.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

apple_maps.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

archlinux.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

artic.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

arxiv.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

ask.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

astrophysics_data_system.py

[feat]: engines: add astrophysical data system

2025-01-16 20:27:55 +01:00

bandcamp.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

base.py

[chore] *: fix typos detected by typos-cli

2024-11-24 12:41:57 +01:00

bilibili.py

[chore] engines: replace datetime.utcfromtimestamp with datetime.fromtimestamp

2025-02-07 17:19:00 +01:00

bing_images.py

[fix] use get accessor to pull desc from bing_images

2024-09-26 07:26:51 +02:00

bing_news.py

[fix] bing news results return invalid images

2024-06-25 11:12:41 +02:00

bing_videos.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

bing.py

[fix] bing fetch engine traits - adjusted XPath selectors

2025-03-01 09:43:06 +01:00

bpb.py

[chore] engines: replace datetime.utcfromtimestamp with datetime.fromtimestamp

2025-02-07 17:19:00 +01:00

brave.py

[fix] brave engine: add sec-fetch headers and source=web argument

2025-03-02 18:19:55 +01:00

bt4g.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

btdigg.py

[fix] Removes `/>` ending tags for void HTML elements

2024-09-15 15:19:51 +02:00

ccc_media.py

[fix] ccc_media engine: filter video formats and ignore audio & SubRip

2024-04-28 08:42:18 +02:00

chefkoch.py

[fix] chefkoch: use German words in content field

2024-05-12 18:36:49 +02:00

cloudflareai.py

add Cloudflare AI Gateway engine

2024-09-23 07:02:10 +02:00

command.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

core.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

cppreference.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

crates.py

[feat] engine: implementation of cargo search (crates.io)

2024-05-17 16:37:39 +02:00

crossref.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

currency_convert.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dailymotion.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

deepl.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

deezer.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

demo_offline.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

demo_online.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

destatis.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

deviantart.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dictzone.py

[fix] hostnames plugin: AttributeError: 'NoneType' object has no attribute 'netloc'

2025-01-28 16:28:12 +01:00

digbt.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

discourse.py

[enh] Add API Key support for discourse.org forums

2024-07-27 09:21:40 +02:00

docker_hub.py

[fix] dockerhub: switch to new api path

2025-01-06 13:46:13 +01:00

doku.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

duckduckgo_definitions.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

duckduckgo_extra.py

[chore] engines: replace datetime.utcfromtimestamp with datetime.fromtimestamp

2025-02-07 17:19:00 +01:00

duckduckgo_weather.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

duckduckgo.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

duden.py

[mod] pylint all files with one profile / drop PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dummy-offline.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dummy.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

ebay.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

elasticsearch.py

Fix search_url building.

2024-06-20 06:30:00 +02:00

emojipedia.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

fdroid.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

findthatmeme.py

[chore] engines: replace datetime.utcfromtimestamp with datetime.fromtimestamp

2025-02-07 17:19:00 +01:00

flickr_noapi.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

flickr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

freesound.py

[black] upgrade black 22.12.0 --> 24.2.0

2024-03-09 08:15:50 +01:00

frinkiac.py

[format.python] initial formatting of the python code

2021-12-27 09:26:22 +01:00

fyyd.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

geizhals.py

[fix] engine geizhals: if there are no offers, there is no best price

2024-07-28 19:00:51 +02:00

genius.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

gitea.py

[fix] various issues in the documentation

2025-02-26 07:15:39 +01:00

github.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

gitlab.py

[feat] gitlab: implement dedicated module

2024-09-15 08:04:21 +02:00

goodreads.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

google_images.py

[fix] \!goi irrelevant results AND display more results

2024-06-16 16:45:03 +02:00

google_news.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

google_play.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

google_scholar.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

google_videos.py

[fix] engines: Google-Web & Google-Video (random arc_id)

2025-03-06 15:43:53 +01:00

google.py

[fix] engines: Google-Web & Google-Video (random arc_id)

2025-03-06 15:43:53 +01:00

hackernews.py

[chore] engines: replace datetime.utcfromtimestamp with datetime.fromtimestamp

2025-02-07 17:19:00 +01:00

hex.py

[mod] engine hex: add sort_criteria & page_size to configuration

2024-05-28 11:55:59 +02:00

imdb.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

imgur.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

ina.py

[fix] ina engine

2022-01-28 22:33:41 +01:00

invidious.py

[feat] videos template: support for view count

2024-07-27 11:49:58 +02:00

ipernity.py

[feat] engines: add ipernity (images)

2025-01-20 17:22:32 +01:00

jisho.py

[format.python] based on bugfix in 9ed626130

2022-05-07 18:23:10 +02:00

json_engine.py

[fix] various issues in the documentation

2025-02-26 07:15:39 +01:00

kickass.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

lemmy.py

[fix] various issues in the documentation

2025-02-26 07:15:39 +01:00

lib_rs.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

libretranslate.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

lingva.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

livespace.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

loc.py

[fix] engine: Library of Congress - image & thumb links

2024-11-26 09:36:59 +01:00

mariadb_server.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

mastodon.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

material_icons.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mediathekviewweb.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mediawiki.py

[fix] gentoo: use mediawiki engine

2024-07-03 10:24:03 +02:00

meilisearch.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

metacpan.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mixcloud.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

mojeek.py

[fix] mojeek web engine: don't add empty fmt argument for web searches

2025-02-20 07:45:57 +01:00

mongodb.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

moviepilot.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

mozhi.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

mrs.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mullvad_leta.py

Update mullvad_leta.py to account for img_elem

2024-07-15 06:58:39 +02:00

mwmbl.py

[mod] engine 'mwmbl: Update API URL

2024-04-10 06:51:28 +02:00

mysql_server.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

npm.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

nyaa.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

odysee.py

[chore] engines: replace datetime.utcfromtimestamp with datetime.fromtimestamp

2025-02-07 17:19:00 +01:00

open_meteo.py

[chore] engines: replace datetime.utcfromtimestamp with datetime.fromtimestamp

2025-02-07 17:19:00 +01:00

openclipart.py

[feat] engines: add openclipart.org

2025-03-01 18:01:51 +01:00

openlibrary.py

[feat] engine: support for openlibrary

2024-10-15 13:06:00 +02:00

opensemantic.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

openstreetmap.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

openverse.py

[fix] openverse: update API and website URL (#4275)

2025-02-02 22:12:24 +01:00

pdbe.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

peertube.py

[feat] videos template: support for view count

2024-07-27 11:49:58 +02:00

photon.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

pinterest.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

piped.py

[feat] videos template: support for view count

2024-07-27 11:49:58 +02:00

piratebay.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

pixiv.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

pkg_go_dev.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

podcastindex.py

[chore] engines: replace datetime.utcfromtimestamp with datetime.fromtimestamp

2025-02-07 17:19:00 +01:00

postgresql.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

presearch.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

public_domain_image_archive.py

[feat] public domain image archive: automatically obtain algolia api key

2025-01-20 12:56:15 +01:00

pubmed.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

pypi.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

qwant.py

[fix] various issues in the documentation

2025-02-26 07:15:39 +01:00

radio_browser.py

[fix] fetch_traits: brave, google, annas_archive & radio_browser

2024-09-15 12:48:35 +02:00

recoll.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

reddit.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

redis_server.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

rottentomatoes.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

rumble.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

scanr_structures.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

searchcode_code.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

searx_engine.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

seekr.py

[fix] various issues in the documentation

2025-02-26 07:15:39 +01:00

semantic_scholar.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

sepiasearch.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

seznam.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

sogou_images.py

[feat] add Sogou WeChat article search support

2025-03-02 13:31:31 +01:00

sogou_videos.py

[chore] add timediff field for sogou_videos

2025-03-02 13:31:31 +01:00

sogou_wechat.py

[feat] add Sogou WeChat article search support

2025-03-02 13:31:31 +01:00

sogou.py

[feat] add Sogou WeChat article search support

2025-03-02 13:31:31 +01:00

solidtorrents.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

solr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

soundcloud.py

[refactor] soundcloud engine

2025-03-01 17:51:14 +01:00

spotify.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

springer.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

sqlite.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

stackexchange.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

startpage.py

[feat] startpage: support for news and images

2025-02-20 13:44:28 +01:00

stract.py

[enh] engine: stract - add language/region support

2024-09-29 14:29:22 +02:00

svgrepo.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

tagesschau.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

tineye.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

tokyotoshokan.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

tootfinder.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

torznab.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

translated.py

[refactor] typification of SearXNG / EngineResults

2025-01-28 07:07:08 +01:00

unsplash.py

[fix] engine unsplash: image links by preserving URL parameters

2025-02-26 08:44:39 +01:00

vimeo.py

[enh] add re-usable func to filter text

2024-05-29 17:56:17 +02:00

voidlinux.py

[chore] *: fix typos detected by typos-cli

2024-11-24 12:41:57 +01:00

wallhaven.py

Fix usage of api_key engine setting

2025-01-06 12:25:33 +01:00

wikicommons.py

[fix] wikicommons engine: remove HTML tags from result items

2024-11-28 06:05:45 +01:00

wikidata.py

[fix] wikidata: increase wikidata queries timeout

2025-03-01 12:21:29 +01:00

wikipedia.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wolframalpha_api.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wolframalpha_noapi.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wordnik.py

[chore] remove invalid base_url from settings.yml engines

2024-11-26 10:06:07 +01:00

wttr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

www1x.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

xpath.py

[fix] various issues in the documentation

2025-02-26 07:15:39 +01:00

yacy.py

[fix] engine yacy: update list of base URLs

2024-07-20 09:59:43 +02:00

yahoo_news.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

yahoo.py

[fix] engine yahoo: HTML tags are included in result titles

2024-09-03 22:26:59 +02:00

yandex_music.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

yandex.py

[feat] engine: implementation of yandex (web, images)

2024-08-21 12:08:35 +02:00

yep.py

[fix] yep engine: remove links to other engines

2024-09-12 00:04:04 +02:00

youtube_api.py

[fix] engine: youtube_api - ignore channels / prevent exceptions

2024-04-13 08:41:00 +02:00

youtube_noapi.py

[enh] add re-usable func to filter text

2024-05-29 17:56:17 +02:00

yummly.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

zlibrary.py

[fix] update_engine_traits.py: annas archive, bing-* and zlibrary engines

2024-12-29 10:12:45 +01:00