Markus Heiser b183e620d8 [refactor] engine: duckduckgo - https://html.duckduckgo.com/html ...

The entire source code of the duckduckgo engine has been reengineered and
purified.

1. DDG used the URL https://html.duckduckgo.com/html for no-JS requests whose
   response is also easier to parse than the previous
   https://lite.duckduckgo.com/lite/ URL

2. the bot detection of DDG has so far caused problems and often led to a
   CAPTCHA, this can be circumvented using `'Sec-Fetch-Mode'] = “navigate”`

Closes: https://github.com/searxng/searxng/issues/3927
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>

2024-10-29 14:56:27 +01:00

..

__init__.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

9gag.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

1337x.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

ahmia.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

alpinelinux.py

[feat] engine: implementation of alpine linux packages

2024-07-14 17:57:58 +02:00

annas_archive.py

[fix] fetch_traits: brave, google, annas_archive & radio_browser

2024-09-15 12:48:35 +02:00

apkmirror.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

apple_app_store.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

apple_maps.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

archlinux.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

artic.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

arxiv.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

ask.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

bandcamp.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

base.py

[fix] issues reported by pylint-3.2.2

2024-05-28 18:10:04 +02:00

bilibili.py

[fix] bilibili engine - ValueError in duration & HTML in title

2024-09-06 07:13:47 +02:00

bing_images.py

[fix] use get accessor to pull desc from bing_images

2024-09-26 07:26:51 +02:00

bing_news.py

[fix] bing news results return invalid images

2024-06-25 11:12:41 +02:00

bing_videos.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

bing.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

bpb.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

brave.py

add get_embeded_stream_url to searx.utils

2024-10-03 07:10:53 +02:00

bt4g.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

btdigg.py

[fix] Removes `/>` ending tags for void HTML elements

2024-09-15 15:19:51 +02:00

ccc_media.py

[fix] ccc_media engine: filter video formats and ignore audio & SubRip

2024-04-28 08:42:18 +02:00

chefkoch.py

[fix] chefkoch: use German words in content field

2024-05-12 18:36:49 +02:00

cloudflareai.py

add Cloudflare AI Gateway engine

2024-09-23 07:02:10 +02:00

command.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

core.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

cppreference.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

crates.py

[feat] engine: implementation of cargo search (crates.io)

2024-05-17 16:37:39 +02:00

crossref.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

currency_convert.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dailymotion.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

deepl.py

[refactor] translation engines: add translate category

2024-04-26 07:33:28 +02:00

deezer.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

demo_offline.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

demo_online.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

destatis.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

deviantart.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dictzone.py

[refactor] translation engines: add translate category

2024-04-26 07:33:28 +02:00

digbt.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

discourse.py

[enh] Add API Key support for discourse.org forums

2024-07-27 09:21:40 +02:00

docker_hub.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

doku.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

duckduckgo_definitions.py

[feat] plugins: new unit converter plugin

2024-04-27 18:11:33 +02:00

duckduckgo_extra.py

add get_embeded_stream_url to searx.utils

2024-10-03 07:10:53 +02:00

duckduckgo_weather.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

duckduckgo.py

[refactor] engine: duckduckgo - https://html.duckduckgo.com/html

2024-10-29 14:56:27 +01:00

duden.py

[mod] pylint all files with one profile / drop PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dummy-offline.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dummy.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

ebay.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

elasticsearch.py

Fix search_url building.

2024-06-20 06:30:00 +02:00

emojipedia.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

fdroid.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

findthatmeme.py

[feat] engine: implementation of findthatmeme

2024-05-28 18:18:13 +02:00

flickr_noapi.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

flickr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

freesound.py

[black] upgrade black 22.12.0 --> 24.2.0

2024-03-09 08:15:50 +01:00

frinkiac.py

[format.python] initial formatting of the python code

2021-12-27 09:26:22 +01:00

fyyd.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

geizhals.py

[fix] engine geizhals: if there are no offers, there is no best price

2024-07-28 19:00:51 +02:00

genius.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

gitea.py

[mod] engine gitea: compatible with modern gitea or forgejo

2024-10-14 14:39:11 +02:00

github.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

gitlab.py

[feat] gitlab: implement dedicated module

2024-09-15 08:04:21 +02:00

goodreads.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

google_images.py

[fix] \!goi irrelevant results AND display more results

2024-06-16 16:45:03 +02:00

google_news.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

google_play.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

google_scholar.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

google_videos.py

add get_embeded_stream_url to searx.utils

2024-10-03 07:10:53 +02:00

google.py

[fix] fetch_traits: brave, google, annas_archive & radio_browser

2024-09-15 12:48:35 +02:00

hackernews.py

[upd] pypi: Bump pylint from 3.2.7 to 3.3.1

2024-10-15 14:29:10 +02:00

hex.py

[mod] engine hex: add sort_criteria & page_size to configuration

2024-05-28 11:55:59 +02:00

imdb.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

imgur.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

ina.py

[fix] ina engine

2022-01-28 22:33:41 +01:00

internet_archive_scholar.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

invidious.py

[feat] videos template: support for view count

2024-07-27 11:49:58 +02:00

jisho.py

[format.python] based on bugfix in 9ed626130

2022-05-07 18:23:10 +02:00

json_engine.py

[fix] json_engine: Fix result fields being mixed up

2024-09-12 10:47:08 +02:00

kickass.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

lemmy.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

lib_rs.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

libretranslate.py

[mod] libretranslate: add direct link to translation (engine)

2024-06-30 16:18:33 +02:00

lingva.py

[refactor] translation engines: add translate category

2024-04-26 07:33:28 +02:00

livespace.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

loc.py

[mod] library of congress: fix engine

2023-09-11 19:42:31 +02:00

mariadb_server.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

mastodon.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

material_icons.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mediathekviewweb.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mediawiki.py

[fix] gentoo: use mediawiki engine

2024-07-03 10:24:03 +02:00

meilisearch.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

metacpan.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mixcloud.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

mojeek.py

[enh] engine: mojeek - add language support

2024-10-15 06:37:01 +02:00

mongodb.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

moviepilot.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

mozhi.py

[feat] mozhi: fix crash, support synonyms and definition

2024-06-15 11:33:09 +02:00

mrs.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mullvad_leta.py

Update mullvad_leta.py to account for img_elem

2024-07-15 06:58:39 +02:00

mwmbl.py

[mod] engine 'mwmbl: Update API URL

2024-04-10 06:51:28 +02:00

mysql_server.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

npm.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

nyaa.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

odysee.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

open_meteo.py

[feat] engine: implementation of Open Meteo

2024-04-07 19:02:53 +02:00

openlibrary.py

[feat] engine: support for openlibrary

2024-10-15 13:06:00 +02:00

opensemantic.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

openstreetmap.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

openverse.py

[fix] ccengine engine - avoid unwanted redirects

2022-01-07 14:14:31 +01:00

pdbe.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

peertube.py

[feat] videos template: support for view count

2024-07-27 11:49:58 +02:00

photon.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

pinterest.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

piped.py

[feat] videos template: support for view count

2024-07-27 11:49:58 +02:00

piratebay.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

pixiv.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

pkg_go_dev.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

podcastindex.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

postgresql.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

presearch.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

pubmed.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

pypi.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

qwant.py

add get_embeded_stream_url to searx.utils

2024-10-03 07:10:53 +02:00

radio_browser.py

[fix] fetch_traits: brave, google, annas_archive & radio_browser

2024-09-15 12:48:35 +02:00

recoll.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

reddit.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

redis_server.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

rottentomatoes.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

rumble.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

scanr_structures.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

searchcode_code.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

searx_engine.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

seekr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

semantic_scholar.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

sepiasearch.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

seznam.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

sjp.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

solidtorrents.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

solr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

soundcloud.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

spotify.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

springer.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

sqlite.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

stackexchange.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

startpage.py

[fix] engine startpage: fetch_traits() / if lang name unknown by babel

2024-05-29 07:52:18 +02:00

stract.py

[enh] engine: stract - add language/region support

2024-09-29 14:29:22 +02:00

svgrepo.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

tagesschau.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

tineye.py

Fix tineye engine url, datetime parsing, and minor refactor

2024-08-21 08:41:53 +02:00

tokyotoshokan.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

tootfinder.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

torznab.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

translated.py

[refactor] translation engines: add translate category

2024-04-26 07:33:28 +02:00

unsplash.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

vimeo.py

[enh] add re-usable func to filter text

2024-05-29 17:56:17 +02:00

voidlinux.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wallhaven.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wikicommons.py

[feat] wikimedia commons: support for videos, audio and other files

2024-05-04 06:23:04 +02:00

wikidata.py

[fix] engine wikidata - WIKIDATA_UNITS has been changed in #3378

2024-05-10 16:04:27 +02:00

wikipedia.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wolframalpha_api.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wolframalpha_noapi.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wordnik.py

[format.python] initial formatting of the python code

2021-12-27 09:26:22 +01:00

wttr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

www1x.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

xpath.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

yacy.py

[fix] engine yacy: update list of base URLs

2024-07-20 09:59:43 +02:00

yahoo_news.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

yahoo.py

[fix] engine yahoo: HTML tags are included in result titles

2024-09-03 22:26:59 +02:00

yandex_music.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

yandex.py

[feat] engine: implementation of yandex (web, images)

2024-08-21 12:08:35 +02:00

yep.py

[fix] yep engine: remove links to other engines

2024-09-12 00:04:04 +02:00

youtube_api.py

[fix] engine: youtube_api - ignore channels / prevent exceptions

2024-04-13 08:41:00 +02:00

youtube_noapi.py

[enh] add re-usable func to filter text

2024-05-29 17:56:17 +02:00

yummly.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

zlibrary.py

[fix] engine zlibrary: handle seized domain

2024-06-25 14:40:19 +02:00