Markus Heiser 540323a4b0 [mod] hardening xpath engine: ignore empty results ...

A SearXNG maintainer on Matrix reported a traceback::

    File "searxng-src/searx/engines/xpath.py", line 272, in response
      dom = html.fromstring(resp.text)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "searx-pyenv/lib/python3.11/site-packages/lxml/html/__init__.py", line 850, in fromstring
      doc = document_fromstring(html, parser=parser, base_url=base_url, **kw)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "searx-pyenv/lib/python3.11/site-packages/lxml/html/__init__.py", line 738, in document_fromstring
      raise etree.ParserError(
    lxml.etree.ParserError: Document is empty

I don't have an example to reproduce the issue, but the issue and this patch are
clearly recognizable even without an example.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>

2024-11-29 14:20:31 +01:00

..

__init__.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

9gag.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

1337x.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

adobe_stock.py

[feat] engine: add adobe stock video and audio engines

2024-11-24 11:56:12 +01:00

ahmia.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

alpinelinux.py

[feat] engine: implementation of alpine linux packages

2024-07-14 17:57:58 +02:00

annas_archive.py

[fix] annas archive: crash when no thumbnail, differing results, paging

2024-11-01 12:49:33 +01:00

apkmirror.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

apple_app_store.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

apple_maps.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

archlinux.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

artic.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

arxiv.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

ask.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

bandcamp.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

base.py

[chore] *: fix typos detected by typos-cli

2024-11-24 12:41:57 +01:00

bilibili.py

[fix] bilibili engine - ValueError in duration & HTML in title

2024-09-06 07:13:47 +02:00

bing_images.py

[fix] use get accessor to pull desc from bing_images

2024-09-26 07:26:51 +02:00

bing_news.py

[fix] bing news results return invalid images

2024-06-25 11:12:41 +02:00

bing_videos.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

bing.py

[chore] *: fix typos detected by typos-cli

2024-11-24 12:41:57 +01:00

bpb.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

brave.py

add get_embeded_stream_url to searx.utils

2024-10-03 07:10:53 +02:00

bt4g.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

btdigg.py

[fix] Removes `/>` ending tags for void HTML elements

2024-09-15 15:19:51 +02:00

ccc_media.py

[fix] ccc_media engine: filter video formats and ignore audio & SubRip

2024-04-28 08:42:18 +02:00

chefkoch.py

[fix] chefkoch: use German words in content field

2024-05-12 18:36:49 +02:00

cloudflareai.py

add Cloudflare AI Gateway engine

2024-09-23 07:02:10 +02:00

command.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

core.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

cppreference.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

crates.py

[feat] engine: implementation of cargo search (crates.io)

2024-05-17 16:37:39 +02:00

crossref.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

currency_convert.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dailymotion.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

deepl.py

[refactor] translation engines: add translate category

2024-04-26 07:33:28 +02:00

deezer.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

demo_offline.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

demo_online.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

destatis.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

deviantart.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dictzone.py

[refactor] translation engines: add translate category

2024-04-26 07:33:28 +02:00

digbt.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

discourse.py

[enh] Add API Key support for discourse.org forums

2024-07-27 09:21:40 +02:00

docker_hub.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

doku.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

duckduckgo_definitions.py

[feat] plugins: new unit converter plugin

2024-04-27 18:11:33 +02:00

duckduckgo_extra.py

[fix] duckduckgo extra: crashes and returns no results

2024-11-25 17:00:52 +01:00

duckduckgo_weather.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

duckduckgo.py

[fix] duckduckgo extra: crashes and returns no results

2024-11-25 17:00:52 +01:00

duden.py

[mod] pylint all files with one profile / drop PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dummy-offline.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

dummy.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

ebay.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

elasticsearch.py

Fix search_url building.

2024-06-20 06:30:00 +02:00

emojipedia.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

fdroid.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

findthatmeme.py

[fix] findthatmeme engine URLs have changed

2024-11-27 11:08:23 +01:00

flickr_noapi.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

flickr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

freesound.py

[black] upgrade black 22.12.0 --> 24.2.0

2024-03-09 08:15:50 +01:00

frinkiac.py

[format.python] initial formatting of the python code

2021-12-27 09:26:22 +01:00

fyyd.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

geizhals.py

[fix] engine geizhals: if there are no offers, there is no best price

2024-07-28 19:00:51 +02:00

genius.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

gitea.py

[mod] engine gitea: compatible with modern gitea or forgejo

2024-10-14 14:39:11 +02:00

github.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

gitlab.py

[feat] gitlab: implement dedicated module

2024-09-15 08:04:21 +02:00

goodreads.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

google_images.py

[fix] \!goi irrelevant results AND display more results

2024-06-16 16:45:03 +02:00

google_news.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

google_play.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

google_scholar.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

google_videos.py

add get_embeded_stream_url to searx.utils

2024-10-03 07:10:53 +02:00

google.py

[fix] google engine: remove <script> tags from result items

2024-11-27 13:49:45 +01:00

hackernews.py

[upd] pypi: Bump pylint from 3.2.7 to 3.3.1

2024-10-15 14:29:10 +02:00

hex.py

[mod] engine hex: add sort_criteria & page_size to configuration

2024-05-28 11:55:59 +02:00

imdb.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

imgur.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

ina.py

[fix] ina engine

2022-01-28 22:33:41 +01:00

invidious.py

[feat] videos template: support for view count

2024-07-27 11:49:58 +02:00

jisho.py

[format.python] based on bugfix in 9ed626130

2022-05-07 18:23:10 +02:00

json_engine.py

[feat] json/xpath engine: config option for method and body

2024-11-28 09:53:21 +01:00

kickass.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

lemmy.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

lib_rs.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

libretranslate.py

[mod] libretranslate: add direct link to translation (engine)

2024-06-30 16:18:33 +02:00

lingva.py

[refactor] translation engines: add translate category

2024-04-26 07:33:28 +02:00

livespace.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

loc.py

[fix] engine: Library of Congress - image & thumb links

2024-11-26 09:36:59 +01:00

mariadb_server.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

mastodon.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

material_icons.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mediathekviewweb.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mediawiki.py

[fix] gentoo: use mediawiki engine

2024-07-03 10:24:03 +02:00

meilisearch.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

metacpan.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mixcloud.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

mojeek.py

[enh] engine: mojeek - add language support

2024-10-15 06:37:01 +02:00

mongodb.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

moviepilot.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

mozhi.py

[feat] mozhi: fix crash, support synonyms and definition

2024-06-15 11:33:09 +02:00

mrs.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

mullvad_leta.py

Update mullvad_leta.py to account for img_elem

2024-07-15 06:58:39 +02:00

mwmbl.py

[mod] engine 'mwmbl: Update API URL

2024-04-10 06:51:28 +02:00

mysql_server.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

npm.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

nyaa.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

odysee.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

open_meteo.py

[feat] engine: implementation of Open Meteo

2024-04-07 19:02:53 +02:00

openlibrary.py

[feat] engine: support for openlibrary

2024-10-15 13:06:00 +02:00

opensemantic.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

openstreetmap.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

openverse.py

[fix] ccengine engine - avoid unwanted redirects

2022-01-07 14:14:31 +01:00

pdbe.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

peertube.py

[feat] videos template: support for view count

2024-07-27 11:49:58 +02:00

photon.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

pinterest.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

piped.py

[feat] videos template: support for view count

2024-07-27 11:49:58 +02:00

piratebay.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

pixiv.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

pkg_go_dev.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

podcastindex.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

postgresql.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

presearch.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

pubmed.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

pypi.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

qwant.py

add get_embeded_stream_url to searx.utils

2024-10-03 07:10:53 +02:00

radio_browser.py

[fix] fetch_traits: brave, google, annas_archive & radio_browser

2024-09-15 12:48:35 +02:00

recoll.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

reddit.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

redis_server.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

rottentomatoes.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

rumble.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

scanr_structures.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

searchcode_code.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

searx_engine.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

seekr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

semantic_scholar.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

sepiasearch.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

seznam.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

solidtorrents.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

solr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

soundcloud.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

spotify.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

springer.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

sqlite.py

[doc] slightly improve documentation of SQL engines

2024-10-03 13:04:06 +02:00

stackexchange.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

startpage.py

[chore] *: fix typos detected by typos-cli

2024-11-24 12:41:57 +01:00

stract.py

[enh] engine: stract - add language/region support

2024-09-29 14:29:22 +02:00

svgrepo.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

tagesschau.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

tineye.py

[chore] *: fix typos detected by typos-cli

2024-11-24 12:41:57 +01:00

tokyotoshokan.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

tootfinder.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

torznab.py

[perf] torrents.html, files.html: don't parse and re-format filesize

2024-06-15 15:42:29 +02:00

translated.py

[refactor] translation engines: add translate category

2024-04-26 07:33:28 +02:00

unsplash.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

vimeo.py

[enh] add re-usable func to filter text

2024-05-29 17:56:17 +02:00

voidlinux.py

[chore] *: fix typos detected by typos-cli

2024-11-24 12:41:57 +01:00

wallhaven.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wikicommons.py

[fix] wikicommons engine: remove HTML tags from result items

2024-11-28 06:05:45 +01:00

wikidata.py

[fix] engine wikidata - WIKIDATA_UNITS has been changed in #3378

2024-05-10 16:04:27 +02:00

wikipedia.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wolframalpha_api.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wolframalpha_noapi.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

wordnik.py

[chore] remove invalid base_url from settings.yml engines

2024-11-26 10:06:07 +01:00

wttr.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

www1x.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

xpath.py

[mod] hardening xpath engine: ignore empty results

2024-11-29 14:20:31 +01:00

yacy.py

[fix] engine yacy: update list of base URLs

2024-07-20 09:59:43 +02:00

yahoo_news.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

yahoo.py

[fix] engine yahoo: HTML tags are included in result titles

2024-09-03 22:26:59 +02:00

yandex_music.py

[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11 14:55:38 +01:00

yandex.py

[feat] engine: implementation of yandex (web, images)

2024-08-21 12:08:35 +02:00

yep.py

[fix] yep engine: remove links to other engines

2024-09-12 00:04:04 +02:00

youtube_api.py

[fix] engine: youtube_api - ignore channels / prevent exceptions

2024-04-13 08:41:00 +02:00

youtube_noapi.py

[enh] add re-usable func to filter text

2024-05-29 17:56:17 +02:00

yummly.py

[mod] simple theme: drop img_src from default results

2024-05-16 07:30:38 +02:00

zlibrary.py

[fix] engine zlibrary: handle seized domain

2024-06-25 14:40:19 +02:00