Markus Heiser 823c490c84 [mod] limiter: block requests from PetalBot ...

Block requests from PetalBlock.  Normally robots.txt is enough to stop
PetalBlock from making requests [1].  However, if SearXNG is offered below a
path (example.org/search), then the robots.txt is not available in the root
paths of the domain / subdomain.

[1] https://webmaster.petalsearch.com/site/petalbot

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>

2023-04-30 09:49:26 +02:00

..

answerers

[fix] issue reported by pylint 22.1.0

2022-02-04 09:45:35 +01:00

data

Merge pull request #2390 from searxng/update_data_update_wikidata_units.py

2023-04-30 07:16:31 +02:00

enginelib

[fix] searxng_extra/update/update_engine_descriptions.py (part 1)

2023-04-15 16:03:59 +02:00

engines

[fix] doc of locales.get_engine_locale() / zh-classical is missleading

2023-04-17 08:48:57 +02:00

infopage

[fix] minor typo in de/search-syntax page

2023-04-08 10:25:52 +02:00

metrics

[fix] prepare for pylint 2.14.0

2022-06-03 15:41:52 +02:00

network

[mod] Shuffle httpx's default ciphers of a SSL context randomly.

2023-03-19 13:40:31 +01:00

plugins

[mod] limiter: block requests from PetalBot

2023-04-30 09:49:26 +02:00

search

[mod] move language recognition to get_search_query_from_webapp

2023-04-15 22:23:33 +02:00

static

[build] /static

2023-04-21 13:38:29 +02:00

templates/simple

[fix] don't show a category if there is no active engine in

2023-04-10 09:22:21 +02:00

translations

[translations] update from Weblate

2023-04-28 07:08:09 +00:00

__init__.py

[format.python] initial formatting of the python code

2021-12-27 09:26:22 +01:00

autocomplete.py

[mod] remove obsolete EngineTraits.supported_languages

2023-03-24 10:37:42 +01:00

babel_extract.py

[mod] move category and names of constants to searx/searxng.msg

2022-03-16 09:55:53 +01:00

compat.py

[fix] pyright repported errors

2022-07-30 18:04:44 +02:00

exceptions.py

[doc] Add doc-strings to searx.exceptions

2023-01-29 19:06:19 +01:00

external_bang.py

[mod] external bang: go to main instead of search page when query is empty

2023-04-25 15:02:34 +02:00

external_urls.py

[fix] typos / reported by @kianmeng in searx PR-3366

2022-09-27 18:32:14 +02:00

flaskfix.py

[format.python] initial formatting of the python code

2021-12-27 09:26:22 +01:00

locales.py

[fix] doc of locales.get_engine_locale() / zh-classical is missleading

2023-04-17 08:48:57 +02:00

preferences.py

[mod] add a Preferences.client property to store client prefs

2023-04-15 21:41:57 +02:00

query.py

[mod] replace searx.languages by searx.sxng_locales

2023-03-24 10:37:42 +01:00

redisdb.py

move searx.shared.redisdb to searx.redisdb

2022-12-10 09:26:38 +01:00

redislib.py

[mod] redislib - optimize LUA script registration.

2022-05-30 11:21:09 +02:00

results.py

[fix] typos / reported by @kianmeng in searx PR-3366

2022-09-27 18:32:14 +02:00

searxng.msg

[mod] clarify the difference of the default category and subgrouping

2023-04-07 11:03:25 +02:00

settings_defaults.py

[mod] replace searx.languages by searx.sxng_locales

2023-03-24 10:37:42 +01:00

settings_loader.py

[fix] categories can't be removed from UI (categories_as_tabs)

2023-04-03 19:08:27 +02:00

settings.yml

Merge pull request #2347 from return42/mod-lang-detection

2023-04-25 15:46:26 +02:00

sxng_locales.py

Update searx.data - update_engine_traits.py

2023-04-16 08:40:44 +02:00

unixthreadname.py

[format.python] initial formatting of the python code

2021-12-27 09:26:22 +01:00

utils.py

[mod] replace utils.match_language by locales.match_locale

2023-03-24 10:37:42 +01:00

version.py

SearXNG version: YYYY.MM.DD without leading zero

2023-01-22 10:45:00 +00:00

webadapter.py

[mod] move language recognition to get_search_query_from_webapp

2023-04-15 22:23:33 +02:00

webapp.py

[mod] move language recognition to get_search_query_from_webapp

2023-04-15 22:23:33 +02:00

webutils.py

[mod] in the preference page, show !bang of subgrouping categories

2023-04-08 11:10:14 +02:00