Beanz/searxng
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
3,797 Commits 4 Branches 0 Tags
Commit Graph

29 Commits

Author SHA1 Message Date
Alexandre Flament
d703119d3a [enh] add raise_for_httperror 
check HTTP response:
* detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time.
* otherwise raise HTTPError as before

the check is done in poolrequests.py (was before in search.py).

update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status
 2020-12-11 14:37:08 +01:00
Alexandre Flament
58d51e082d [fix] wikipedia: minor fix: return no result instead of crash in some very few cases. 
In few cases, the JSON results doesn't contains the key 'type'.
 2020-12-07 17:42:05 +01:00
Alexandre Flament
f0054d67f1 [fix] wikipedia engine: don't raise an error when the query is not found 
Add a new parameter "raise_for_status", set by default to True.
When True, any HTTP status code >= 300 raise an exception ( #2332 )
When False, the engine can manage the HTTP status code by itself.
 2020-12-04 20:04:39 +01:00
Dalf
1022228d95 Drop Python 2 (1/n): remove unicode string and url_utils 2020-09-10 10:39:04 +02:00
Marc Abonce Seguin
ab20ca182c use Wikipedia's REST v1 API 2020-09-10 09:54:30 +02:00
Marc Abonce Seguin
77b9faa8df fix Wikipedia's paragraph extraction 2020-07-26 23:53:40 -07:00
Marc Abonce Seguin
5706c12fba remove empty parenthesis in wikipedia's summary 
They're usually IPA pronunciations which are removed
by the API.
 2019-12-21 22:47:08 -06:00
Marc Abonce Seguin
c18048e045 exclude disambiguation pages from wikipedia infobox 2019-12-21 22:47:08 -06:00
Adam Tauber
00512e36c1 [fix] handle empty response from wikipedia engine - closes #1114 2019-12-21 21:01:08 +01:00
Noémi Ványi
97351a2c72 fix after rebase 2019-01-07 21:28:58 +01:00
Noémi Ványi
b63d645a52 Revert "remove 'all' option from search languages" 
This reverts commit 4d1770398a6af8902e75c0bd885781584d39e796.
 2019-01-07 21:19:00 +01:00
Marc Abonce Seguin
5568f24d6c [fix] check language aliases when setting search language 2019-01-06 20:31:57 -06:00
Marc Abonce Seguin
772c048d01 refactor engine's search language handling 
Add match_language function in utils to match any user given
language code with a list of engine's supported languages.

Also add language_aliases dict on each engine to translate
standard language codes into the custom codes used by the engine.
 2018-03-27 00:08:03 -06:00
marc
4d1770398a remove 'all' option from search languages 2017-12-06 01:20:15 -06:00
Adam Tauber
52e615dede [enh] py3 compatibility 2017-05-15 12:02:30 +02:00
marc
1175b3906f change language list to only include languages with a minimum of engines 
that support them.
users can still query lesser supported through the :lang_code bang.
 2016-12-29 01:55:30 -06:00
marc
4a1ff56389 minor fixes in utils/fetch_languages.py 2016-12-16 22:14:14 -06:00
marc
af35eee10b tests for _fetch_supported_languages in engines 
and refactor method to make it testable without making requests
 2016-12-15 00:40:21 -06:00
marc
f62ce21f50 [mod] fetch supported languages for several engines 
utils/fetch_languages.py gets languages supported by each engine and
generates engines_languages.json with each engine's supported language.
 2016-12-13 19:58:10 -06:00
marc
149802c569 [enh] add supported_languages on engines and auto-generate languages.py 2016-12-13 19:32:00 -06:00
marc
c2e4014287 [fix] urls merge in infobox (#593) 
TODO:
    merge attributes
 2016-08-05 23:51:04 -05:00
a01200356
8d335dbdae [enh] wikipedia infobox 
creates simple multilingual infobox using wikipedia's api
 2016-04-17 16:22:19 -05:00
Thomas Pointhuber
52ad49ccba using general mediawiki-engine 
* writing general mediawiki-engine
* using this engine for wikipedia
* using this engine for uncyclopedia
 2014-09-03 11:40:29 +02:00
Thomas Pointhuber
bb628469d3 fix wikipedia engine and add comments 
* add paging support
* make number_of_results changable
* make result calculation more clear
* add comments
 2014-09-02 21:01:24 +02:00
asciimoo
2a788c8f29 [enh] search language support init 2014-01-31 04:35:23 +01:00
asciimoo
e7792d77a7 [mod] wikipedia engine removed 2013-10-23 23:46:33 +02:00
asciimoo
a0037313ea [mod] wikipedia limited to first result 2013-10-16 23:21:04 +02:00
asciimoo
4bf44076d4 [enh] proper urls 2013-10-15 22:28:27 +02:00
asciimoo
e4b768b6cc [enh] wikipedia search added 2013-10-15 20:51:35 +02:00