Username
|
e89db20f5b
|
scraper: add Bing and Yahoo engines
|
2025-12-28 15:19:39 +01:00 |
|
Username
|
adbe20dae3
|
cleanup: remove unused imports and dead code
|
2025-12-26 19:34:23 +01:00 |
|
Username
|
272eba0f05
|
scraper: reuse connections, cycle circuit on block
CI / syntax-check (push) Successful in 6s
CI / memory-leak-check (push) Successful in 15s
|
2025-12-25 19:26:23 +01:00 |
|
Username
|
269fed55ff
|
refactor core modules, integrate network stats
|
2025-12-25 11:13:20 +01:00 |
|
Username
|
33f9a211ce
|
scraper: fix return values and add stats logging
- Return counts from proxyfind for tracking
- Add 15-minute stats interval logging
- Track new_urls and queries count
|
2025-12-24 00:19:53 +01:00 |
|
Username
|
e7478de79e
|
scraper: add engine stats API for dashboard
- EngineTracker.get_stats() returns detailed per-engine metrics
- get_scraper_stats() module function for external access
- includes success counts, backoff status, availability
|
2025-12-23 17:23:28 +01:00 |
|
Username
|
b88aa2a878
|
scraper: add multi-engine support and tracking
|
2025-12-21 23:37:48 +01:00 |
|
Username
|
9588da92e7
|
scraper: remove dead InstanceTracker class
|
2025-12-20 22:50:34 +01:00 |
|
Username
|
8ce6900244
|
scraper: integrate multi-lingual search terms
- Use translations module for 70% non-English search terms
- Initialize translations config on startup
- Add engines module for multi-engine support
|
2025-12-20 22:27:51 +01:00 |
|
Username
|
86cabd1562
|
standardize code style: shebangs, class definitions, comments
|
2025-12-20 18:05:41 +01:00 |
|
Username
|
e7a8ff7df7
|
scraper: remove debug print
|
2025-12-20 16:46:00 +01:00 |
|
Your Name
|
6b6cd94cec
|
spaces to tabs
|
2021-06-27 12:31:15 +02:00 |
|
Your Name
|
cae6f75643
|
changs
|
2021-05-02 00:22:12 +02:00 |
|
Your Name
|
9aa2c91f41
|
more random changes
|
2021-02-06 11:00:25 +01:00 |
|
Mickaël Serneels
|
70b6285394
|
scraper: more changes
|
2019-05-01 17:43:29 +02:00 |
|
Mickaël Serneels
|
482cf79676
|
scraper: make query configurable (Proxies, Websites, Search)
--scraper.query = 'pws'
|
2019-05-01 17:43:28 +02:00 |
|
Mickaël Serneels
|
15fc29abc4
|
externalize searx instances into new file "searx.instances"
|
2019-05-01 17:43:28 +02:00 |
|
Mickaël Serneels
|
475f10560e
|
search: more changes
|
2019-05-01 17:43:28 +02:00 |
|
Mickaël Serneels
|
fdd486f73c
|
remove '-intitle:pdf' from default search
|
2019-05-01 17:43:28 +02:00 |
|
Mickaël Serneels
|
a2783bdfcf
|
don't loop over every searx instances
randomly pick one per search, instead
|
2019-05-01 17:43:28 +02:00 |
|
Mickaël Serneels
|
c729bf666e
|
searx: use sample instances
don't loop over *all* instances
|
2019-05-01 17:43:28 +02:00 |
|
rofl0r
|
2bacf77c8c
|
split ppf into two programs, ppf/scraper
|
2019-01-18 22:53:35 +00:00 |
|