Commit Graph

  • e0e330301a dbs: add session persistence and stats history Username 2025-12-23 17:23:04 +01:00
  • 71fb3800ee config: add gevent dependency and min_threads option Username 2025-12-23 17:22:52 +01:00
  • 267035802a ppf: reset stale_count when content hash changes Username 2025-12-22 00:05:06 +01:00
  • f382a4ab6a ppf: add content hash for duplicate proxy list detection Username 2025-12-22 00:03:12 +01:00
  • 6b5eb83bf4 fetch: add robust proxy string validation Username 2025-12-21 23:49:02 +01:00
  • 73192311f3 docs: update dockerfile and readme Username 2025-12-21 23:38:04 +01:00
  • 01d5dfd477 minor: cleanup comboparse and http2 Username 2025-12-21 23:37:59 +01:00
  • 9e7c8d78b3 fetch: unify known proxies cache Username 2025-12-21 23:37:58 +01:00
  • 747e6dd7aa ppf: improve exception handling and logging Username 2025-12-21 23:37:57 +01:00
  • 901f2c1aee httpd: improve api error handling Username 2025-12-21 23:37:49 +01:00
  • b88aa2a878 scraper: add multi-engine support and tracking Username 2025-12-21 23:37:48 +01:00
  • 0274b84af8 engines: improve search engine rate limiting Username 2025-12-21 23:37:48 +01:00
  • 00623f3a18 connection_pool: add health tracking and backoff Username 2025-12-21 23:37:39 +01:00
  • 77867d0b2d dbs: add latency columns and migration Username 2025-12-21 23:37:38 +01:00
  • 2e1d9b7d3f gitignore: add database and data file patterns Username 2025-12-21 23:37:38 +01:00
  • e2ef1b7e36 docs: mark geolocation and ssl testing as completed Username 2025-12-21 23:37:23 +01:00
  • 95bafcacff proxywatchd: add startup logging, fix geolocation error handling Username 2025-12-21 23:37:19 +01:00
  • b6c0a89afd add IP2Location for geolocation Username 2025-12-21 23:37:13 +01:00
  • d48cc3f9eb config: fix defaults for database and checktype Username 2025-12-21 23:37:09 +01:00
  • 8718d33276 fix: use canonical schema from dbs.py in proxywatchd Username 2025-12-21 10:30:31 +01:00
  • f4e242fc18 add systemd unit for rootless podman container Username 2025-12-21 10:23:27 +01:00
  • 55bc9a635e docs: add README and update ROADMAP Username 2025-12-21 10:19:18 +01:00
  • 79475c2bff add latency tracking and dynamic thread scaling Username 2025-12-21 00:08:19 +01:00
  • 1e43f50aa6 style: normalize test file indentation Username 2025-12-20 23:19:22 +01:00
  • e24f68500c style: normalize indentation and improve code style Username 2025-12-20 23:18:45 +01:00
  • d356cdf6ee docs: mark priority queue complete Username 2025-12-20 23:11:54 +01:00
  • a694e441a4 proxywatchd: add priority queue for job scheduling Username 2025-12-20 23:11:49 +01:00
  • c224c55afe docs: mark tor connection pooling complete Username 2025-12-20 23:02:30 +01:00
  • af5e1ce4b0 proxywatchd: integrate tor connection pool Username 2025-12-20 23:02:26 +01:00
  • bc945a33ff add tor connection pool with health monitoring Username 2025-12-20 23:02:21 +01:00
  • ce79ef7d7f engines: consolidate extract_urls with base class method Username 2025-12-20 22:50:46 +01:00
  • 4780b6f095 fetch: consolidate extract_proxies into single implementation Username 2025-12-20 22:50:39 +01:00
  • 9588da92e7 scraper: remove dead InstanceTracker class Username 2025-12-20 22:50:34 +01:00
  • 3188d50707 docs: update TODO and ROADMAP with completed work Username 2025-12-20 22:28:57 +01:00
  • bef12e6bcf searx.instances: update with active SearXNG instances Username 2025-12-20 22:28:52 +01:00
  • f289057267 cleanup: minor fixes in comboparse and soup_parser Username 2025-12-20 22:28:47 +01:00
  • c759f7197e ppf: use shared proxy cache from fetch module Username 2025-12-20 22:28:42 +01:00
  • 3c88bc3298 fetch: add unified proxy cache functions Username 2025-12-20 22:28:37 +01:00
  • 2f2ff9a385 proxywatchd: add stats tracking and httpd integration Username 2025-12-20 22:28:23 +01:00
  • 3f2074f0cf misc: add log levels and failure categorization Username 2025-12-20 22:28:16 +01:00
  • 2212a9e00a httpd: add HTTP API server for proxy queries Username 2025-12-20 22:28:10 +01:00
  • 3b3267d0db engines: add modular search engine abstraction Username 2025-12-20 22:28:04 +01:00
  • 8ce6900244 scraper: integrate multi-lingual search terms Username 2025-12-20 22:27:51 +01:00
  • eeb71a1d55 config: add LibreTranslate settings Username 2025-12-20 22:27:45 +01:00
  • 8132023c97 translations: add multi-lingual search term generation Username 2025-12-20 22:27:37 +01:00
  • 4547ec3188 roadmap: update completed work Username 2025-12-20 18:25:55 +01:00
  • 90a6756ade dbs: add indexes and optimize batch inserts Username 2025-12-20 18:25:33 +01:00
  • c054fa3c11 mysqlite: enable WAL mode for better concurrency Username 2025-12-20 18:25:33 +01:00
  • 86cabd1562 standardize code style: shebangs, class definitions, comments Username 2025-12-20 18:05:41 +01:00
  • 4c9a658d26 add test infrastructure for --nobs Username 2025-12-20 17:33:40 +01:00
  • 1d865d5250 ppf: use soup_parser instead of direct bs4 import Username 2025-12-20 17:33:40 +01:00
  • 0fd8424d33 config: add --nobs flag to disable BeautifulSoup Username 2025-12-20 17:33:39 +01:00
  • 31a3ac9a8b soup_parser: add stdlib HTMLParser fallback Username 2025-12-20 17:33:39 +01:00
  • 2a21bd44ed make IP2Location optional Username 2025-12-20 16:53:00 +01:00
  • 52e82f1f33 remove lxml dependency Username 2025-12-20 16:52:11 +01:00
  • 7846eb22c9 add project context documentation Username 2025-12-20 16:47:10 +01:00
  • ac254873a5 gitignore: add local config directory Username 2025-12-20 16:47:09 +01:00
  • fc72640f75 add copilot instructions Username 2025-12-20 16:46:44 +01:00
  • d9cea386e9 add project roadmap and task list Username 2025-12-20 16:46:43 +01:00
  • a4e2c2ed7c add docker support Username 2025-12-20 16:46:37 +01:00
  • 9d2701dfa0 add requirements.txt Username 2025-12-20 16:46:36 +01:00
  • 6ab04a77c7 add gitignore Username 2025-12-20 16:46:36 +01:00
  • 68d6a8e15f proxywatchd: implement multi-target validation with work-stealing queue Username 2025-12-20 16:46:09 +01:00
  • 57a7687b08 ppf: remove dead http server code Username 2025-12-20 16:46:08 +01:00
  • dc545494b9 soup_parser: remove dead gumbo code Username 2025-12-20 16:46:08 +01:00
  • e7a8ff7df7 scraper: remove debug print Username 2025-12-20 16:46:00 +01:00
  • 67eb5413e4 misc: remove unused random_string function Username 2025-12-20 16:45:59 +01:00
  • a62c46600c comboparse: remove test code Username 2025-12-20 16:45:58 +01:00
  • 15ff16b8d6 force py2 usage Your Name 2021-10-30 07:13:04 +02:00
  • d7db366857 split to ip/port, "cleanse" ips and ports, bugfixes Your Name 2021-08-22 20:39:50 +02:00
  • c3bb49d229 proxywatchd: make use of verifycert Your Name 2021-07-27 22:36:01 +02:00
  • ee481ea31e ppf: make scraper use extra proxies if available Your Name 2021-07-27 22:35:39 +02:00
  • d4dd2a42ea proxywatchd.py: randomly choose from available regex keys Your Name 2021-07-05 16:54:17 +02:00
  • d78212ac50 proxywatchd.py: add more websites Your Name 2021-07-05 16:45:02 +02:00
  • a0bc4e4502 do not perform ssl_check when successive_success=0 Your Name 2021-07-03 20:11:46 +02:00
  • f6c3347eb4 proxywatchd: match specific regex per server/protocol Your Name 2021-07-03 19:59:47 +02:00
  • c58e9c3dde remove config.ini and imports.txt Your Name 2021-07-03 18:44:12 +02:00
  • a005cc109c force ssl check (mitm) every 3 consecutive success check Your Name 2021-07-03 18:43:20 +02:00
  • 416f31de3c remove proxyflood Your Name 2021-07-03 17:18:00 +02:00
  • 37622d8a17 update from twatscrape Your Name 2021-07-03 17:17:18 +02:00
  • 11c5bd67b3 add http check Your Name 2021-07-03 17:16:52 +02:00
  • 7cc02fc0a4 config.py: add config.watchd.checktype, to select irc or http check Your Name 2021-07-03 17:16:26 +02:00
  • 47fee8df4f proxylist database: add "mitm" row Your Name 2021-07-03 17:15:44 +02:00
  • 6b6cd94cec spaces to tabs Your Name 2021-06-27 12:31:15 +02:00
  • 6619499df4 add updowntoay to urignore Your Name 2021-06-27 12:12:49 +02:00
  • af3b04f90f useless shitty proxyflood thing Your Name 2021-06-27 12:12:20 +02:00
  • e236c7cdb1 config.py: add more useless thing for proxyflood Your Name 2021-06-27 12:12:04 +02:00
  • 9efeff6ec1 changes Your Name 2021-06-02 14:54:46 +02:00
  • d3d83e1d90 changes Your Name 2021-05-12 08:06:03 +02:00
  • 29675be5a2 proxyflood: change nickname on 432 instead of adding numbers Your Name 2021-05-02 17:19:01 +02:00
  • 9439b69fc7 proxyflood.py: add 404 Your Name 2021-05-02 16:12:41 +02:00
  • 9a7a913401 proxywatchd.py: also accept "ERROR" as success message (heh) Your Name 2021-05-02 16:11:57 +02:00
  • cae6f75643 changs Your Name 2021-05-02 00:22:12 +02:00
  • 66006a0273 update server list Your Name 2021-04-27 13:45:42 +02:00
  • f7e5a5e3b6 add more flood stuff Your Name 2021-04-27 13:45:24 +02:00
  • 3ab7d9c04d rename flood.max_time -> flood.duration Your Name 2021-04-26 03:32:05 +02:00
  • be1c6fbb4e add flood section to sample config Your Name 2021-04-26 03:30:27 +02:00
  • 89e73a818a add more flood stuff Your Name 2021-04-26 03:29:43 +02:00
  • 5984f23616 add usernames Your Name 2021-04-26 02:07:22 +02:00
  • 2962613e80 update server list (remove unresolving server) Your Name 2021-04-26 01:54:23 +02:00