Mickaël Serneels c8d594fb73 add url extraction ...

url get extracted from webpage when page contains proxies

this allows to "learn" as much links as possible from a working website

2019-05-01 22:58:23 +02:00

comboparse.py

comboparse: fix bug with bool cmd args always True

2019-01-13 16:40:12 +00:00

config.ini.sample

watchd: introduce configurable 'outage_threshold'

2019-01-18 15:34:49 +00:00

config.py

scraper: make query configurable (Proxies, Websites, Search)

2019-05-01 17:43:28 +02:00

dbs.py

set default error value to 1 for new urls

2019-05-01 17:43:28 +02:00

fetch.py

ppf: check content-type (once) before trying to download/extract proxies

2019-05-01 17:43:28 +02:00

http2.py

rocksock/http2: bump to latest

2019-01-08 15:48:38 +00:00

import.txt

update imports.txt

2019-05-01 17:43:28 +02:00

misc.py

pretty: hide printed '^C' when ^C'ing

2019-01-07 23:36:56 +00:00

mysqlite.py

mysqlite.py: improve

2019-01-18 20:42:15 +00:00

ppf.py

add url extraction

2019-05-01 22:58:23 +02:00

proxywatchd.py

proxywatchd: remove bogus blanket exception handler

2019-05-01 20:05:57 +01:00

remove_bad_proxies_from_proxylist.bash

working but inefficient script to remove invalid proxies from db

2019-01-09 00:41:46 +00:00

rocksock.py

add latest rocksock

2019-05-01 20:04:30 +01:00

scraper.py

scraper: more changes

2019-05-01 17:43:29 +02:00

search_terms.txt

initial commit

2019-01-03 16:36:31 +00:00

searx.instances

add own searx instance

2019-05-01 17:43:29 +02:00

servers.txt

remove noexistent server

2019-03-05 22:29:16 +00:00

servers.txt.sample

add servers.txt.sample

2019-03-05 22:29:16 +00:00

soup_parser.py

move includes in root directory

2019-01-05 00:22:28 +00:00

urignore.txt

update urignore

2019-05-01 17:43:28 +02:00

Description

No description provided

3.7 MiB

Languages

Python 74.2%

JavaScript 10.5%

CSS 7.4%

Shell 4%

HTML 3.7%

Other 0.2%