 rofl0r
|
10d6b3afd8
|
servers.txt: remove dead server
|
2019-01-10 19:22:21 +00:00 |
|
|
mickael
|
383ae6f431
|
fix: no uris were tested because commented"
|
2019-01-10 00:21:57 +00:00 |
|
|
mserneels
|
0cbc434883
|
Merge branch 'experiment' into 'master'
Experiment
See merge request mserneels/ppf!11
|
2019-01-09 23:40:54 +00:00 |
|
|
mickael
|
da4f228479
|
discard urls who fail at first test
|
2019-01-09 23:38:59 +00:00 |
|
|
mickael
|
15dee0cd73
|
add -intitle:pdf to searx query
|
2019-01-09 23:30:55 +00:00 |
|
|
mickael
|
e94644a60e
|
searx: loop for 10 pages on each searx instance
|
2019-01-09 22:55:55 +00:00 |
|
|
mickael
|
8993727f03
|
changed regex
|
2019-01-09 20:07:28 +00:00 |
|
|
mickael
|
33887385f0
|
is_usable_proxy: group the 2 firsts lines
|
2019-01-09 19:23:09 +00:00 |
|
|
mickael
|
9828db79d4
|
is_usable_proxy(): dont check twice if A < 1
|
2019-01-09 19:11:05 +00:00 |
|
|
mickael
|
6f0d5c1ffa
|
modify and rename should_i_... function
> remove :port from D
> check if octets are within a correct range
|
2019-01-09 19:01:55 +00:00 |
|
|
mickael
|
a74d6dfce8
|
do not save invalid IPs
|
2019-01-09 00:42:28 +00:00 |
|
|
mickael
|
bde24ce0e9
|
working but inefficient script to remove invalid proxies from db
|
2019-01-09 00:41:46 +00:00 |
|
|
mserneels
|
484fe325f8
|
Merge branch 'changes9' into 'master'
Changes9
See merge request mserneels/ppf!10
|
2019-01-08 19:55:45 +00:00 |
|
|
rofl0r
|
bd1e85a883
|
proxywatchd: add safeguards against tor outage
|
2019-01-08 16:06:01 +00:00 |
|
|
rofl0r
|
6e4c45175e
|
ppf: add safeguards against tor outage
|
2019-01-08 15:48:38 +00:00 |
|
|
rofl0r
|
b6839eea79
|
rocksock/http2: bump to latest
|
2019-01-08 15:48:38 +00:00 |
|
|
rofl0r
|
b88a8426dc
|
rocksock: bump to latest
|
2019-01-08 04:38:28 +00:00 |
|
|
rofl0r
|
b9058b0334
|
http2: bump to latest
|
2019-01-08 04:38:14 +00:00 |
|
|
rofl0r
|
1f3179de48
|
ppf: check for valid ports
|
2019-01-08 04:30:50 +00:00 |
|
|
rofl0r
|
9ccf8b7854
|
ppf: write dates as int
|
2019-01-08 04:19:09 +00:00 |
|
|
rofl0r
|
35421b980e
|
rocksock: bump to latest
|
2019-01-08 03:35:40 +00:00 |
|
|
rofl0r
|
fb917184b0
|
watchd: remove catch-it-all except statements
it took considerable time to figure out why it suddenly stopped
working due to a typo inside the try/except block.
|
2019-01-08 03:34:44 +00:00 |
|
|
rofl0r
|
38d89f5bd9
|
ppf: add option for number of http retries
|
2019-01-08 03:30:31 +00:00 |
|
|
rofl0r
|
115c4a56f5
|
ppf: honor timeout
|
2019-01-08 03:25:52 +00:00 |
|
|
rofl0r
|
f16f754b0e
|
implement combo config parser
allows all options to be overridden by command line.
e.g.
[watchd]
threads=10
debug=false
--watch.threads=50 --debug=true
|
2019-01-08 02:17:10 +00:00 |
|
|
rofl0r
|
e7b8d526c0
|
ppf: print url if fetching failed
|
2019-01-08 00:46:41 +00:00 |
|
|
mickael
|
20bc8be2fa
|
pretty: hide printed '^C' when ^C'ing
|
2019-01-07 23:36:56 +00:00 |
|
|
mickael
|
15bdbf63fd
|
pyflakes: remove unused imports
|
2019-01-07 23:27:28 +00:00 |
|
|
mickael
|
1b3ce72efc
|
add and use combining class
|
2019-01-07 23:19:14 +00:00 |
|
|
mickael
|
e31ac03f6f
|
avoid double "checktime" usage
|
2019-01-07 22:09:22 +00:00 |
|
|
mickael
|
6c8b707637
|
Merge branch 'master' of ssh://gitlab.com/mserneels/ppf
|
2019-01-07 21:41:46 +00:00 |
|
|
mickael
|
1288dca38f
|
fixme: change var names
|
2019-01-07 21:41:41 +00:00 |
|
|
mserneels
|
a86cc925be
|
Merge branch 'changes8' into 'master'
watchd: first halfbaked attempt to detect/combat tor issues
See merge request mserneels/ppf!9
|
2019-01-07 21:38:12 +00:00 |
|
|
rofl0r
|
dfa90109da
|
watchd: first halfbaked attempt to detect/combat tor issues
|
2019-01-07 21:35:36 +00:00 |
|
|
mickael
|
aeff09d2b3
|
move math function inside the sql statement
|
2019-01-07 21:11:08 +00:00 |
|
|
mserneels
|
f47745c8d6
|
Merge branch 'changes7' into 'master'
Changes7
See merge request mserneels/ppf!8
|
2019-01-07 18:56:23 +00:00 |
|
|
rofl0r
|
9d41e21258
|
remove dead irc servers (DNS NXDOMAIN)
|
2019-01-07 16:22:26 +00:00 |
|
|
rofl0r
|
9e8beca4e1
|
do not treat empty lines as servers
|
2019-01-07 16:22:06 +00:00 |
|
|
rofl0r
|
9e3c08fcf4
|
watchd: do not count name resolution errors as proxy fail
|
2019-01-07 15:57:15 +00:00 |
|
|
rofl0r
|
be99b8517b
|
watchd: beautify logging
|
2019-01-07 15:38:51 +00:00 |
|
|
rofl0r
|
d93f14ad67
|
watchd: distribute remaining jobs among threads if one is idle
|
2019-01-07 15:38:51 +00:00 |
|
|
rofl0r
|
898c8f36ee
|
ppf: fix cpu hogs
|
2019-01-07 15:38:51 +00:00 |
|
|
rofl0r
|
ad7c7fce67
|
ppf: use timeout and only 1 try for http
|
2019-01-07 05:37:44 +00:00 |
|
|
rofl0r
|
497f8b2050
|
watchd: remove non-printable chars from logged response
|
2019-01-07 02:54:33 +00:00 |
|
|
rofl0r
|
c8d93751fe
|
rocksock: bump to latest
|
2019-01-07 02:53:36 +00:00 |
|
|
mickael
|
8b15faf84d
|
ppf: change user-agent; use headers
|
2019-01-06 23:29:30 +00:00 |
|
|
mserneels
|
1fd4792218
|
Merge branch 'merge1' into 'master'
Merge1
See merge request mserneels/ppf!7
|
2019-01-06 22:45:50 +00:00 |
|
|
rofl0r
|
e51dbe113b
|
watchd: optional debug output
|
2019-01-06 22:44:18 +00:00 |
|
|
rofl0r
|
312f77469e
|
watchd: disable some noise in the proxy-found log output
|
2019-01-06 22:42:16 +00:00 |
|
|
rofl0r
|
5a6c49d88b
|
watchd: collect stats
|
2019-01-06 22:42:09 +00:00 |
|