Commit Graph

266 Commits

Author SHA1 Message Date
mickael
e94644a60e searx: loop for 10 pages on each searx instance 2019-01-09 22:55:55 +00:00
mickael
8993727f03 changed regex 2019-01-09 20:07:28 +00:00
mickael
33887385f0 is_usable_proxy: group the 2 firsts lines 2019-01-09 19:23:09 +00:00
mickael
9828db79d4 is_usable_proxy(): dont check twice if A < 1 2019-01-09 19:11:05 +00:00
mickael
6f0d5c1ffa modify and rename should_i_... function
> remove :port from D
> check if octets are within a correct range
2019-01-09 19:01:55 +00:00
mickael
a74d6dfce8 do not save invalid IPs 2019-01-09 00:42:28 +00:00
mickael
bde24ce0e9 working but inefficient script to remove invalid proxies from db 2019-01-09 00:41:46 +00:00
mserneels
484fe325f8 Merge branch 'changes9' into 'master'
Changes9

See merge request mserneels/ppf!10
2019-01-08 19:55:45 +00:00
rofl0r
bd1e85a883 proxywatchd: add safeguards against tor outage 2019-01-08 16:06:01 +00:00
rofl0r
6e4c45175e ppf: add safeguards against tor outage 2019-01-08 15:48:38 +00:00
rofl0r
b6839eea79 rocksock/http2: bump to latest 2019-01-08 15:48:38 +00:00
rofl0r
b88a8426dc rocksock: bump to latest 2019-01-08 04:38:28 +00:00
rofl0r
b9058b0334 http2: bump to latest 2019-01-08 04:38:14 +00:00
rofl0r
1f3179de48 ppf: check for valid ports 2019-01-08 04:30:50 +00:00
rofl0r
9ccf8b7854 ppf: write dates as int 2019-01-08 04:19:09 +00:00
rofl0r
35421b980e rocksock: bump to latest 2019-01-08 03:35:40 +00:00
rofl0r
fb917184b0 watchd: remove catch-it-all except statements
it took considerable time to figure out why it suddenly stopped
working due to a typo inside the try/except block.
2019-01-08 03:34:44 +00:00
rofl0r
38d89f5bd9 ppf: add option for number of http retries 2019-01-08 03:30:31 +00:00
rofl0r
115c4a56f5 ppf: honor timeout 2019-01-08 03:25:52 +00:00
rofl0r
f16f754b0e implement combo config parser
allows all options to be overridden by command line.

e.g.
[watchd]
threads=10
debug=false

--watch.threads=50 --debug=true
2019-01-08 02:17:10 +00:00
rofl0r
e7b8d526c0 ppf: print url if fetching failed 2019-01-08 00:46:41 +00:00
mickael
20bc8be2fa pretty: hide printed '^C' when ^C'ing 2019-01-07 23:36:56 +00:00
mickael
15bdbf63fd pyflakes: remove unused imports 2019-01-07 23:27:28 +00:00
mickael
1b3ce72efc add and use combining class 2019-01-07 23:19:14 +00:00
mickael
e31ac03f6f avoid double "checktime" usage 2019-01-07 22:09:22 +00:00
mickael
6c8b707637 Merge branch 'master' of ssh://gitlab.com/mserneels/ppf 2019-01-07 21:41:46 +00:00
mickael
1288dca38f fixme: change var names 2019-01-07 21:41:41 +00:00
mserneels
a86cc925be Merge branch 'changes8' into 'master'
watchd: first halfbaked attempt to detect/combat tor issues

See merge request mserneels/ppf!9
2019-01-07 21:38:12 +00:00
rofl0r
dfa90109da watchd: first halfbaked attempt to detect/combat tor issues 2019-01-07 21:35:36 +00:00
mickael
aeff09d2b3 move math function inside the sql statement 2019-01-07 21:11:08 +00:00
mserneels
f47745c8d6 Merge branch 'changes7' into 'master'
Changes7

See merge request mserneels/ppf!8
2019-01-07 18:56:23 +00:00
rofl0r
9d41e21258 remove dead irc servers (DNS NXDOMAIN) 2019-01-07 16:22:26 +00:00
rofl0r
9e8beca4e1 do not treat empty lines as servers 2019-01-07 16:22:06 +00:00
rofl0r
9e3c08fcf4 watchd: do not count name resolution errors as proxy fail 2019-01-07 15:57:15 +00:00
rofl0r
be99b8517b watchd: beautify logging 2019-01-07 15:38:51 +00:00
rofl0r
d93f14ad67 watchd: distribute remaining jobs among threads if one is idle 2019-01-07 15:38:51 +00:00
rofl0r
898c8f36ee ppf: fix cpu hogs 2019-01-07 15:38:51 +00:00
rofl0r
ad7c7fce67 ppf: use timeout and only 1 try for http 2019-01-07 05:37:44 +00:00
rofl0r
497f8b2050 watchd: remove non-printable chars from logged response 2019-01-07 02:54:33 +00:00
rofl0r
c8d93751fe rocksock: bump to latest 2019-01-07 02:53:36 +00:00
mickael
8b15faf84d ppf: change user-agent; use headers 2019-01-06 23:29:30 +00:00
mserneels
1fd4792218 Merge branch 'merge1' into 'master'
Merge1

See merge request mserneels/ppf!7
2019-01-06 22:45:50 +00:00
rofl0r
e51dbe113b watchd: optional debug output 2019-01-06 22:44:18 +00:00
rofl0r
312f77469e watchd: disable some noise in the proxy-found log output 2019-01-06 22:42:16 +00:00
rofl0r
5a6c49d88b watchd: collect stats 2019-01-06 22:42:09 +00:00
mickael
3223cc82c4 use http2.py instead of requests 2019-01-06 22:22:42 +00:00
mickael
62153a6972 bump to latest 2019-01-06 21:34:51 +00:00
mickael
358044ccea watchd: make use of ssl configurable 2019-01-06 20:09:27 +00:00
mickael
0ab3a6d066 connect_socket: fix proto bug 2019-01-06 19:43:05 +00:00
mickael
91654d4b9e remove unused "is_drone_bl()" function 2019-01-06 19:12:42 +00:00