username/ppf
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
297 Commits 1 Branch 0 Tags
e24f68500ce65e3903d218c155e716507a9f2986
Commit Graph

42 Commits

Author SHA1 Message Date
Username
e24f68500c style: normalize indentation and improve code style 
- convert tabs to 4-space indentation
- add docstrings to modules and classes
- remove unused import (copy)
- use explicit object inheritance
- use 'while True' over 'while 1'
- use 'while args' over 'while len(args)'
- use '{}' over 'dict()'
- consistent string formatting
- Python 2/3 compatible Queue import
 2025-12-20 23:18:45 +01:00
Username
eeb71a1d55 config: add LibreTranslate settings 
- libretranslate_url: API endpoint (default: https://lt.mymx.me/translate)
- libretranslate_enabled: toggle for dynamic translations (default: True)
 2025-12-20 22:27:45 +01:00
Username
0fd8424d33 config: add --nobs flag to disable BeautifulSoup 2025-12-20 17:33:39 +01:00
Your Name
7cc02fc0a4 config.py: add config.watchd.checktype, to select irc or http check 2021-07-03 18:47:34 +02:00
Your Name
6b6cd94cec spaces to tabs 2021-06-27 12:31:15 +02:00
Your Name
e236c7cdb1 config.py: add more useless thing for proxyflood 2021-06-27 12:12:04 +02:00
Your Name
9efeff6ec1 changes 2021-06-02 14:54:46 +02:00
Your Name
d3d83e1d90 changes 2021-05-12 08:06:03 +02:00
Your Name
cae6f75643 changs 2021-05-02 00:22:12 +02:00
Your Name
f7e5a5e3b6 add more flood stuff 2021-04-27 13:45:24 +02:00
Your Name
3ab7d9c04d rename flood.max_time -> flood.duration 2021-04-26 03:32:05 +02:00
Your Name
89e73a818a add more flood stuff 2021-04-26 03:29:43 +02:00
Your Name
3f7ec14931 add options to floodbot 2021-04-26 01:53:38 +02:00
Your Name
b29c734002 fix: url → self.url, make thread option configurable 2021-02-06 14:33:44 +01:00
Your Name
78b29a1187 some changes 2021-01-24 03:52:56 +01:00
Mickaël Serneels
eeedf9d0a1 extract url only from same domains ? (default: False) 
setting this option will make ppf not follow external links when extracting uris
 2019-05-14 21:24:29 +02:00
Mickaël Serneels
482cf79676 scraper: make query configurable (Proxies, Websites, Search) 
--scraper.query = 'pws'
 2019-05-01 17:43:28 +02:00
Mickaël Serneels
c194d5cfc7 scraper: add debug option 2019-05-01 17:43:28 +02:00
Mickaël Serneels
75318209ab oldies_multi: change default value from 100 to 10 2019-05-01 17:43:28 +02:00
Mickaël Serneels
bad4d25bcf make watchd.tor_safeguard a configurable option (default: True) 2019-05-01 17:43:28 +02:00
Mickaël Serneels
003a9074d2 make server file configurable 2019-05-01 17:43:28 +02:00
mickael
310b01140a irc: implement use_ssl = 2 
0: disabled, 1: enabled, 2: maybe
default is 0
 2019-05-01 17:43:28 +02:00
mickael
1ad5ca53e5 take care of old proxies 
test old proxies during free time
 2019-03-05 22:29:16 +00:00
rofl0r
ddee92d20f watchd: introduce configurable 'outage_threshold' 2019-01-18 15:34:49 +00:00
rofl0r
24d2c08c9f ppf: make it possible to import a file containing proxies directly 
using --file filename.html
 2019-01-11 05:45:13 +00:00
rofl0r
8b10df9c1b ppf.py: start using stale_count 2019-01-11 05:08:32 +00:00
rofl0r
d2cb7441a8 ppf: add optional debug output 2019-01-11 05:03:40 +00:00
mickael
4c6a83373f split databases 2019-01-11 00:25:01 +00:00
rofl0r
5e774b4e2a config.py: put section name in var 
avoids errors due to typos
 2019-01-11 00:25:01 +00:00
rofl0r
ef9158015f proxywatchd: make checktime constants configurable 
this requires only saving the last checked time in `tested`.
you can run the following sql statement to update the existing values
in the database:
sqlite3 proxylist.sqlite \
"update proxylist set tested=tested-(1800+(failed*3600)) where failed < 6"
 2019-01-11 00:25:01 +00:00
rofl0r
38d89f5bd9 ppf: add option for number of http retries 2019-01-08 03:30:31 +00:00
rofl0r
f16f754b0e implement combo config parser 
allows all options to be overridden by command line.

e.g.
[watchd]
threads=10
debug=false

--watch.threads=50 --debug=true
 2019-01-08 02:17:10 +00:00
mickael
1b3ce72efc add and use combining class 2019-01-07 23:19:14 +00:00
mickael
e31ac03f6f avoid double "checktime" usage 2019-01-07 22:09:22 +00:00
mickael
aeff09d2b3 move math function inside the sql statement 2019-01-07 21:11:08 +00:00
rofl0r
9e8beca4e1 do not treat empty lines as servers 2019-01-07 16:22:06 +00:00
rofl0r
e51dbe113b watchd: optional debug output 2019-01-06 22:44:18 +00:00
mickael
358044ccea watchd: make use of ssl configurable 2019-01-06 20:09:27 +00:00
mickael
4d513898fb make "submit_after" a configuratble option (config.ini) 2019-01-06 00:38:22 +00:00
rofl0r
9ac3ed45d6 rewrite threading code in jobwatchd 
now it distributes the tasks properly among all threads,
and it can be used as a standalone program.
there are some minor performance issues which will be fixed shortly.
 2019-01-05 06:35:41 +00:00
rofl0r
ff5d121d5f allow some config options optionally to be set by command line 2019-01-05 04:41:31 +00:00
rofl0r
ffbe450aee outsource configuration to external module 2019-01-05 03:47:03 +00:00