Username
e24f68500c
style: normalize indentation and improve code style
...
- convert tabs to 4-space indentation
- add docstrings to modules and classes
- remove unused import (copy)
- use explicit object inheritance
- use 'while True' over 'while 1'
- use 'while args' over 'while len(args)'
- use '{}' over 'dict()'
- consistent string formatting
- Python 2/3 compatible Queue import
2025-12-20 23:18:45 +01:00
Username
90a6756ade
dbs: add indexes and optimize batch inserts
2025-12-20 18:25:33 +01:00
Your Name
d7db366857
split to ip/port, "cleanse" ips and ports, bugfixes
2021-08-22 20:39:50 +02:00
Your Name
a005cc109c
force ssl check (mitm) every 3 consecutive success check
...
needs a new entry in proxies.sqlite
sqlite3 proxies.sqlite "alter table proxylist add consecutive_success int"
sqlite3 proxies.sqlite "update proxylist set consecutive_success=0"
2021-07-03 18:47:34 +02:00
Your Name
47fee8df4f
proxylist database: add "mitm" row
...
update any existing db as follow:
sqlite3 proxies.sqlite "alter table proxylist add mitm int"
sqlite3 proxies.sqlite "update proxylist set mitm=0"
2021-07-03 18:47:08 +02:00
Your Name
d658309ee4
dbs: ensure items are unique
2021-02-06 23:22:39 +01:00
Your Name
615af656a2
fix: differentiate log message on added url/proxy
2021-02-06 12:21:16 +01:00
Your Name
78b29a1187
some changes
2021-01-24 03:52:56 +01:00
Mickaël Serneels
8900153871
set default error value to 1 for new urls
2019-05-01 17:43:28 +02:00
rofl0r
8400eab7ee
insert_proxies: remove 500-at-a-time logic
...
it's now done by mysqlite.py executemany.
2019-01-18 21:50:48 +00:00
rofl0r
8be5ab1567
ppf: move insert function into dbs.py
2019-01-18 21:43:17 +00:00
rofl0r
0dad0176f3
ppf: add new field proxies_added to be able to rate sites
...
sqlite3 urls.sqlite "alter table uris add proxies_added INT"
sqlite3 urls.sqlite "update uris set proxies_added=0"
2019-01-18 15:44:09 +00:00
rofl0r
69d366f7eb
ppf: add retrievals field so we know whether an url is new
...
use
sqlite3 urls.sqlite "alter table uris add retrievals INT"
sqlite3 urls.sqlite "update uris set retrievals=0"
2019-01-13 16:40:12 +00:00
rofl0r
bc41bad9de
dbs.py: remove unused column hash
2019-01-13 16:40:12 +00:00
mickael
4c6a83373f
split databases
2019-01-11 00:25:01 +00:00
