270 Commits

Author SHA1 Message Date
M09ic
9bb4ae7341 update words 2024-05-17 17:54:52 +08:00
M09ic
ea090aa6bd fix proxy config bug when use http proxy 2024-05-17 17:47:42 +08:00
M09ic
f755fc3816 support -x/--method custom http method
support --raw parser input from raw http
2024-05-17 17:47:11 +08:00
M09ic
75680c21f4 update dependency 2024-05-16 18:35:39 +08:00
M09ic
b2d85a7698 fix abs path parse 2024-04-26 18:57:02 +08:00
M09Ic
13530eee5d update README.md v0.9.6 2024-03-07 15:40:25 +08:00
M09Ic
006e1af2db fix --check-only panic 2024-03-07 15:26:30 +08:00
M09Ic
3da923b2a8 update README.md 2024-03-07 15:02:20 +08:00
M09Ic
ec3ee45b89 add config load log 2024-03-07 04:24:00 +08:00
M09Ic
4e78e55b6e fix config load priority, now config < cmd
enhance bar print
fix config.yaml default
2024-03-07 04:15:28 +08:00
M09Ic
b1e42e763d optimize config.
1. add flag --init to init config.yaml
2. default load config.yaml if this file exist
2024-03-07 02:55:51 +08:00
M09Ic
9e82bb1ab3 use mpb replace uiprogress 2024-03-07 00:24:30 +08:00
M09Ic
16f149dadf enhance crawl print 2024-03-06 18:26:59 +08:00
M09Ic
ab830a5e98 support --no-dict flag 2024-03-06 18:14:07 +08:00
M09Ic
c70d26fd84 fix read body bug when MaxBodyLength == 0 2024-03-06 17:55:18 +08:00
M09Ic
f24f8899a9 update ver v0.9.5 2024-03-04 20:04:34 +08:00
M09Ic
d1d6982282 refactor fingers 2024-03-04 20:03:06 +08:00
M09Ic
b487e3da15 fix standard client null proxy bug 2024-03-03 01:59:56 +08:00
M09Ic
9eb4a13e20 进一步优化日志输出, 减少非必要输出 2024-02-20 21:28:07 +08:00
M09Ic
88dc9fe7cd fix fingerprinthub and fingers match bug v0.9.4 2024-02-20 21:09:00 +08:00
M09Ic
b9e970eb91 fix fingerpinthub match bug 2024-02-20 19:34:35 +08:00
M09Ic
e58af07439 update README.md 2024-02-20 19:17:28 +08:00
M09Ic
376e8cdc38 issues19, add custom extract config 2024-02-20 19:12:05 +08:00
M09Ic
a40655287a fix statistor 2024-02-20 18:52:43 +08:00
M09Ic
20993e5500 support fingerprinthub detect 2024-02-20 18:25:43 +08:00
M09Ic
a49239b78a update go version to 1.21 v0.9.3 2024-02-12 16:55:16 +08:00
M09Ic
04c449a297 support config.yaml 2024-02-12 16:49:44 +08:00
M09Ic
61167054ee refactor pool 2024-02-12 02:54:07 +08:00
M09Ic
c1309fe7da 修复functions重复生成目标的bug
优化自动识别能力, 404,200,403现在都会自动进行unique
append-file 现在生效于uniquestatus与whitestatus
2024-02-10 12:48:22 +08:00
M09Ic
0bf3c0433a 403,200,502页面将会启用append-file 2024-02-08 17:41:54 +08:00
M09Ic
9b74f7c9a3 将active修改为finger
修复append-file拼接时的bug
2024-02-08 16:46:34 +08:00
M09Ic
e37201eb75 support append-file 2024-02-08 16:28:27 +08:00
M09Ic
09c2a86a18 refactor package dependency 2024-02-08 15:26:01 +08:00
M09Ic
007ff96478 进一步简化日志, 提供-v参数开启详细日志 2024-02-08 14:57:33 +08:00
M09Ic
cea66e69e0 clean check log v0.9.2 2024-02-07 03:01:07 +08:00
M09Ic
051c270df8 add dicc.txt as default dict 2024-02-07 02:59:55 +08:00
M09Ic
1f493fe104 兼容dirsearch的字典与规则, -e 将会作用于字典内的%EXT% 2024-02-07 02:34:18 +08:00
M09Ic
3272210e07 enable upx release 2024-02-07 01:55:42 +08:00
M09Ic
2222b49632 修复代理为空时的报错bug 2024-02-07 01:54:31 +08:00
M09Ic
f35a07050e support http/socks5 proxy 2024-02-07 01:29:05 +08:00
M09Ic
ea5218b7f3 修复fasthttp client中, timeout不生效的bug 2024-02-07 00:46:11 +08:00
M09Ic
414b85a4f0 enable upx release 2024-01-03 14:59:10 +08:00
M09Ic
408004223c Merge branch 'issue8' into dev 2023-12-28 14:58:23 +08:00
M09Ic
4cbb7b05ba bump dependency 2023-12-28 14:34:19 +08:00
M09Ic
00c880f16e 优化爬虫的url处理 2023-06-30 17:43:47 +08:00
M09Ic
a36e06e96b 修复--timeout实际没生效的bug 2023-06-30 17:29:49 +08:00
M09Ic
db29ce3e39 当爬虫启动时, --read-all将会自动启用 2023-06-30 12:20:17 +08:00
M09Ic
82f0630324 optimized. 添加没有输出目标时的错误信息 2023-06-12 11:19:23 +08:00
M09Ic
949843ce17 optimized. 优化retry的逻辑, 默认为0, 如果为0则不会在命令行输出配置日志 2023-06-12 11:19:22 +08:00
M09Ic
72853f2a06 optimized. 添加没有输出目标时的错误信息 2023-06-12 11:18:23 +08:00