141 Commits

Author SHA1 Message Date
M09Ic
3e63812ab0 adapt all finger engine 2024-06-29 03:56:44 +08:00
M09Ic
cec35ec667 adapt new fingers engine and refactor output format 2024-06-29 03:49:29 +08:00
M09Ic
cbf60343bb fix expr not work bug 2024-06-06 18:11:45 +08:00
M09Ic
b84535a06b fix NewBaseline panic 2024-06-04 16:24:36 +08:00
M09ic
cbb8e2f295 misc update, bar and finger panic 2024-05-21 18:05:27 +08:00
M09ic
75680c21f4 update dependency 2024-05-16 18:35:39 +08:00
M09Ic
4e78e55b6e fix config load priority, now config < cmd
enhance bar print
fix config.yaml default
2024-03-07 04:15:28 +08:00
M09Ic
9e82bb1ab3 use mpb replace uiprogress 2024-03-07 00:24:30 +08:00
M09Ic
16f149dadf enhance crawl print 2024-03-06 18:26:59 +08:00
M09Ic
c70d26fd84 fix read body bug when MaxBodyLength == 0 2024-03-06 17:55:18 +08:00
M09Ic
d1d6982282 refactor fingers 2024-03-04 20:03:06 +08:00
M09Ic
9eb4a13e20 进一步优化日志输出, 减少非必要输出 2024-02-20 21:28:07 +08:00
M09Ic
88dc9fe7cd fix fingerprinthub and fingers match bug 2024-02-20 21:09:00 +08:00
M09Ic
b9e970eb91 fix fingerpinthub match bug 2024-02-20 19:34:35 +08:00
M09Ic
376e8cdc38 issues19, add custom extract config 2024-02-20 19:12:05 +08:00
M09Ic
a40655287a fix statistor 2024-02-20 18:52:43 +08:00
M09Ic
20993e5500 support fingerprinthub detect 2024-02-20 18:25:43 +08:00
M09Ic
61167054ee refactor pool 2024-02-12 02:54:07 +08:00
M09Ic
c1309fe7da 修复functions重复生成目标的bug
优化自动识别能力, 404,200,403现在都会自动进行unique
append-file 现在生效于uniquestatus与whitestatus
2024-02-10 12:48:22 +08:00
M09Ic
09c2a86a18 refactor package dependency 2024-02-08 15:26:01 +08:00
M09Ic
007ff96478 进一步简化日志, 提供-v参数开启详细日志 2024-02-08 14:57:33 +08:00
M09Ic
051c270df8 add dicc.txt as default dict 2024-02-07 02:59:55 +08:00
M09Ic
2222b49632 修复代理为空时的报错bug 2024-02-07 01:54:31 +08:00
M09Ic
f35a07050e support http/socks5 proxy 2024-02-07 01:29:05 +08:00
M09Ic
ea5218b7f3 修复fasthttp client中, timeout不生效的bug 2024-02-07 00:46:11 +08:00
M09Ic
4cbb7b05ba bump dependency 2023-12-28 14:34:19 +08:00
M09Ic
00c880f16e 优化爬虫的url处理 2023-06-30 17:43:47 +08:00
M09Ic
a36e06e96b 修复--timeout实际没生效的bug 2023-06-30 17:29:49 +08:00
M09Ic
73f724b92a feat. 新增--index --random 支持自定义index与random目录 2023-06-03 22:24:52 +08:00
M09Ic
fc3f476fe2 修复bytes类型转换错误的bug 2023-06-03 21:09:01 +08:00
M09Ic
1a656b26a1 新增--retry插件 2023-05-04 12:04:59 +08:00
M09Ic
4b78503d64 添加url错误是的报错信息 2023-04-25 17:33:07 +08:00
M09Ic
0167f376db 修复派生的url可能导致部分插件出错的bug. 现在一旦url出现错误, 判定该请求无效 2023-04-25 17:28:08 +08:00
M09Ic
3698d01903 添加--scope与--no-scope参数, 用来指定爬虫的作用范围
修复recursive中的多个bug
2023-04-14 20:05:21 +08:00
M09Ic
1bcf2f297d 修复url解析错误的bug
修复redirect的wg计算错误的bug
2023-04-06 21:20:24 +08:00
M09Ic
77b92b44ea 关闭check-only的kepp-alive.
新增checkonly的--match指定过滤器
2023-04-04 01:21:31 +08:00
M09Ic
8ec00abe10 修复多个可能导致报错的bug.
checkonly支持upgrade与redirect
2023-04-04 00:47:33 +08:00
M09Ic
9eb55ebd66 适配gogo v2.11.0 2023-04-04 00:47:33 +08:00
M09Ic
4a12286beb 实装random useragent 2023-03-24 14:20:31 +08:00
M09Ic
58913caba7 修复部分情况下url不合法导致出现报错的bug 2023-02-21 17:58:16 +08:00
M09Ic
d62bbdf5df 调整指纹收集的逻辑 2023-02-19 22:27:16 +08:00
M09Ic
296bea96a0 修复check-only失效的bug 2023-02-19 16:14:51 +08:00
M09Ic
680d18a573 跳过二进制的返回数据读取 2023-02-08 19:18:33 +08:00
M09Ic
5ace37824a 调整extract格式 2023-02-08 15:30:40 +08:00
M09Ic
b3589db853 新增一种特殊的过滤模式--unique 或指定状态码的--unique-status 200 2023-02-08 12:58:56 +08:00
M09Ic
ae746b9e67 优化location的处理, 某些应用可能会使用小写 2023-02-07 18:37:19 +08:00
M09Ic
c3993fc8c2 多处性能与代码优化, 能更好的支持不同的fuzz了 2023-02-04 19:44:37 +08:00
M09Ic
02f601051c spray输出相关的代码整合到spray中 2023-02-01 18:31:50 +08:00
M09Ic
940c5b9e99 修复在优化stat时一个线程安全问题导致程序阻塞的bug 2023-01-29 18:23:55 +08:00
M09Ic
5aaf062f22 适配新版本gogo 2023-01-28 15:56:21 +08:00