53 Commits

Author SHA1 Message Date
M09Ic
f1b9400e19 refactor: remove internal pkg, use engine replace
fix: chunk mod not read
fix: nil bar panic
enhance: add default accept and user-agent
2025-02-22 20:31:32 +08:00
M09Ic
de12d568ce enhance: add hard exit, https://github.com/chainreactors/spray/issues/78 2024-11-01 12:30:55 +08:00
M09Ic
b4c6a77a98 fix host mod not work, https://github.com/chainreactors/spray/issues/63 2024-08-29 01:43:16 +08:00
M09Ic
77a5e58a2a add --print print all preset config 2024-08-26 01:47:39 +08:00
M09Ic
105c426396 refactor plugin 2024-08-26 01:20:03 +08:00
M09Ic
1c28898631 refactor output and format 2024-08-26 00:04:44 +08:00
M09Ic
28aacea18c update quickstart note 2024-08-06 16:31:22 +08:00
M09Ic
021e84ae81 enhance runner structure 2024-08-06 03:58:41 +08:00
M09Ic
18e8594da1 update version 2024-07-24 13:51:27 +08:00
M09Ic
ec5102fd8f fix stat and error print bug 2024-07-24 13:41:03 +08:00
M09Ic
d5286eace5 fix ctrl+c cannot exit 2024-07-24 04:21:43 +08:00
M09Ic
7af848a6fd refactor option.go 2024-07-22 16:27:07 +08:00
M09Ic
da7a3d221d support multi fingers features 2024-07-17 01:40:30 +08:00
M09Ic
3f4094d89e refactor cmd ui. 2024-07-14 04:08:50 +08:00
M09ic
b2d85a7698 fix abs path parse 2024-04-26 18:57:02 +08:00
M09Ic
ec3ee45b89 add config load log 2024-03-07 04:24:00 +08:00
M09Ic
4e78e55b6e fix config load priority, now config < cmd
enhance bar print
fix config.yaml default
2024-03-07 04:15:28 +08:00
M09Ic
b1e42e763d optimize config.
1. add flag --init to init config.yaml
2. default load config.yaml if this file exist
2024-03-07 02:55:51 +08:00
M09Ic
c70d26fd84 fix read body bug when MaxBodyLength == 0 2024-03-06 17:55:18 +08:00
M09Ic
f24f8899a9 update ver 2024-03-04 20:04:34 +08:00
M09Ic
d1d6982282 refactor fingers 2024-03-04 20:03:06 +08:00
M09Ic
376e8cdc38 issues19, add custom extract config 2024-02-20 19:12:05 +08:00
M09Ic
20993e5500 support fingerprinthub detect 2024-02-20 18:25:43 +08:00
M09Ic
a49239b78a update go version to 1.21 2024-02-12 16:55:16 +08:00
M09Ic
04c449a297 support config.yaml 2024-02-12 16:49:44 +08:00
M09Ic
61167054ee refactor pool 2024-02-12 02:54:07 +08:00
M09Ic
e37201eb75 support append-file 2024-02-08 16:28:27 +08:00
M09Ic
09c2a86a18 refactor package dependency 2024-02-08 15:26:01 +08:00
M09Ic
007ff96478 进一步简化日志, 提供-v参数开启详细日志 2024-02-08 14:57:33 +08:00
M09Ic
4cbb7b05ba bump dependency 2023-12-28 14:34:19 +08:00
M09Ic
db29ce3e39 当爬虫启动时, --read-all将会自动启用 2023-06-30 12:20:17 +08:00
M09Ic
2421c4178d 添加自动化编译 2023-05-04 12:23:24 +08:00
M09Ic
25188b24e8 -F新增从stdin中读, 并添加颜色参数 2023-02-08 19:17:42 +08:00
M09Ic
5ace37824a 调整extract格式 2023-02-08 15:30:40 +08:00
M09Ic
5aaf062f22 适配新版本gogo 2023-01-28 15:56:21 +08:00
M09Ic
3943943405 完成对extract相关功能的重构 2023-01-28 13:15:49 +08:00
M09Ic
e30bab194a 优化统计模块, 现在check失败的任务也会在stat中保留了 2023-01-12 18:17:53 +08:00
M09Ic
02195a8005 添加了多处错误与日志描述 2023-01-12 16:35:34 +08:00
M09Ic
f87acdf657 实装--crawl-depth 2023-01-10 01:09:00 +08:00
M09Ic
b019324383 新增--read-all参数, 用来取消body max read限制 2023-01-09 21:47:06 +08:00
M09Ic
bb92c994cd 实现--bak, 自动生成字典爆破备份文件 2023-01-06 00:48:13 +08:00
M09Ic
26cc384de0 新增--file-bak参数, 开启有效结果的备份文件爆破, 可以使用-a同时开启三个 2023-01-05 23:26:14 +08:00
M09Ic
7e10db2391 添加help的补充说明, 优化README文档 2023-01-05 15:53:10 +08:00
M09Ic
30a82a7657 初步实现-F
给--probe添加缩写-o
2023-01-04 12:06:13 +08:00
M09Ic
0d81491d5a 大量优化, 实装断点续传, 添加ctrl+c的后续处理 2022-12-12 17:05:44 +08:00
M09Ic
f9c5a71258 实现断点续传 2022-12-02 19:59:15 +08:00
M09Ic
be0fc35cab 实装--check-only参数, 实现类似httpx的批量请求的功能 2022-11-18 20:27:29 +08:00
M09Ic
9f2223aeca 实装deadline
修复多处bug
2022-11-10 16:52:00 +08:00
M09Ic
e88d780e81 添加templates以及templates generator 2022-10-28 00:01:05 +08:00
M09Ic
5c48bce5d4 添加option文件, 从runner中分离不必要的功能 2022-10-27 18:53:26 +08:00