Commit Graph
37 Commits
Author SHA1 Message Date
M09Ic 345d2a5bf9 fix config load priority, now config < cmd
enhance bar print
fix config.yaml default
2024-03-07 04:15:28 +08:00
M09Ic 6e435cfbe7 optimize config.
1. add flag --init to init config.yaml
2. default load config.yaml if this file exist
2024-03-07 02:55:51 +08:00
M09Ic 5c1f8700d4 fix read body bug when MaxBodyLength == 0 2024-03-06 17:55:18 +08:00
M09Ic 156d1884c9 update ver 2024-03-04 20:04:34 +08:00
M09Ic 34bcc60ddf refactor fingers 2024-03-04 20:03:06 +08:00
M09Ic 4af1378554 issues19, add custom extract config 2024-02-20 19:12:05 +08:00
M09Ic 3657e4d19e support fingerprinthub detect 2024-02-20 18:25:43 +08:00
M09Ic 1d3e1c1c22 update go version to 1.21 2024-02-12 16:55:16 +08:00
M09Ic 4ddb3e2a00 support config.yaml 2024-02-12 16:49:44 +08:00
M09Ic 4aca5fff76 refactor pool 2024-02-12 02:54:07 +08:00
M09Ic b1d4af93a0 support append-file 2024-02-08 16:28:27 +08:00
M09Ic 9ab33c654b refactor package dependency 2024-02-08 15:26:01 +08:00
M09Ic 6d98d039c1 进一步简化日志, 提供-v参数开启详细日志 2024-02-08 14:57:33 +08:00
M09Ic c8084a3987 bump dependency 2023-12-28 14:34:19 +08:00
M09Ic cb42efd9ed 当爬虫启动时, --read-all将会自动启用 2023-06-30 12:20:17 +08:00
M09Ic 8aee640332 添加自动化编译 2023-05-04 12:23:24 +08:00
M09Ic 24b56af2d6 -F新增从stdin中读, 并添加颜色参数 2023-02-08 19:17:42 +08:00
M09Ic 6faec1756a 调整extract格式 2023-02-08 15:30:40 +08:00
M09Ic 3abc250ab6 适配新版本gogo 2023-01-28 15:56:21 +08:00
M09Ic cf08e5cc1d 完成对extract相关功能的重构 2023-01-28 13:15:49 +08:00
M09Ic cf763b5861 优化统计模块, 现在check失败的任务也会在stat中保留了 2023-01-12 18:17:53 +08:00
M09Ic 581bd56796 添加了多处错误与日志描述 2023-01-12 16:35:34 +08:00
M09Ic c6f41ef84b 实装--crawl-depth 2023-01-10 01:09:00 +08:00
M09Ic b8a31be639 新增--read-all参数, 用来取消body max read限制 2023-01-09 21:47:06 +08:00
M09Ic 350cf68e45 实现--bak, 自动生成字典爆破备份文件 2023-01-06 00:48:13 +08:00
M09Ic ae45bd5daa 新增--file-bak参数, 开启有效结果的备份文件爆破, 可以使用-a同时开启三个 2023-01-05 23:26:14 +08:00
M09Ic aaa4b17b1b 添加help的补充说明, 优化README文档 2023-01-05 15:53:10 +08:00
M09Ic 38d507e060 初步实现-F
给--probe添加缩写-o
2023-01-04 12:06:13 +08:00
M09Ic eac33a7f0d 大量优化, 实装断点续传, 添加ctrl+c的后续处理 2022-12-12 17:05:44 +08:00
M09Ic 341998b26b 实现断点续传 2022-12-02 19:59:15 +08:00
M09Ic abe552c16a 实装--check-only参数, 实现类似httpx的批量请求的功能 2022-11-18 20:27:29 +08:00
M09Ic 53bc242693 实装deadline
修复多处bug
2022-11-10 16:52:00 +08:00
M09Ic 859a3c9333 添加templates以及templates generator 2022-10-28 00:01:05 +08:00
M09Ic 01d44b28a7 添加option文件, 从runner中分离不必要的功能 2022-10-27 18:53:26 +08:00
M09Ic 9a7766bb75 misc commit 2022-09-15 19:27:07 +08:00
M09Ic dec5cd8fc6 rename to github.com/chainreactors/spray 2022-09-08 17:04:41 +08:00
M09Ic a95f5c2154 init 2022-09-08 15:57:17 +08:00