How to use deepspider
Performs AI-driven web crawling and JavaScript reverse engineering, recovering parameter logic from browser evidence for validation.
This article is auto-derived from indexed fields (wiki / faq / compatibility_json), not freshly AI-generated.
This article is derived from the plugin's already-indexed fields (wiki / faq / compatibility_json / readme), not freshly generated by AI. Source field is noted at the end of each section.
Quick start
Performs AI-driven web crawling and JavaScript reverse engineering, recovering parameter logic from browser evidence for validation.
— source: plugins.ai_summary
Install & verify
dsh plugin --profile web add --allow-build=deepspider github:ma-pony/deepspider
Run the command above in your DSH Web Profile. Then enable the plugin in the plugin list.
— source: plugins.install
Key points
- 沿真实请求的 Initiator、调用栈和脚本源码定位参数写入边界。
- 分析动态执行、Webpack、Worker、WebAssembly、状态机和高度混淆代码。
- 用 Hook、Debugger 和属性采集补足浏览器事实,而不是直接修改捕获源码。
- 将 Cookie 生成所需的浏览器依赖描述成可审计的 Runtime Recipe,再由独立 Worker 执行。
- 用真实请求验证自动生成的 Cookie,并导出可以脱离浏览器 Session 重跑的 Solver;其他输出继续使用通用浏览器、Hook、Debugger 和 Code Mode 定位与实现。
— source: plugin_wiki.readme_en (fallback readme_raw)
Compatibility
- DSH: 未声明
- Node: >=24.15.0
- Platforms: 跨平台
- Native modules: sdenv, cycletls
— source: plugin_wiki.compatibility_json
Pitfalls
Review the upstream repo before installing. This guide is auto-derived from indexed fields and may lag the latest release. If anything contradicts the official docs, treat the upstream source as authoritative.
— source: general rule