Skip to main content

How to use deepspider

Performs AI-driven web crawling and JavaScript reverse engineering, recovering parameter logic from browser evidence for validation.

This article is auto-derived from indexed fields (wiki / faq / compatibility_json), not freshly AI-generated.

This article is derived from the plugin's already-indexed fields (wiki / faq / compatibility_json / readme), not freshly generated by AI. Source field is noted at the end of each section.

Quick start

Performs AI-driven web crawling and JavaScript reverse engineering, recovering parameter logic from browser evidence for validation.

— source: plugins.ai_summary

Install & verify

dsh plugin --profile web add --allow-build=deepspider github:ma-pony/deepspider

Run the command above in your DSH Web Profile. Then enable the plugin in the plugin list.

— source: plugins.install

Key points

  • 沿真实请求的 Initiator、调用栈和脚本源码定位参数写入边界。
  • 分析动态执行、Webpack、Worker、WebAssembly、状态机和高度混淆代码。
  • 用 Hook、Debugger 和属性采集补足浏览器事实,而不是直接修改捕获源码。
  • 将 Cookie 生成所需的浏览器依赖描述成可审计的 Runtime Recipe,再由独立 Worker 执行。
  • 用真实请求验证自动生成的 Cookie,并导出可以脱离浏览器 Session 重跑的 Solver;其他输出继续使用通用浏览器、Hook、Debugger 和 Code Mode 定位与实现。

— source: plugin_wiki.readme_en (fallback readme_raw)

Compatibility

  • DSH: 未声明
  • Node: >=24.15.0
  • Platforms: 跨平台
  • Native modules: sdenv, cycletls

— source: plugin_wiki.compatibility_json

Pitfalls

Review the upstream repo before installing. This guide is auto-derived from indexed fields and may lag the latest release. If anything contradicts the official docs, treat the upstream source as authoritative.

— source: general rule