⏳ This skill is pending AI review.
Scores will appear once the review pipeline completes.
website2markdown
Convert web pages to clean Markdown using the Website2Markdown API (md.genedai.me). Use when you need to fetch, read, extract, or analyze web page content — especially when WebFetch fails, returns incomplete content, or the target is JS-heavy/paywalled. Supports 21 platform adapters (WeChat, Zhihu, Feishu, Twitter/X, etc.), batch processing, structured extraction, and deep crawling.
// RATINGS
// README
website2markdown-skills
Convert any web page to clean Markdown from your AI agent. One command install, auto-discovered.
Quick Install
Pick your agent, run one command:
# Claude Code
git clone https://github.com/Digidai/website2markdown-skills ~/.claude/skills/website2markdown
# OpenAI Codex CLI
git clone https://github.com/Digidai/website2markdown-skills ~/.codex/skills/website2markdown
# Gemini CLI
git clone https://github.com/Digidai/website2markdown-skills ~/.gemini/skills/website2markdown
# OpenClaw (via ClawHub)
npx clawhub@latest install website2markdown
# Cursor / Windsurf / Other agents
git clone https://github.com/Digidai/website2markdown-skills .claude/skills/website2markdown
That's it. Open a new session and the skill is auto-discovered.
Verify
You: Read this article: https://example.com
Agent: [Uses md.genedai.me API → returns clean Markdown]
Update
cd ~/.claude/skills/website2markdown && git pull
What It Does
Teaches your AI agent to convert any URL to clean Markdown — JS-heavy SPAs, paywalled content, anti-bot pages, and 21 Chinese/international platforms.
You: Read this WeChat article: https://mp.weixin.qq.com/s/abc123
Agent: [Calls md.genedai.me with force_browser=true]
# 深度解析：大模型在企业的落地实践
> 作者：张三 | 2026-03-25
## 核心观点
1. 大模型的应用场景正在从实验室走向生产环境...
You: Compare these 3 blog posts and summarize the differences
Agent: [Uses batch API to fetch all 3 in one request, then compares]
You: Crawl the Cloudflare docs and save as Markdown files
Agent: [Uses deep crawl API with BFS, saves each page]
Capabilities
| API | What It Does |
|---|---|
GET /<url>?raw=true | Convert one URL to Markdown |
POST /api/batch | Batch convert up to 10 URLs |
POST /api/extract | Extract structured data (CSS/XPath/Regex) |
POST /api/deepcrawl | Crawl a site with BFS or keyword scoring |
POST /api/jobs | Async task queue for long-running work |
21 Platform Adapters
| Chinese Platforms | International |
|---|---|
| WeChat, Zhihu, Feishu/Lark, Yuque, Juejin, CSDN, 36Kr, Toutiao, Weibo, NetEase | Twitter/X, Reddit, Notion, GitHub, Substack, Medium |
These platforms have anti-bot protection, login walls, or complex JS rendering. The API handles all of it automatically.
Agent Compatibility
| Agent | Install Path | Command |
|---|---|---|
| Claude Code | ~/.claude/skills/ | git clone ... ~/.claude/skills/website2markdown |
| Codex CLI | ~/.codex/skills/ | git clone ... ~/.codex/skills/website2markdown |
| Gemini CLI | ~/.gemini/skills/ | git clone ... ~/.gemini/skills/website2markdown |
| OpenClaw | ClawHub | npx clawhub@latest install website2markdown |
| Cursor | Project .claude/skills/ | git clone ... .claude/skills/website2markdown |
| Windsurf | Project .claude/skills/ | git clone ... .claude/skills/website2markdown |
Follows the AgentSkills open standard.
Skills vs MCP Server
Have a terminal? Use Skills (this repo) — faster, richer context. No terminal (Claude Desktop, IDE only)? Use the MCP Server.
| Skills | MCP Server | |
|---|---|---|
| Latency | Direct HTTP (fastest) | MCP protocol overhead |
| Context | Full patterns, error handling, 21 adapters | Tool schema only |
| Install | git clone (one command) | npm install -g + JSON config |
| Update | git pull | npm update -g |
Project Structure
website2markdown-skills/
├── SKILL.md # Core skill — agent reads this
├── references/
│ ├── advanced-apis.md # Batch, Extract, DeepCrawl, Jobs docs
│ └── platform-adapters.md # 21 platform adapter details
└── assets/
└── recipes.md # Copy-paste curl recipes
Contributing
- Fork → edit → test by copying to your agent's skills dir → PR
- Keep
SKILL.mdunder 250 lines (it's the hub, not the encyclopedia) - API details go in
references/, curl examples inassets/recipes.md
Links
- Live API: md.genedai.me
- Source code: Digidai/website2markdown
- MCP Server: @digidai/mcp-website2markdown
- llms.txt: md.genedai.me/llms.txt
License
// HOW IT'S BUILT
KEY FILES