weibo-scraper

@rrrrrredy⭐ 0 stars

Weibo public content reader for visible posts that do not require login. Uses web search and Playwright visitor-mode rendering to fetch public user timelines or post text. Triggers: check Weibo, scrape Weibo, Weibo user, read Weibo post, Weibo timeline, fetch Weibo content. Not for: login-required or fans-only content; extracting account cookies; private messages; large-scale batch scraping; non-Weibo platforms.

—/10

// RATINGS

⭐GitHub Stars

⭐ 0GitHub ↗

New / niche

🟢ProSkills Score

—

📍

Not yet listed on ClawHub or SkillsMP

// README

weibo-scraper

Weibo public content scraper — no login required.

OpenClaw Skill — works with OpenClaw AI agents

What It Does

Fetches public Weibo posts without needing a Weibo account. Uses web search to locate user profiles and post URLs, then opens pages via Playwright with a visitor cookie to extract post text and timestamps. Supports user timeline browsing and individual post content extraction.

Quick Start

openclaw skill install weibo-scraper
# Or:
git clone https://github.com/rrrrrredy/weibo-scraper.git ~/.openclaw/skills/weibo-scraper

Run dependency setup on first use:

bash scripts/setup.sh

Features

No login required: visitor cookie mode for public content access
User timeline: fetch a user's recent public posts (typically 10-15 visible)
Post extraction: read full text content from individual post URLs
Web search integration: locate user UIDs and post URLs via site:weibo.com queries
Fallback selectors: handles CSS class name changes with alternative extraction methods
Hard stop protection: auto-stops after 3 consecutive failures to prevent infinite retries

Usage

Trigger with natural language:

"查一下 @某用户的微博"
"看看这个微博用户最近发了什么"
"抓取微博内容"
"搜微博" / "微博动态"

Project Structure

weibo-scraper/
├── SKILL.md                # Skill definition and workflow
├── scripts/
│   └── setup.sh            # Dependency setup script
├── references/
│   └── weibo-api-notes.md  # API notes and technical details
├── README.md
├── LICENSE
└── .gitignore