x-twitter-scraper

@rrrrrredy⭐ 1 stars

Use when the user needs public X/Twitter data without login: user profile lookup, recent timeline up to about 20 tweets, full tweet content including Note Tweet long-form, pinned tweet lookup, or JSON export. Trigger for check Twitter/X user, view recent tweets, scrape public X profile, and fetch a specific tweet. Not for full history timelines, authenticated/private content, or advanced search requiring login.

—/10

// RATINGS

⭐GitHub Stars

⭐ 1GitHub ↗

New / niche

🟢ProSkills Score

—

📍

Not yet listed on ClawHub or SkillsMP

// README

x-twitter-scraper

X/Twitter public data scraper — no login required.

OpenClaw Skill — works with OpenClaw AI agents

What It Does

Scrapes public X/Twitter data using the GraphQL API with guest tokens — no account needed. Supports fetching user profiles, recent timelines (up to ~20 tweets), and full single-tweet content including Note Tweet long-form text. Outputs clean text or structured JSON.

Quick Start

openclaw skill install x-twitter-scraper
# Or:
git clone https://github.com/rrrrrredy/x-twitter-scraper.git ~/.openclaw/skills/x-twitter-scraper

Run dependency setup on first use:

bash scripts/setup.sh
pip install httpx -q

Features

No login required: guest token authentication for public data
User profiles: followers, following, bio, pinned tweets
Timeline scraping: up to ~20 most recent tweets per user
Full tweet content: includes Note Tweet long-form text
JSON output: add --json flag for structured data
Auto-updatable: GraphQL query IDs refreshable via setup script
Hard stop protection: auto-stops after 3 consecutive failures

Usage

Trigger with natural language:

"查 @elonmusk 的 X 主页"
"看 @某人最新推文"
"获取这条推文的完整内容"
"查 X 动态" / "看推特"

CLI examples:

python3 scripts/x_scraper.py profile _LuoFuli
python3 scripts/x_scraper.py timeline elonmusk --count 5
python3 scripts/x_scraper.py tweet 2034379957913129140
python3 scripts/x_scraper.py profile _LuoFuli --json

Project Structure

x-twitter-scraper/
├── SKILL.md              # Skill definition and workflow
├── scripts/
│   ├── setup.sh          # Dependency setup & query ID extraction
│   └── x_scraper.py      # Main scraper CLI tool
├── references/
│   └── .gitkeep
└── .gitignore