xhs-scraper_skill

Overview

This skill scrapes Xiaohongshu (Little Red Book) search results via a CDP-connected browser (agent-browser). It collects list-card metadata, optionally visits detail pages to extract full content, and exports results as Markdown, RSS, or JSON. Designed for automated keyword-driven harvesting of notes for analysis, monitoring, and feed generation.

How this skill works

The skill drives a browser using the Chrome DevTools Protocol to perform a search, scroll the list page to load cards, and capture card metadata (title, author, time, link, cover). Optionally it opens a configurable number of detail pages to extract full note text and images. Output is formatted as Markdown, RSS, or structured JSON for downstream consumption.

When to use it

• Collect public Xiaohongshu notes for keyword research or trend monitoring
• Generate an RSS feed or JSON dataset from platform search results
• Scrape list-level metadata only or include detail-level full text for deeper analysis
• Automate periodic harvesting for competitor or content tracking
• Prepare markdown exports for documentation or manual review

Best practices

• Run against a stable CDP-enabled browser instance (agent-browser) to avoid session issues
• Start with small scroll and detail limits to validate selectors before scaling up
• Respect the platform’s terms of service and rate limits; add delays if needed
• Choose JSON for programmatic workflows, RSS for feed consumption, Markdown for human-readable archives
• Keep output paths and formats explicit and rotate or deduplicate results when running repeatedly

Example use cases

• Harvest top notes for a given job-related keyword and export as Markdown for recruiter review
• Build a daily RSS feed of new notes for a product or topic to monitor sentiment
• Create a JSON dataset of note titles, authors, and timestamps for trend analysis
• Scrape detailed note bodies for a small sample to train or evaluate content classifiers
• Produce Markdown archives of candidate interview experiences or study notes for team knowledge sharing