fetch-text_skill

Overview

This skill fetch-text extracts the complete textual content from a URL or a base64-encoded PDF and returns structured metadata. It auto-detects the source format (PDF, HTML, Markdown, or plain text) and supports Collection inputs by using the first item's content as the target URL. The output includes full text, format, page and character counts, and source metadata for reliable downstream processing.

How this skill works

Provide a target that is a URL, a base64 PDF, a Note ID, or a Collection ID. The skill inspects the input, auto-detects the content format, downloads or decodes the resource, and extracts all readable text without filtering. For Collections it reads the first note’s content field as the URL and then proceeds with extraction, returning JSON with text, format, metadata, page_count (PDF), and char_count.

When to use it

• You have a specific URL or a base64 PDF and need the complete unfiltered text.
• You need to ingest full documents for NLP tasks (summarization, indexing, entity extraction).
• You want accurate format detection across PDF/HTML/Markdown/TXT inputs.
• You receive a Collection ID and need to extract its first item’s content as the source.

Best practices

• Pass a canonical URL or direct base64 PDF to avoid redirects and partial captures.
• For collections, ensure the first item’s content is the intended URL or file reference.
• If PDFs are large, expect longer extraction time and consider paginated processing on downstream tasks.
• Validate returned metadata.uri and format before downstream processing to handle unexpected content types.
• Use this skill when you require complete text; use a search-oriented skill when you only need snippets or ranked passages.

Example use cases

• Extract full text from academic PDFs (arXiv, publisher PDFs) for corpus creation.
• Scrape entire web articles or documentation pages for indexing or offline analysis.
• Ingest legal or compliance documents as base64 PDFs to feed an NLP pipeline for entity and clause extraction.
• Process a Collection of notes by pointing to the Collection ID to automatically use its first item’s link as the extraction target.
• Convert Markdown or plain text files hosted at a URL into a single text payload for summarization.