rag_service_skill

Overview

This skill provides a high-performance RAG (retrieval-augmented generation) multi-route retrieval service. It integrates Milvus for vector semantic search, applies a Rerank model for precise result ordering, and offers scalable document storage and history recall for large collections. The service is designed for production-grade retrieval tasks with low latency and high accuracy.

How this skill works

The service embeds documents into vector space and stores them in Milvus for fast approximate nearest neighbor search. A configurable retrieval step returns top-K candidates which are optionally passed to a Rerank model that refines ordering based on relevance. It also exposes document ingestion and health-check endpoints and returns structured results including scores, metadata, and timing.

When to use it

• Enable semantic search across large unstructured document sets
• Combine retrieval with generation to ground LLM outputs in source texts
• Require result reordering for improved precision in top results
• Store and recall document history alongside embeddings
• Optimize latency and throughput for production retrieval pipelines

Best practices

• Tune embedding model and Milvus index parameters for your dataset size
• Set sensible top_k and min_score thresholds to balance recall and precision
• Enable rerank when top result quality matters, especially for short queries
• Include metadata (title, url, tags) to aid downstream filtering and presentation
• Monitor elapsed_ms and from_cache flags to identify performance bottlenecks

Example use cases

• Provide grounded answers in a customer support assistant by retrieving relevant KB articles
• Augment a summarization pipeline with precise source excerpts for provenance
• Search and surface legal, medical, or research documents by semantic similarity
• Maintain an evolving document corpus for product documentation and retrieve historical changes
• Drive a tool that feeds high-quality retrieved passages into an LLM for response generation