rag-observability-evals
From the author
Monitor and evaluate RAG systems with retrieval quality metrics, groundedness checks, hallucination detection, and continuous regression testing.
Install
npx skills add BagelHole/DevOps-Security-Agent-Skills --skill rag-observability-evals -a claude-code
Installs to .claude/skills/rag-observability-evals/ · Each command fetches the skill straight from GitHub with the open skills CLI.
Download .zip
Byte-identical to the scanned commit, with the repository’s licence and a SOURCE.txt.
Want your agent to suggest skills while you type? See how to use skills from your IDE.
Safety checks on SKILL.md
No warnings.
Why 83
Security100
Provenance77
Maintenance70
Licence100
Adoption50
aiqbench computes the trust score from public signals. It is not a security audit, so read a skill before you install it.
Similar skills
Closest to this one by what they do and when they are used.
- rag-infrastructureBagelHole/DevOps-Security-Agent-SkillsBuild and operate Retrieval-Augmented Generation (RAG) infrastructure with vector stores, embedding pipelines, and hybrid search. Covers ingestion, chunking strategies, reranking, and production deployment patterns.DevOps★ 1.2K
- observability-and-reliabilitycbrock84/headcountMakes systems debuggable and reliably operable — instrumentation, alerting that is worth waking for, service objectives, and learning from failure. Use this to instrument a service, fix alerting that is ignored, set error budgets or reliability targets, prepare for on-call, or run a blameless post-incident review.DevOps★ 2.1K
- agent-observabilityBagelHole/DevOps-Security-Agent-SkillsInstrument AI agents with tracing, token metrics, latency, and cost visibility. Use for reliability and debugging.DevOps★ 1.2K
- python-observabilitywshobson/agentsPython observability patterns including structured logging, metrics, and distributed tracing. Use when adding logging, implementing metrics collection, setting up tracing, or debugging production systems.DevOps★ 41.6K
- langsmith-observabilityOrchestra-Research/AI-Research-SKILLsLLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.DevOps★ 13.9K
- rag-evalNVIDIA/skillsFilesystem RAG benchmarks: corpus/, train.json, evaluate_rag.py (RAGAS quality). Not for prod monitoring, latency/throughput benchmarking (use rag-perf), or evals outside this repo layout.Other★ 3.7K
Ratings & reviews
—
no reviews
Tried this skill? Rate it to help others. Sign in
Discussion
Join the discussion. Sign in