Skip to content

Latest commit

 

History

History
46 lines (35 loc) · 2.15 KB

api-version-notes.md

File metadata and controls

46 lines (35 loc) · 2.15 KB

RAGAS API verification notes

Last verified: 11 August 2026

Target package: RAGAS 0.4.3, released 13 January 2026.

Primary sources:

Interfaces used

Concern Interface used in this repository
Metric import ragas.metrics.collections
Async score call await metric.ascore(**metric_inputs)
Result MetricResult.value, with optional MetricResult.reason
Dataset fields user_input, retrieved_contexts, response, reference
Judge factory ragas.llms.llm_factory()
Embedding factory ragas.embeddings.base.embedding_factory()
Azure provider LiteLLM with azure/<deployment-name>

Deliberately avoided

  • from ragas.metrics import ... for the legacy metric classes
  • single_turn_ascore(sample)
  • the old ground_truths field
  • LangchainLLMWrapper and LangchainEmbeddingsWrapper
  • the v0.3 evaluate(dataset=..., metrics=...) orchestration pattern
  • AnswerSimilarity; the current replacement is SemanticSimilarity
  • ContextUtilization as the main context-quality name; this project uses ContextPrecision with a reference. RAGAS retains ContextUtilization as a wrapper for context precision without a reference.

The evaluator calls Collections metrics directly because this keeps metric inputs explicit, returns the modern MetricResult, and lets applications decide how to store experiments. RAGAS' @experiment architecture can be added around the same evaluator when its dataset backends and tracked experiment lifecycle are required.

RAGAS evolves quickly. Keep the exact pin during initial adoption, review migration notes, and rerun tests/test_ragas_api_contract.py before changing the version.