Skip to main content

agrag.chunking.base

The Chunker contract: how a Document becomes Chunks, and how that is recorded.

Classes:

  • Chunker – Splits one Document into Chunks and builds their provenance.
  • ChunkerMissingExtraError – A chunker needs a package extra that is not installed.
  • ChunkingError – A chunker broke the chunk contract or failed to chunk a document.
  • SpanChunker – A chunker that only decides where to cut. Text and offsets come from the source.

Functions:

Attributes: