fastrag.ingestion.filters.url#

URLFilter: filters sources or documents by URI regex patterns.

Classes

URLFilter([include_patterns, exclude_patterns])

Filters sources or documents by URI regex patterns.
class fastrag.ingestion.filters.url.URLFilter(include_patterns=None, exclude_patterns=None)[source]#

Bases: Filter[Source | Document]

Filters sources or documents by URI regex patterns.

Parameters:

  • include_patterns (Sequence[str] | None)

  • exclude_patterns (Sequence[str] | None)

property header_safe: bool#

This predicate uses identity/metadata only.

matches(item)[source]#

Return True when item’s URI passes the filter.

Reads Source.uri directly, and a Document’s metadata["source_uri"], falling back to source_id when absent.

Parameters:

item (Source | Document)

Return type:

bool