TFIDFRetriever
Sparse retriever using TF-IDF vectorization for document retrieval.
Fits a :class:sklearn.feature_extraction.text.TfidfVectorizer on
the injected chunks and retrieves via pairwise distance.
Parameters
- TFIDFVectorizer : object
- TF-IDF Vectorizer parameters.
- similarity_function : string, default=
cosine - Distance metric for comparing TF-IDF vectors.
- top_k : integer, default=
5 - Number of chunks to select.
Methods
get_chunk_vectors(self, chunk_ids: List[int]) -> numpy.ndarray
TFIDFRetrieverReturn the TF-IDF vectors for the given chunk IDs.
init_model(self) -> None
TFIDFRetrieverRestore saved state or fit the vectorizer from scratch.
load(self) -> bool
TFIDFRetrieverLoad a previously saved TF-IDF state from disk.
retrieve(self, query: str, top_k: int | None = None) -> List[DashAI.back.models.RAG.documents.chunk.Chunk]
TFIDFRetrieverRetrieve the top-k chunks by TF-IDF similarity.
save(self) -> None
TFIDFRetrieverPersist the vectorizer, TF-IDF matrix, and chunk map to disk.
score_chunks(self, chunk_ids: List[int], query: str) -> List[Tuple[int, float]]
TFIDFRetrieverScore a set of chunk IDs against the query.
add(self, child: DashAI.back.models.RAG.retrievers.base_retriever.BaseRetriever) -> None
UnitRetrieverAdd a child retriever (not supported for unit retrievers).
get_children(self) -> List[DashAI.back.models.RAG.retrievers.base_retriever.BaseRetriever]
UnitRetrieverReturn the (empty) list of child retrievers.
get_credential(self, name: str)
ConfigObjectResolve a registered credential component by name.
Parameters
- name : str
- Credential component class name (e.g. "HuggingFaceCredential").
Returns
- BaseCredential
- An instance of the requested credential component.
get_id(self) -> int | None
BaseRetrieverReturn the database ID of this retriever, or None.
get_metadata(cls) -> Dict[str, Any]
BaseRetrieverReturn the UI metadata shared by every retriever.
Returns
- Dict[str, Any]
- Dictionary with the icon shown for the retriever in the frontend.
get_schema(cls) -> dict
ConfigObjectGenerates the component related Json Schema.
Returns
- dict
- Dictionary representing the Json Schema of the component.
inject_infra(self, env_RAG_path: str, chunks: Dict[int, Dict[int, DashAI.back.models.RAG.documents.chunk.Chunk]], persistence: Any) -> None
UnitRetrieverInject runtime infrastructure with type-checked persistence.
remove(self, child: DashAI.back.models.RAG.retrievers.base_retriever.BaseRetriever) -> None
UnitRetrieverRemove a child retriever (not supported for unit retrievers).
set_id(self, id: int) -> None
BaseRetrieverAssign a database ID to this retriever.
validate_and_transform(self, raw_data: dict) -> dict
ConfigObjectIt takes the data given by the user to initialize the model and returns it with all the objects that the model needs to work.
Parameters
- raw_data : dict
- A dictionary with the data provided by the user to initialize the model.
Returns
- dict
- A validated dictionary with the necessary objects.