xtrace_sdk.data_loaders package

Subpackages

Submodules

xtrace_sdk.data_loaders.base module

xtrace_sdk.data_loaders.generic_loader_v2 module

xtrace_sdk.data_loaders.txt_loader module

Module contents

This module provides data loader functionality for the XTrace SDK.

A data loader is responsible to load data from a source, encrypt it, and store it in a persistent storage. It needs to work with the following components:

  1. Storage: A storage component that provides methods to store and retrieve data.

  2. Encryption: An encryption component that provides methods to encrypt and decrypt text data.

  3. Embedding: An embedding component that provides methods to embed data into a vector space.

  4. Homomorphic Encryption: A homomorphic encryption component that provides methods to perform computations on encrypted data.

  5. Connector: A connector component that provides methods to connect to a remote storage service or local disk.