You could ingest without an internet connection, except for the first time you run the ingest script, when the embeddings model is downloaded.
Note: during the ingest process no data leaves your local environment. If you want to start from an empty database, delete the db folder. You can ingest as many documents as you want, and all will be accumulated in the local embeddings database. Will take 20-30 seconds per document, depending on the size of the document. It will create a db folder containing the local vectorstore. Ingestion complete ! You can now run privateGPT.py to query your documents Using embedded DuckDB with persistence: data will be stored in: db Loaded 1 new documents from source_documents Run the following command to ingest all the data. Put any and all your files into the source_documents directory Instructions for ingesting your own dataset This repo uses a state of the union transcript as an example. Note: because of the way langchain loads the SentenceTransformers embeddings, the first time you run the script it will require internet connection to download the embeddings model itself. TARGET_SOURCE_CHUNKS: The amount of chunks (sources) that will be used to answer a question MODEL_N_CTX: Maximum token limit for the LLM modelĮMBEDDINGS_MODEL_NAME: SentenceTransformers embeddings model name (see ) MODEL_PATH: Path to your GPT4All or LlamaCpp supported LLM PERSIST_DIRECTORY: is the folder you want your vectorstore in
0 kommentar(er)
