Skip to main content

Local Filesystem Embedding Models

Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services.

Example Configuration​

To configure an embedding model using local files, you can specify the details in the spicepod.yaml file as shown below:

embeddings:
  - name: all_minilm_l6_v2
    from: file:model.safetensors
    files:
      - path: /Users/jeadie/Github/spiceai/models/embed/config.json
      - path: models/embed/tokenizer.json

Required Files​

  • Model file, one of: model.safetensors, pytorch_model.bin.
  • A tokenizer file with the filename tokenizer.json.
  • A config file with the filename config.json.