Skip to content

File Parsing With upload #16156

@OssNass

Description

@OssNass

I have the Following docker configuration:

litellm:
    image: ghcr.io/berriai/litellm:main-latest
    container_name: litellm
    networks:
      - web
      - litellm-net
    volumes:
      - /mnt/litellm/litellm_config.yaml:/app/config.yaml
      - /mnt/litellm/files:/app/uploads
    command: ["--config", "/app/config.yaml"]
    init: true
    restart: unless-stopped
    depends_on:
      postgres:
        condition: service_healthy
    environment:
      STORE_MODEL_IN_DB: True
      # --- Required for LiteLLM proxy + DB-backed key/usage storage ---
      DATABASE_URL: postgresql://litellm:litellm@litellm-db:5432/litellmdb
      LITELLM_MASTER_KEY: sk-Aa200279
      LITELLM_SALT_KEY: sk-Advgd8sdgfsdf
      JWT_SECRET: ^*tgH7YUIWE2WG
      LITELLM_AUTO_PARSE_FILES: False
      LITELLM_LOCAL_FILE_PARSER: True
      LITELLM_USE_LOCAL_PARSER_ONLY: True

with the following litellm_config.yaml:

general_settings:
  user_header_name: X-OpenWebUI-User-Id
  log_level: debug



files_settings:
  - file_provider: local
    enable_upload: true
    max_file_size_mb: 50
    allowed_extensions:
      - .txt
      - .pdf
      - .csv
      - .png
      - .jpg
    storage_path: /app/uploads
    auto_parse: false


litellm_settings:
  auto_parse_files: false

I am trying to configure file upload to work with local file parser instead of using OpenAI's but I always fail, and it tires to send to OpenAI

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions