Effect of quantization? #34
Description
Embeddings are quantized into int8 when written to clusters/. What effect does this quantization have on our
- search metrics
- throughput/communication
- other?
{{ message }}
Embeddings are quantized into int8 when written to clusters/. What effect does this quantization have on our