Search results

load quantized model error

Status: Open.

#23 In fpgaminer/GPTQ-triton;

· wanghz18 opened on Aug 9, 2024

GPTQ guide?

Status: Open.

#22 In fpgaminer/GPTQ-triton;

· vgoklani opened on Jun 14, 2023

question about the quantization formula

Status: Open.

#18 In fpgaminer/GPTQ-triton;

· irasin opened on May 11, 2023

rotary embedding and layer norm

Status: Open.

#17 In fpgaminer/GPTQ-triton;

· qwopqwop200 opened on May 8, 2023

Cache auto-tuning?

Status: Open.

#15 In fpgaminer/GPTQ-triton;

· vedantroy opened on May 3, 2023

1-bit acceleration support

Status: Open.

#7 In fpgaminer/GPTQ-triton;

· NicoNico6 opened on Apr 14, 2023

Cuda vs Triton on an RTX 3060 12GB

Status: Open.

#5 In fpgaminer/GPTQ-triton;

· 1aienthusiast opened on Apr 2, 2023

Needs more VRAM than normal GPTQ CUDA version?

Status: Open.

#1 In fpgaminer/GPTQ-triton;

· DanielWe2 opened on Mar 28, 2023