Search results

Potential Async Data Race in cp_async4_stream Usage - Request for Validation

Status: Open.

#42 In IST-DASLab/marlin;

· Zephyreeze opened on Jul 24, 2025

Question about the meaning of <code>slice_count</code> and <code>slice_idx</code> in global reduction condition

Status: Open.

#41 In IST-DASLab/marlin;

· ZhengChen6 opened on Jul 24, 2025

Issue with running kernel on blackwell GPUs (RTX 5090)

Status: Open.

#40 In IST-DASLab/marlin;

· huoshenlaile opened on Mar 10, 2025

Different batch size results to different result for gptq_marlin_gemm kernel.

Status: Open.

#38 In IST-DASLab/marlin;

· rooooc opened on Dec 30, 2024

Question about matrix A

Status: Open.

#37 In IST-DASLab/marlin;

· Zhao-Dongyu opened on Oct 23, 2024

Marlin vs gguf

Status: Open.

#36 In IST-DASLab/marlin;

· blap opened on Sep 13, 2024

comparison with FastTransformer for BatchSize=1

Status: Open.

#35 In IST-DASLab/marlin;

· matrix97317 opened on Sep 11, 2024

How to move the pointer of B and s in cuda kernel

Status: Open.

#34 In IST-DASLab/marlin;

· Eutenacity opened on Aug 22, 2024

comparison with SmoothQuant

Status: Open.

#32 In IST-DASLab/marlin;

· lxww302 opened on Jul 29, 2024

RuntimeError: CUDA error: an illegal instruction was encountered when runing test.py

Status: Open.

#30 In IST-DASLab/marlin;

· MekkCyber opened on Jul 2, 2024

Trying to understand the kernel

Status: Open.

#29 In IST-DASLab/marlin;

· MekkCyber opened on Jun 27, 2024

Why the linear input for Layer.pack "must be of type <code>torch.half</code>"?

Status: Open.

#28 In IST-DASLab/marlin;

· Azure-Tang opened on Jun 26, 2024