Issues

• 3-bit dequantize to be tested

  casper-hansen/AutoAWQ_kernels#37 · Filter by author vince62s opened on Jan 31, 2025

• awq_ext is not defined

  casper-hansen/AutoAWQ_kernels#34 · Filter by author Yarflam opened on Oct 13, 2024
  1

• conversion error big time

  casper-hansen/AutoAWQ_kernels#33 · Filter by author BBC-Esq opened on Sep 11, 2024
  2

• Is there Any way to infer awq marlin model

  casper-hansen/AutoAWQ_kernels#26 · Filter by author DeJoker opened on Jul 23, 2024
  1

• Why not set stream in gemmv2_forward_cuda and dequantize_weights_cuda

  casper-hansen/AutoAWQ_kernels#23 · Filter by author grimoire opened on Jul 3, 2024

• AssertionError: AWQ kernels could not be loaded.

  casper-hansen/AutoAWQ_kernels#21 · Filter by author xieziyi881 opened on Jun 21, 2024
  5

• when can v100 be supported

  casper-hansen/AutoAWQ_kernels#18 · Filter by author 1SingleFeng opened on May 28, 2024
  1

• cuda 12.2 AssertionError: AWQ kernels could not be loaded.

  casper-hansen/AutoAWQ_kernels#16 · Filter by author s-natsubori opened on Apr 2, 2024
  2

• Question about QUICK kernel integration

  casper-hansen/AutoAWQ_kernels#15 · Filter by author crisb-7 opened on Feb 28, 2024

• DLL load failed on Windows via pip

  casper-hansen/AutoAWQ_kernels#14 · Filter by author GuillaumeBruand opened on Feb 27, 2024