Planning large-scale evaluations of quantized Qwen3.6 27B (accuracy, speed, latency, and memory consumption).
Models I'll evaluate:
Intel/Qwen3.6-27B-int4-AutoRound
Qwen/Qwen3.6-27B-FP8
cyankiwi/Qwen3.6-27B-AWQ-BF16-INT4
rdtand/Qwen3.6-27B-PrismaQuant-5.5bit-vllm
kaitchup/Qwen3.6-27B-autoround-nvfp4-linearattn-BF16