Bit-interleaved Q1_0 8x32 repack kernels for x86 AVX2 - #29

Draft

pl752 wants to merge 11 commits into

PrismML-Eng:prismfrom

pl752:perf/q1_0_8x32_repack_AVX2

Commits on Apr 19, 2026

ggml-cpu: Optimized x86 and generic cpu q1_0 dot (follow up) (#21636)

pl752
authored and
khosravipasha
committed
ca01960
Add release-prism workflow
khosravipasha
committed
7e2a218
Add Q2_0 quantization: type definition and CPU backend
khosravipasha
committed
9f31ffc
Add Q2_0 Metal backend
khosravipasha
committed
0eed534
cuda: Q2_0
khosravipasha
committed
e380897
release-prism: install spirv-headers for ubuntu-arm64 vulkan build
khosravipasha
committed
d104cf1

Commits on May 2, 2026

Implemented bit-interleaved Q1_0 8x32 repack kernels for x86 AVX2
pl752
committed
d11c45d

Commits on May 5, 2026

Corrected gemv with assumption of nr==1 for consistency
pl752
committed
5a9ab76
Unrolled mm256 registers to avoid register pointers
pl752
committed
3fa569d
Split 8 cols to two passes to reduce register pressure
pl752
committed
4e34da1

Commits on May 8, 2026

Implement rot4 Q1.0 repack kernels with positive-sum GEMV optimization
pl752
committed
a508eee