Skip to content

Add support for reading L1/L2 cache sizes for different platforms(Windows, Linux, MacOS) for our efficient cache aware multi-vector distance functions. #1062

Description

@suri-kumkaran

We might be able to take some reference from - https://github.com/ciresnave/hardware-query/blob/main/src/cpu.rs

We have the type TileBudget type which we need to wire by reading cache sizes from the machine.

Think more on how we can do minimal system calls and reuse the cache sizes across all distance computations.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

Status
In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions