Skip to content

Track CSR storage and traversal improvements #80

Open
3 of 8 issues completed
Open

Description

@prrao87

Goal

lance-csr rebuilds its CSR in memory on every engine start. (A hop that names its relationship variable used to fall back to joins too; #87 keeps it on the CSR, using the edge row addresses from #73.) On-disk CSR engines such as LadybugDB open without a build and keep edge properties next to the topology. This issue tracks the work to close that gap where it matters for lance-csr, with Lance staying the source of truth and the CSR staying a derived index on a single machine.

Most of these ideas come from lance-graph's CSR roadmap (lance-format/lance-graph#159) and the review of its native expand PR (lance-format/lance-graph#162).

Sub-issues

Related, not a sub-issue: #92, IC5's memory-mode slowdown since #87 moved named hops onto the CSR.

Each sub-issue describes the problem and the idea only; designs come later, and anything claimed as faster is measured against main on both benchmark suites first.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions