Skip to content

Discuss durable local chDB storage for Maple local mode #701

Description

@ShawnChen-Sirius

I was looking at Maple's local mode and noticed that it already treats embedded chDB as a real local store, not just a temporary cache. The unclean-shutdown handling and local-store migration flow also suggest that recovery semantics matter a lot for this mode.

That made me wonder whether chdb-durable could be a useful fit here.

chdb-durable is a durable mode for embedded chDB: it keeps authoritative state in object storage or a local durable namespace, restores from checkpoints plus WAL replay, and uses a single-writer lease.

Potential value for Maple:

  1. Recover local telemetry after process crash or machine restart.
  2. Avoid wiping/rebuilding the local chDB store after dirty shutdowns.
  3. Store local-mode state in S3/R2/GCS/Azure/local durable storage.
  4. Checkpoint after successful local-store migrations.

Today chdb-durable is mainly exposed from Python. If this direction sounds useful, the chDB side can help contribute a JS/TypeScript, Bun, or sidecar durable integration and discuss the Maple-side changes together.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions