Skip to content

test: cover Mosaic read path combinations#401

Merged
JingsongLi merged 1 commit into
apache:mainfrom
QuakeWang:mosaic-read-tests
Jun 22, 2026
Merged

test: cover Mosaic read path combinations#401
JingsongLi merged 1 commit into
apache:mainfrom
QuakeWang:mosaic-read-tests

Conversation

@QuakeWang

Copy link
Copy Markdown
Member

Purpose

Linked issue: #378

The Mosaic reader already supports projection, missing physical columns, row selection, deletion vectors, and row-group pruning, but the test coverage did not exercise several important combinations across the format reader and DataFileReader layers. This made regressions around schema alignment, null preservation, stats conversion, and composed read filters easy to miss.

Brief change log

  • Add Mosaic format tests for supported scalar/temporal type round-trips and nullable values.
  • Cover Mosaic stats value conversion into Paimon Datum, including fail-open cases.
  • Cover batch splitting behavior used by Mosaic reads.
  • Add DataFileReader tests for Mosaic with deletion vectors, mixed Mosaic/Parquet splits, and predicate + deletion vector + projection composition.

Tests

  • cargo fmt --all -- --check
  • git diff --check
  • cargo test -p paimon --features mosaic mosaic -- --nocapture
  • cargo clippy -p paimon --features mosaic --tests -- -D warnings

API and Format

Documentation

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>
@QuakeWang QuakeWang force-pushed the mosaic-read-tests branch from cfea595 to e46173f Compare June 22, 2026 02:28

@JingsongLi JingsongLi left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@JingsongLi JingsongLi merged commit 2c6eca0 into apache:main Jun 22, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants