feat: shared ScanScheduler, FileScheduler cache, and V1 reader cache on Dataset - #3

Open

jeremywgleeson wants to merge 14 commits into

mainfrom

devin/1774288046-cache-fragment-readers

Commits on Mar 23, 2026

feat: store shared ScanScheduler on Dataset for reuse across fragment reads

devin-ai-integration[bot]
and
jeremywgleeson
committed
3132878
style: fix rustfmt formatting for shared scan scheduler tuple

devin-ai-integration[bot]
and
jeremywgleeson
committed
40f58f7
feat: add FileScheduler cache on Dataset to avoid re-opening S3 files per request

devin-ai-integration[bot]
and
jeremywgleeson
committed
ac2131b
style: fix import ordering for rustfmt compliance

devin-ai-integration[bot]
and
jeremywgleeson
committed
6f8a39b
style: fix rustfmt formatting for FileScheduler cache code

devin-ai-integration[bot]
and
jeremywgleeson
committed
521bd53
perf: add S3 call counting and scheduler timing instrumentation

devin-ai-integration[bot]
and
jeremywgleeson
committed
d243bd7
perf: add S3 byte counting and V1/V2 format logging for profiling

devin-ai-integration[bot]
and
jeremywgleeson
committed
42f5f1e
style: fix rustfmt formatting for V1/V2 format logging

devin-ai-integration[bot]
and
jeremywgleeson
committed
42ee910
perf: add V1 (CloudObjectReader) S3 call counting for profiling

devin-ai-integration[bot]
and
jeremywgleeson
committed
339918b
style: fix import ordering in lib.rs

devin-ai-integration[bot]
and
jeremywgleeson
committed
dbd1244
feat: re-export S3 profiling counters through lance crate

devin-ai-integration[bot]
and
jeremywgleeson
committed
7c0a86c
perf: cache V1 PreviousFileReader instances on Dataset to avoid per-request S3 reader creation

devin-ai-integration[bot]
and
jeremywgleeson
committed
8f1e055

Navigation Menu

Uh oh!

feat: shared ScanScheduler, FileScheduler cache, and V1 reader cache on Dataset - #3

feat: shared ScanScheduler, FileScheduler cache, and V1 reader cache on Dataset#3
jeremywgleeson wants to merge 14 commits into
mainfrom
devin/1774288046-cache-fragment-readers

Commits on Mar 23, 2026

feat: store shared ScanScheduler on Dataset for reuse across fragment reads

style: fix rustfmt formatting for shared scan scheduler tuple

feat: add FileScheduler cache on Dataset to avoid re-opening S3 files per request

style: fix import ordering for rustfmt compliance

style: fix rustfmt formatting for FileScheduler cache code

perf: add S3 call counting and scheduler timing instrumentation

perf: add S3 byte counting and V1/V2 format logging for profiling

style: fix rustfmt formatting for V1/V2 format logging

perf: add V1 (CloudObjectReader) S3 call counting for profiling

style: fix import ordering in lib.rs

feat: re-export S3 profiling counters through lance crate

perf: cache V1 PreviousFileReader instances on Dataset to avoid per-request S3 reader creation

Commits on Mar 24, 2026

fix: add missing v1_reader_cache field to Dataset initializer in commit.rs

style: fix rustfmt formatting for v1_reader_cache insert