Skip to content

Generalize indexing schema versions#1284

Draft
jwils wants to merge 1 commit into
joshuaw/indexer-ingestion-adaptersfrom
joshuaw/generalize-indexing-schema-version
Draft

Generalize indexing schema versions#1284
jwils wants to merge 1 commit into
joshuaw/indexer-ingestion-adaptersfrom
joshuaw/generalize-indexing-schema-version

Conversation

@jwils

@jwils jwils commented Jul 1, 2026

Copy link
Copy Markdown
Collaborator

Why

The indexing event decoder contract should not force non-JSON transports to expose JSON-specific schema versioning. Proto/Kafka decoders can omit schema_version, while JSON ingestion owns the json_schema_version mapping when needed.

What

  • Replace indexer event/output usage of json_schema_version with generic schema_version
  • Add a JSON ingestion JSON Lines decoder that maps json_schema_version to schema_version
  • Add schema artifact wrappers for generic version selection and envelope validation adaptation
  • Update warehouse partition/log naming, docs, RBS, and tests for the generic event contract

Risk Assessment

Medium: this changes core indexing event normalization and warehouse log keys, but JSON ingestion compatibility is preserved through the new decoder and the affected unit suites pass.

References

@jwils jwils force-pushed the joshuaw/generalize-indexing-schema-version branch from 690e775 to ec0cb6b Compare July 1, 2026 01:25
@jwils jwils changed the title Generalize indexing schema version Allow omitted JSON schema versions Jul 1, 2026
@jwils jwils force-pushed the joshuaw/generalize-indexing-schema-version branch from ec0cb6b to ab31afa Compare July 1, 2026 01:51
@jwils jwils changed the title Allow omitted JSON schema versions Generalize indexing schema versions Jul 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant