s3: document format=parquet option and page-level compression

[rituparnakhaund]

Update S3 output plugin documentation to reflect the new format=parquet option that separates output format selection from byte-level compression.

Documents:

• New parquet value for the format option
• Page-level compression codec control via compression when format is parquet
• Migration path from deprecated compression=parquet syntax
• Configuration examples with and without page-level compression
• Updated existing parquet examples to use new syntax

Related code PR: fluent/fluent-bit#11885

Summary by CodeRabbit

• Documentation
  • Updated S3 output docs with additional compression options (including zstd and arrow) and clarified Parquet page-codec behavior.
  • Added a dedicated Parquet section describing how Parquet output works, codec mappings, upload requirements, examples, migration from deprecated syntax, and build prerequisites.
  • Clarified Arrow guidance and revised sample configurations to use the new format/compression settings.

[coderabbitai]

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 4df8d4ed-8fea-454d-9298-91aa8e7ec915

📥 Commits

Reviewing files that changed from the base of the PR and between efda012 and 546958f.

📒 Files selected for processing (1)

• pipeline/outputs/s3.md

---

📝 Walkthrough

Walkthrough

This PR updates the S3 output documentation to comprehensively describe Parquet format capabilities. The compression parameter table is expanded to list new values, followed by a detailed Parquet format section with codec mappings, configuration examples, migration guidance, and build requirements. Arrow format description is clarified, and test examples are updated to use the new format parameter syntax.

Changes

S3 Output Parquet Format Documentation

Layer / File(s)	Summary
Compression and format parameter documentation pipeline/outputs/s3.md	Parameter table updated to document compression support for zstd, arrow, and parquet, and format parameter now includes parquet with note that page-level codec is controlled by compression.
Parquet format section, examples, and format guidance pipeline/outputs/s3.md	Introduces comprehensive Parquet format section documenting format parquet behavior, Parquet page codec mappings for compression values, use_put_object On requirement, YAML and fluent-bit.conf examples, migration from deprecated compression=parquet, and build requirements. Arrow description clarified to specify compression: arrow produces Apache Arrow (Feather) output. Test configuration examples updated to use format: parquet and compression: snappy.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~8 minutes

Possibly related PRs

• fluent/fluent-bit-docs#2570: Modifies the same S3 output documentation around the format parameter, including Parquet and related format options.
• fluent/fluent-bit-docs#2359: Updates pipeline/outputs/s3.md compression option documentation with Parquet/Arrow prerequisites.
• fluent/fluent-bit-docs#2111: Updates pipeline/outputs/s3.md with Parquet codec mapping, build requirements, and example configurations—directly overlapping with this PR's Parquet documentation.

Suggested labels

5.0

Suggested reviewers

• eschabell
• cosmo0920
• patrick-stephens

Poem

🐰 Logs in rows and columns neat,
Parquet pages, codecs meet,
Arrow feathers, snappy streams,
Docs now bridge our format dreams,
Hop, test, and ship — the data's sweet!

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title accurately summarizes the main changes: documenting the new format=parquet option and how page-level compression is controlled.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[eschabell]

@rituparnakhaund thanks for the docs PR, I pushed a fix for vale issues and now just waiting on code PR merging.