Skip to content

Catalog using S3 List and Hive partitioning #11

Description

@rdettai

It would be valuable to make it possible to dynamically create a partitioned catalog from the S3 file structure.

  • Create a new TableProvider that uses S3 List and the folder structure to create a file table
  • Implement the SplittableTable that using this provider
  • Cache this catalog to increase speed on subsequent calls
  • Add S3 List access to the Fuse

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions