Skip to content

Support nested array with struct elements in sort_array #4584

@hsiang-c

Description

@hsiang-c

What is the problem the feature request solves?

When we sort an array<array<struct<...>>> or array<struct<array<...>>>, Comet falls back to Spark b/c DF doesn't support these nested types.

One of our use cases is sort_array(collect_set(named_struct())) and the result of collect_set is of type ArrayType(StructType(... ArrayType(StructType..)))

Describe the potential solution

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestpriority:mediumFunctional bugs, performance regressions, broken features

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions