Skip to content

Convert AQEShuffleReadExec to native implementation. #2125

@guixiaowen

Description

@guixiaowen

Convert AQEShuffleReadExec to native implementation

eg:

select /*+ REBALANCE(a) */ * from xxx_uuu_xxxx_datasource

after convert

InputAdapter
+- AQEShuffleRead coalesced
+- ShuffleQueryStage 0
+- NativeShuffleExchange hashpartitioning(a#0, 1000), REBALANCE_PARTITIONS_BY_COL, [id=#24]
+- InputAdapter [#0]
+- NativeOrcScan test.xxx_uuu_xxxx_datasource (FileScan orc bigdata_qa.xxx_uuu_xxxx_datasource[a#0] Batched: true, DataFilters: [], Format: ORC, Location: InMemoryFileIndex(1 paths)[-----, PartitionFilters: [], PushedFilters: [], ReadSchema: struct<a:string>)

AQEShuffleReadExec never convert to native

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions