Commit 1b3518d
committed
[Java IO] Add ArrowFlight IO connector
Add a new IO connector for Apache Arrow Flight, enabling high-performance
data transfer over gRPC using the Arrow columnar format.
Includes read (BoundedSource) and write (DoFn with doPut) support with
endpoint-level split parallelism and bearer token authentication.
Fixes #201161 parent 7620a93 commit 1b3518d
8 files changed
Lines changed: 1106 additions & 0 deletions
File tree
- buildSrc/src/main/groovy/org/apache/beam/gradle
- sdks/java/io/arrow-flight
- src
- main/java/org/apache/beam/sdk/io/arrowflight
- test/java/org/apache/beam/sdk/io/arrowflight
- website/www/site/content/en/documentation/io
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
65 | 65 | | |
66 | 66 | | |
67 | 67 | | |
| 68 | + | |
68 | 69 | | |
69 | 70 | | |
70 | 71 | | |
| |||
Lines changed: 2 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
925 | 925 | | |
926 | 926 | | |
927 | 927 | | |
| 928 | + | |
| 929 | + | |
928 | 930 | | |
929 | 931 | | |
930 | 932 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
0 commit comments