Skip to content

Arrow: bump to 24.0.0; thrift: bump to 0.22#6177

Open
aalkin wants to merge 8 commits intoalisw:masterfrom
aalkin:enable-thrift-and-parquet
Open

Arrow: bump to 24.0.0; thrift: bump to 0.22#6177
aalkin wants to merge 8 commits intoalisw:masterfrom
aalkin:enable-thrift-and-parquet

Conversation

@aalkin
Copy link
Copy Markdown
Collaborator

@aalkin aalkin commented Mar 11, 2026

  • Bump version of thrift to current (0.22)
  • Move thrift building to cmake instead of configure
  • Add thrift as a dependency to Arrow, so that Parquet is enabled
  • Bump arrow version to current (24.0.0)

@aalkin aalkin requested a review from a team as a code owner March 11, 2026 11:29
@aalkin aalkin changed the title Arrow: enable Parquet Arrow: bump to 23.0.1 and enable Parquet Mar 12, 2026
@aalkin
Copy link
Copy Markdown
Collaborator Author

aalkin commented Mar 12, 2026

Aparently this will require some small changes to O2, as usage of compute functions now requires a call to arrow::compute::Initialize().

@ktf
Copy link
Copy Markdown
Member

ktf commented Mar 12, 2026

Can we hide that behind an #if __has_include?

Comment thread thrift.sh Outdated
Co-authored-by: Giulio Eulisse <10544+ktf@users.noreply.github.com>
@aalkin
Copy link
Copy Markdown
Collaborator Author

aalkin commented Mar 12, 2026

Yes, it can be hidden. From what I understand, now arrow does not preload all the compute libraries by default, which should be good for the memory consumption. So I need to identify contexts where we rely on compute functions (not Gandiva), which are probably only the slicing and index building, where I can call Initialize as late as possible.

@aalkin aalkin marked this pull request as draft March 12, 2026 17:07
@aalkin
Copy link
Copy Markdown
Collaborator Author

aalkin commented Mar 13, 2026

Draft until AliceO2Group/AliceO2#15152 is integrated.

@aalkin aalkin marked this pull request as ready for review March 16, 2026 10:06
Comment thread thrift.sh
Comment thread thrift.sh Outdated
Comment thread thrift.sh
Co-authored-by: Anton Alkin <anton.alkin@cern.ch>
@aalkin
Copy link
Copy Markdown
Collaborator Author

aalkin commented Mar 16, 2026

@singiamtel @ktf it looks like mac CI has bison version 2.3, while thrift requires at least 2.5 (note that the current on homebrew is 3.8.2).

@aalkin
Copy link
Copy Markdown
Collaborator Author

aalkin commented Mar 17, 2026

I've made a PR for homebrew-system-deps to include homebrew-provided bison alisw/homebrew-system-deps#67

Comment thread arrow.sh Outdated
@aalkin aalkin changed the title Arrow: bump to 23.0.1 and enable Parquet Arrow: bump to 23.0.1 Mar 17, 2026
@aalkin aalkin changed the title Arrow: bump to 23.0.1 Arrow: bump to 23.0.1 and thrift to 0.22 Mar 17, 2026
@aalkin aalkin changed the title Arrow: bump to 23.0.1 and thrift to 0.22 Arrow: bump to 23.0.1; thrift: bump to 0.22 Mar 17, 2026
Comment thread arrow.sh Outdated
Comment thread arrow.sh Outdated
Co-authored-by: Anton Alkin <anton.alkin@cern.ch>
@aalkin aalkin changed the title Arrow: bump to 23.0.1; thrift: bump to 0.22 Arrow: bump to 24.0.0; thrift: bump to 0.22 Apr 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants