Skip to content

Normalize NVIDIA library paths to /usr/lib/#425

Open
maherthomsi wants to merge 3 commits into
bottlerocket-os:developfrom
maherthomsi:nvidia-normalization
Open

Normalize NVIDIA library paths to /usr/lib/#425
maherthomsi wants to merge 3 commits into
bottlerocket-os:developfrom
maherthomsi:nvidia-normalization

Conversation

@maherthomsi
Copy link
Copy Markdown
Contributor

@maherthomsi maherthomsi commented May 5, 2026

Merge with bottlerocket-os/bottlerocket-core-kit#919
Description of changes:

Normalize NVIDIA library installation paths from /usr/lib/nvidia/tesla/ to the standard /usr/lib/ path. Create backwards-compatibility symlinks in /usr/lib/nvidia/tesla/ pointing back to /usr/lib/ for workloads thatreference the legacy path.

Changes across kmod-6.1-nvidia-r580, kmod-6.12-nvidia-r580, and kmod-6.18-nvidia-r580:

  • Move library installation from nvidia/tesla/ subdirectory to /usr/lib/ directly
  • Add %{_cross_libdir}/nvidia/tesla/* to %files for the backwards-compat symlinks
  • Remove nvidia-ld.so.conf.in (Source302) and all references — no longer needed since libraries are in the standard linker search path
  • Remove nvidia/tesla tmpfiles directory entry

Testing done:

  • Built kernel-kit for both x86_64 and aarch64
  • Published to ECR and built aws-k8s-1.35-nvidia variant AMIs
  • Launched g4dn.xlarge (Tesla T4) node on EKS cluster
  • Verified nvidia-smi works (driver 580.126.09)
  • Verified on host: libraries at /usr/lib/, symlinks at /usr/lib/nvidia/tesla/../../<lib>
  • Verified in container: libraries mounted at /usr/lib/, symlinks at /usr/lib/nvidia/tesla//usr/lib/<lib>
  • Ran nvidia smoke tests - all passed

Terms of contribution:

By submitting this pull request, I agree that this contribution is dual-licensed under the terms of both the Apache License, version 2.0, and the MIT license.

@maherthomsi maherthomsi changed the title Normalize library paths to /usr/lib/ Normalize NVIDIA library paths to /usr/lib/ May 5, 2026
@mgsharm
Copy link
Copy Markdown
Contributor

mgsharm commented May 5, 2026

Can we have separate commits for each kmod. Also the commit is not signed and doesn't have Signed-off-by.

@maherthomsi
Copy link
Copy Markdown
Contributor Author

Split up commits for each kmod. Signed commits and added Signed off by to commits

Move nvidia libraries from /usr/lib/nvidia/tesla/ to the standard
/usr/lib/ path. Create backwards-compatibility symlinks in
/usr/lib/nvidia/tesla/ pointing back to /usr/lib/.

Remove nvidia-ld.so.conf.in (Source302) and its references since
libraries are now in the standard linker search path. Remove the
tmpfiles entry for the nvidia/tesla directory.

Signed-off-by: Maher Homsi <maherhom@amazon.com>
Move nvidia libraries from /usr/lib/nvidia/tesla/ to the standard
/usr/lib/ path. Create backwards-compatibility symlinks in
/usr/lib/nvidia/tesla/ pointing back to /usr/lib/.

Remove nvidia-ld.so.conf.in (Source302) and its references since
libraries are now in the standard linker search path. Remove the
tmpfiles entry for the nvidia/tesla directory.

Signed-off-by: Maher Homsi <maherhom@amazon.com>
Move nvidia libraries from /usr/lib/nvidia/tesla/ to the standard
/usr/lib/ path. Create backwards-compatibility symlinks in
/usr/lib/nvidia/tesla/ pointing back to /usr/lib/.

Remove nvidia-ld.so.conf.in (Source302) and its references since
libraries are now in the standard linker search path. Remove the
tmpfiles entry for the nvidia/tesla directory.

Signed-off-by: Maher Homsi <maherhom@amazon.com>
@maherthomsi maherthomsi force-pushed the nvidia-normalization branch from 66fe31d to a06d78e Compare May 11, 2026 17:57
@maherthomsi
Copy link
Copy Markdown
Contributor Author

Force push to fix merge conflicts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants