chore: Update torch to 2.11

[gkumbhat]

Description of the change

Update upper limit of torch to 2.11

Related issues or PRs

N/A

How to verify the PR

Was the PR tested

• I have added >=1 unit test(s) for every new method I have added (if that coverage is difficult, please briefly explain the reason)
• I have ensured all unit tests pass

Checklist for passing CI/CD:

• All commits are signed showing "Signed-off-by: Name <email@domain.com>" with git commit -signoff or equivalent
• PR title and commit messages adhere to Conventional Commits
• Contribution is formatted with tox -e fix
• Contribution passes linting with tox -e lint
• Contribution passes spellcheck with tox -e spellcheck
• Contribution passes all unit tests with tox -e unit

Note: CI/CD performs unit tests on multiple versions of Python from a fresh install. There may be differences with your local environment and the test environment.

[andrea-fasoli]

@gkumbhat we encounter similar problems with llmcompressor as in the case of transformers 5.x upgrade.
The current release of llmcompressor == 0.10.0.2 on pypi does not support pytorch 2.11. This support is available in llmcompressor main branch, which however does not support yet transformers 5.x.

We should be able to advance to pt2.11 as long as we leave llmcompressor optional and only install the fp8-infer dependency group as before.

I will double check that tests are passing with pt2.11.

[andrea-fasoli]

@chichun-charlie-liu I confirmed the unit tests pass. With the pt2.11 update tried here, there are some pylint errors triggered by BertConfig, LlamaConfig, and GraniteConfig. I will check what has changed.

[chichun-charlie-liu]

lgtm, thanks!