Skip to content

Add basic fp8/bfp8 support, future implementations of 8-bit floating …#3374

Open
Geramy wants to merge 1 commit intoml-explore:mainfrom
Geramy:geramy/fp8_support
Open

Add basic fp8/bfp8 support, future implementations of 8-bit floating …#3374
Geramy wants to merge 1 commit intoml-explore:mainfrom
Geramy:geramy/fp8_support

Conversation

@Geramy
Copy link
Copy Markdown

@Geramy Geramy commented Apr 4, 2026

…point functions next.

Proposed changes

The proposed changes are to include fp8 and bfp8 support.

Checklist

Put an x in the boxes that apply.

  • I have read the CONTRIBUTING document
  • I have run pre-commit run --all-files to format my code / installed pre-commit prior to committing changes
  • I have added tests that prove my fix is effective or that my feature works

@zcbenz
Copy link
Copy Markdown
Collaborator

zcbenz commented Apr 6, 2026

Rather than float8/bfloat8, I think it is more common using names like float8_e4m3/float8_e5m2, and there are also a few other float8 types (e.g. e8m0) that we should consider in advance.

JAX's float8 types: https://github.com/jax-ml/ml_dtypes
CUTLASS: https://github.com/NVIDIA/cutlass/blob/main/include/cutlass/float8.h

I think we should have a consensus on the type names with the team first.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants