Skip to content

Commit da13bf2

Browse files
authored
Update README.md for float8 unification (#895)
1 parent b2e1d49 commit da13bf2

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

torchao/float8/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,8 @@ throughput speedups of up to 1.5x on 128 GPU LLaMa 3 70B pretraining jobs.
1111

1212
:warning: <em>The codebase is stable, but backwards compatibility is not yet guaranteed.</em>
1313

14+
:warning: <em>These APIs are training-only and float8-only, and we plan to [unify them with the rest of torchao](https://github.com/pytorch/ao/issues/894) in the future.</em>
15+
1416
# Single GPU User API
1517

1618
We provide three per-tensor scaling strategies: dynamic, delayed and static. See https://arxiv.org/pdf/2209.05433.pdf, Section 4.3 for more details. These strategies are configurable separately for activations (`input`), weights (`weight`) and gradients (`grad_output`).

0 commit comments

Comments
 (0)