Skip to content

Commit 3c01f4c

Browse files
omrishivLeiWang1999
authored andcommitted
[Doc][Neuron] add note to neuron documentation about resolving triton issue (vllm-project#9257)
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com> Signed-off-by: LeiWang1999 <leiwang1999@outlook.com>
1 parent 0f75509 commit 3c01f4c

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/source/getting_started/neuron-installation.rst

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,10 @@ Installation steps:
2727

2828
.. _build_from_source_neuron:
2929

30+
.. note::
31+
32+
The currently supported version of Pytorch for Neuron installs `triton` version `2.1.0`. This is incompatible with vLLM >= 0.5.3. You may see an error `cannot import name 'default_dump_dir...`. To work around this, run a `pip install --upgrade triton==3.0.0` after installing the vLLM wheel.
33+
3034
Build from source
3135
-----------------
3236

0 commit comments

Comments
 (0)