Commit 4c9ac83
authored
Update beginner documentation (#1822)
SUMMARY:
While exploring the LLM-Compressor project, I noticed that several
beginner-level examples in the documentation were out of date and no
longer run as written. This PR aims to fix these small issues, making
the docs use non-deprecated code. A summary of the changes is below:
- Utilize `SamplingParams` as an input to `model.generate()` since old
code no longer worked
- Align CLI + `curl` examples: use "TinyLlama-1.1B-Chat-v1.0-INT8"
consistently (removes `./` prefix but keeps model key consistent between
`vllm serve` and `curl`)
- Update import paths as needed
These changes affect only documentation, not runtime code.
TEST PLAN:
All changes here **only affect documentation**. All changes to the
example code blocks were tested locally on a blank Python 3.9 conda
environment with `llmcompressor` and `vllm` installed.
Signed-off-by: Rayan Syed <rsyed@bu.edu>1 parent a7bc45d commit 4c9ac83
File tree
3 files changed
+13
-7
lines changed- docs
- getting-started
- guides
3 files changed
+13
-7
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
24 | 24 | | |
25 | 25 | | |
26 | 26 | | |
27 | | - | |
| 27 | + | |
28 | 28 | | |
29 | 29 | | |
30 | | - | |
31 | | - | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
32 | 34 | | |
33 | 35 | | |
34 | 36 | | |
| |||
39 | 41 | | |
40 | 42 | | |
41 | 43 | | |
42 | | - | |
| 44 | + | |
43 | 45 | | |
44 | 46 | | |
45 | 47 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
38 | 38 | | |
39 | 39 | | |
40 | 40 | | |
41 | | - | |
| 41 | + | |
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
69 | 69 | | |
70 | 70 | | |
71 | 71 | | |
72 | | - | |
| 72 | + | |
73 | 73 | | |
74 | 74 | | |
75 | 75 | | |
| |||
88 | 88 | | |
89 | 89 | | |
90 | 90 | | |
91 | | - | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
92 | 96 | | |
93 | 97 | | |
94 | 98 | | |
| |||
0 commit comments