File tree Expand file tree Collapse file tree 2 files changed +3
-1
lines changed
vLLM/01-offline-inference_neuron Expand file tree Collapse file tree 2 files changed +3
-1
lines changed Original file line number Diff line number Diff line change @@ -38,7 +38,7 @@ Last updated: Mar 31, 2024
3838- (Feb 2024) [ AWS Tranium 기반 위에 llama-2-7B 및 Dolly Dataset 으로 파인 튜닝] ( hf-optimum/02-Fine-tune-Llama-7B-Trn1/README.md )
3939
4040## 2.3. vLLM on Inferentia/Trainium
41- - (Mar 2024) [ vLLM 으로 Inferentia2 (inf2.48xlarge)에서 배치성 추론 하기] ( vLLM/01-offline-inference_neuron/Readme.md )
41+ - (Mar 2024) SOLAR-10.7B-instruct, yanolja-KoSOLAR-10.7B 배치 추론 함: [ vLLM 으로 Inferentia2 (inf2.48xlarge)에서 배치성 추론 하기] ( vLLM/01-offline-inference_neuron/Readme.md )
4242
4343# 3. 관련 블로그
4444- [ 주요 블로그 보기] ( blog/Readme.md )
Original file line number Diff line number Diff line change @@ -71,6 +71,8 @@ Last Update: Mar 31, 2024
7171 - ![ select_neuronx.jpg] ( img/select_neuronx.jpg )
7272- 아래를 클릭하여 노트북을 샐행 하세요.
7373 - [ 01-offline_inference_neuron.ipynb] ( 01-offline_inference_neuron.ipynb )
74+ - [ 02-SOLAR-10.7B-Instruct-offline_inference_neuron.ipynb] ( 02-SOLAR-10.7B-Instruct-offline_inference_neuron.ipynb )
75+ - [ 03-yanolja-KoSOLAR-10.7B-v02-offline_inference_neuron.ipynb] ( 03-yanolja-KoSOLAR-10.7B-v02-offline_inference_neuron.ipynb )
7476
7577
7678
You can’t perform that action at this time.
0 commit comments