File tree Expand file tree Collapse file tree 6 files changed +15
-14
lines changed Expand file tree Collapse file tree 6 files changed +15
-14
lines changed Original file line number Diff line number Diff line change 1919import torch
2020from torch .utils .data import DataLoader
2121NGC_CHECKPOINT_URLS = {}
22- NGC_CHECKPOINT_URLS ["electricity" ] = "https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/versions/21.06.0/zip"
23- NGC_CHECKPOINT_URLS ["traffic" ] = "https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_traffic_amp/versions/21.06.0/zip"
24-
25-
22+ NGC_CHECKPOINT_URLS ["electricity" ] = "https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/versions/22.11.0_amp/zip"
23+ NGC_CHECKPOINT_URLS ["traffic" ] = "https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-traffic/versions/22.11.0_amp/zip"
2624def _download_checkpoint (checkpoint , force_reload ):
2725 model_dir = os .path .join (torch .hub ._get_torch_home (), 'checkpoints' )
2826 if not os .path .exists (model_dir ):
Original file line number Diff line number Diff line change @@ -146,6 +146,9 @@ NVIDIA DGX A100 (1x A100 80GB): bash ./triton/runner/start_NVIDIA-DGX-A100-\(1x-
146146NVIDIA T4: bash ./triton/runner/start_NVIDIA-T4.sh
147147```
148148
149+ If one encounters an error like ` the provided PTX was compiled with an unsupported toolchain ` , follow the steps in
150+ [ Step by step deployment process] ( #step-by-step-deployment-process ) .
151+
149152## Performance
150153The performance measurements in this document were conducted at the time of publication and may not reflect
151154the performance achieved from NVIDIA’s latest software release. For the most up-to-date performance measurements, go to
@@ -2077,7 +2080,7 @@ Please use the data download from the [Main QSG](https://github.com/NVIDIA/DeepL
20772080#### Prepare Checkpoint
20782081Please place a ` checkpoint.pt ` from TFT trained on electricity in ` runner_workspace/checkpoints/electricity_bin/ ` . Note that the ` electricity_bin `
20792082subdirectory may not be created yet. In addition one can download a zip archive of a trained checkpoint
2080- [ here] ( https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/ versions/21.06.0 /zip )
2083+ [ here] ( https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/ versions/22.11.0_amp /zip )
20812084
20822085#### Setup Container
20832086Build and run a container that extends the NGC PyTorch container with the Triton Inference Server client libraries and dependencies.
@@ -2242,7 +2245,7 @@ mkdir -p ${SHARED_DIR}/input_data
22422245python triton/prepare_input_data.py \
22432246 --input-data-dir ${SHARED_DIR} /input_data/ \
22442247 --dataset ${DATASETS_DIR} /${DATASET} \
2245- --checkpoint ${CHECKPOINT_DIR} / \
2248+ --checkpoint ${CHECKPOINT_DIR} /
22462249```
22472250
22482251</details >
Original file line number Diff line number Diff line change 11checkpoints :
22- name : electricity_bin
3- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/ versions/21.06.0 /zip
3+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/ versions/22.11.0_amp /zip
44- name : traffic_bin
5- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_traffic_amp/ versions/21.06.0 /zip
5+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-traffic/ versions/22.11.0_amp /zip
66configurations :
77- accelerator : none
88 batch_size :
Original file line number Diff line number Diff line change 11checkpoints :
22- name : electricity_bin
3- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/ versions/21.06.0 /zip
3+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/ versions/22.11.0_amp /zip
44- name : traffic_bin
5- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_traffic_amp/ versions/21.06.0 /zip
5+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-traffic/ versions/22.11.0_amp /zip
66configurations :
77- accelerator : none
88 batch_size :
Original file line number Diff line number Diff line change 11checkpoints :
22- name : electricity_bin
3- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/ versions/21.06.0 /zip
3+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/ versions/22.11.0_amp /zip
44- name : traffic_bin
5- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_traffic_amp/ versions/21.06.0 /zip
5+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-traffic/ versions/22.11.0_amp /zip
66configurations :
77- accelerator : none
88 batch_size :
Original file line number Diff line number Diff line change 11checkpoints :
22- name : electricity_bin
3- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/ versions/21.06.0 /zip
3+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/ versions/22.11.0_amp /zip
44- name : traffic_bin
5- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_traffic_amp/ versions/21.06.0 /zip
5+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-traffic/ versions/22.11.0_amp /zip
66configurations :
77- accelerator : none
88 batch_size :
You can’t perform that action at this time.
0 commit comments