Skip to content

Commit c1261d7

Browse files
committed
Updated pr.
1 parent 03c00fa commit c1261d7

File tree

2 files changed

+8
-7
lines changed

2 files changed

+8
-7
lines changed
Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
.. admonition:: Distributed Training with OCI Data Science
2+
:class: note
3+
4+
You need to configure your `networking <https://docs.oracle.com/en-us/iaas/Content/Network/Concepts/overview.htm>`_
5+
and `IAM <https://docs.oracle.com/en-us/iaas/Content/Identity/Concepts/overview.htm>`_ policies.
6+
We recommend running the training on a private subnet.
7+
In this example, internet access is needed to download the source code and the pre-trained model.

docs/source/user_guide/large_language_model/training_llm.rst

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -7,13 +7,7 @@ Oracle Cloud Infrastructure (OCI) `Data Science Jobs (Jobs) <https://docs.oracle
77
provides fully managed infrastructure to enable training large language model at scale.
88
This page shows an example of fine-tuning the `Llama 2 <https://ai.meta.com/llama/>`_ model. For model details on the APIs, see :doc:`../jobs/run_pytorch_ddp`.
99

10-
.. admonition:: Distributed Training with OCI Data Science
11-
:class: note
12-
13-
You need to configure your `networking <https://docs.oracle.com/en-us/iaas/Content/Network/Concepts/overview.htm>`_
14-
and `IAM <https://docs.oracle.com/en-us/iaas/Content/Identity/Concepts/overview.htm>`_ policies.
15-
We recommend running the training on a private subnet.
16-
In this example, internet access is needed to download the source code and the pre-trained model.
10+
.. include:: ../_template/distributed_training_policies.rst
1711

1812
The `llama-recipes <https://github.com/facebookresearch/llama-recipes>`_ repository contains example code to fine-tune llama2 model.
1913
The example `fine-tuning script <https://github.com/facebookresearch/llama-recipes/blob/1aecd00924738239f8d86f342b36bacad180d2b3/examples/finetuning.py>`_ supports both full parameter fine-tuning

0 commit comments

Comments
 (0)