Skip to content

Commit b844c67

Browse files
committed
Update index.rst
1 parent ac8e8fc commit b844c67

File tree

1 file changed

+28
-0
lines changed
  • docs/source/user_guide/large_language_model

1 file changed

+28
-0
lines changed

docs/source/user_guide/large_language_model/index.rst

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,9 +4,37 @@
44
Large Language Model
55
####################
66

7+
Oracle Cloud Infrastructure (OCI) provides fully managed infrastructure to work with Large Language Model (LLM).
8+
9+
Train and Deploy LLM
10+
********************
11+
You can train LLM at scale with multi-node and multi-GPU using `Data Science Jobs (Jobs) <https://docs.oracle.com/en-us/iaas/data-science/using/jobs-about.htm>`_, and deploy it with `Data Science Model Deployment (Model Deployments) <https://docs.oracle.com/en-us/iaas/data-science/using/model-dep-about.htm>`_. The following blog posts show examples training and deploying Llama2 models:
12+
13+
* `Multi-GPU multinode fine-tuning Llama2 on OCI Data Science <https://blogs.oracle.com/ai-and-datascience/post/multi-gpu-multi-node-finetuning-llama2-oci>`_
14+
* `Deploy Llama 2 in OCI Data Science <https://blogs.oracle.com/ai-and-datascience/post/llama2-oci-data-science-cloud-platform>`_
15+
* `Quantize and deploy Llama 2 70B on cost-effective NVIDIA A10 Tensor Core GPUs in OCI Data Science <https://blogs.oracle.com/ai-and-datascience/post/quantize-deploy-llama2-70b-costeffective-a10s-oci>`_
16+
17+
18+
Integration with LangChain
19+
**************************
20+
ADS is designed to work with LangChain, enabling developers to incorporate various LangChain components and models deployed on OCI seamlessly into their applications. Additionally, ADS can package LangChain applications and deploy it as a REST API endpoint using OCI Data Science Model Deployment.
21+
22+
23+
.. admonition:: Installation
24+
:class: note
25+
26+
Install ADS and other dependencies for LLM integrations.
27+
28+
.. code-block:: bash
29+
30+
$ python3 -m pip install "oracle-ads[llm]"
31+
32+
733
834
.. toctree::
935
:hidden:
1036
:maxdepth: 2
1137

38+
training_llm
1239
deploy_langchain_application
40+
retrieval

0 commit comments

Comments
 (0)