Skip to content

Commit b2de39f

Browse files
committed
Update overview.rst, runtime_non_byoc.rst, and 12 more files...
1 parent d33be59 commit b2de39f

File tree

10 files changed

+37
-36
lines changed

10 files changed

+37
-36
lines changed

docs/source/user_guide/jobs/data_science_job.rst

Lines changed: 9 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ Quick Start
66
Before creating a job, ensure that you have policies configured for Data Science resources.
77
See also: :doc:`policies` and `About Data Science Policies <https://docs.oracle.com/en-us/iaas/data-science/using/policies.htm>`_.
88

9-
.. include:: ../jobs/components/toc_local.rst
9+
.. include:: ../jobs/toc_local.rst
1010

1111
Define a Job
1212
============
@@ -15,20 +15,21 @@ In ADS, a job is defined by :doc:`infra_and_runtime`.
1515
The Data Science Job infrastructure is configured through a :py:class:`~ads.jobs.DataScienceJob` instance.
1616
The runtime can be an instance of:
1717

18-
.. include:: ../jobs/components/runtime_types.rst
18+
.. include:: ../jobs/runtime_types.rst
1919

20-
Here is an example to define and run a Python :py:class:`~ads.jobs.Job` with the source code from an http
21-
`link <https://github.com/oracle-samples/oci-data-science-ai-samples/blob/432357b123b7401ef67b116fe19aec217ca920f0/jobs/python/job%2Bsamples/greeting-env-cmd.py>`_:
20+
Here is an example to define and run a Python :py:class:`~ads.jobs.Job`.
2221

2322
.. include:: ../jobs/tabs/quick_start_job.rst
2423

25-
The source code can be a script, a Jupyter notebook, a folder or a zip file.
26-
The source code location can be a local or remote, including OCI Object Storage.
27-
2824
The :py:class:`~ads.jobs.PythonRuntime` is designed for :doc:`Running a Python Workload <run_python>`.
29-
You can also :doc:`run_notebook`, :doc:`run_script` and :doc:`run_git`
25+
The source code is specified by :py:meth:`~ads.jobs.PythonRuntime.with_source` (``path/to/script.py``).
26+
It can be a script, a Jupyter notebook, a folder or a zip file.
27+
The source code location can be a local or remote, including HTTP URL and OCI Object Storage.
28+
An `example Python script <https://github.com/oracle-samples/oci-data-science-ai-samples/blob/master/jobs/python/job%2Bsamples/greeting-env-cmd.py>`_
29+
is available on `Data Science AI Sample GitHub Repository <https://github.com/oracle-samples/oci-data-science-ai-samples>`_.
3030

3131
For more details, see :doc:`infra_and_runtime` configurations.
32+
You can also :doc:`run_notebook`, :doc:`run_script` and :doc:`run_git`.
3233

3334

3435
YAML

docs/source/user_guide/jobs/index.rst

Lines changed: 15 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,19 @@
22
Data Science Jobs
33
#################
44

5-
.. include:: ../jobs/components/overview.rst
5+
.. include:: ../jobs/overview.rst
66

7-
.. include:: ../jobs/toc.rst
7+
.. toctree::
8+
:maxdepth: 1
9+
10+
../jobs/data_science_job
11+
../jobs/policies
12+
../jobs/infra_and_runtime
13+
../jobs/run_python
14+
../jobs/run_notebook
15+
../jobs/run_script
16+
../jobs/run_container
17+
../jobs/run_git
18+
../cli/opctl/_template/jobs
19+
../cli/opctl/_template/monitoring
20+
../cli/opctl/localdev/local_jobs

docs/source/user_guide/jobs/infra_and_runtime.rst

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ Infrastructure and Runtime
33

44
This page describes the configurations of **Infrastructure** and **Runtime** defining a Data Science Job.
55

6-
.. include:: ../jobs/components/toc_local.rst
6+
.. include:: ../jobs/toc_local.rst
77

88
Example
99
=======
@@ -122,7 +122,7 @@ and other configurations for the environment to run the workload.
122122
Depending on the source code, ADS provides different types of *runtime* for defining a data science job,
123123
including:
124124

125-
.. include:: ../jobs/components/runtime_types.rst
125+
.. include:: ../jobs/runtime_types.rst
126126

127127

128128
Environment Variables

docs/source/user_guide/jobs/components/overview.rst renamed to docs/source/user_guide/jobs/overview.rst

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,8 @@ You can also sequence jobs and keep the state by writing state information to
2020
`Object Storage <https://docs.oracle.com/en-us/iaas/Content/Object/Concepts/objectstorageoverview.htm>`_
2121

2222
For example, you may want to experiment with how different model classes perform on the same training data
23-
by using the [ADSTuner](https://accelerated-data-science.readthedocs.io/en/latest/user_guide/model_training/ads_tuner.html) to perform hyperparameter tuning on each model class.
23+
by using the `ADSTuner <https://accelerated-data-science.readthedocs.io/en/latest/user_guide/model_training/ads_tuner.html>`_
24+
to perform hyperparameter tuning on each model class.
2425
You could do this in parallel by having a different job run for each class of models.
2526
For a given job run, you could pass an environment variable that identifies the model class that you want to use.
2627
Each model can write its results to the Logging service or Object Storage.

docs/source/user_guide/jobs/run_python.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ You can configure the environment variables, command line arguments and conda en
66
as described in :doc:`infra_and_runtime`. This section shows the additional enhancements provided by
77
:py:class:`~ads.jobs.PythonRuntime`.
88

9-
.. include:: ../jobs/components/toc_local.rst
9+
.. include:: ../jobs/toc_local.rst
1010

1111
Here is an example to define and run a job using :py:class:`~ads.jobs.PythonRuntime`:
1212

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,11 @@
11
* :py:class:`~ads.jobs.PythonRuntime`
22
for Python code stored locally, OCI object storage, or other remote location supported by
3-
`fsspec <https://filesystem-spec.readthedocs.io/en/latest/>`_. See :doc:`run_python`.
3+
`fsspec <https://filesystem-spec.readthedocs.io/en/latest/>`_. See :doc:`../jobs/run_python`.
44
* :py:class:`~ads.jobs.GitPythonRuntime`
5-
for Python code from a Git repository. See :doc:`run_git`.
5+
for Python code from a Git repository. See :doc:`../jobs/run_git`.
66
* :py:class:`~ads.jobs.NotebookRuntime`
77
for a single Jupyter notebook stored locally, OCI object storage, or other remote location supported by
8-
`fsspec <https://filesystem-spec.readthedocs.io/en/latest/>`_. See :doc:`run_notebook`.
8+
`fsspec <https://filesystem-spec.readthedocs.io/en/latest/>`_. See :doc:`../jobs/run_notebook`.
99
* :py:class:`~ads.jobs.ScriptRuntime`
1010
for bash or shell scripts stored locally, OCI object storage, or other remote location supported by
11-
`fsspec <https://filesystem-spec.readthedocs.io/en/latest/>`_. See :doc:`run_script`.
11+
`fsspec <https://filesystem-spec.readthedocs.io/en/latest/>`_. See :doc:`../jobs/run_script`.
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
1-
.. include:: ../jobs/components/runtime_non_byoc.rst
1+
.. include:: ../jobs/runtime_non_byoc.rst
22

33
* :py:class:`~ads.jobs.ContainerRuntime` for container images.

docs/source/user_guide/jobs/toc.rst

Lines changed: 0 additions & 14 deletions
This file was deleted.
File renamed without changes.

docs/source/user_guide/pipeline/pipeline_step.rst

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -93,7 +93,7 @@ When constructing a Custom Scrip step ``infrastructure``, you specify the Comput
9393

9494
A Custom Script step can have different types of ``runtime`` depending on the source code you run:
9595

96-
.. include:: ../jobs/components/runtime_non_byoc.rst
96+
.. include:: ../jobs/runtime_non_byoc.rst
9797

9898
All of these runtime options allow you to configure a `Data Science Conda Environment <https://docs.oracle.com/iaas/data-science/using/conda_understand_environments.htm>`__ for running your code.
9999

@@ -182,7 +182,7 @@ To define a Custom Script step with ``PythonRuntime`` you can use:
182182
kind: runtime
183183
spec:
184184
conda:
185-
slug: pytorch19_p37_cpu_v1
185+
slug: pytorch110_p38_cpu_v1
186186
type: service
187187
entrypoint: zip_or_dir/my_package/entry.py
188188
outputDir: output
@@ -200,7 +200,7 @@ To define a Custom Script step with ``PythonRuntime`` you can use:
200200

201201
runtime = (
202202
PythonRuntime()
203-
.with_service_conda("pytorch19_p37_cpu_v1")
203+
.with_service_conda("pytorch110_p38_cpu_v1")
204204
# The job artifact directory is named "zip_or_dir"
205205
.with_source("local/path/to/zip_or_dir", entrypoint="zip_or_dir/my_package/entry.py")
206206
# Change the working directory to be inside the job artifact directory

0 commit comments

Comments
 (0)