release 2.5.7

Author: liudmylaru

CONTRIBUTING.md

@@ -0,0 +1,53 @@
+# Contributing to this repository
+
+We welcome your contributions! There are multiple ways to contribute.
+
+## Opening issues
+
+For bugs or enhancement requests, file a GitHub issue unless it's
+security related. When filing a bug, remember that the better written the bug is,
+the more likely it is to be fixed. If you think you've found a security
+vulnerability, don't raise a GitHub issue and follow the instructions in our
+[security policy](./SECURITY.md).
+
+## Contributing code
+
+We welcome your code contributions. Before submitting code using a pull request,
+you must sign the [Oracle Contributor Agreement](https://oca.opensource.oracle.com) (OCA) and
+your commits need to include the following line using the name and e-mail
+address you used to sign the OCA:
+
+```text
+Signed-off-by: Your Name <you@example.org>
+```
+
+This can be automatically added to pull requests by committing with `--sign-off`
+or `-s`, for example:
+
+```text
+git commit --signoff
+```
+
+Only pull requests from committers that can be verified as having signed the OCA
+are accepted.
+
+## Pull request process
+
+1. Ensure there is an issue created to track and discuss the fix or enhancement
+   you intend to submit.
+2. Fork this repository.
+3. Create a branch in your fork to implement the changes. We recommend using
+   the issue number as part of your branch name, for example `1234-fixes`.
+4. Ensure that any documentation is updated with the changes that are required
+   by your change.
+5. Ensure that any samples are updated if the base image has been changed.
+6. Submit the pull request. *Don't leave the pull request blank*. Explain exactly
+   what your changes are meant to do and provide simple steps about how to validate
+   your changes. Ensure that you reference the issue you created as well.
+7. We assign the pull request to 2-3 people for review before it is merged.
+
+## Code of conduct
+
+Follow the [Golden Rule](https://en.wikipedia.org/wiki/Golden_Rule). If you'd
+like more specific guidelines, see the 
+[Contributor Covenant Code of Conduct](https://www.contributor-covenant.org/version/1/4/code-of-conduct/).

LICENSE.txt

@@ -0,0 +1,35 @@
+Copyright (c) 2020, 2022 Oracle and/or its affiliates.
+
+The Universal Permissive License (UPL), Version 1.0
+
+Subject to the condition set forth below, permission is hereby granted to any
+person obtaining a copy of this software, associated documentation and/or data
+(collectively the "Software"), free of charge and under any and all copyright
+rights in the Software, and any and all patent rights owned or freely
+licensable by each licensor hereunder covering either (i) the unmodified
+Software as contributed to or provided by such licensor, or (ii) the Larger
+Works (as defined below), to deal in both
+
+(a) the Software, and
+(b) any piece of software and/or hardware listed in the lrgrwrks.txt file if
+one is included with the Software (each a "Larger Work" to which the Software
+is contributed by such licensors),
+
+without restriction, including without limitation the rights to copy, create
+derivative works of, display, perform, and distribute the Software and make,
+use, sell, offer for sale, import, export, have made, and have sold the
+Software and the Larger Work(s), and to sublicense the foregoing rights on
+either these or other terms.
+
+This license is subject to the following condition:
+The above copyright notice and either this complete permission notice or at
+a minimum a reference to the UPL must be included in all copies or
+substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

MANIFEST.in

@@ -0,0 +1,21 @@
+include LICENSE.txt
+include THIRD_PARTY_LICENSES.txt
+include ads/ads_version.json
+include ads/common/*.json
+include ads/feature_engineering/*.json
+include ads/templates/*.jinja2
+include ads/common/function/*.yaml
+include ads/common/artifact/*.*
+include ads/jobs/schema/**
+include ads/opctl/index.yaml
+include ads/opctl/operators/**/*.py
+include ads/opctl/docker/**
+include ads/opctl/conda/manifest_template.yaml
+global-exclude tests/**
+global-exclude notebooks/**
+exclude tests/**
+exclude notebooks/**
+exclude build/lib/tests/**
+exclude build/lib/notebooks/**
+exclude benchmark/**
+include ads/ads

Makefile

@@ -0,0 +1,12 @@
+
+dist: clean
+	@python3 setup.py sdist bdist_wheel
+
+publish: dist
+	@twine upload dist/*
+
+clean:
+	@rm -rf dist build oracle_ads.egg-info
+	@find ./ -name '*.pyc' -exec rm -f {} \;
+	@find ./ -name 'Thumbs.db' -exec rm -f {} \;
+	@find ./ -name '*~' -exec rm -f {} \;

README-development.md

@@ -0,0 +1,90 @@
+# Summary
+
+The Oracle Accelerated Data Science (ADS) SDK used by data scientists and analysts for
+data exploration and experimental machine learning to democratize machine learning and
+analytics by providing easy-to-use, performant, and user friendly tools that
+brings together the best of data science practices.
+
+The ADS SDK helps you connect to different data sources, perform exploratory data analysis,
+data visualization, feature engineering, model training, model evaluation, and
+model interpretation. ADS also allows you to connect to the model catalog to save and load
+models to and from the catalog.
+
+## Documentation
+
+ - [ads-documentation](https://docs.oracle.com/en-us/iaas/tools/ads-sdk/latest/index.html)
+ - [oci-data-science-ai-samples](https://github.com/oracle/oci-data-science-ai-samples)
+
+## Get Support
+
+- Open a [GitHub issue](https://github.com/oracle/accelerated-data-science/issues) for bug reports, questions, or requests for enhancements.
+- Report a security vulnerability according to the [Reporting Vulnerabilities guide](https://www.oracle.com/corporate/security-practices/assurance/vulnerability/reporting.html).
+
+## Getting started
+
+These are the minimum required steps to install and set up the ADS SDK to run on your local machine
+for development and testing purposes.
+
+### Step 1: Create a conda environment
+
+Install Anaconda from `https://repo.continuum.io/miniconda/` for the operating system you are using.
+
+In the terminal client, enter the following where <yourenvname> is the name you want to call your environment,
+and set the Python version you want to use. ADS SDK requires Python >=3.7.
+
+```bash
+    conda create -n <yourenvname> python=3.7 anaconda
+```
+
+This installs the Python version and all the associated anaconda packaged libraries at `path_to_your_anaconda_location/anaconda/envs/<yourenvname>`
+
+### Step 2: Activate your environment
+
+To activate or switch into your conda environment, run this command:
+
+```bash
+    conda activate <yourenvname>
+```
+
+To list of all your environments, use the `conda env list` command.
+
+### Step 3: Clone ADS and install dependencies
+
+Open the destination folder where you want to clone ADS library, and install dependencies like this:
+
+```bash
+    cd <desctination_folder>
+    git clone git@github.com:oracle/accelerated-data-science.git
+    python3 -m pip install -e .
+```
+
+To which packages were installed and their version numbers, run:
+
+```bash
+    python3 -m pip freeze
+```
+
+### Step 4: Setup configuration files
+
+You should also set up configuration files, see the [SDK and CLI Configuration File](https://docs.cloud.oracle.com/Content/API/Concepts/sdkconfig.htm).
+
+
+### Step 5: Versioning and generation the wheel
+
+Use `ads_version.json` for versioning. The ADS SDK is packaged as a wheel. To generate the wheel, you can run:
+
+```bash
+    python3 setup.py sdist bdist_wheel
+```
+
+This wheel can then be installed using `pip`.
+
+## Security
+
+Consult the [security guide](./SECURITY.md) for our responsible security
+vulnerability disclosure process.
+
+## License
+
+Copyright (c) 2020, 2022 Oracle, Inc. All rights reserved.
+Licensed under the Universal Permissive License v 1.0 as shown at https://oss.oracle.com/licenses/upl.

README.md

@@ -0,0 +1,133 @@
+# Oracle Accelerated Data Science SDK (ADS)
+
+The [Oracle Accelerated Data Science (ADS) SDK](https://docs.oracle.com/en-us/iaas/tools/ads-sdk/latest/index.html) is maintained by the [Oracle Cloud Infrastructure Data Science service](https://docs.oracle.com/en-us/iaas/data-science/using/data-science.htm) team. It speeds up common data science activities by providing tools that automate and/or simplify common data science tasks, along with providing a data scientist friendly pythonic interface to Oracle Cloud Infrastructure (OCI) services, most notably OCI Data Science, Data Flow, Object storage, and the Autonomous Database. ADS gives you an interface to manage the lifecycle of machine learning models, from data acquisition to model evaluation, interpretation, and model deployment.  
+
+With ADS you can:
+
+ - Read datasets from Oracle Object Storage, Oracle RDBMS (ATP/ADW/On-prem), AWS S3 and other sources into `Pandas dataframes`.
+ - Easily compute summary statistics on your dataframes and perform data profiling. 
+ - Tune models using hyperparameter optimization with the `ADSTuner` tool. 
+ - Generate detailed evaluation reports of your model candidates with the `ADSEvaluator` module. 
+ - Save machine learning models to the [OCI Data Science Model Catalog](https://docs.oracle.com/en-us/iaas/data-science/using/models-about.htm).
+ - Deploy those models as HTTP endpoints with [Model Deployment](https://docs.oracle.com/en-us/iaas/data-science/using/model-dep-about.htm).
+ - Launch distributed ETL, data processing, and model training jobs in Spark with [OCI Data Flow](https://docs.oracle.com/en-us/iaas/data-flow/using/home.htm).
+ - Train machine learning models in OCI Data Science [Jobs](https://docs.oracle.com/en-us/iaas/data-science/using/jobs-about.htm). 
+ - Manage the lifecycle of conda environments through the `ads conda` command line interface (CLI). 
+
+## Installation
+
+You have various options when installing ADS.
+
+### Installing the oracle-ads base package
+
+```bash
+  $ python3 -m pip install oracle-ads
+```
+
+### Installing extras libraries
+
+To use ADS within a [Notebook Session](https://docs.oracle.com/en-us/iaas/data-science/using/manage-notebook-sessions.htm) of the OCI Data Science service: 
+
+```bash
+  $ python3 -m pip install oracle-ads[notebook]
+```
+
+For machine learning tasks install
+
+```bash
+  $ python3 -m pip install oracle-ads[boosted]
+```
+
+To work on text related tasks run
+
+```bash
+  $ python3 -m pip install oracle-ads[text]
+```
+
+For access to a broad set of data formats (for example, Excel, Avro, etc.) run
+
+```bash
+  $ python3 -m pip install oracle-ads[data]
+```
+
+**Note**
+
+Multiple extra dependencies can be installed together. For example:
+
+```bash
+  $ python3 -m pip install  oracle-ads[notebook,boosted,text]
+```
+
+## Documentation
+
+  - [Oracle Accelerated Data Science SDK (ADS) Documentation](https://docs.oracle.com/en-us/iaas/tools/ads-sdk/latest/index.html)
+  - [Oracle Cloud Infrastructure Data Science and AI services Examples](https://github.com/oracle/oci-data-science-ai-samples)
+  - [Oracle AI & Data Science Blog](https://blogs.oracle.com/ai-and-datascience/)
+  - [Oracle Cloud Infrastructure Documentation](https://docs.oracle.com/en-us/iaas/data-science/using/data-science.htm)
+
+## Examples
+
+### Load data from Object Storage
+
+```python
+  import ads
+  from ads.common.auth import default_signer
+
+  ads.set_auth(auth="api_key", profile="DEFAULT")
+  bucket_name = <bucket-name>
+  file_name = <file-name>
+  namespace = <namespace>
+  df = pd.read_csv(f"oci://{bucket_name}@{namespace}/{file_name}", storage_options=default_signer())
+```
+
+### Load data from ADB (simple)
+
+```python
+  connection_parameters = {
+      "user_name": "<username>",
+      "password": "<password>",
+      "service_name": "<service_name_{high|med|low}>",
+      "wallet_location": "/full/path/to/my_wallet.zip",
+  }
+  import pandas as pd
+  import ads
+
+  # simple read of a SQL query into a dataframe with no bind variables
+  df = pd.DataFrame.ads.read_sql(
+      "SELECT * FROM SH.SALES",
+      connection_parameters=connection_parameters,
+  )
+```
+
+### Load data from ADB (using sql-injection-safe bind variables)
+
+```python
+  df = pd.DataFrame.ads.read_sql(
+      """
+      SELECT
+      *
+      FROM
+      SH.SALES
+      WHERE
+          ROWNUM <= :max_rows
+      """,
+      bind_variables={
+          max_rows : 100
+      },
+      connection_parameters=connection_parameters,
+  )
+```
+
+## Contributing
+
+This project welcomes contributions from the community. Before submitting a pull request, please review our contribution guide.
+
+Find Getting Started instructions for developers in [README-development.md](./README-development.md)
+
+## Security
+
+Please consult the security guide for our responsible security vulnerability disclosure process.
+
+## License
+
+Copyright (c) 2020, 2022 Oracle and/or its affiliates. Licensed under the Universal Permissive License v 1.0 as shown at https://oss.oracle.com/licenses/upl/

SECURITY.md

@@ -0,0 +1,36 @@
+# Reporting security vulnerabilities
+
+Oracle values the independent security research community and believes that
+responsible disclosure of security vulnerabilities helps us ensure the security
+and privacy of all our users.
+
+Please do NOT raise a GitHub Issue to report a security vulnerability. If you
+believe you have found a security vulnerability, please submit a report to
+[secalert_us@oracle.com](mailto:secalert_us@oracle.com) preferably with a proof of concept. 
+Please review some additional information on 
+[how to report security vulnerabilities to Oracle](https://www.oracle.com/corporate/security-practices/assurance/vulnerability/reporting.html).
+We encourage people who contact Oracle Security to use email encryption using
+[our encryption key](https://www.oracle.com/security-alerts/encryptionkey.html).
+
+We ask that you do not use other channels or contact the project maintainers
+directly.
+
+Non-vulnerability related security issues including ideas for new or improved
+security features are welcome on GitHub Issues.
+
+## Security updates, alerts and bulletins
+
+Security updates will be released on a regular cadence. Many of our projects
+will typically release security fixes in conjunction with the
+[Oracle Critical Patch Update](https://www.oracle.com/security-alerts/encryptionkey.html) program. 
+Security updates are released on the Tuesday closest to the 17th day of January, April, July and October. 
+A pre-release announcement will be published on the Thursday preceding each release. Additional
+information, including past advisories, is available on our 
+[security alerts](https://www.oracle.com/security-alerts/) page.
+
+## Security-related information
+
+We will provide security related information such as a threat model, considerations
+for secure use, or any known security issues in our documentation. Please note
+that labs and sample code are intended to demonstrate a concept and may not be
+sufficiently hardened for production use.