Skip to content

Commit 5936fc6

Browse files
authored
Update docs (#706)
1 parent 35ab929 commit 5936fc6

File tree

7 files changed

+70
-10
lines changed

7 files changed

+70
-10
lines changed

cli/cmd/lib_cluster_config.go

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -284,21 +284,21 @@ func confirmInstallClusterConfig(clusterConfig *clusterconfig.Config, awsCreds *
284284

285285
if clusterConfig.Spot != nil && *clusterConfig.Spot {
286286
if *clusterConfig.SpotConfig.OnDemandBaseCapacity == 0 && *clusterConfig.SpotConfig.OnDemandPercentageAboveBaseCapacity == 0 {
287-
fmt.Println(fmt.Sprintf("WARNING: you've disabled on-demand instances (%s=0 and %s=0); spot instances are not guaranteed to be available so please take that into account for production clusters", clusterconfig.OnDemandBaseCapacityKey, clusterconfig.OnDemandPercentageAboveBaseCapacityKey))
287+
fmt.Printf("WARNING: you've disabled on-demand instances (%s=0 and %s=0); spot instances are not guaranteed to be available so please take that into account for production clusters; see https://www.cortex.dev/v/%s/cluster-management/spot-instances for more information\n", clusterconfig.OnDemandBaseCapacityKey, clusterconfig.OnDemandPercentageAboveBaseCapacityKey, consts.CortexVersionMinor)
288288
} else {
289-
fmt.Println("WARNING: you've enabled spot instances; spot instances are not guaranteed to be available so please take that into account for production clusters")
289+
fmt.Printf("WARNING: you've enabled spot instances; spot instances are not guaranteed to be available so please take that into account for production clusters; see https://www.cortex.dev/v/%s/cluster-management/spot-instances for more information\n", consts.CortexVersionMinor)
290290
}
291291
fmt.Println()
292292
}
293293

294-
exitMessage := fmt.Sprintf("cluster configuration can be modified via the cluster config file; see https://www.cortex.dev/v/%s/cluster-management/config", consts.CortexVersionMinor)
294+
exitMessage := fmt.Sprintf("cluster configuration can be modified via the cluster config file; see https://www.cortex.dev/v/%s/cluster-management/config for more information", consts.CortexVersionMinor)
295295
prompt.YesOrExit("would you like to continue with this installation?", exitMessage)
296296
}
297297

298298
func confirmUpdateClusterConfig(clusterConfig *clusterconfig.Config, awsCreds *AWSCredentials) {
299299
fmt.Println(clusterConfigConfirmaionStr(clusterConfig, awsCreds) + "\n")
300300

301-
exitMessage := fmt.Sprintf("cluster configuration can be modified via the cluster config file; see https://www.cortex.dev/v/%s/cluster-management/config", consts.CortexVersionMinor)
301+
exitMessage := fmt.Sprintf("cluster configuration can be modified via the cluster config file; see https://www.cortex.dev/v/%s/cluster-management/config for more information", consts.CortexVersionMinor)
302302
prompt.YesOrExit(fmt.Sprintf("your cluster (%s in %s) will be updated according to the configuration above, are you sure you want to continue?", clusterConfig.ClusterName, *clusterConfig.Region), exitMessage)
303303
}
304304

File renamed without changes.
Lines changed: 59 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,59 @@
1+
# EC2 instances
2+
3+
_WARNING: you are on the master branch, please refer to the docs on the branch that matches your `cortex version`_
4+
5+
You can spin up a Cortex cluster on a variety of AWS instance types. If you are unsure about which instance to pick, review these options as a starting point. This is not a comprehensive guide so please refer to the [full documentation](https://aws.amazon.com/ec2/instance-types/) on AWS for more information.
6+
7+
## T3 instances
8+
9+
[T3 instances](https://aws.amazon.com/ec2/instance-types/t3/) are useful for **development** clusters that primarily run model inferences with low compute and memory resource utilization.
10+
11+
* Example: [iris classification](../../examples/sklearn/iris-classifier)
12+
* Compute: low
13+
* Memory: low
14+
* GPU: no
15+
* AWS cost: starts at $0.0052 per hour*
16+
17+
## C5 instances
18+
19+
[C5 instances](https://aws.amazon.com/ec2/instance-types/c5/) are useful for clusters that primarily run model inferences with medium compute and low memory resource utilization.
20+
21+
* Example: [language identification](../../examples/pytorch/language-identifier)
22+
* Compute: medium
23+
* Memory: low
24+
* GPU: no
25+
* AWS cost: starts at $0.085 per hour*
26+
27+
## M5 instances
28+
29+
[M5 instances](https://aws.amazon.com/ec2/instance-types/m5/) are useful for clusters that primarily run model inferences with low compute and memory resource utilization.
30+
31+
* Example: [MPG estimation](../../examples/sklearn/mpg-estimator)
32+
* Compute: low
33+
* Memory: medium
34+
* GPU: no
35+
* AWS cost: starts at $0.096 per hour*
36+
37+
## G4 instances
38+
39+
[G4 instances](https://aws.amazon.com/ec2/instance-types/g4/) are useful for clusters that primarily run model inferences with high compute and low memory resource utilization that can run on GPUs.
40+
41+
* Example: [image classification](../../examples/tensorflow/image-classifier)
42+
* Compute: high
43+
* Memory: medium
44+
* GPU: yes
45+
* AWS cost: starts at $0.526 per hour*
46+
47+
## P2 instances
48+
49+
[P2 instances](https://aws.amazon.com/ec2/instance-types/p2/) are useful for clusters that primarily run model inferences with high compute and high memory resource utilization that can run on GPUs.
50+
51+
* Example: [text generation](../../examples/tensorflow/text-generator)
52+
* Compute: high
53+
* Memory: high
54+
* GPU: yes
55+
* AWS cost: starts at $0.900 per hour*
56+
57+
<br>
58+
59+
&ast; On-demand pricing for the US West (Oregon) AWS region.

docs/cluster-management/install.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,11 +5,11 @@ _WARNING: you are on the master branch, please refer to the docs on the branch t
55
## Prerequisites
66

77
1. [Docker](https://docs.docker.com/install)
8-
2. [AWS credentials](aws.md)
8+
2. [AWS credentials](aws-credentials.md)
99

1010
## Installation
1111

12-
See [cluster configuration](config.md) to learn how you can customize your cluster.
12+
See [cluster configuration](config.md) to learn how you can customize your installation and [EC2 instances](ec2-instances.md) for an overview of how to pick an appropriate EC2 instance type for your cluster.
1313

1414
<!-- CORTEX_VERSION_MINOR -->
1515
```bash

docs/cluster-management/uninstall.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ _WARNING: you are on the master branch, please refer to the docs on the branch t
44

55
## Prerequisites
66

7-
1. [AWS credentials](aws.md)
7+
1. [AWS credentials](aws-credentials.md)
88
2. [Docker](https://docs.docker.com/install)
99
3. [Cortex CLI](install.md)
1010
4. [AWS CLI](https://aws.amazon.com/cli)

docs/cluster-management/update.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ _WARNING: you are on the master branch, please refer to the docs on the branch t
55
## Prerequisites
66

77
1. [Docker](https://docs.docker.com/install)
8-
2. [AWS credentials](aws.md)
8+
2. [AWS credentials](aws-credentials.md)
99

1010
## Updating your cluster configuration
1111

docs/summary.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -34,9 +34,10 @@
3434

3535
* [CLI commands](cluster-management/cli.md)
3636
* [Cluster configuration](cluster-management/config.md)
37-
* [Spot instances](cluster-management/spot-instances.md)
38-
* [AWS credentials](cluster-management/aws.md)
37+
* [AWS credentials](cluster-management/aws-credentials.md)
3938
* [Security](cluster-management/security.md)
39+
* [AWS instances](cluster-management/ec2-instances.md)
40+
* [Spot instances](cluster-management/spot-instances.md)
4041
* [Update](cluster-management/update.md)
4142
* [Uninstall](cluster-management/uninstall.md)
4243
* [Telemetry](cluster-management/telemetry.md)

0 commit comments

Comments
 (0)