Skip to content

Commit 87396fc

Browse files
authored
Update docker-hub-rate-limiting.md with verification steps (#1577)
1 parent 5f4b6e4 commit 87396fc

File tree

1 file changed

+13
-0
lines changed

1 file changed

+13
-0
lines changed

docs/guides/docker-hub-rate-limiting.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,19 @@ _WARNING: you are on the master branch, please refer to the docs on the branch t
44

55
Docker Hub's [newly enforced rate-limiting policy](https://www.docker.com/increase-rate-limits) can negatively impact your cluster. This is much likelier to be an issue if you've set `subnet_visibility: private` in your cluster configuration file, since with private subnets, all requests from all nodes are routed through the NAT Gateway, and will therefore have the same IP address (docker imposes the rate limit per IP address). If you haven't specified `subnet_visibility` or have set `subnet_visibility: public`, this is less likely to be an issue for you, since each instance will have its own IP address.
66

7+
If you are affected by Docker Hub's rate limiting, your may encounter issues such as:
8+
- your APIs typically run as expected but new replicas (during scale up) or newly submitted batch jobs suddenly stop working for a period of time and then eventually they start working again
9+
- you encounter scaling issues for Realtime APIs
10+
- batch jobs are stuck in an in progress state for an unusually long period of time
11+
12+
Follow these steps to determine if this issue is affecting your cluster:
13+
1. [Setup kubectl](./kubectl-setup.md)
14+
2. `kubectl get pods --all-namespaces`
15+
3. Check the pod status column for image pull failures such as `ErrImagePull`, `ImagePullBackoff`. If you don't see any, the rate limiting may not be affecting you currently.
16+
4. Get the pod id and namespace of a pod encountering image pull failures
17+
5. `kubectl describe pod <pod id> --namespace <pod namespace>`
18+
6. Under the events section, if you see error events related to docker hub rate limiting, then your cluster is likely affected by the rate limiting
19+
720
We are actively working on a long term resolution to this problem. In the meantime, there are two ways to avoid this issue:
821

922
## Paid Docker Hub subscription

0 commit comments

Comments
 (0)