Skip to content

Commit 7927b70

Browse files
clarify part2
1 parent 0aa9cef commit 7927b70

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

week05_large_models/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
### Practice / homework
99
This homework consists of two parts:
1010
- Part 1: [`./practice_part1.ipynb`](./practice_part1.ipynb) - memory-efficient training and inference
11-
- Part 2: **TBU** - implementing tensor parallelism
11+
- Part 2: **TBU** - implementing model and sequence parallelism
1212

1313
Part 2 is much more convenient with multiple GPUs - though, it can *potentially* be solved by emulating GPUs with CPU-only code.
1414
For YSDA and HSE students, you can use either DataSphere or one of the GPU servers available for this course (recommended). If you are an online student, you can try to register for kaggle kernels ([they ley you run on 2x T4](https://www.kaggle.com/discussions/product-feedback/361104)) in jupyter-like interface. That said, implementing assignments B and C in Kaggle is more difficult than intended. For non-enrolled online students, we recommend option A unless you have access to some other multi-GPU-hardware or are intentionally masochistic.

0 commit comments

Comments
 (0)