Skip to content

Commit 7611a82

Browse files
committed
Add shared resource sustainability documentation
Added comprehensive section on storage sustainability for CSE shared servers, including: - Clear explanation of collaborative infrastructure model - Benefits of purchasing dedicated vs using shared storage - Detailed hardware recommendations (U.2/U.3 NVMe SSDs, 4-8TB capacity) - Consumer and enterprise grade options with pricing - Acknowledgment of contributing labs (Rose Lab, Berg-Kirkpatrick Lab) - Email template for students to request storage from PIs This addresses the ongoing storage capacity and I/O performance issues by educating users on the "you buy, you use" principle while maintaining a professional and constructive tone.
1 parent d0fb697 commit 7611a82

File tree

1 file changed

+99
-0
lines changed

1 file changed

+99
-0
lines changed

docs/shared/index.md

Lines changed: 99 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -65,6 +65,105 @@ Check your allocated resources using similar commands as in RoseLab.
6565
If the data drive is full, you (or your PI) would need to purchase your own additional storage, since Roselab admins cannot delete users' files on their behalf. Roselab admins can only provide guidance on mounting your storage and mapping it to your container. Contact the RoseLab admins for more information.
6666
:::
6767

68+
## Understanding Shared Resources: Storage and Sustainability
69+
70+
### How the Shared Servers Work
71+
72+
The CSE shared servers operate on a **collaborative infrastructure model**:
73+
74+
- **Compute resources** (CPUs, GPUs, RAM) are shared among all users
75+
- **Base storage** (4TB home, 6TB shared data) was established through initial lab contributions
76+
- **Additional storage** is provided by individual labs purchasing their own drives
77+
- **Administration** is provided on a volunteer basis
78+
79+
**Key principle**: Disks don't come from nowhere. When your lab needs storage, your lab provides storage.
80+
81+
### Storage You Can Count On
82+
83+
When you or your PI purchases storage for your lab:
84+
- **Dedicated access**: Only your lab members can use the space you bought
85+
- **Better performance**: Your own SSD means no I/O contention with other users
86+
- **Guaranteed availability**: The storage you purchase is yours, not subject to shared resource pressure
87+
- **Admin support**: We'll mount and configure it for your lab's exclusive use
88+
89+
When you don't purchase storage:
90+
- **Limited quota**: Shared pool provides 128GB per user (subject to availability)
91+
- **Performance degradation**: Shared disks can reach 100% I/O utilization during peak usage
92+
- **No guarantees**: Shared storage may become full, blocking your work
93+
94+
### What You Need
95+
96+
**Compatible hardware**: 2.5" NVMe SSD with **U.2 or U.3 connector** (strongly preferred over SATA for performance)
97+
98+
**Recommended options**:
99+
100+
**Consumer grade** (best price/performance for most users):
101+
- Samsung 870 QVO/EVO 4TB: ~$250-300
102+
- Samsung 870 QVO/EVO 8TB: ~$500-600
103+
- Budget option: Refurbished consumer SSDs on eBay
104+
105+
**Enterprise grade** (higher endurance and performance):
106+
- Samsung PM983/PM9A3 series (U.2): 4TB ~$300-400, 8TB ~$600-800
107+
- Micron 7450/9400 series (U.2/U.3): 4TB ~$350-450, 8TB ~$700-900
108+
- Intel D7 series (U.2/U.3): Similar pricing to Micron
109+
- Budget option: Refurbished enterprise drives on eBay (~30-50% discount)
110+
111+
**Capacity guide**:
112+
- Single user with typical datasets: 4TB minimum
113+
- Multiple lab members or large datasets: 8TB recommended
114+
- Heavy I/O workloads: Consider enterprise NVMe for better endurance
115+
116+
### Acknowledging Contributors
117+
118+
We're grateful to the labs that have invested in the shared infrastructure:
119+
120+
- **Rose Lab** - for significant infrastructure investments and ongoing administrative support
121+
- **Berg-Kirkpatrick Lab** - for storage contributions
122+
123+
These contributions have made high-quality GPU computing accessible to dozens of researchers across CSE.
124+
125+
### Why This Matters
126+
127+
The shared servers serve 45+ users across multiple labs. As usage grows, so does the demand for storage and I/O bandwidth.
128+
129+
**This creates a choice**:
130+
- **Contribute when you benefit**: Labs that use the servers can purchase storage proportional to their needs
131+
- **Everyone benefits**: Your investment gives your lab guaranteed resources while reducing pressure on shared storage
132+
133+
Without ongoing contributions, the system faces resource exhaustion - leading to full disks, degraded performance, and blocked research for everyone.
134+
135+
### Getting Storage for Your Lab
136+
137+
If you need more storage than the base allocation:
138+
139+
1. **Discuss with your PI**: Explain your storage needs and the benefits of dedicated drives
140+
2. **Purchase compatible SSD**: Any 2.5" SATA/NVMe drive works (see recommendations above)
141+
3. **Contact RoseLab admins**: We'll mount the drive and configure it for your lab's exclusive access
142+
143+
::: info Email Template for Your PI
144+
Subject: Storage Purchase Request for CSE Shared GPU Servers
145+
146+
Dear Prof. [PI Name],
147+
148+
I'm using the CSE shared GPU servers for [project name] and have encountered storage limitations. The server admin suggests our lab purchase dedicated storage.
149+
150+
**Details**:
151+
- Required: 2.5" NVMe SSD with U.2 or U.3 connector
152+
- Recommended capacity: 4-8TB
153+
- Consumer option: Samsung 870 QVO/EVO 4TB (~$250-300) or 8TB (~$500-600)
154+
- Enterprise option: Samsung PM9A3 or Micron 7450 series (~$300-900 depending on capacity)
155+
156+
**Benefits**:
157+
- Exclusive use by our lab only
158+
- Better I/O performance than shared storage
159+
- Admin handles mounting and configuration
160+
161+
Could we discuss this? The storage bottleneck is currently affecting [specific task].
162+
163+
Best regards,
164+
[Your Name]
165+
:::
166+
68167
## Support
69168

70169
Roselab admins provide only limited support for the shared servers. Remember to keep your access credentials secure and do not share them with others.

0 commit comments

Comments
 (0)