Skip to content

Commit 82c4205

Browse files
flakey5bmuenzenmeyeravivkeller
authored
doc: incident report template, 10/20 incident report (#57)
* doc: incident report template, 10/20 incident report Add a incident report template and a incident report for the incident that happened on 10/20. Signed-off-by: flakey5 <73616808+flakey5@users.noreply.github.com> * Update incidents/2025-10-20.md Co-authored-by: Brian Muenzenmeyer <brian.muenzenmeyer@gmail.com> * Apply suggestions from code review Co-authored-by: Aviv Keller <me@aviv.sh> * Update incidents/2025-10-20.md --------- Signed-off-by: flakey5 <73616808+flakey5@users.noreply.github.com> Co-authored-by: Brian Muenzenmeyer <brian.muenzenmeyer@gmail.com> Co-authored-by: Aviv Keller <me@aviv.sh>
1 parent 2c2897a commit 82c4205

File tree

2 files changed

+72
-0
lines changed

2 files changed

+72
-0
lines changed

INCIDENT_REPORT_TEMPLATE.md

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,28 @@
1+
# YYYY-MM-DD Incident Report
2+
3+
<!-- Please refer to INCIDENT_RESPONSE_PLAN.md for more info on how to respond to incidents -->
4+
5+
- Incident Commander: <!-- FILL IN -->
6+
- Severity Level: <!-- FILL IN -->
7+
8+
<!-- General description of incident: what happened, the impact -->
9+
10+
## Timeline
11+
12+
<!-- List of events that happened from incident start til incident end -->
13+
14+
## Impact
15+
16+
<!-- Description of what was impacted and what that impact looked like -->
17+
18+
## Root Cause
19+
20+
<!-- Description of what actually caused the incident to happen -->
21+
22+
## Fix
23+
24+
<!-- Description of what was done to fix the issue. This should include links to relevant PRs, issues, ... -->
25+
26+
## Follow-up Work
27+
28+
<!-- List of work to be done as a follow up to this incident. Ideally this includes links to issues or PRs. -->

incidents/2025-10-20.md

Lines changed: 44 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,44 @@
1+
# 2025-10-20 Incident Report
2+
3+
- Incident Commander: @bmuenzenmeyer
4+
- Severity Level: P2
5+
6+
For a brief period of time, the downloads page was blank due to a false assumption on their always being an active LTS version of Node.
7+
8+
## Timeline
9+
10+
- **2025-10-20 11:58 PM UTC**: Start of impact. v22.21.0 was promoted, updating [index.json](https://nodejs.org/index.json).
11+
12+
- **2025-10-21 12:33 AM UTC**: Initial report of incident [nodejs/nodejs.org#8248](https://github.com/nodejs/nodejs.org/issues/8248) created.
13+
14+
- **2025-10-21 12:55 AM UTC**: Initial report acknowledged in [OpenJS Slack](https://openjs-foundation.slack.com/archives/CVAMEJ4UV/p1761008123880979), investigation began.
15+
16+
- **2025-10-21 01:09 AM UTC**: Root cause identified.
17+
18+
- **2025-10-21 01:21 AM UTC**: [nodejs/nodejs.org#8251](https://github.com/nodejs/nodejs.org/pull/8251) opened to resolve issue.
19+
20+
- **2025-10-21 01:30 AM UTC**: [nodejs/nodejs.org#8251](https://github.com/nodejs/nodejs.org/pull/8251) merged. Impact stopped shortly after.
21+
22+
## Impact
23+
24+
Users navigating to `https://nodejs.org/en/download` would see a blank page instead of the proper download instructions.
25+
26+
`https://nodejs.org/en/download/current` was unaffected by this issue.
27+
28+
## Root Cause
29+
30+
It was assumed that there would always be an active LTS version of Node.js.
31+
This was not the case with the release of v22.21.0, since v22 moved into Maintenance LTS while v24 still had a week until it became Active LTS.
32+
33+
Since there was no active LTS release, the downloads page rendered nothing.
34+
35+
## Fix
36+
37+
The fix ([nodejs/nodejs.org#8251](https://github.com/nodejs/nodejs.org/pull/8251)) was to make the downloads page look for the Maintenance LTS version if the Active LTS version does not exist.
38+
39+
## Follow-up Work
40+
41+
- Better in-the-moment contemplation of use of status page
42+
- Better Playwright tests are needed
43+
- We need to test the actual content of the pages instead of just testing for a successful status code.
44+
- [nodejs/nodejs.org#8249](https://github.com/nodejs/nodejs.org/issues/8249)

0 commit comments

Comments
 (0)