Skip to content

Commit b513d01

Browse files
authored
Merge pull request #2218 from sandeepyadav-lt/atx-6202-stage
Automatic AI RCA - Org product Preferences enhancements
2 parents 9f4731f + ca16c94 commit b513d01

File tree

1 file changed

+9
-4
lines changed

1 file changed

+9
-4
lines changed

docs/analytics-ai-root-cause-analysis.md

Lines changed: 9 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -76,7 +76,7 @@ AI RCA is an intelligent feature that uses advanced machine learning algorithms
7676
2. **Configure Analysis Scope**: Choose which types of test failures to analyze:
7777
- **All failures**: Analyze every failed test, regardless of previous status
7878
- **New failures**: Analyze only tests that have failed recently after having passed at least 10 consecutive times previously.
79-
- **Always failing**: Analyze only tests that have failed in all of their previous 5 runs to identify persistent issues.
79+
- **Consistent Failures**: Analyze only tests that have failed in all of their previous 5 runs to identify persistent issues.
8080

8181
### Step 3: Set Special Instructions (Optional)
8282

@@ -130,7 +130,7 @@ Our CRM application has specific failure patterns to watch for:
130130

131131
### Step 4: Configure Intelligent Targeting
132132

133-
Configure intelligent targeting rules to precisely control which tests, builds, tags, or jobs are included in AI-powered analysis:
133+
Configure intelligent targeting rules to precisely control which tests, builds, tags, projects, or jobs are included in AI-powered analysis:
134134

135135
1. **Add Targeting Rules**: Enter regex patterns in the input field
136136
2. **Click Include (+) or Exclude (-)**: Choose whether to include or exclude matching tests
@@ -139,6 +139,7 @@ Configure intelligent targeting rules to precisely control which tests, builds,
139139
- **Build Names**: Include or exclude builds with specific names (e.g., hourly, nightly)
140140
- **Test Tags**: Include or exclude tests with specific tags (e.g., playwright_test, atxHyperexecute_test)
141141
- **Build Tags**: Include or exclude builds with specific tags (e.g., hourly, nightly)
142+
- **Project Names**: Include or exclude tests from specific projects using regex patterns
142143
- **Job Labels**: Include tests with specific job labels or tags
143144

144145
#### Rule Logic and Application
@@ -148,7 +149,7 @@ The intelligent targeting system applies rules using the following logic:
148149
**Rule Evaluation Process:**
149150
1. **Include Rules (AND Logic)**: All Include rules within the same category must match for a test to be considered
150151
2. **Exclude Rules (OR Logic)**: Any Exclude rule that matches will immediately exclude the test from analysis
151-
3. **Cross-Category Logic**: Include rules across different categories (Test Names, Build Tags, etc.) must ALL match
152+
3. **Cross-Category Logic**: Include rules across different categories (Test Names, Build Tags, Project Names, etc.) must ALL match
152153
4. **Exclusion Precedence**: Exclude rules take priority over Include rules - if any exclude rule matches, the test is excluded regardless of include matches
153154

154155
**Best Practices for Rule Configuration:**
@@ -173,7 +174,11 @@ The intelligent targeting system applies rules using the following logic:
173174
- **Include**: `playwright_test|atxHyperexecute_test` - Focus on specific test frameworks
174175
- **Exclude**: `.*smoke.*` - Skip smoke tests
175176

176-
**Result**: AI-powered analysis will run only on production tests (excluding non-critical ones) from hourly builds, focusing on Playwright or HyperExecute test tags, while excluding smoke tests. This configuration helps narrow down analysis to the most critical test scenarios.
177+
**Project Names:**
178+
- **Include**: `^ecommerce|^payment` - Only analyze tests from projects starting with "ecommerce" or "payment"
179+
- **Exclude**: `.*staging.*` - Skip tests from staging projects
180+
181+
**Result**: AI-powered analysis will run only on production tests (excluding non-critical ones) from hourly builds, focusing on Playwright or HyperExecute test tags, while excluding smoke tests. The analysis will target ecommerce and payment projects, excluding staging projects. This configuration helps narrow down analysis to the most critical test scenarios.
177182
:::
178183

179184

0 commit comments

Comments
 (0)