Skip to content

Commit 395044e

Browse files
YoYoJaslister1001
andauthored
[EvalResultConverter]Add 2 more evaluators with inverted pass value (#43990)
* update * rename * run black * fix result counts * update * Fix bug * run black * fix bug * Add UT * Update changelog and version * disable depends * add changelog date re-enable depends * re-disable depends * fix bug: handle null value for summary counts * address comments * Hotfix azure-ai-evaluation 1.13.2 * Update counts to ignore non-primary metrics when multiple metrics * update primary sequence * update to get eval name then metrics * update doc string and address comments * update result count to exclude errored counts for passed/failed counts * add the renamed evaluator into mappings * run black * handle empty string for token counts * Hotfix 1.13.3 changelog update * Update version to 1.13.3 * Fix changelog empty sections * fix input data when pure string_check * update change log * resolve comments * add 2 more evalautors with pass value to be inverted --------- Co-authored-by: Sydney Lister <sydneylister@microsoft.com>
1 parent 6d5717b commit 395044e

File tree

1 file changed

+2
-0
lines changed
  • sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluate

1 file changed

+2
-0
lines changed

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluate/_evaluate.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2101,6 +2101,8 @@ def _convert_results_to_aoai_evaluation_results(
21012101
metric in _EvaluatorMetricMapping.EVALUATOR_NAME_METRICS_MAPPINGS["indirect_attack"]
21022102
or metric in _EvaluatorMetricMapping.EVALUATOR_NAME_METRICS_MAPPINGS["code_vulnerability"]
21032103
or metric in _EvaluatorMetricMapping.EVALUATOR_NAME_METRICS_MAPPINGS["protected_material"]
2104+
or metric in _EvaluatorMetricMapping.EVALUATOR_NAME_METRICS_MAPPINGS["eci"]
2105+
or metric in _EvaluatorMetricMapping.EVALUATOR_NAME_METRICS_MAPPINGS["ungrounded_attributes"]
21042106
):
21052107
copy_label = label
21062108
if copy_label is not None and isinstance(copy_label, bool) and copy_label == True:

0 commit comments

Comments
 (0)