Merge branch 'develop' v0.4.5

Author: Bob Strahan

.github/workflows/developer-tests.yml

@@ -59,7 +59,7 @@ jobs:
 
       - name: Install Node.js and basedpyright
         run: |
-          curl -fsSL https://deb.nodesource.com/setup_20.x | bash -
+          curl -fsSL https://deb.nodesource.com/setup_22.x | bash -
           apt-get install -y nodejs
           npm install -g basedpyright
 
@@ -104,6 +104,7 @@ jobs:
         with:
           files: lib/idp_common_pkg/test-reports/test-results.xml
           check_name: Test Results
+          comment_mode: off  # Disable PR comments to avoid permission issues on fork PRs
 
       - name: Code Coverage Report
         uses: irongut/CodeCoverageSummary@v1.3.0

CHANGELOG.md

@@ -5,6 +5,53 @@ SPDX-License-Identifier: MIT-0
 
 ## [Unreleased]
 
+## [0.4.5]
+
+### Added
+
+- **Document Split Classification Metrics for Evaluating Page-Level Classification and Document Segmentation**
+  - Added `DocSplitClassificationMetrics` class for comprehensive evaluation of document splitting and classification accuracy
+  - **Three Accuracy Types**: Page-level classification accuracy, split accuracy without order consideration, and split accuracy with exact page order matching
+  - **Visual Reporting**: Generates markdown reports with color-coded indicators (🟢 Excellent, 🟡 Good, 🟠 Fair, 🔴 Poor), progress bars, and detailed section analysis tables
+  - **Automatic Integration**: Integrates with evaluation service when ground truth and predicted sections are available
+  - **Documentation**: Guide in `lib/idp_common_pkg/idp_common/evaluation/README.md` with usage examples, metric explanations, and best practices
+
+- **Caching improvements to Agentic Extraction Service**
+  - Optimized prompt caching by caching document context (text/images) on first LLM call, reducing token costs and quota consumption
+
+- **Enhanced Bedrock Retry Logic for Agentic Extraction**
+  - New `bedrock_utils.py` module with exponential backoff and comprehensive error handling
+  - Improves agentic extraction reliability for transient failures and rate limiting
+
+- **Review Agent Model Configuration**
+  - Added `review_agent_model` parameter to enable separate model for reviewing extraction work
+  - Defaults to main extraction model if not specified
+  - Configurable through Web UI extraction settings
+
+
+### Fixed
+
+- **Evaluation Output URI Fields Lost Across All Patterns - causing (a) missing Page Text Confidence content in UI, (2) failed Assessment step when reprocessing document after editing classes (No module named 'fitz')**
+  - Fixed bug where `text_confidence_uri` was being set to null in evaluation output for all three patterns
+  - Root cause: AppSync service `_appsync_to_document()` method incorrectly mapped page URIs, and evaluation functions overwrote correct documents with corrupted AppSync responses
+
+- **UI: Metering Data Not Displayed During Document Processing**
+  - Fixed UI subscription query missing `Metering` field, preventing real-time cost display
+  - Users can now see estimated costs accumulate in real-time without manual page refresh
+
+- **UI: Estimated Cost Panel Arrow Misalignment**
+  - Fixed expand/contract arrow displaying above "Estimated Cost" heading
+
+- **Agentic Extraction Reliability Improvements**
+  - Updated Pydantic model serialization to use `model_dump(mode="json")` for proper JSON handling
+  - Resolved linting issues and improved code quality across extraction modules
+
+### Templates
+   - us-west-2: `https://s3.us-west-2.amazonaws.com/aws-ml-blog-us-west-2/artifacts/genai-idp/idp-main_0.4.5.yaml`
+   - us-east-1: `https://s3.us-east-1.amazonaws.com/aws-ml-blog-us-east-1/artifacts/genai-idp/idp-main_0.4.5.yaml`
+   - eu-central-1: `https://s3.eu-central-1.amazonaws.com/aws-ml-blog-eu-central-1/artifacts/genai-idp/idp-main_0.4.5.yaml`
+
+
 ## [0.4.4]
 
 ### Added

README.md

@@ -34,6 +34,8 @@ White-glove customization, deployment, and integration support for production us
 
 **Prefer AWS CDK?** This solution is also available as [GenAI IDP Accelerator for AWS CDK](https://github.com/cdklabs/genai-idp), providing the same functional capabilities through AWS CDK constructs for customers who prefer Infrastructure-as-Code with CDK.
 
+**Prefer Terraform?** This solution is also available as [GenAI IDP Terraform](https://github.com/awslabs/genai-idp-terraform), providing the same functional capabilities as a Terraform module that integrates with existing infrastructure and supports customization through module variables.
+
 ## Key Features
 
 - **Serverless Architecture**: Built entirely on AWS serverless technologies including Lambda, Step Functions, SQS, and DynamoDB
@@ -121,7 +123,7 @@ idp-cli download-results \
     --output-dir ./results/
 ```
 
-**See [IDP CLI Documentation](./idp_cli/README.md)** for:
+**See [IDP CLI Documentation](./docs/idp-cli.md)** for:
 - CLI-based stack deployment and updates
 - Batch document processing
 - Complete evaluation workflows with baselines
@@ -162,7 +164,7 @@ For detailed deployment and testing instructions, see the [Deployment Guide](./d
 
 - [Architecture](./docs/architecture.md) - Detailed component architecture and data flow
 - [Deployment](./docs/deployment.md) - Build, publish, deploy, and test instructions
-- [IDP CLI](./idp_cli/README.md) - Command line interface for batch processing and evaluation workflows
+- [IDP CLI](./docs/idp-cli.md) - Command line interface for batch processing and evaluation workflows
 - [Web UI](./docs/web-ui.md) - Web interface features and usage
 - [Agent Analysis](./docs/agent-analysis.md) - Natural language analytics and data visualization feature
 - [Custom MCP Agent](./docs/custom-MCP-agent.md) - Integrating external MCP servers for custom tools and capabilities

VERSION

@@ -1 +1 @@
-0.4.4
+0.4.5

config_library/pattern-2/lending-package-sample/config.yaml

@@ -1811,7 +1811,7 @@ agents:
     parameters:
       max_log_events: 5
       time_range_hours_default: 24
-  
+
   chat_companion:
     model_id: us.anthropic.claude-haiku-4-5-20251001-v1:0
 pricing:

docs/deployment.md

@@ -98,7 +98,7 @@ idp-cli deploy \
 - Integration with CI/CD pipelines
 - No manual console clicking required
 
-**For complete CLI documentation**, see [IDP CLI Documentation](../idp_cli/README.md).
+**For complete CLI documentation**, see [IDP CLI Documentation](./idp-cli.md).
 
 ---
 
@@ -416,7 +416,7 @@ idp-cli download-results \
 cat ./eval-results/eval-test/invoice.pdf/evaluation/report.md
 ```
 
-**For complete evaluation workflow documentation**, see [IDP CLI - Complete Evaluation Workflow](../idp_cli/README.md#complete-evaluation-workflow).
+**For complete evaluation workflow documentation**, see [IDP CLI - Complete Evaluation Workflow](./idp-cli.md#complete-evaluation-workflow).
 
 ---