use correct fetch mcp

Author: chrisbaswell

.claude/context/web_automation_guide.md

@@ -31,28 +31,30 @@ await page.waitForSelector('.dynamic-content');
 const content = await page.textContent('.dynamic-content');
 ```
 
-### 🔍 **Fetch MCP** - For Lightweight Data Retrieval
+### 🔍 **Fetch MCP** - For Enhanced Data Retrieval & Content Processing
 
 **Use Fetch when you need:**
-- **API Calls**: REST API consumption, data retrieval
-- **Simple Web Scraping**: Static HTML content extraction
-- **Information Gathering**: Research tasks, data collection
+- **Multi-format Content**: HTML, JSON, plain text, or Markdown output
+- **API Calls**: REST API consumption with custom headers
+- **Web Scraping**: Clean text extraction from websites  
+- **Content Transformation**: HTML to Markdown conversion
+- **Research Tasks**: Information gathering with formatted output
 - **Fast Requests**: Lightweight operations without browser overhead
-- **Bulk Data Processing**: Multiple rapid requests
-- **RSS/XML Parsing**: Feed processing, data syndication
-- **Health Checks**: Server monitoring, uptime checks
+- **Bulk Data Processing**: Multiple rapid requests with different formats
+- **Documentation Parsing**: Extract clean content from docs sites
 
-**Example Use Cases:**
+**Enhanced Capabilities (zcaceres/fetch-mcp):**
 ```bash
-# Research tasks
-"Fetch the latest Laravel documentation for validation rules"
-"Get the current weather data from OpenWeatherMap API"
-"Retrieve the latest GitHub releases for Laravel framework"
-
-# API integration
-"Fetch user data from the CRM API"
-"Get product information from the inventory system"
-"Retrieve exchange rates from the financial API"
+# Multiple output formats available
+"Fetch Laravel docs as Markdown for easier reading"
+"Get API response as clean JSON structure" 
+"Extract plain text from news article (no HTML)"
+"Fetch website content as raw HTML for parsing"
+
+# Custom headers for authenticated requests
+"Fetch protected API endpoint with Bearer token"
+"Get content from site requiring specific User-Agent"
+"Access authenticated documentation with API key"
 ```
 
 ## Complementary Use Cases
@@ -95,11 +97,12 @@ const content = await page.textContent('.dynamic-content');
 
 ## Performance Considerations
 
-### **Fetch MCP Performance**
+### **Enhanced Fetch MCP Performance**
 - ⚡ **Fast**: Minimal overhead, direct HTTP requests
-- 💾 **Lightweight**: Low memory usage
-- 🔄 **Scalable**: Handle multiple concurrent requests
-- 📊 **Efficient**: Perfect for bulk data operations
+- 💾 **Lightweight**: Low memory usage compared to browser automation
+- 🔄 **Versatile**: Multiple output formats (HTML, JSON, text, Markdown)
+- 📊 **Efficient**: Perfect for bulk data operations with content transformation
+- 🔧 **Flexible**: Custom headers support for authenticated requests
 
 ### **Playwright MCP Performance**
 - 🐌 **Slower**: Full browser execution overhead
@@ -149,11 +152,19 @@ playwright('test product display on frontend');
 
 ## Agent Task Examples
 
-### **Research Tasks** (Fetch MCP)
+### **Research Tasks** (Enhanced Fetch MCP)
 ```
-Agent: "Research the latest Laravel 12 security features"
-→ Fetch: Laravel docs, security guides, release notes
-→ Result: Comprehensive security feature summary
+Agent: "Get Laravel 12 security best practices as clean Markdown"
+→ Enhanced Fetch: HTML to Markdown conversion, clean formatting
+→ Result: Well-formatted security documentation
+
+Agent: "Extract plain text from this news article (remove ads/navigation)"
+→ Enhanced Fetch: Text extraction with HTML cleanup
+→ Result: Clean article content only
+
+Agent: "Fetch API documentation and return as JSON structure"
+→ Enhanced Fetch: JSON parsing with structured output
+→ Result: Properly formatted API reference data
 ```
 
 ### **Testing Tasks** (Playwright MCP)
@@ -174,12 +185,14 @@ Agent: "Integrate and test a new payment provider"
 
 ## Best Practices
 
-### **Choose Fetch MCP When:**
-- The content is static HTML
-- You need simple data extraction
-- Performance is critical
-- You're making API calls
-- The site doesn't require JavaScript
+### **Choose Enhanced Fetch MCP When:**
+- You need content in specific formats (Markdown, plain text, JSON)
+- The content is static HTML or API responses
+- You want clean text extraction without ads/navigation
+- Performance is critical for bulk operations
+- You're making API calls with custom authentication headers
+- You need content transformation (HTML to Markdown)
+- The site doesn't require JavaScript interaction
 
 ### **Choose Playwright MCP When:**
 - Content is JavaScript-generated

.claude_config

@@ -34,8 +34,8 @@
       "args": ["-y", "@playwright/mcp"]
     },
     "fetch": {
-      "command": "npx",
-      "args": ["-y", "@modelcontextprotocol/server-fetch"]
+      "command": "node",
+      "args": ["~/.config/claude-code/mcp-servers/fetch-mcp/dist/index.js"]
     },
     "github": {
       "command": "npx",

README.md

@@ -9,7 +9,7 @@ This Laravel 12 project has been configured with Claude Code and optimized MCP s
 - **Memory** - Shared knowledge base across projects  
 - **Context7** - Latest Laravel 12 documentation access
 - **Playwright** - Browser automation and testing capabilities (Microsoft MCP)
-- **Fetch** - HTTP requests and web data retrieval (Official MCP)
+- **Fetch** - Enhanced HTTP requests, web scraping, and content transformation (zcaceres/fetch-mcp)
 
 ### Project-Specific Servers
 - **Filesystem** - Access to this project's files
@@ -291,7 +291,7 @@ npx playwright test --debug  # Debug mode
 - **Memory**: Persistent knowledge across sessions
 - **Database**: Direct database queries and schema analysis
 - **Playwright**: Browser automation, testing, and web scraping
-- **Fetch**: HTTP requests, API calls, and web data retrieval
+- **Fetch**: Enhanced HTTP requests with HTML, JSON, text, and Markdown parsing
 - **Filesystem**: Read and modify project files
 
 ### Usage Tips

setup.sh

@@ -482,16 +482,37 @@ install_filesystem() {
     fi
 }
 
-# Install Fetch MCP Server (Official MCP version)
+# Install Fetch MCP Server (zcaceres version - enhanced capabilities)
 install_fetch() {
-    print_step "Installing Fetch MCP Server (Official MCP)..."
+    print_step "Installing Fetch MCP Server (zcaceres - enhanced version)..."
 
-    print_status "Installing Fetch MCP server via npm..."
-    if npm install -g @modelcontextprotocol/server-fetch; then
-        print_success "Fetch MCP Server installed!"
+    cd "$MCP_DIR"
+    
+    if [ -d "fetch-mcp" ]; then
+        print_status "Removing existing fetch-mcp installation..."
+        rm -rf fetch-mcp
+    fi
+    
+    print_status "Cloning zcaceres fetch-mcp repository..."
+    if ! git clone https://github.com/zcaceres/fetch-mcp.git fetch-mcp; then
+        print_error "Failed to clone zcaceres fetch-mcp repository"
+        return 1
+    fi
+    
+    cd fetch-mcp
+    
+    print_status "Installing fetch-mcp dependencies..."
+    if ! npm install; then
+        print_error "Failed to install fetch-mcp dependencies"
+        return 1
+    fi
+    
+    print_status "Building fetch-mcp..."
+    if npm run build; then
+        print_success "Enhanced Fetch MCP Server installed!"
         return 0
     else
-        print_error "Failed to install Fetch MCP Server"
+        print_error "Failed to build fetch-mcp"
         return 1
     fi
 }
@@ -694,20 +715,20 @@ configure_claude_mcp() {
         print_warning "Playwright MCP server not found - skipping configuration"
     fi
 
-    # Add global Fetch MCP server
-    if command -v npx &> /dev/null && npx @modelcontextprotocol/server-fetch --version &> /dev/null 2>&1; then
+    # Add global Fetch MCP server (zcaceres enhanced version)
+    if [ -f "$MCP_DIR/fetch-mcp/dist/index.js" ]; then
         if ! claude mcp list 2>/dev/null | grep -q "^fetch:"; then
-            print_status "Adding global Fetch MCP server..."
-            if claude mcp add "fetch" npx @modelcontextprotocol/server-fetch; then
-                print_success "Global Fetch MCP server added"
+            print_status "Adding global Enhanced Fetch MCP server..."
+            if claude mcp add "fetch" node "$MCP_DIR/fetch-mcp/dist/index.js"; then
+                print_success "Global Enhanced Fetch MCP server added"
             else
-                print_warning "Failed to add global Fetch MCP server"
+                print_warning "Failed to add global Enhanced Fetch MCP server"
             fi
         else
-            print_success "Global Fetch MCP server already configured"
+            print_success "Global Enhanced Fetch MCP server already configured"
         fi
     else
-        print_warning "Fetch MCP server not found - skipping configuration"
+        print_warning "Enhanced Fetch MCP server not found - skipping configuration"
     fi
 
     print_header "Setting up project-specific MCP servers..."
@@ -895,7 +916,7 @@ create_project_context() {
 
 ### Development Tools
 - **Claude Code**: AI-powered development assistant
-- **MCP Servers**: Context7, GitHub, Memory, Database, Playwright, Fetch, Filesystem
+- **MCP Servers**: Context7, GitHub, Memory, Database, Playwright, Enhanced Fetch, Filesystem
 - **Testing**: Pest PHP for feature and unit testing
 - **Code Quality**: Laravel Pint for code formatting