Improve if VERBOSE log and prompt

Author: joshbickett

operate/models/apis.py

@@ -247,6 +247,8 @@ async def call_gpt_4_vision_preview_ocr(messages, objective, model):
         )
 
         content = response.choices[0].message.content
+        if VERBOSE:
+            print("[call_gpt_4_vision_preview_ocr] response content", content)
 
         if content.startswith("```json"):
             content = content[len("```json") :]  # Remove starting ```json
@@ -256,8 +258,6 @@ async def call_gpt_4_vision_preview_ocr(messages, objective, model):
         content_str = content
 
         content = json.loads(content)
-        if VERBOSE:
-            print("[call_gpt_4_vision_preview_ocr] content", content)
 
         processed_content = []
 

operate/models/prompts.py

@@ -208,7 +208,7 @@
 You have 4 possible operation actions available to you. The `pyautogui` library will be used to execute your decision. Your output will be used in a `json.loads` loads statement.
 
 1. click - Move mouse and click
-[{{ "thought": "write a thought here", "operation": "click", "text": "The text in the button or link to click" }}] # Look for buttons or links with text to click. If the button you want to click doesn't have text you can say `"no button"` for the text value and we'll try a different method.
+[{{ "thought": "write a thought here", "operation": "click", "text": "The text in the button or link to click" }}]  # Look for text to click. Try to find relevant text to click, but if there's nothing relevant enough you can return `"nothing to click"` for the text value and we'll try a different method.
 
 2. write - Write with your keyboard
 [{{ "thought": "write a thought here", "operation": "write", "content": "text to write here" }}]
@@ -258,7 +258,7 @@
 You have 4 possible operation actions available to you. The `pyautogui` library will be used to execute your decision. Your output will be used in a `json.loads` loads statement.
 
 1. click - Move mouse and click
-[{{ "thought": "write a thought here", "operation": "click", "text": "The text in the button or link to click" }}] # Look for buttons or links with text to click. If the button you want to click doesn't have text you can say `"no button"` for the text value and we'll try a different method.
+[{{ "thought": "write a thought here", "operation": "click", "text": "The text in the button or link to click" }}]  # Look for text to click. Try to find relevant text to click, but if there's nothing relevant enough you can return `"nothing to click"` for the text value and we'll try a different method.
 
 2. write - Write with your keyboard
 [{{ "thought": "write a thought here", "operation": "write", "content": "text to write here" }}]