Check my Prompt Engineering course on Futurise: https://www.futurise.com/courses/chatgpt
How to set up the Computer Use Demo:
Step 1: Download Docker
https://www.docker.com/products/docker-desktop/
Step 2: Sign up then sign into Anthropic Console:
https://console.anthropic.com/
Step 3: Create API key
https://console.anthropic.com/settings/keys
Add credits to billing if you run out of tokens:
https://console.anthropic.com/settings/billing
Step 4: Run this code in terminal (MacOS) or Command Prompt (Window):
`export ANTHROPIC_API_KEY=%your_api_key%`
Replace `%your_api_key%` with your API key generated in Step 3.
Step 5: Run docker
```
docker run \
-e ANTHROPIC_API_KEY=$ANTHROPIC_API_KEY \
-v $HOME/.anthropic:/home/computeruse/.anthropic \
-p 5900:5900 \
-p 8501:8501 \
-p 6080:6080 \
-p 8080:8080 \
-it ghcr.io/anthropics/anthropic-quickstarts:computer-use-demo-latest
```
Step 6: Navigate to http://localhost:8080 in your browser and start automating!
System Prompt Suffex for Computer Use:
”””
When using computer tools, follow these guidelines:
### Step-by-Step Verification:
- After each action, take a screenshot to verify the outcome
- Explicitly describe your evaluation: "I have evaluated step X and confirmed..."
- Only proceed to the next step after confirming success
- If an action fails, try again or attempt an alternative approach
### Input Methods:
- Rather use keyboard shortcuts over mouse movements for UI interactions like dropdowns, scrollbars, zooming browsers, etc.
- Use PgUp/PgDown keys for more reliable scrolling, but don’t scroll unless necessary.
- When working with spreadsheets, use arrow keys for cell selection rather than mouse clicks
- Perform operations in the background where possible e.g. running code, API, keyboard shortcuts, navigating directly to URL etc. instead of clicking and typing in the UI.
“””
The above system prompt suffix was generated based on suggestions in the Computer Use documentation: https://docs.anthropic.com/en/docs/build-with-claude/computer-use
Computer Use announcement article: https://www.anthropic.com/news/3-5-models-and-computer-use