Content
In this post, we’ll explore how to use the Goose screen toolkit alongside Goose AI to enhance productivity and streamline your workflows.
Table of Contents
- What is Goose?
Getting Started with Goose AI
- Step 1: Install Goose
- Step 2: Obtain API Keys
- Step 3: Configure Goose Profiles
Using Goose for Screenshots
- Taking Screenshots
- Creating HTML Page from a Screenshot
What is Goose?
Goose is your AI-powered agent designed to:
- Automate repetitive tasks.
- Assist in debugging.
- Help you write code more efficiently.
It’s a tool aimed at boosting productivity for developers and tech enthusiasts alike.
Getting Started with Goose AI
Step 1: Install Goose
The first step is to download and install Goose. Visit the official Goose installation page for instructions tailored to your operating system.
Step 2: Obtain API Keys
To connect Goose with your AI provider, you need to obtain API keys. For OpenAI, visit the API Key page and follow the instructions to generate your key.
Step 3: Configure Goose Profiles
After installing Goose, edit the profiles.yaml file to add the screen toolkit. Use your preferred text editor to update the configuration as follows:
~/.config/goose/profiles.yaml
default:
provider: openai
processor: gpt-4o
accelerator: gpt-4o
moderator: passive
toolkits:
- name: developer
requires: {}
- name: screen
requires: {}
Save changes and exit
Start goose session by typing
goose session start
Taking Screenshots in the Goose Terminal
To capture a screenshot using Goose, simply type:
Take the screenshot of my system
Enter the command to open the image
open /tmp/goose_screenshot_87f9f7e4e51c4895bb265fc26091d66e.jpg
Creating HTML Page from a Screenshot
- Let’s take it a step further by creating a simple HTML page based on a screenshot. Here’s the screenshoot that we're going to ask to goose to take:
Capturing the Screenshot
- Ensure the desired file is open in your IDE (e.g., VS Code).
- Ask Goose to take a screenshot by typing:
Did you see the VS Code, take the screenshot
To describe the screenshot, ask Goose with the following command:
Describe this
/tmp/goose_screenshot_eee0a601cf1e430d8ef14c30adf123cf.jpg
The response
The screenshot shows a dark-themed IDE with an HTML file
open. The HTML file
contains the basic structure of a webpage with a <title> and
<body> section,
which includes a header and a paragraph. The sidebar appears to
have a
directory structure visible. If you need more details, let me
know!
- Instruct goose to generate the code
implement the html code inside the index.html you just created of the screen
shoot you just captured
The code
<!DOCTYPE html>
<html>
<head>
<title>My First Webpage</title>
</head>
<body>
<h1>My First Webpage</h1>
<p>This is a paragraph...</p>
</body>
</html>
- Finally I will ask goose to open the file in my browser
open the index.html in my chrome
Voila it opens!!!
Using goose screen it easily simplifies your tasks, and makes you more productive