2025-01-24 13:04:43 -08:00
---
2025-01-25 10:14:27 -06:00
sidebar_position: 2
title: Configure LLM Provider
2025-01-24 13:04:43 -08:00
---
import Tabs from '@theme/Tabs ';
import TabItem from '@theme/TabItem ';
# Supported LLM Providers
2025-01-25 10:14:27 -06:00
You can use Goose with your preferred LLM. Goose supports a variety of LLM providers. To configure your chosen provider or see available options, run `goose configure` in the CLI or visit the `Provider Settings` page in the Goose Desktop.
2025-01-24 13:04:43 -08:00
<Tabs groupId="interface">
<TabItem value="cli" label="Goose CLI" default>
1. Run the following command:
2025-01-26 02:08:39 -06:00
2025-01-24 13:04:43 -08:00
```sh
goose configure
` ``
2025-01-26 02:08:39 -06:00
2. Select ` Configure Providers` from the menu and press Enter.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
` ``
┌ goose-configure
│
◆ What would you like to configure?
│ ● Configure Providers (Change provider or update credentials)
│ ○ Toggle Extensions
│ ○ Add Extension
└
` ``
3. Choose a model provider and press Enter.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
` ``
┌ goose-configure
│
◇ What would you like to configure?
│ Configure Providers
│
◆ Which model provider should we use?
│ ● Anthropic (Claude and other models from Anthropic)
│ ○ Databricks
│ ○ Google Gemini
│ ○ Groq
│ ○ Ollama
│ ○ OpenAI
│ ○ OpenRouter
└
` ``
4. Enter you API key when prompted. Get more info on [how to obtain your API key](/docs/getting-started/providers#available-providers).
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
## Available Providers
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
### OpenAI
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
OpenAI offers powerful language models that include GPT-4, GPT-3.5-turbo, and more.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
1. Run the following command and choose ` Configure Providers`:
` ``sh
goose configure
` ``
2. Select ` OpenAI` from the list of available providers.
3. Enter your ` OPENAI_API_KEY` when prompted, which you can obtain by registering at [OpenAI's platform](https://platform.openai.com/api-keys).
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
### Databricks
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
Databricks is a data analytics and AI platform that provides access to various AI models and tools. They offer integration with popular models and custom model deployment.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
1. Run the following command and choose ` Configure Providers`:
` ``sh
goose configure
` ``
2. Select ` Databricks` as your provider.
3. Enter your ` DATABRICKS_HOST` and ` DATABRICKS_TOKEN`, which can be generated in your [Databricks Account Settings](https://www.databricks.com/).
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
### Ollama
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
Ollama is an open-source project that allows running large language models locally. It supports various open-source models and provides an API for integration.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
1. Run the following command and choose ` Configure Providers`:
` ``sh
goose configure
` ``
2. Select ` Ollama` and follow the steps to download and set up your models as detailed on [Ollama's site](https://ollama.com/). Requires ` OLLAMA_HOST`.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
### Anthropic
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
Anthropic is an AI research company that offers advanced language models through its API. Their primary model is Claude, which comes in various versions.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
1. Run the following command and choose ` Configure Providers`:
` ``sh
goose configure
` ``
2. Choose ` Anthropic` and provide the ` ANTHROPIC_API_KEY`, obtainable via [Anthropic's platform](https://www.anthropic.com/).
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
### Google Gemini
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
Google Gemini is a suite of large language models developed by Google. It offers multimodal capabilities and can be accessed through the [Google AI Studio](https://ai.google.dev/gemini-api/docs).
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
1. Run the following command and choose ` Configure Providers`:
` ``sh
goose configure
` ``
2. Pick ` Google Gemini` from the list of providers and input your ` GOOGLE_API_KEY`.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
### Groq
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
Groq is an AI company that offers high-performance inference for large language models. They provide access to various models through their API.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
1. Run the following command and choose ` Configure Providers`:
` ``sh
goose configure
` ``
2. Select ` Groq` from the list of providers and input your ` GROQ_API_KEY`, set up via the [Groq Console](https://groq.com/).
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
### OpenRouter
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
OpenRouter is a platform that provides access to multiple AI models from various providers through a single API. It simplifies the process of using different AI models in applications.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
1. Run the following command and choose ` Configure Providers`:
` ``sh
goose configure
` ``
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
2. Select ` OpenRouter` from the list of providers and input your ` OPENROUTER_API_KEY`, set up via the [OpenRouter Console](https://openrouter.ai/).
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
</TabItem>
<TabItem value="ui" label="Goose Desktop">
**To update your LLM provider and API key:**
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
1. Click the three dots (` ...`) in the top-right corner.
2. Select ` Provider Settings` from the menu.
3. Click Edit, enter your API key, and click ` Set as Active`.
2025-01-24 13:04:43 -08:00
2025-01-26 02:08:39 -06:00
</TabItem>
</Tabs>