# Connect to OpenAI-compatible API endpoints from Excel

> **Info**
>
> This feature is only available if your space is on the [Business or Enterprise plan](https://autosheet.com/docs/resources/pricing/subscription) or [pay-as-you-go pricing](https://autosheet.com/docs/resources/pricing/pay-as-you-go).

GPT for Excel – Autosheet can connect to any AI service that provides an [OpenAI-compatible API endpoint](https://developers.openai.com/api/reference/overview). You can connect to two main types of services: [**cloud-based platforms**](https://autosheet.com/docs/resources/guides/concepts#cloud-hosted-model), which provide access to models over the internet with no software installation or setup required on your part, and [**local servers**](https://autosheet.com/docs/resources/guides/concepts#local-model), which you run on a local machine, such as your own computer or another computer on a local network.

You can use the endpoint-connected models both as [Agent models](https://autosheet.com/docs/resources/guides/concepts#agent-model) and [bulk models](https://autosheet.com/docs/resources/guides/concepts#bulk-model), but the endpoint requirements are different:

- **Agent models**: The endpoint must be compatible with the [OpenAI Responses API](https://developers.openai.com/api/reference/responses/overview) and be publicly accessible over the internet through HTTPS. In addition, the model must support a context size of at least 32K tokens.
- **Bulk models**: The endpoint must be compatible with the [OpenAI Chat Completions API](https://developers.openai.com/api/reference/chat-completions/overview).

Here are some popular services that provide an OpenAI-compatible API endpoint:

- **Cloud-based platforms:**

  - [Anyscale](https://www.anyscale.com/)
  - [Fireworks AI](https://fireworks.ai/)
  - [Together AI](https://www.together.ai/)

- **Local servers:**

  - [LM Studio](https://lmstudio.ai/)
  - [LocalAI](https://localai.io/)
  - [Ollama](https://ollama.com/)

> **Info**
>
> Depending on the model you use, the model settings defined in Autosheet (temperature (creativity), top-p, frequency penalty, and presence penalty) may not work as expected. If you get bad results, try tweaking the settings.

To use models from an OpenAI-compatible API endpoint:

1. [Set up the endpoint.](https://autosheet.com/docs/gpt-for-excel/setup/manage-models/connect-to-api-endpoints#set-up-an-api-endpoint)
2. [Select a model available through the endpoint.](https://autosheet.com/docs/gpt-for-excel/setup/manage-models/connect-to-api-endpoints#select-a-model-from-the-api-endpoint)

## Set up an API endpoint

**Agent models**

**Prerequisites**

- You have an endpoint URL and, if needed, an API key for accessing the service.
- The endpoint supports the following OpenAI-compatible API resource path: `/v1/responses`
- The endpoint is publicly accessible over the internet through HTTPS.
- The model supports a context size of at least 32K tokens.

1. Sign in to the [Autosheet dashboard](https://dashboard.autosheet.com/) with your [Microsoft or Google account](https://autosheet.com/docs/gpt-for-excel/setup/sign-in).

2. In the sidebar, select **Custom API endpoints**.

3. Select the **Agent models** tab.

4. Click **OpenAI-compatible endpoints (Responses API)**.

   > **Tip**
   >
   > If you already have OpenAI-compatible API endpoints set up, click **Add an OpenAI-compatible API endpoint**.

5. Define the endpoint settings:

   - **Endpoint URL**: Enter the URL of the service that provides the endpoint.
   - **Model ID**: Enter the ID of the model to use through the endpoint. The model ID is sent to the endpoint in the request payload.
   - **Display name (optional)**: Enter a short name that identifies the model in the Agent model switcher.
   - **API key (optional)**: If required, enter the API key for accessing the service.

   ![Define OpenAI-compatible API endpoint settings](https://autosheet.com/docs/article-images/dashboard/api-endpoints-settings-openai-agent.png)

6. Click **Check** to validate the settings and click **Save**.

   ![Save OpenAI-compatible API endpoint settings](https://autosheet.com/docs/article-images/dashboard/api-endpoints-settings-openai-save.png)

You have set up the OpenAI-compatible API endpoint. The model is now available in the [Agent model switcher](https://autosheet.com/docs/gpt-for-excel/setup/manage-models/connect-to-api-endpoints#select-a-model-from-the-api-endpoint) and on the [models page](https://autosheet.com/docs/admin/ai-configuration/manage-models) of the Autosheet dashboard.

**Bulk models**

**Prerequisites**

- You have an endpoint URL and, if needed, an API key for accessing the service.

- The endpoint supports the following OpenAI-compatible API resource paths:

  - `/v1/models`
  - `/v1/chat/completions`

1. Sign in to the [Autosheet dashboard](https://dashboard.autosheet.com/) with your [Microsoft or Google account](https://autosheet.com/docs/gpt-for-excel/setup/sign-in).

2. In the sidebar, select **Custom API endpoints**.

3. Select the **Bulk models** tab.

4. Click **OpenAI-compatible endpoints (Chat Completions API)**.

   > **Tip**
   >
   > If you already have OpenAI-compatible API endpoints set up, click **Add an OpenAI-compatible API endpoint**.

5. Define the endpoint settings:

   - **Endpoint URL**: Enter the URL of the service that provides the endpoint.
   - **Display name (optional)**: Enter a short name that is prefixed to the model names in the model switcher. By default, the model names are prefixed with "custom/".
   - **API key (optional)**: If required, enter the API key for accessing the service.

   ![Define OpenAI-compatible API endpoint settings](https://autosheet.com/docs/article-images/dashboard/api-endpoints-settings-openai-bulk.png)

6. Click **Check** to validate the settings and click **Save**.

   ![Save OpenAI-compatible API endpoint settings](https://autosheet.com/docs/article-images/dashboard/api-endpoints-settings-openai-save.png)

   > **Tip**
   >
   > If you get an error saying that the URL is invalid, make sure that the endpoint supports:
   >
   > - **Cross-origin resource sharing (CORS).** See the LM Studio setup instructions for [macOS](https://autosheet.com/docs/gpt-for-excel/setup/manage-models/connect-to-api-endpoints/set-up-lm-studio-on-macos#start-and-configure-the-lm-studio-server) or [Windows](https://autosheet.com/docs/gpt-for-excel/setup/manage-models/connect-to-api-endpoints/set-up-lm-studio-on-windows#start-and-configure-the-lm-studio-server).
   > - **HTTPS (needed with Safari and with Microsoft Office for Mac).** See the LM Studio setup instructions for [macOS](https://autosheet.com/docs/gpt-for-excel/setup/manage-models/connect-to-api-endpoints/set-up-lm-studio-on-macos#enable-https-for-the-lm-studio-server).

You have set up the OpenAI-compatible API endpoint. You can now use all models available through the endpoint in GPT for Excel – Autosheet.

## Select a model from the API endpoint

**Agent models**

1. Open a Microsoft Excel workbook.

2. On the [ribbon](https://support.microsoft.com/en-US/Office/foundations-experiences/show-or-hide-the-ribbon-in-office), select **Home > GPT for Excel Word – Autosheet**.

   ![GPT for Excel Word – Autosheet on the Home ribbon](https://autosheet.com/docs/article-images/gpt-for-excel/launch.png)

   > **Info**
   >
   > If **GPT for Excel Word – Autosheet** is not visible on the ribbon, or if it's grayed out, select **Home > Add-ins > My Add-ins > GPT for Excel Word – Autosheet**. [Learn more.](https://autosheet.com/docs/gpt-for-excel/troubleshooting/add-in-not-working#add-in-button-is-grayed-out)

3. In the sidebar, select **Agent**.

4. Open the model switcher and select a model. You can find the endpoint-connected models at the end of the list.

   ![Select an endpoint-connected model for the Agent](https://autosheet.com/docs/article-images/gpt-for-excel/model-switcher-custom-endpoint-agent.png)

GPT for Excel – Autosheet now uses the selected model as the Agent model.

> **Info**
>
> Some Agent tools, such as web search, are not available when the Agent uses an endpoint-connected model.

**Bulk models**

1. Open a Microsoft Excel workbook.

2. On the [ribbon](https://support.microsoft.com/en-US/Office/foundations-experiences/show-or-hide-the-ribbon-in-office), select **Home > GPT for Excel Word – Autosheet**.

   ![GPT for Excel Word – Autosheet on the Home ribbon](https://autosheet.com/docs/article-images/gpt-for-excel/launch.png)

   > **Info**
   >
   > If **GPT for Excel Word – Autosheet** is not visible on the ribbon, or if it's grayed out, select **Home > Add-ins > My Add-ins > GPT for Excel Word – Autosheet**. [Learn more.](https://autosheet.com/docs/gpt-for-excel/troubleshooting/add-in-not-working#add-in-button-is-grayed-out)

3. In the sidebar, select **Bulk tools** and select one of the tools.

   ![Bulk tools in the sidebar](https://autosheet.com/docs/article-images/gpt-for-excel/bulk-tools-in-sidebar.png)

4. Open the model switcher and select a model. You can find the endpoint-connected models under **Connected models**, at the end of the list.

   ![Select an endpoint-connected model for bulk work](https://autosheet.com/docs/article-images/gpt-for-excel/model-switcher-custom-endpoint-bulk.png)

   > **Info**
   >
   > The available models depend on the models provided by the service.

Autosheet now uses the selected model to generate responses for bulk tools and GPT functions.

## What's next

- To try out an OpenAI-compatible AI service with Autosheet, set up LM Studio on [macOS](https://autosheet.com/docs/gpt-for-excel/setup/manage-models/connect-to-api-endpoints/set-up-lm-studio-on-macos) or [Windows](https://autosheet.com/docs/gpt-for-excel/setup/manage-models/connect-to-api-endpoints/set-up-lm-studio-on-windows).