> For the complete documentation index, see [llms.txt](https://docs.enginsight.com/docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.enginsight.com/docs/manual/english/platform-usage/siem/orchestration-soar-beta/llm-providers/add-llm-provider.md).

# Add LLM Provider

{% hint style="warning" %}
**Please note**: This view is currently in **Beta status**. User interface and functionalities can change at any time.

<i class="fa-eye">:eye:</i> This view is only visible if you have enabled the **Enable beta features** option under **Settings** → [User Account](/docs/manual/english/administration/settings/user-account.md).
{% endhint %}

***

<i class="fa-computer-mouse">:computer-mouse:</i> Click <i class="fa-plus">:plus:</i> **Add LLM Provider** in the upper-right corner of the [LLM provider overview](/docs/manual/english/platform-usage/siem/orchestration-soar-beta/llm-providers.md#llm-providers-overview) to add a new LLM provider. The **SIEM** → **Orchestration (SOAR)** → **LLM Providers** → **Add** view opens.

<figure><img src="https://2423388680-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FV7OrHgKXA0t1jankQBYf%2Fuploads%2FqTv7IaS4Q3oHtNgZIsR8%2Fenginsight-screenshot-siem-orchestration-llm%20provider-add%20llm%20provider.jpg?alt=media&amp;token=7b45cadf-a0ed-438f-8fcb-8244d85789f6" alt=""><figcaption></figcaption></figure>

<i class="fa-computer-mouse">:computer-mouse:</i> After configuring all settings, click **Add LLM Provider** to save and add the new LLM provider.

<i class="fa-computer-mouse">:computer-mouse:</i> Click **Back** to return to the list overview.

{% hint style="danger" %}
**Please note**: If you leave this view without saving, all configured settings will be lost and cannot be recovered.
{% endhint %}

***

## General Settings

Here you can configure various basic settings.

<figure><img src="https://2423388680-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FV7OrHgKXA0t1jankQBYf%2Fuploads%2FWXsLOe4WmRKT44rt6GxF%2Fenginsight-screenshot-siem-orchestration-llm%20provider-add%20llm%20provider-general%20settings.jpg?alt=media&amp;token=f2647d19-25d5-41ac-8b43-39fe60dea0e2" alt=""><figcaption></figcaption></figure>

The following options are available:

<table><thead><tr><th width="200.21875">Option</th><th>Description</th></tr></thead><tbody><tr><td>Name</td><td>Enter a meaningful name for the LLM provider.</td></tr><tr><td>Description</td><td><p>Provide a more detailed description for the LLM provider.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>This field is optional.</p></div></td></tr><tr><td>Enabled</td><td><p>Enable the LLM provider so that it can be used to perform actions in the context of the <a href="/docs/manual/english/platform-usage/siem/data-lake.md">data lake</a> and in <a href="/docs/manual/english/platform-usage/siem/orchestration-soar-beta/playbooks.md">playbooks</a>.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>This option is disabled by default.</p></div><p><i class="fa-computer-mouse">:computer-mouse:</i> Select or deselect the checkbox <i class="fa-square">:square:</i> next to <strong>Enabled</strong> to enable or or disable the LLM provider.</p></td></tr><tr><td>Standard LLM Provider</td><td><p>Set this LLM provider as the standard provider. If you do not select a different provider when entering a prompt, the provider defined here is used by default.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>This option is disabled by default.</p></div><p><i class="fa-computer-mouse">:computer-mouse:</i> Select or deselect the checkbox <i class="fa-square">:square:</i> next to <strong>Standard LLM Provider</strong> to enable or disable the use of this LLM provider as the standard.</p></td></tr></tbody></table>

***

## Provider Details

Here you can select an LLM provider and enter the information required for API access to the selected model.

{% hint style="warning" %}
**Please note**: Model requests may incur high costs depending on the context length and number of tokens. Check the current pricing for the LLM you use and monitor your consumption regularly.
{% endhint %}

<figure><img src="https://2423388680-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FV7OrHgKXA0t1jankQBYf%2Fuploads%2FQBn0AQ1hJms7ZcALlBnu%2Fenginsight-screenshot-siem-orchestration-llm%20provider-add%20llm%20provider-provider%20details.jpg?alt=media&amp;token=1529accd-56c1-432b-8adc-31bc39f8dfba" alt=""><figcaption></figcaption></figure>

The following options are available:

<table><thead><tr><th width="200.13671875">Option</th><th>Provider</th></tr></thead><tbody><tr><td>Provider</td><td><p>Select the provider of the LLM that you want to use.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>ChatGPT is selected as the default LLM provider.</p></div><p><i class="fa-computer-mouse">:computer-mouse:</i> Click the <strong>Provider</strong> field to expand a list of all available LLM providers and  select a provider.<br><br>The following providers are available:</p><ul><li><strong>ChatGPT</strong></li><li><strong>Ollama</strong></li><li><strong>DeepMask</strong></li><li><strong>OpenAI Compatible</strong>: All LLM providers that use the OpenAI API, for example IONOS CLOUD AI.</li></ul></td></tr><tr><td>Model</td><td>Enter the <em>model identifier</em> of the specific model that you want to use.</td></tr><tr><td>Base URL</td><td><p><i class="fa-eye">:eye:</i> This option is not available for all LLM providers.<br></p><p>Enter the base URL used to access the LLM provider's API.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>For information about an LLM provider's base URL, refer to the respective provider documentation.</p></div></td></tr><tr><td>Key</td><td>Enter the API key for the selected LLM provider to authenticate and execute requests to the model.</td></tr><tr><td>Parallel Prompts</td><td><p>Define how many prompts the LLM is allowed to process simultaneously.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>The default value is <strong>1</strong>.</p></div><p><i class="fa-computer-mouse">:computer-mouse:</i> Click the <strong>Parallel Prompts</strong> field and use the <i class="fa-angle-up">:angle-up:</i> and <i class="fa-angle-down">:angle-down:</i> buttons to increase or decrease the number. Alternatively, enter a number manually and press <strong>Enter</strong> to confirm your input.</p></td></tr></tbody></table>

***

## Usage Limits

Here you can define usage limits for tokens, requests, or computing time to control the resource consumption of the LLM in use.

<i class="fa-computer-mouse">:computer-mouse:</i> Click <i class="fa-plus">:plus:</i> **Add Usage Limits** to open additional input fields where you can define a new usage limit.

<figure><img src="https://2423388680-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FV7OrHgKXA0t1jankQBYf%2Fuploads%2F1stUApPyzhAc7XnveCIv%2Fenginsight-screenshot-siem-orchestration-llm%20provider-add%20llm%20provider-usage%20limits.jpg?alt=media&amp;token=9c385a0c-f76c-42fd-9db1-69b7c6c748f0" alt=""><figcaption></figcaption></figure>

The following options are available:

<table><thead><tr><th width="200.21875">Option</th><th>Description</th></tr></thead><tbody><tr><td>Type</td><td><p>Shows the type of resource whose consumption should be limited.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>This field cannot be changed. The default type is <strong>Tokens</strong>.</p></div></td></tr><tr><td>Threshold</td><td><p>Enter the maximum amount of the resource that may be used within the defined time horizon.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>The default limit is <strong>1000000</strong>.</p></div><p><i class="fa-computer-mouse">:computer-mouse:</i> Click the <strong>Threshold</strong> field and use the <i class="fa-angle-up">:angle-up:</i> and <i class="fa-angle-down">:angle-down:</i> buttons to increase or decrease the number. Alternatively, enter a number manually and press <strong>Enter</strong> to confirm your input.</p></td></tr><tr><td>Time Horizon</td><td><p>Select the unit of time for the usage limit. The time horizon is determined by the time unit selected here and the configured interval.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>The default time unit is <strong>Months</strong>.</p></div><p><i class="fa-computer-mouse">:computer-mouse:</i> Click the <strong>Time Horizon</strong> field to expand a list of all available options, then select an option.<br><br>The following options are available:</p><ul><li><strong>Months</strong>: The usage limit applies on a monthly basis.</li><li><strong>Weeks</strong>: The usage limit applies on a weekly basis.</li><li><strong>Days</strong>: The usage limit applies on a daily basis.</li></ul></td></tr><tr><td>Interval</td><td><p>Define the number of days, weeks, or months for which the usage limit applies.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>The default interval is <strong>1</strong>.</p></div><p><i class="fa-computer-mouse">:computer-mouse:</i> Click the <strong>Interval</strong> field and use the <i class="fa-angle-up">:angle-up:</i> and <i class="fa-angle-down">:angle-down:</i> buttons to increase or decrease the number. Alternatively, enter a number manually and press <strong>Enter</strong> to confirm your input.</p></td></tr></tbody></table>

<i class="fa-computer-mouse">:computer-mouse:</i> Click **Reset Usage Limits** and confirm the message that appears by clicking **Delete** to remove all added usage limits.

<i class="fa-computer-mouse">:computer-mouse:</i> Click the **Delete** icon <i class="fa-trash">:trash:</i> next to the input fields for a usage limit to delete the respective usage limit.

***

## Further Resources

**Knowledge Base**

* [How do I create an LLM provider for IONOS CLOUD AI in the Enginsight SIEM?](https://docs.enginsight.com/docs/knowledge-base/english/vendor-specific-guides/how-do-i-create-an-llm-provider-for-ionos-cloud-ai-in-the-enginsight-siem)

***
