fortinet.fortios.fortios_llm_server module – Configure LLM Proxy servers in Fortinet’s FortiOS and FortiGate.

Note

This module is part of the fortinet.fortios collection (version 2.6.0).

You might already have this collection installed if you are using the ansible package. It is not included in ansible-core. To check whether it is installed, run ansible-galaxy collection list.

To install it, use: ansible-galaxy collection install fortinet.fortios. You need further requirements to be able to use this module, see Requirements for details.

To use it in a playbook, specify: fortinet.fortios.fortios_llm_server.

New in fortinet.fortios 2.0.0

Synopsis

  • This module is able to configure a FortiGate or FortiOS (FOS) device by allowing the user to set and modify llm feature and server category. Examples include all parameters and values need to be adjusted to datasources before usage. Tested with FOS v6.0.0

Requirements

The below requirements are needed on the host that executes this module.

  • ansible>=2.16

Parameters

Parameter

Comments

access_token

string

Token-based authentication. Generated from GUI of Fortigate.

enable_log

boolean

Enable/Disable logging for task.

Choices:

  • false ← (default)

  • true

llm_server

dictionary

Configure LLM Proxy servers.

accept_custom_model

string

accept custom model

Choices:

  • "enable"

  • "disable"

anthropic_version

string

Anthropic version in API

api_key

list / elements=string

API Keys of the LLM server

azure_api_version

string

Azure API version.

azure_resource_name

string

Azure resource name.

built_in_server

string

built-in LLM server

Choices:

  • "openai"

  • "azure"

  • "azure-openai"

  • "gemini"

  • "anthropic"

  • "grok"

  • "gemini-with-openai-api"

  • "anthropic-with-openai-api"

chat_completions_api

string

Chat Completions API of this server

Choices:

  • "none"

  • "openai"

  • "azure-openai"

  • "gemini"

  • "anthropic"

custom_model_allow_regex

string

custom model allow regex, allow all if empty

custom_model_block_regex

string

custom model block regex, no block if empty

display_name

string

display name of the LLM Server

end_point

string

Overwrite the default end-point of the vendor.

image_gen_api

string

Image-Gen API of this server

Choices:

  • "none"

  • "openai"

  • "azure-openai"

models

list / elements=string

models of the LLM Server

name

string / required

LLM Proxy server name.

type

string

LLM server type

Choices:

  • "built-in"

  • "customized"

verify_cert

string

Enable/disable certificate verification.

Choices:

  • "enable"

  • "disable"

member_path

string

Member attribute path to operate on.

Delimited by a slash character if there are more than one attribute.

Parameter marked with member_path is legitimate for doing member operation.

member_state

string

Add or delete a member under specified attribute path.

When member_state is specified, the state option is ignored.

Choices:

  • "present"

  • "absent"

state

string / required

Indicates whether to create or remove the object.

Choices:

  • "present"

  • "absent"

vdom

string

Virtual domain, among those defined previously. A vdom is a virtual instance of the FortiGate that can be configured and used as a different unit.

Default: "root"

Notes

Note

  • Legacy fortiosapi has been deprecated, httpapi is the preferred way to run playbooks

Examples

- name: Configure LLM Proxy servers.
  fortinet.fortios.fortios_llm_server:
      vdom: "{{ vdom }}"
      state: "present"
      access_token: "<your_own_value>"
      llm_server:
          accept_custom_model: "enable"
          anthropic_version: "<your_own_value>"
          api_key: "<your_own_value>"
          azure_api_version: "<your_own_value>"
          azure_resource_name: "<your_own_value>"
          built_in_server: "openai"
          chat_completions_api: "none"
          custom_model_allow_regex: "<your_own_value>"
          custom_model_block_regex: "<your_own_value>"
          display_name: "<your_own_value>"
          end_point: "<your_own_value>"
          image_gen_api: "none"
          models: "<your_own_value>"
          name: "default_name_16"
          type: "built-in"
          verify_cert: "enable"

Return Values

Common return values are documented here, the following are the fields unique to this module:

Key

Description

build

string

Build number of the fortigate image

Returned: always

Sample: "1547"

http_method

string

Last method used to provision the content into FortiGate

Returned: always

Sample: "PUT"

http_status

string

Last result given by FortiGate on last operation applied

Returned: always

Sample: "200"

mkey

string

Master key (id) used in the last call to FortiGate

Returned: success

Sample: "id"

name

string

Name of the table used to fulfill the request

Returned: always

Sample: "urlfilter"

path

string

Path of the table used to fulfill the request

Returned: always

Sample: "webfilter"

revision

string

Internal revision number

Returned: always

Sample: "17.0.2.10658"

serial

string

Serial number of the unit

Returned: always

Sample: "FGVMEVYYQT3AB5352"

status

string

Indication of the operation’s result

Returned: always

Sample: "success"

vdom

string

Virtual domain used

Returned: always

Sample: "root"

version

string

Version of the FortiGate

Returned: always

Sample: "v5.6.3"

Authors

  • Link Zheng (@chillancezen)

  • Jie Xue (@JieX19)

  • Hongbin Lu (@fgtdev-hblu)

  • Frank Shen (@frankshen01)

  • Miguel Angel Munoz (@mamunozgonzalez)

  • Nicolas Thomas (@thomnico)