Skip to Content
kosemdocs
ReferenceAPILlm gateway settings

Get LLM gateway settings in organization

Gets the LLM gateway's settings of an organization or a project. The settings set at this level, of which those unset are absent; what applies, in `effective`, with where each value comes from; and what the level above makes apply, in `inherited`, which a setting unset here takes. The ETag header is the settings' revision.

GET
/v1/organizations/{organization}/settings/llmGateway

Gets the LLM gateway's settings of an organization or a project.

The settings set at this level, of which those unset are absent; what applies, in effective, with where each value comes from; and what the level above makes apply, in inherited, which a setting unset here takes. The ETag header is the settings' revision.

Authorization

bearer
headerAuthorizationBearer <token>

An access token, or an API key.

Path Parameters

organization*string

The organization's ID.

Match^org_[0-7][0-9a-hjkmnp-tv-z]{25}$

Response Body

OK

application/json
  1. response
effective*

What the level above makes apply, which a setting unset here takes: for a project, its organization's effective settings; for an organization, kosem's defaults.

inherited*

What the level above makes apply, which a setting unset here takes: for a project, its organization's effective settings; for an organization, kosem's defaults.

monthlySpendLimit?

The most that requests here may cost in a calendar month (UTC), in US dollars; absent while unset, which is no limit. An organization's limit counts all of its projects, and a project's only itself. Once a limit is reached, the gateway refuses requests until the month ends; requests already running may go a little past it. Only models whose prices kosem knows count.

name*string

Resource name, organizations/{organization_id}/settings/llmGateway or projects/{project_id}/settings/llmGateway.

updateTime?string

When the settings set here last changed; absent if they never did.

Formatdate-time
Example Request
curl -X GET 'https://api.kosem.ai/v1/organizations/string/settings/llmGateway'
Example Response
{
  "effective": {
    "monthlySpendLimit": {
      "source": "organization",
      "value": {
        "currencyCode": "string",
        "nanos": -999999999,
        "units": 0
      }
    }
  },
  "inherited": {
    "monthlySpendLimit": {
      "source": "organization",
      "value": {
        "currencyCode": "string",
        "nanos": -999999999,
        "units": 0
      }
    }
  },
  "monthlySpendLimit": {
    "currencyCode": "string",
    "nanos": -999999999,
    "units": 0
  },
  "name": "string",
  "updateTime": "2019-08-24T14:15:22Z"
}