easyai-ai-gateway/apps/api/internal/skillbundle/content/skills/ai-gateway-ops-management/references/model-pricing-and-policies.md

Model Pricing and Policies

Contents

• Pricing Rule Sets
• Billing Configuration and Estimate Reconciliation
• Runtime Policy Sets
• Runner Policy and Runtime Recovery

Pricing Rule Sets

Read rule sets and effective rule rows:

curl --fail-with-body \
  -H "Authorization: Bearer $GATEWAY_ADMIN_TOKEN" \
  "$GATEWAY_BASE_URL/api/admin/pricing/rule-sets"

curl --fail-with-body \
  -H "Authorization: Bearer $GATEWAY_ADMIN_TOKEN" \
  "$GATEWAY_BASE_URL/api/admin/pricing/rules"

Reuse-first pricing decision

Do not create a pricing rule until all existing active rule sets have been compared against the target resource types, units, calculator types, base prices, weights, and conditions.

Evaluate the price that the runtime will actually use:

1. Identify the inherited pricing source from the base model and platform, then check whether the platform-model has an explicit pricingRuleSetId or billing override.
2. Reuse the existing rule when it already describes the required raw unit prices and calculators.
3. Apply the effective discount:
   • a positive platform-model discountFactor takes precedence;
   • otherwise pricingMode: "inherit_discount" uses the platform defaultDiscountFactor;
   • AI Gateway does not multiply the platform and platform-model discount factors together.
4. Verify the resulting amount with /api/v1/pricing/estimate, simulation billing lines, or an approved test request.
5. Create a new rule set only when no existing rule plus the available platform/platform-model discount can produce the required price or express the required unit/calculator structure.

Do not clone an otherwise identical pricing rule merely to represent a provider or account discount. Keep the reusable base price in the rule and express the instance-specific adjustment with defaultDiscountFactor or discountFactor.

For the complete binding, estimate, task-charge, and wallet-reconciliation workflow, read model-billing-configuration-and-estimation.md before changing billing settings.

Create an example text pricing rule set:

curl --fail-with-body \
  -H "Authorization: Bearer $GATEWAY_ADMIN_TOKEN" \
  -H 'Content-Type: application/json' \
  -d '{
    "ruleSetKey": "example-chat-pricing-v1",
    "name": "Example Chat Pricing",
    "description": "Input and output token pricing",
    "category": "model",
    "currency": "resource",
    "status": "active",
    "metadata": {},
    "rules": [
      {
        "ruleKey": "input",
        "displayName": "Input tokens",
        "resourceType": "text_input",
        "unit": "1k_tokens",
        "basePrice": 0.001,
        "calculatorType": "token_usage",
        "priority": 10,
        "status": "active"
      },
      {
        "ruleKey": "output",
        "displayName": "Output tokens",
        "resourceType": "text_output",
        "unit": "1k_tokens",
        "basePrice": 0.002,
        "calculatorType": "token_usage",
        "priority": 20,
        "status": "active"
      }
    ]
  }' \
  "$GATEWAY_BASE_URL/api/admin/pricing/rule-sets"

PATCH /api/admin/pricing/rule-sets/{ruleSetID} replaces the stored rules with the supplied list. Preserve every rule that should remain. Delete only non-default rule sets after checking base-model, platform, and platform-model bindings.

Runtime Policy Sets

Read and create policies:

curl --fail-with-body \
  -H "Authorization: Bearer $GATEWAY_ADMIN_TOKEN" \
  "$GATEWAY_BASE_URL/api/admin/runtime/policy-sets"

Compare the existing policy sets before creating one. Reuse a policy when the effective rate-limit metrics, limits, windows, concurrency lease TTL, retry count, auto-disable behavior, degradation behavior, and scope semantics match the target. A different platform name or model name alone is not a reason to duplicate a policy.

Create a new policy only when at least one required behavior cannot be represented by an existing policy plus the supported platform-model override fields. Record the mismatch that justified the new policy.

{
  "policyKey": "example-balanced-v1",
  "name": "Example Balanced",
  "description": "Retry and concurrency policy",
  "rateLimitPolicy": {
    "rules": [
      {"metric": "rpm", "limit": 60, "windowSeconds": 60},
      {"metric": "concurrent", "limit": 5, "leaseTtlSeconds": 120}
    ]
  },
  "retryPolicy": {"maxRetries": 2},
  "autoDisablePolicy": {},
  "degradePolicy": {},
  "metadata": {},
  "status": "active"
}

POST the body to /api/admin/runtime/policy-sets. Use PATCH with a complete body. Default policy sets cannot be deleted.

Runner Policy and Runtime Recovery

Read the current global runner policy before changing it:

curl --fail-with-body \
  -H "Authorization: Bearer $GATEWAY_ADMIN_TOKEN" \
  "$GATEWAY_BASE_URL/api/admin/runtime/runner-policy"

PATCH the same endpoint with the complete current fields plus approved changes to failoverPolicy, hardStopPolicy, singleSourcePolicy, or cacheAffinityPolicy.

Operational endpoints:

• PATCH /api/admin/platforms/{platformID}/dynamic-priority
• GET /api/admin/runtime/rate-limit-windows
• GET /api/admin/runtime/model-rate-limits
• POST /api/admin/runtime/model-rate-limits/{platformModelID}/restore

Use restore only after identifying whether the model, platform cooldown, or platform disablement was automatic and whether the upstream condition has recovered.