Responses

  • 200 application/json
    Hide response attribute Show response attribute object
    • endpointsarray[object] Required
      Hide endpoints attributes Show endpoints attributes object
      • chunking_settingsobject
        Hide chunking_settings attributes Show chunking_settings attributes object
        • max_chunk_sizenumber

          The maximum size of a chunk in words. This value cannot be higher than 300 or lower than 20 (for sentence strategy) or 10 (for word strategy).

        • overlapnumber

          The number of overlapping words for chunks. It is applicable only to a word chunking strategy. This value cannot be higher than half the max_chunk_size value.

        • sentence_overlapnumber

          The number of overlapping sentences for chunks. It is applicable only for a sentence chunking strategy. It can be either 1 or 0.

        • strategystring

          The chunking strategy: sentence or word.

      • servicestring Required

        The service type

      • service_settingsobject Required
      • task_settingsobject
      • inference_idstring Required

        The inference Id

      • task_typestring Required

        Values are sparse_embedding, text_embedding, rerank, completion, or chat_completion.

GET /_inference
curl \
 --request GET 'http://api.example.com/_inference' \
 --header "Authorization: $API_KEY"