Index

A

Asset (class in octoai.clients.asset_orch)

AssetOrchestrator (class in octoai.clients.asset_orch) Audio (class in octoai.types)

C

cancel() (octoai.clients.fine_tuning.FineTuningClient method) Chat (class in octoai.chat) ChatCompletion (class in octoai.chat) CheckpointData (class in octoai.clients.asset_orch) Choice (class in octoai.chat) ChoiceDelta (class in octoai.chat) choices (octoai.chat.ChatCompletion attribute) Client (class in octoai.client) client (octoai.chat.Completions attribute) CODELLAMA_13B_INSTRUCT (octoai.chat.TextModel attribute) CODELLAMA_34B_INSTRUCT (octoai.chat.TextModel attribute) CODELLAMA_70B_INSTRUCT (octoai.chat.TextModel attribute)

CODELLAMA_7B_INSTRUCT (octoai.chat.TextModel attribute) completion_tokens (octoai.chat.CompletionUsage attribute) Completions (class in octoai.chat) completions (octoai.chat.Chat attribute) CompletionUsage (class in octoai.chat) content (octoai.chat.ChoiceDelta attribute) CONTROLNET_SD (octoai.clients.image_gen.Engine attribute) CONTROLNET_SDXL (octoai.clients.image_gen.Engine attribute) create() (octoai.chat.Completions method) (octoai.clients.asset_orch.AssetOrchestrator method) (octoai.clients.fine_tuning.FineTuningClient method) created (octoai.chat.ChatCompletion attribute)

D

data (octoai.types.Audio attribute) (octoai.types.Image attribute) (octoai.types.Media attribute) (octoai.types.Video attribute)

default_download() (octoai.types.Media method) delete() (octoai.clients.asset_orch.AssetOrchestrator method) (octoai.clients.fine_tuning.FineTuningClient method) delta (octoai.chat.Choice attribute) download() (octoai.types.Media method)

E

endpoint (octoai.chat.Completions attribute)

Engine (class in octoai.clients.image_gen)

F

File (class in octoai.types) file (octoai.types.File attribute) FileData (class in octoai.clients.asset_orch) filename (octoai.types.File attribute) find_additional_endpoints() (in module octoai.service) FineTuningClient (class in octoai.clients.fine_tuning) finish_reason (octoai.chat.Choice attribute)

from_base64() (octoai.types.Media class method) from_endpoint_response() (octoai.types.Media class method) from_file() (octoai.types.Media class method) from_numpy() (octoai.types.Audio class method) (octoai.types.Video class method) from_pil() (octoai.types.Image class method) from_url() (octoai.types.Media class method)

G

generate() (octoai.clients.image_gen.ImageGenerator method) get() (octoai.clients.asset_orch.AssetOrchestrator method) (octoai.clients.fine_tuning.FineTuningClient method)

get_api_schema() (octoai.server.Server method) get_future_result() (octoai.client.Client method) get_model_list() (in module octoai.chat) get_usage_examples() (octoai.server.Server method)

H

headers (octoai.types.File attribute)

health_check() (octoai.client.Client method)

I

id (octoai.chat.ChatCompletion attribute) Image (class in octoai.types) ImageGenerateResponse (class in octoai.clients.image_gen) ImageGenerator (class in octoai.clients.image_gen) images (octoai.clients.image_gen.ImageGenerateResponse property) implements_form_data() (in module octoai.service) index (octoai.chat.Choice attribute) infer() (octoai.client.Client method) (octoai.service.Service method) infer_async() (octoai.client.Client method) INFER_FORM_DATA (octoai.server.ServiceMethod attribute) INFER_JSON (octoai.server.ServiceMethod attribute) infer_stream() (octoai.client.Client method) inference_time_ms (octoai.server.InferenceResponse attribute) (octoai.service.ResponseAnalytics attribute)

InferenceFuture (class in octoai.client) InferenceRequest (class in octoai.server) InferenceResponse (class in octoai.server) inputs (octoai.server.InferenceRequest attribute) inspect_input_parameters() (in module octoai.service) inspect_input_types() (in module octoai.service) inspect_output_types() (in module octoai.service) is_future_ready() (octoai.client.Client method) is_running (octoai.server.Server property) is_store_assets_needed() (in module octoai.server) is_valid() (octoai.types.Audio method) (octoai.types.Image method) (octoai.types.Video method)

L

LAUNCH_PREDICT_LOOP (octoai.server.Server.State attribute) list() (octoai.clients.asset_orch.AssetOrchestrator method) (octoai.clients.fine_tuning.FineTuningClient method)

LLAMA_2_13B_CHAT (octoai.chat.TextModel attribute) LLAMA_2_70B_CHAT (octoai.chat.TextModel attribute) load_service() (in module octoai.server) LoraData (class in octoai.clients.asset_orch)

M

maybe_set_volume_environment_variables() (in module octoai.server) Media (class in octoai.types) MediaUrl (class in octoai.types) message (octoai.chat.Choice attribute) method (octoai.server.InferenceRequest attribute) MISTRAL_7B_INSTRUCT (octoai.chat.TextModel attribute) MIXTRAL_8X7B_INSTRUCT (octoai.chat.TextModel attribute) model (octoai.chat.ChatCompletion attribute) model_config (octoai.chat.ChatCompletion attribute) (octoai.chat.Choice attribute) (octoai.chat.ChoiceDelta attribute) (octoai.chat.CompletionUsage attribute) (octoai.client.InferenceFuture attribute) (octoai.service.ResponseAnalytics attribute) (octoai.types.Audio attribute) (octoai.types.Image attribute) (octoai.types.Media attribute) (octoai.types.MediaUrl attribute) (octoai.types.Video attribute) model_fields (octoai.chat.ChatCompletion attribute) (octoai.chat.Choice attribute) (octoai.chat.ChoiceDelta attribute) (octoai.chat.CompletionUsage attribute) (octoai.client.InferenceFuture attribute) (octoai.service.ResponseAnalytics attribute) (octoai.types.Audio attribute) (octoai.types.Image attribute) (octoai.types.Media attribute) (octoai.types.MediaUrl attribute) (octoai.types.Video attribute)

ModelData (class in octoai.clients.asset_orch) module octoai octoai.chat octoai.client octoai.clients octoai.clients.asset_orch octoai.clients.fine_tuning octoai.clients.image_gen octoai.errors octoai.server octoai.service octoai.types octoai.utils

O

object (octoai.chat.ChatCompletion attribute) octoai module octoai.chat module octoai.client module octoai.clients module octoai.clients.asset_orch module octoai.clients.fine_tuning module octoai.clients.image_gen module octoai.errors module

octoai.server module octoai.service module octoai.types module octoai.utils module OctoAIAssetReadyTimeoutError OctoAIClientError OctoAIError OctoAIServerError OctoAIValidationError on_server_shutdown() (octoai.service.Service method) on_server_startup() (octoai.service.Service method) outputs (octoai.server.InferenceResponse attribute)

P

path() (in module octoai.service) performance_time_ms (octoai.service.ResponseAnalytics attribute)

poll_url (octoai.client.InferenceFuture attribute) prepare_for_serving() (octoai.server.Server method) prompt_tokens (octoai.chat.CompletionUsage attribute)

R

removed_for_safety (octoai.clients.image_gen.ImageGenerateResponse property) response_id (octoai.client.InferenceFuture attribute) response_pipe (octoai.server.InferenceRequest attribute) ResponseAnalytics (class in octoai.service)

retry() (in module octoai.utils) role (octoai.chat.ChoiceDelta attribute) run() (octoai.server.Server method) RUNNING (octoai.server.Server.State attribute)

S

SD (octoai.clients.image_gen.Engine attribute) SDXL (octoai.clients.image_gen.Engine attribute) Server (class in octoai.server) Server.State (class in octoai.server) Service (class in octoai.service) ServiceMethod (class in octoai.server) setup() (octoai.service.Service method) SETUP_SERVICE (octoai.server.Server.State attribute)

SHUTTING_DOWN (octoai.server.Server.State attribute) size (octoai.types.File attribute) SSD (octoai.clients.image_gen.Engine attribute) state (octoai.server.Server property) STOPPED (octoai.server.Server.State attribute) store_assets() (octoai.server.Server method) (octoai.service.Service method) system_fingerprint (octoai.chat.ChatCompletion attribute)

T

TextModel (class in octoai.chat) TextualInversionData (class in octoai.clients.asset_orch) to_base64() (octoai.types.Media method) to_bytes() (octoai.types.Media method) to_file() (octoai.types.Media method) to_name() (octoai.chat.TextModel method) (octoai.clients.image_gen.Engine method)

to_numpy() (octoai.types.Audio method) (octoai.types.Video method) to_numpy_iterator() (octoai.types.Video method) to_pil() (octoai.types.Image method) total_tokens (octoai.chat.CompletionUsage attribute) transform_form_data_signature() (in module octoai.service)

U

UNINITIALIZED (octoai.server.Server.State attribute) url (octoai.types.MediaUrl attribute)

url2str() (octoai.types.MediaUrl method) usage (octoai.chat.ChatCompletion attribute)

V

VAEData (class in octoai.clients.asset_orch)

Video (class in octoai.types) volume_path() (in module octoai.service)

W

wait_for_ready() (octoai.clients.asset_orch.AssetOrchestrator method)