Class Gemini

Integration for Gemini models.

Hierarchy (View Summary)

BaseLlm
- Gemini
  - ApigeeLlm

Constructors

constructor

new Gemini(params: GeminiParams): Gemini
Parameters
- params: GeminiParams
  The parameters for creating a Gemini instance.
Returns Gemini
Overrides BaseLlm.constructor
- Defined in core/src/models/google_llm.ts:96

Properties

`Readonly`[BASE_MODEL_SYMBOL]

"[BASE_MODEL_SYMBOL]": true

A unique symbol to identify BaseLlm classes.

`Readonly`[GEMINI_MODEL_SYMBOL]

"[GEMINI_MODEL_SYMBOL]": true

`Readonly`model

model: string

`Readonly`useInteractionsApi

useInteractionsApi: boolean

`Protected` `Readonly`vertexai

vertexai: boolean

`Static` `Readonly`supportedModels

supportedModels: (string | RegExp)[] = ...

A list of model name patterns that are supported by this LLM.

Returns

A list of supported models.

Accessors

apiBackend

get apiBackend(): GoogleLLMVariant
Returns GoogleLLMVariant
- Defined in core/src/models/google_llm.ts:239

apiClient

get apiClient(): GoogleGenAI
Returns GoogleGenAI
- Defined in core/src/models/google_llm.ts:218

liveApiClient

get liveApiClient(): GoogleGenAI
Returns GoogleGenAI
- Defined in core/src/models/google_llm.ts:263

liveApiVersion

get liveApiVersion(): string
Returns string
- Defined in core/src/models/google_llm.ts:248

`Protected`trackingHeaders

get trackingHeaders(): Record<string, string>
Returns Record<string, string>
Inherited from BaseLlm.trackingHeaders
- Defined in core/src/models/base_llm.ts:81

Methods

connect

connect(llmRequest: LlmRequest): Promise<BaseLlmConnection>
Connects to the Gemini model and returns an llm connection.
Parameters
- llmRequest: LlmRequest
  LlmRequest, the request to send to the Gemini model.
Returns Promise<BaseLlmConnection>
BaseLlmConnection, the connection to the Gemini model.
Overrides BaseLlm.connect
- Defined in core/src/models/google_llm.ts:288

generateContentAsync

generateContentAsync(
    llmRequest: LlmRequest,
    stream?: boolean,
    abortSignal?: AbortSignal,
): AsyncGenerator<LlmResponse, void>
Sends a request to the Gemini model.
Parameters
- llmRequest: LlmRequest
  LlmRequest, the request to send to the Gemini model.
- stream: boolean = false
  bool = false, whether to do streaming call.
- OptionalabortSignal: AbortSignal
Returns AsyncGenerator<LlmResponse, void>
Yields
LlmResponse: The model response.
Overrides BaseLlm.generateContentAsync
- Defined in core/src/models/google_llm.ts:157

`Protected`getHttpOptions

getHttpOptions(): HttpOptions
Returns HttpOptions
- Defined in core/src/models/google_llm.ts:214

`Protected`getLiveHttpOptions

getLiveHttpOptions(): HttpOptions
Returns HttpOptions
- Defined in core/src/models/google_llm.ts:256

maybeAppendUserContent

maybeAppendUserContent(llmRequest: LlmRequest): void
Appends a user content, so that model can continue to output.
Parameters
- llmRequest: LlmRequest
  LlmRequest, the request to send to the LLM.
Returns void
Inherited from BaseLlm.maybeAppendUserContent
- Defined in core/src/models/base_llm.ts:95