Interface ChatGroqInput

interface ChatGroqInput {
    apiKey?: string;
    maxTokens?: number;
    model?: string;
    modelName?: string;
    stop?: null | string | string[];
    stopSequences?: string[];
    streaming?: boolean;
    temperature?: number;
}

Hierarchy (view full)

Properties

apiKey? maxTokens? model? modelName? stop? stopSequences? streaming? temperature?

Properties

OptionalapiKey

apiKey?: string

The Groq API key to use for requests.

Default

process.env.GROQ_API_KEY

OptionalmaxTokens

maxTokens?: number

The maximum number of tokens that the model can process in a single response. This limits ensures computational efficiency and resource management.

Optionalmodel

model?: string

The name of the model to use.

Default

"mixtral-8x7b-32768"

OptionalmodelName

modelName?: string

The name of the model to use. Alias for model

Default

"mixtral-8x7b-32768"

Optionalstop

stop?: null | string | string[]

Up to 4 sequences where the API will stop generating further tokens. The returned text will not contain the stop sequence. Alias for stopSequences

OptionalstopSequences

stopSequences?: string[]

Up to 4 sequences where the API will stop generating further tokens. The returned text will not contain the stop sequence.

Optionalstreaming

streaming?: boolean

Whether or not to stream responses.

Optionaltemperature

temperature?: number

The temperature to use for sampling.

Default

0.7

Settings

Member Visibility

On This Page

Properties