Skip to main content

Properties


Properties

max_new_tokens

Maximum number of tokens to generate

max_prompt_length

Maximum length of the prompt in tokens

temperature

Controls randomness of generated text

top_p

Probability for most probable tokens sampling

repetition_penalty

Repetition penalty

frequency_penalty

Frequency penalty

presence_penalty

Presence penalty

stop_sequences

List of sequences to stop generation

seed

Random seed for controlling the randomness of text generation

logit_bias

Logit bias to modify token likelihood