en_US:"The maximum number of tokens that can be generated by the model varies depending on the model."
zh_Hans:"模型可生成的最大 token 个数,不同模型上限不同。"
- name:temperature
use_template:temperature
label:
en_US:"Temperature"
zh_Hans:"采样温度"
type:float
default:0.7
min:0.0
max:1.0
precision:1
required:true
help:
en_US:"The randomness of the sampling temperature control output. The temperature value is within the range of [0.0, 1.0]. The higher the value, the more random and creative the output; the lower the value, the more stable it is. It is recommended to adjust either top_p or temperature parameters according to your needs to avoid adjusting both at the same time."
zh_Hans:"采样温度控制输出的随机性。温度值在 [0.0, 1.0] 范围内,值越高,输出越随机和创造性;值越低,输出越稳定。建议根据需求调整 top_p 或 temperature 参数,避免同时调整两者。"
- name:top_p
use_template:top_p
label:
en_US:"Top P"
zh_Hans:"Top P"
type:float
default:0.7
min:0.0
max:1.0
precision:1
required:true
help:
en_US:"The value range of the sampling method is [0.0, 1.0]. The top_p value determines that the model selects tokens from the top p% of candidate words with the highest probability; when top_p is 0, this parameter is invalid. It is recommended to adjust either top_p or temperature parameters according to your needs to avoid adjusting both at the same time."
en_US:"The value range is [0,100], which limits the model to only select from the top k words with the highest probability when choosing the next word at each step. The larger the value, the more diverse text generation will be."
zh_Hans:"取值范围为 [0,100],限制模型在每一步选择下一个词时,只从概率最高的前 k 个词中选取。数值越大,文本生成越多样。"
- name:frequency_penalty
use_template:frequency_penalty
label:
en_US:"Frequency Penalty"
zh_Hans:"频率惩罚"
type:float
default:0
min:-1.0
max:1.0
precision:1
required:false
help:
en_US:"Used to adjust the frequency of repeated content in automatically generated text. Positive numbers reduce repetition, while negative numbers increase repetition. After setting this parameter, if a word has already appeared in the text, the model will decrease the probability of choosing that word for subsequent generation."