technovangelist / notes / repeat_penalty

repeat_penalty

Repeat_penalty is a parameter that helps discourage repeated words or phrases. The model determines the probability of the next word being chosen for the output. positive logits are always divided by the repeat penalty, and negative logits are multiplied by the repeat penalty.

The window used to determine if a word has been repeated defaults to 64, but can be set with repeat_last_n.

#ollama/parameters