'How to specify maximum number of words OpenAI completion should return
How can I specify the number of words the Open AI completion should return?
E.g imagine I ask the AI the question
Who is Elon Musk?
What parameter can I use to make sure the AI sends back results less than or equal to 300 words.
I was thinking the max_tokens parameter was for that but it seems max_tokens is for breaking the input down not the output.
Any ideas would be greatly appreciated. Thank you
Solution 1:[1]
The parameter you are looking for in the Playground is called Maximum length and in the API "max_tokens"
As described in the documentation, max_tokens has to do with the output not the input:
The maximum number of tokens allowed for the generated answer
Please note that this parameter is dealing with tokens not words. If you want to find the equivalent number of words to tokens use the tokenizer.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | minasg |