Max Tokens reached for initial discussion

#3
by knight7561 - opened

This is the response for hi to the chat agent:

Step 1

๐Ÿ’ฅ Error
Error in generating model output:
422 Client Error: Unprocessable Entity for url: /static-proxy?url=https%3A%2F%2Fapi-inference.huggingface.co%2Fmodels%2FQwen%2FQwen2.5-Coder-32B-Instruct%2Fv1%2Fchat%2Fcompletions%3C%2Fa%3E%3Cbr%3E%3Ca href="/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F655f6ce8abb296623a4337bf%2FUDrrLraIIB1OpzHHem5Pc.png" rel="nofollow">Screenshot 2025-03-10 at 00.36.22.png

Input validation error: inputs tokens + max_new_tokens must be <= 16000. Given: 20453 inputs tokens and 2096 max_new_tokens
Make sure 'text-generation' task is supported by the model.

Sign up or log in to comment