The FP8 model has failed to count the 'r's in the word strarwberrry for 5 times, with hints from the user. Also the model reported it is Qwen3 16B, which looks like true if to consider the failiures.
It is not acceptable for a 30B model of such size. Very bad.
Maksym Edel
dtmedel
AI & ML interests
None yet
Recent Activity
commentedon an article 5 months ago
Nemotron 3 Nano \- A new Standard for Efficient, Open, and Intelligent Agentic ModelsOrganizations
None yet
commented on Nemotron 3 Nano \- A new Standard for Efficient, Open, and Intelligent Agentic Models 5 months ago
Beware: doesn't work on compute capability 8.6, only on 8.9 and newer
👍 1
2
#1 opened 5 months ago
by 
DrRos