Quantized model is not working properly when CUBLAS is ON
envgap__ggml-org__whisper.cpp-1661
01 / FAILURE SIGNATURE
As reported upstream
No identifying execution failure has been captured.
Not a benchmark task.
- The project already builds and runs before the fix, so there is nothing to repair.
02 / ENVIRONMENT RECIPE
- Base commit
9286d3f584240ba58bd44a1bd1e85141579c78d4- Manifest
CMakeLists.txt- Reproduce
Awaiting issue-specific recipe- Run under trace
Awaiting a meaningful runtime command
03 / ORIGINAL ISSUE TEXT
ggml-org/whisper.cpp #1661 · read the original issue
### Discussed in https://github.com/ggerganov/whisper.cpp/discussions/1656 <div type='discussions-op-text'> <sup>Originally posted by **Sing303** December 19, 2023</sup> Now when I try to use quantization models with FULL GPU CUBLAS, instead of recognizing text it writes nonsense, all kinds of signs instead of words.</div>
04 / LABELS
Labels from the report text only; not yet run
No supported category has been assigned.
Label rules and the text that matched
[]