← All tasks
pythonoobabooga/text-generation-webui #4005Not a task: not reproduced

ERROR: llama_cpp_python_cuda-0.2.6+cu117-cp310-cp310-manylinux_2_31_x86_64.whl is not a supported wheel on this platform.

envgap__oobabooga__text-generation-webui-4005

Original GitHub issue ↗Opened 2023-09-20

01 / FAILURE SIGNATURE

As reported upstream

ERROR: bitsandbytes-0.41.1-py3-none-win_amd64.whl is not a supported wheel on this platform.
Not a benchmark task.
  • No curated issue-specific recipe or verified environment fix is available.

02 / ENVIRONMENT RECIPE

Base commit
Not freshly verified
Manifest
requirements.txt
Reproduce
Awaiting issue-specific recipe
Run under trace
Awaiting a meaningful runtime command

03 / ORIGINAL ISSUE TEXT

oobabooga/text-generation-webui #4005 · read the original issue
### Describe the bug

not sure why.  REinstalled cuda 11.7 (after using --uninstall as well as bin\cuda_uninstaller), and getting an error on latest commit when I try to pip install -r requirements.txt



ERROR: llama_cpp_python_cuda-0.2.6+cu117-cp310-cp310-manylinux_2_31_x86_64.whl is not a supported wheel on this platform.



Ignoring llama-cpp-python-cuda: markers 'platform_system == "Windows"' don't match your environment

ERROR: llama_cpp_python_cuda-0.2.6+cu117-cp310-cp310-manylinux_2_31_x86_64.whl is not a supported wheel on this platform.

(textgen) [root@pve0 text-generation-webui]# nvidia-smi

Tue Sep 19 19:58:24 2023

+-----------------------------------------------------------------------------+

| NVIDIA-SMI 515.43.04    Driver Version: 515.43.04    CUDA Version: 11.7     |

|-------------------------------+----------------------+----------------------+

| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |

| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |

|                               |                      |               MIG M. |

|===============================+======================+======================|

|   0  Quadro P1000        Off  | 00000000:05:00.0 Off |                  N/A |

| 64%   57C    P0    N/A /  N/A |      0MiB /  4096MiB |      0%      Default |

|                               |                      |                  N/A |

+-------------------------------+----------------------+----------------------+



+-----------------------------------------------------------------------------+

| Processes:                                                                  |

|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |

|        ID   ID                                                   Usage      |

|=============================================================================|

|  No running processes found                                                 |

+-----------------------------------------------------------------------------+



### Is there an existing issue for this?

- [X] I have searched the existing issues

### Reproduction

oracle linux 8

python 3.10.9 (new conda instance)

cuda 11.7

### Screenshot

_No response_

### Logs

```shell
(textgen) [root@pve0 text-generation-webui]# echo $LD_LIBRARY_PATH

/usr/local/cuda-11.7/lib64

(textgen) [root@pve0 text-generation-webui]# ls /usr/local/cuda

cuda/      cuda-11/   cuda-11.7/ cuda-11.8/

(textgen) [root@pve0 text-generation-webui]# ls /usr/local/cuda/

bin                CUDA_Toolkit_Release_Notes.txt  gds      lib64    LICENSE  nsight-compute-2022.2.0  nsight-systems-2022.1.3  nvvm   src      version.json

compute-sanitizer  extras                          include  libnvvp  man      nsightee_plugins         nvml                     share  targets

(textgen) [root@pve0 text-generation-webui]# ls /usr/local/cuda/lib

ls: cannot access '/usr/local/cuda/lib': N
Continue on GitHub ↗

04 / LABELS

Labels from the report text only; not yet run

No supported category has been assigned.

Label rules and the text that matched
[]

Issue-specific recipe and runtime smoke command require review against the complete issue and repository.

Legacy reproduction is generic install-only; match the actual issue failure before admission.