[BUG] Failed to load library libonnxruntime_providers_cuda.so

[mrmatteastwood]

Describe the bug
When executing rembg, the following error appears:

2025-12-10 14:59:01.119155285 [E:onnxruntime:Default, provider_bridge_ort.cc:2251 TryGetProviderInfo_CUDA] /onnxruntime_src/onnxruntime/core/session/provider_bridge_ort.cc:1844 onnxruntime::Provider& onnxruntime::ProviderLibrary::Get() [ONNXRuntimeError] : 1 : FAIL : Failed to load library libonnxruntime_providers_cuda.so with error: libcublasLt.so.12: cannot open shared object file: No such file or directory

To Reproduce
Steps to reproduce the behavior:

1. Install rembg:

cd ~/.venvs
python3 -m venv bgremovers && cd bgremovers
source ~/.venvs/bgremovers/bin/activate
pip install "rembg[gpu,cli]"

2. Remove background from some image, e.g.: $ rembg i -a removebackground.jpg bgremoved.png

Expected behavior
No error messages should appear.

OS Version:
Linux Mint 22.2 Cinnamon

Rembg version:
v2.0.69

Additional context
Note that this error does not seem to interfere with the program's functionality; it still successfully removes backgrounds.

Full terminal output from fresh installation in new venv all the way through to execution and error:

user@MYPC:~/.venvs$ python3 -m venv bgremovers && cd bgremovers
user@MYPC:~/.venvs/bgremovers$ . bin/activate
(bgremovers) user@MYPC:~/.venvs/bgremovers$ pip install "rembg[gpu,cli]"
Collecting rembg[cli,gpu]
  Using cached rembg-2.0.69-py3-none-any.whl.metadata (17 kB)
Collecting jsonschema (from rembg[cli,gpu])
  Using cached jsonschema-4.25.1-py3-none-any.whl.metadata (7.6 kB)
Collecting numpy (from rembg[cli,gpu])
  Downloading numpy-2.3.5-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (62 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.1/62.1 kB 1.1 MB/s eta 0:00:00
Collecting opencv-python-headless (from rembg[cli,gpu])
  Using cached opencv_python_headless-4.12.0.88-cp37-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (19 kB)
Collecting pillow (from rembg[cli,gpu])
  Using cached pillow-12.0.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (8.8 kB)
Collecting pooch (from rembg[cli,gpu])
  Using cached pooch-1.8.2-py3-none-any.whl.metadata (10 kB)
Collecting pymatting (from rembg[cli,gpu])
  Using cached pymatting-1.1.14-py3-none-any.whl.metadata (7.7 kB)
Collecting scikit-image (from rembg[cli,gpu])
  Using cached scikit_image-0.25.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (14 kB)
Collecting scipy (from rembg[cli,gpu])
  Using cached scipy-1.16.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (62 kB)
Collecting tqdm (from rembg[cli,gpu])
  Using cached tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)
Collecting onnxruntime-gpu (from rembg[cli,gpu])
  Using cached onnxruntime_gpu-1.23.2-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (5.4 kB)
Collecting aiohttp (from rembg[cli,gpu])
  Using cached aiohttp-3.13.2-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (8.1 kB)
Collecting asyncer (from rembg[cli,gpu])
  Using cached asyncer-0.0.11-py3-none-any.whl.metadata (6.9 kB)
Collecting click (from rembg[cli,gpu])
  Using cached click-8.3.1-py3-none-any.whl.metadata (2.6 kB)
Collecting fastapi (from rembg[cli,gpu])
  Using cached fastapi-0.124.1-py3-none-any.whl.metadata (30 kB)
Collecting filetype (from rembg[cli,gpu])
  Using cached filetype-1.2.0-py2.py3-none-any.whl.metadata (6.5 kB)
Collecting gradio (from rembg[cli,gpu])
  Using cached gradio-6.1.0-py3-none-any.whl.metadata (16 kB)
Collecting python-multipart (from rembg[cli,gpu])
  Using cached python_multipart-0.0.20-py3-none-any.whl.metadata (1.8 kB)
Collecting uvicorn (from rembg[cli,gpu])
  Using cached uvicorn-0.38.0-py3-none-any.whl.metadata (6.8 kB)
Collecting watchdog (from rembg[cli,gpu])
  Using cached watchdog-6.0.0-py3-none-manylinux2014_x86_64.whl.metadata (44 kB)
Collecting aiohappyeyeballs>=2.5.0 (from aiohttp->rembg[cli,gpu])
  Using cached aiohappyeyeballs-2.6.1-py3-none-any.whl.metadata (5.9 kB)
Collecting aiosignal>=1.4.0 (from aiohttp->rembg[cli,gpu])
  Using cached aiosignal-1.4.0-py3-none-any.whl.metadata (3.7 kB)
Collecting attrs>=17.3.0 (from aiohttp->rembg[cli,gpu])
  Using cached attrs-25.4.0-py3-none-any.whl.metadata (10 kB)
Collecting frozenlist>=1.1.1 (from aiohttp->rembg[cli,gpu])
  Using cached frozenlist-1.8.0-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl.metadata (20 kB)
Collecting multidict<7.0,>=4.5 (from aiohttp->rembg[cli,gpu])
  Using cached multidict-6.7.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (5.3 kB)
Collecting propcache>=0.2.0 (from aiohttp->rembg[cli,gpu])
  Using cached propcache-0.4.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (13 kB)
Collecting yarl<2.0,>=1.17.0 (from aiohttp->rembg[cli,gpu])
  Using cached yarl-1.22.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (75 kB)
Collecting anyio<5.0,>=3.4.0 (from asyncer->rembg[cli,gpu])
  Using cached anyio-4.12.0-py3-none-any.whl.metadata (4.3 kB)
Collecting sniffio>=1.1 (from asyncer->rembg[cli,gpu])
  Using cached sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB)
Collecting starlette<0.51.0,>=0.40.0 (from fastapi->rembg[cli,gpu])
  Using cached starlette-0.50.0-py3-none-any.whl.metadata (6.3 kB)
Collecting pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4 (from fastapi->rembg[cli,gpu])
  Using cached pydantic-2.12.5-py3-none-any.whl.metadata (90 kB)
Collecting typing-extensions>=4.8.0 (from fastapi->rembg[cli,gpu])
  Using cached typing_extensions-4.15.0-py3-none-any.whl.metadata (3.3 kB)
Collecting annotated-doc>=0.0.2 (from fastapi->rembg[cli,gpu])
  Using cached annotated_doc-0.0.4-py3-none-any.whl.metadata (6.6 kB)
Collecting aiofiles<25.0,>=22.0 (from gradio->rembg[cli,gpu])
  Using cached aiofiles-24.1.0-py3-none-any.whl.metadata (10 kB)
Collecting brotli>=1.1.0 (from gradio->rembg[cli,gpu])
  Using cached brotli-1.2.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (6.1 kB)
Collecting ffmpy (from gradio->rembg[cli,gpu])
  Using cached ffmpy-1.0.0-py3-none-any.whl.metadata (3.0 kB)
Collecting gradio-client==2.0.1 (from gradio->rembg[cli,gpu])
  Using cached gradio_client-2.0.1-py3-none-any.whl.metadata (7.1 kB)
Collecting groovy~=0.1 (from gradio->rembg[cli,gpu])
  Using cached groovy-0.1.2-py3-none-any.whl.metadata (6.1 kB)
Collecting httpx<1.0,>=0.24.1 (from gradio->rembg[cli,gpu])
  Using cached httpx-0.28.1-py3-none-any.whl.metadata (7.1 kB)
Collecting huggingface-hub<2.0,>=0.33.5 (from gradio->rembg[cli,gpu])
  Using cached huggingface_hub-1.2.1-py3-none-any.whl.metadata (13 kB)
Collecting jinja2<4.0 (from gradio->rembg[cli,gpu])
  Downloading jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB)
Collecting markupsafe<4.0,>=2.0 (from gradio->rembg[cli,gpu])
  Downloading markupsafe-3.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.7 kB)
Collecting orjson~=3.0 (from gradio->rembg[cli,gpu])
  Using cached orjson-3.11.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (41 kB)
Collecting packaging (from gradio->rembg[cli,gpu])
  Using cached packaging-25.0-py3-none-any.whl.metadata (3.3 kB)
Collecting pandas<3.0,>=1.0 (from gradio->rembg[cli,gpu])
  Using cached pandas-2.3.3-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (91 kB)
Collecting pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4 (from fastapi->rembg[cli,gpu])
  Using cached pydantic-2.12.4-py3-none-any.whl.metadata (89 kB)
Collecting pydub (from gradio->rembg[cli,gpu])
  Using cached pydub-0.25.1-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting pyyaml<7.0,>=5.0 (from gradio->rembg[cli,gpu])
  Using cached pyyaml-6.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.4 kB)
Collecting safehttpx<0.2.0,>=0.1.7 (from gradio->rembg[cli,gpu])
  Using cached safehttpx-0.1.7-py3-none-any.whl.metadata (4.2 kB)
Collecting semantic-version~=2.0 (from gradio->rembg[cli,gpu])
  Using cached semantic_version-2.10.0-py2.py3-none-any.whl.metadata (9.7 kB)
Collecting tomlkit<0.14.0,>=0.12.0 (from gradio->rembg[cli,gpu])
  Using cached tomlkit-0.13.3-py3-none-any.whl.metadata (2.8 kB)
Collecting typer<1.0,>=0.12 (from gradio->rembg[cli,gpu])
  Using cached typer-0.20.0-py3-none-any.whl.metadata (16 kB)
Collecting fsspec (from gradio-client==2.0.1->gradio->rembg[cli,gpu])
  Downloading fsspec-2025.12.0-py3-none-any.whl.metadata (10 kB)
Collecting h11>=0.8 (from uvicorn->rembg[cli,gpu])
  Using cached h11-0.16.0-py3-none-any.whl.metadata (8.3 kB)
Collecting jsonschema-specifications>=2023.03.6 (from jsonschema->rembg[cli,gpu])
  Using cached jsonschema_specifications-2025.9.1-py3-none-any.whl.metadata (2.9 kB)
Collecting referencing>=0.28.4 (from jsonschema->rembg[cli,gpu])
  Using cached referencing-0.37.0-py3-none-any.whl.metadata (2.8 kB)
Collecting rpds-py>=0.7.1 (from jsonschema->rembg[cli,gpu])
  Using cached rpds_py-0.30.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB)
Collecting coloredlogs (from onnxruntime-gpu->rembg[cli,gpu])
  Using cached coloredlogs-15.0.1-py2.py3-none-any.whl.metadata (12 kB)
Collecting flatbuffers (from onnxruntime-gpu->rembg[cli,gpu])
  Using cached flatbuffers-25.9.23-py2.py3-none-any.whl.metadata (875 bytes)
Collecting protobuf (from onnxruntime-gpu->rembg[cli,gpu])
  Using cached protobuf-6.33.2-cp39-abi3-manylinux2014_x86_64.whl.metadata (593 bytes)
Collecting sympy (from onnxruntime-gpu->rembg[cli,gpu])
  Downloading sympy-1.14.0-py3-none-any.whl.metadata (12 kB)
Collecting numpy (from rembg[cli,gpu])
  Using cached numpy-2.2.6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB)
Collecting platformdirs>=2.5.0 (from pooch->rembg[cli,gpu])
  Using cached platformdirs-4.5.1-py3-none-any.whl.metadata (12 kB)
Collecting requests>=2.19.0 (from pooch->rembg[cli,gpu])
  Using cached requests-2.32.5-py3-none-any.whl.metadata (4.9 kB)
Collecting numba!=0.49.0 (from pymatting->rembg[cli,gpu])
  Using cached numba-0.63.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.9 kB)
Collecting networkx>=3.0 (from scikit-image->rembg[cli,gpu])
  Downloading networkx-3.6.1-py3-none-any.whl.metadata (6.8 kB)
Collecting imageio!=2.35.0,>=2.33 (from scikit-image->rembg[cli,gpu])
  Using cached imageio-2.37.2-py3-none-any.whl.metadata (9.7 kB)
Collecting tifffile>=2022.8.12 (from scikit-image->rembg[cli,gpu])
  Using cached tifffile-2025.10.16-py3-none-any.whl.metadata (31 kB)
Collecting lazy-loader>=0.4 (from scikit-image->rembg[cli,gpu])
  Using cached lazy_loader-0.4-py3-none-any.whl.metadata (7.6 kB)
Collecting idna>=2.8 (from anyio<5.0,>=3.4.0->asyncer->rembg[cli,gpu])
  Using cached idna-3.11-py3-none-any.whl.metadata (8.4 kB)
Collecting certifi (from httpx<1.0,>=0.24.1->gradio->rembg[cli,gpu])
  Using cached certifi-2025.11.12-py3-none-any.whl.metadata (2.5 kB)
Collecting httpcore==1.* (from httpx<1.0,>=0.24.1->gradio->rembg[cli,gpu])
  Using cached httpcore-1.0.9-py3-none-any.whl.metadata (21 kB)
Collecting filelock (from huggingface-hub<2.0,>=0.33.5->gradio->rembg[cli,gpu])
  Downloading filelock-3.20.0-py3-none-any.whl.metadata (2.1 kB)
Collecting hf-xet<2.0.0,>=1.2.0 (from huggingface-hub<2.0,>=0.33.5->gradio->rembg[cli,gpu])
  Using cached hf_xet-1.2.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB)
Collecting shellingham (from huggingface-hub<2.0,>=0.33.5->gradio->rembg[cli,gpu])
  Using cached shellingham-1.5.4-py2.py3-none-any.whl.metadata (3.5 kB)
Collecting typer-slim (from huggingface-hub<2.0,>=0.33.5->gradio->rembg[cli,gpu])
  Using cached typer_slim-0.20.0-py3-none-any.whl.metadata (16 kB)
Collecting llvmlite<0.47,>=0.46.0dev0 (from numba!=0.49.0->pymatting->rembg[cli,gpu])
  Using cached llvmlite-0.46.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (5.0 kB)
Collecting python-dateutil>=2.8.2 (from pandas<3.0,>=1.0->gradio->rembg[cli,gpu])
  Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
Collecting pytz>=2020.1 (from pandas<3.0,>=1.0->gradio->rembg[cli,gpu])
  Using cached pytz-2025.2-py2.py3-none-any.whl.metadata (22 kB)
Collecting tzdata>=2022.7 (from pandas<3.0,>=1.0->gradio->rembg[cli,gpu])
  Using cached tzdata-2025.2-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting annotated-types>=0.6.0 (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi->rembg[cli,gpu])
  Using cached annotated_types-0.7.0-py3-none-any.whl.metadata (15 kB)
Collecting pydantic-core==2.41.5 (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi->rembg[cli,gpu])
  Using cached pydantic_core-2.41.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.3 kB)
Collecting typing-inspection>=0.4.2 (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi->rembg[cli,gpu])
  Using cached typing_inspection-0.4.2-py3-none-any.whl.metadata (2.6 kB)
Collecting charset_normalizer<4,>=2 (from requests>=2.19.0->pooch->rembg[cli,gpu])
  Using cached charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (37 kB)
Collecting urllib3<3,>=1.21.1 (from requests>=2.19.0->pooch->rembg[cli,gpu])
  Using cached urllib3-2.6.1-py3-none-any.whl.metadata (6.6 kB)
Collecting rich>=10.11.0 (from typer<1.0,>=0.12->gradio->rembg[cli,gpu])
  Using cached rich-14.2.0-py3-none-any.whl.metadata (18 kB)
Collecting humanfriendly>=9.1 (from coloredlogs->onnxruntime-gpu->rembg[cli,gpu])
  Using cached humanfriendly-10.0-py2.py3-none-any.whl.metadata (9.2 kB)
Collecting mpmath<1.4,>=1.1.0 (from sympy->onnxruntime-gpu->rembg[cli,gpu])
  Downloading mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB)
Collecting six>=1.5 (from python-dateutil>=2.8.2->pandas<3.0,>=1.0->gradio->rembg[cli,gpu])
  Using cached six-1.17.0-py2.py3-none-any.whl.metadata (1.7 kB)
Collecting markdown-it-py>=2.2.0 (from rich>=10.11.0->typer<1.0,>=0.12->gradio->rembg[cli,gpu])
  Using cached markdown_it_py-4.0.0-py3-none-any.whl.metadata (7.3 kB)
Collecting pygments<3.0.0,>=2.13.0 (from rich>=10.11.0->typer<1.0,>=0.12->gradio->rembg[cli,gpu])
  Using cached pygments-2.19.2-py3-none-any.whl.metadata (2.5 kB)
Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich>=10.11.0->typer<1.0,>=0.12->gradio->rembg[cli,gpu])
  Using cached mdurl-0.1.2-py3-none-any.whl.metadata (1.6 kB)
Using cached aiohttp-3.13.2-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (1.8 MB)
Using cached asyncer-0.0.11-py3-none-any.whl (9.5 kB)
Using cached click-8.3.1-py3-none-any.whl (108 kB)
Using cached fastapi-0.124.1-py3-none-any.whl (112 kB)
Using cached filetype-1.2.0-py2.py3-none-any.whl (19 kB)
Using cached gradio-6.1.0-py3-none-any.whl (23.0 MB)
Using cached gradio_client-2.0.1-py3-none-any.whl (55 kB)
Using cached pillow-12.0.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (7.0 MB)
Using cached python_multipart-0.0.20-py3-none-any.whl (24 kB)
Using cached uvicorn-0.38.0-py3-none-any.whl (68 kB)
Using cached jsonschema-4.25.1-py3-none-any.whl (90 kB)
Using cached onnxruntime_gpu-1.23.2-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (300.5 MB)
Using cached opencv_python_headless-4.12.0.88-cp37-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (54.0 MB)
Using cached numpy-2.2.6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.5 MB)
Using cached pooch-1.8.2-py3-none-any.whl (64 kB)
Using cached pymatting-1.1.14-py3-none-any.whl (54 kB)
Using cached scipy-1.16.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (35.7 MB)
Using cached rembg-2.0.69-py3-none-any.whl (43 kB)
Using cached scikit_image-0.25.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (15.0 MB)
Using cached tqdm-4.67.1-py3-none-any.whl (78 kB)
Using cached watchdog-6.0.0-py3-none-manylinux2014_x86_64.whl (79 kB)
Using cached aiofiles-24.1.0-py3-none-any.whl (15 kB)
Using cached aiohappyeyeballs-2.6.1-py3-none-any.whl (15 kB)
Using cached aiosignal-1.4.0-py3-none-any.whl (7.5 kB)
Using cached annotated_doc-0.0.4-py3-none-any.whl (5.3 kB)
Using cached anyio-4.12.0-py3-none-any.whl (113 kB)
Using cached attrs-25.4.0-py3-none-any.whl (67 kB)
Using cached brotli-1.2.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (1.4 MB)
Using cached frozenlist-1.8.0-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl (242 kB)
Using cached groovy-0.1.2-py3-none-any.whl (14 kB)
Using cached h11-0.16.0-py3-none-any.whl (37 kB)
Using cached httpx-0.28.1-py3-none-any.whl (73 kB)
Using cached httpcore-1.0.9-py3-none-any.whl (78 kB)
Using cached huggingface_hub-1.2.1-py3-none-any.whl (520 kB)
Using cached imageio-2.37.2-py3-none-any.whl (317 kB)
Downloading jinja2-3.1.6-py3-none-any.whl (134 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 134.9/134.9 kB 2.6 MB/s eta 0:00:00
Using cached jsonschema_specifications-2025.9.1-py3-none-any.whl (18 kB)
Using cached lazy_loader-0.4-py3-none-any.whl (12 kB)
Downloading markupsafe-3.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (22 kB)
Using cached multidict-6.7.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (256 kB)
Downloading networkx-3.6.1-py3-none-any.whl (2.1 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 10.7 MB/s eta 0:00:00
Using cached numba-0.63.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (3.8 MB)
Using cached orjson-3.11.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (139 kB)
Using cached packaging-25.0-py3-none-any.whl (66 kB)
Using cached pandas-2.3.3-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (12.4 MB)
Using cached platformdirs-4.5.1-py3-none-any.whl (18 kB)
Using cached propcache-0.4.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (221 kB)
Using cached pydantic-2.12.4-py3-none-any.whl (463 kB)
Using cached pydantic_core-2.41.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB)
Using cached pyyaml-6.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (807 kB)
Using cached referencing-0.37.0-py3-none-any.whl (26 kB)
Using cached requests-2.32.5-py3-none-any.whl (64 kB)
Using cached rpds_py-0.30.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (394 kB)
Using cached safehttpx-0.1.7-py3-none-any.whl (9.0 kB)
Using cached semantic_version-2.10.0-py2.py3-none-any.whl (15 kB)
Using cached sniffio-1.3.1-py3-none-any.whl (10 kB)
Using cached starlette-0.50.0-py3-none-any.whl (74 kB)
Using cached tifffile-2025.10.16-py3-none-any.whl (231 kB)
Using cached tomlkit-0.13.3-py3-none-any.whl (38 kB)
Using cached typer-0.20.0-py3-none-any.whl (47 kB)
Using cached typing_extensions-4.15.0-py3-none-any.whl (44 kB)
Using cached yarl-1.22.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (377 kB)
Using cached coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB)
Using cached ffmpy-1.0.0-py3-none-any.whl (5.6 kB)
Using cached flatbuffers-25.9.23-py2.py3-none-any.whl (30 kB)
Using cached protobuf-6.33.2-cp39-abi3-manylinux2014_x86_64.whl (323 kB)
Using cached pydub-0.25.1-py2.py3-none-any.whl (32 kB)
Downloading sympy-1.14.0-py3-none-any.whl (6.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.3/6.3 MB 12.3 MB/s eta 0:00:00
Using cached annotated_types-0.7.0-py3-none-any.whl (13 kB)
Using cached certifi-2025.11.12-py3-none-any.whl (159 kB)
Using cached charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (153 kB)
Downloading fsspec-2025.12.0-py3-none-any.whl (201 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 201.4/201.4 kB 5.8 MB/s eta 0:00:00
Using cached hf_xet-1.2.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)
Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB)
Using cached idna-3.11-py3-none-any.whl (71 kB)
Using cached llvmlite-0.46.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (56.3 MB)
Downloading mpmath-1.3.0-py3-none-any.whl (536 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 9.1 MB/s eta 0:00:00
Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Using cached pytz-2025.2-py2.py3-none-any.whl (509 kB)
Using cached rich-14.2.0-py3-none-any.whl (243 kB)
Using cached shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB)
Using cached typing_inspection-0.4.2-py3-none-any.whl (14 kB)
Using cached tzdata-2025.2-py2.py3-none-any.whl (347 kB)
Using cached urllib3-2.6.1-py3-none-any.whl (131 kB)
Downloading filelock-3.20.0-py3-none-any.whl (16 kB)
Using cached typer_slim-0.20.0-py3-none-any.whl (47 kB)
Using cached markdown_it_py-4.0.0-py3-none-any.whl (87 kB)
Using cached pygments-2.19.2-py3-none-any.whl (1.2 MB)
Using cached six-1.17.0-py2.py3-none-any.whl (11 kB)
Using cached mdurl-0.1.2-py3-none-any.whl (10.0 kB)
Installing collected packages: pytz, pydub, mpmath, flatbuffers, filetype, brotli, watchdog, urllib3, tzdata, typing-extensions, tqdm, tomlkit, sympy, sniffio, six, shellingham, semantic-version, rpds-py, pyyaml, python-multipart, pygments, protobuf, propcache, platformdirs, pillow, packaging, orjson, numpy, networkx, multidict, mdurl, markupsafe, llvmlite, idna, humanfriendly, hf-xet, h11, groovy, fsspec, frozenlist, filelock, ffmpy, click, charset_normalizer, certifi, attrs, annotated-types, annotated-doc, aiohappyeyeballs, aiofiles, yarl, uvicorn, typing-inspection, typer-slim, tifffile, scipy, requests, referencing, python-dateutil, pydantic-core, opencv-python-headless, numba, markdown-it-py, lazy-loader, jinja2, imageio, httpcore, coloredlogs, anyio, aiosignal, starlette, scikit-image, rich, pymatting, pydantic, pooch, pandas, onnxruntime-gpu, jsonschema-specifications, httpx, asyncer, aiohttp, typer, safehttpx, jsonschema, huggingface-hub, fastapi, rembg, gradio-client, gradio
Successfully installed aiofiles-24.1.0 aiohappyeyeballs-2.6.1 aiohttp-3.13.2 aiosignal-1.4.0 annotated-doc-0.0.4 annotated-types-0.7.0 anyio-4.12.0 asyncer-0.0.11 attrs-25.4.0 brotli-1.2.0 certifi-2025.11.12 charset_normalizer-3.4.4 click-8.3.1 coloredlogs-15.0.1 fastapi-0.124.1 ffmpy-1.0.0 filelock-3.20.0 filetype-1.2.0 flatbuffers-25.9.23 frozenlist-1.8.0 fsspec-2025.12.0 gradio-6.1.0 gradio-client-2.0.1 groovy-0.1.2 h11-0.16.0 hf-xet-1.2.0 httpcore-1.0.9 httpx-0.28.1 huggingface-hub-1.2.1 humanfriendly-10.0 idna-3.11 imageio-2.37.2 jinja2-3.1.6 jsonschema-4.25.1 jsonschema-specifications-2025.9.1 lazy-loader-0.4 llvmlite-0.46.0 markdown-it-py-4.0.0 markupsafe-3.0.3 mdurl-0.1.2 mpmath-1.3.0 multidict-6.7.0 networkx-3.6.1 numba-0.63.1 numpy-2.2.6 onnxruntime-gpu-1.23.2 opencv-python-headless-4.12.0.88 orjson-3.11.5 packaging-25.0 pandas-2.3.3 pillow-12.0.0 platformdirs-4.5.1 pooch-1.8.2 propcache-0.4.1 protobuf-6.33.2 pydantic-2.12.4 pydantic-core-2.41.5 pydub-0.25.1 pygments-2.19.2 pymatting-1.1.14 python-dateutil-2.9.0.post0 python-multipart-0.0.20 pytz-2025.2 pyyaml-6.0.3 referencing-0.37.0 rembg-2.0.69 requests-2.32.5 rich-14.2.0 rpds-py-0.30.0 safehttpx-0.1.7 scikit-image-0.25.2 scipy-1.16.3 semantic-version-2.10.0 shellingham-1.5.4 six-1.17.0 sniffio-1.3.1 starlette-0.50.0 sympy-1.14.0 tifffile-2025.10.16 tomlkit-0.13.3 tqdm-4.67.1 typer-0.20.0 typer-slim-0.20.0 typing-extensions-4.15.0 typing-inspection-0.4.2 tzdata-2025.2 urllib3-2.6.1 uvicorn-0.38.0 watchdog-6.0.0 yarl-1.22.0
(bgremovers) user@MYPC:~/.venvs/bgremovers$ cd ~/zzLocal/Test/
(bgremovers) user@MYPC:~/zzLocal/Test$ rembg i -a removebackground.jpg bgremoved.png
Downloading data from 'https://github.com/danielgatis/rembg/releases/download/v0.0.0/u2net.onnx' to file '/home/thebrightside/.u2net/u2net.onnx'.
100%|███████████████████████████████████████| 176M/176M [00:00<00:00, 1.17TB/s]
2025-12-10 12:49:40.146363146 [E:onnxruntime:Default, provider_bridge_ort.cc:2251 TryGetProviderInfo_CUDA] /onnxruntime_src/onnxruntime/core/session/provider_bridge_ort.cc:1844 onnxruntime::Provider& onnxruntime::ProviderLibrary::Get() [ONNXRuntimeError] : 1 : FAIL : Failed to load library libonnxruntime_providers_cuda.so with error: libcublasLt.so.12: cannot open shared object file: No such file or directory

My full system specs: https://termbin.com/0nzy

[mrmatteastwood]

Quick follow-up: This issue occurs after installing CUDA following the instructions by NVIDIA:

https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_local

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-ubuntu2404.pin
sudo mv cuda-ubuntu2404.pin /etc/apt/preferences.d/cuda-repository-pin-600
wget https://developer.download.nvidia.com/compute/cuda/13.1.0/local_installers/cuda-repo-ubuntu2404-13-1-local_13.1.0-590.44.01-1_amd64.deb
sudo dpkg -i cuda-repo-ubuntu2404-13-1-local_13.1.0-590.44.01-1_amd64.deb
sudo cp /var/cuda-repo-ubuntu2404-13-1-local/cuda-*-keyring.gpg /usr/share/keyrings/
sudo apt-get update
sudo apt-get -y install cuda-toolkit-13-1

After following these steps, I also installed nvidia-cuda-toolkit:

sudo apt install -y nvidia-cuda-toolkit
The issue still persists though.