python site-packages are not recognized after install (bug on linux / workes fine on Windows) #104000

New Issue

Clemens Beute · 2023-01-19T13:34:52+01:00

Clemens Beute commented

2023-01-19 13:34:52 +01:00

System Information
Operating system: Linux-6.0.12-76060006-generic-x86_64-with-glibc2.35 64 Bits
Graphics card: NVIDIA GeForce RTX 2080 SUPER/PCIe/SSE2 NVIDIA Corporation 4.5.0 NVIDIA 510.108.03

Blender Version
Broken: version: 3.4.1, branch: blender-v3.4-release, commit date: 2022-12-19 17:00, hash: 55485cb379
Worked: (3.0.0, not 100% shure)

Short description of error
I have an add-on that uses Pillow, so I would install Pillow to blenders Python.
This stopped working recently.
The add-on is installed (I checked, by looking into the site-packages folder and by executing blenders Python in a terminal -> outside of blender the import PIL works, in blender it doesn't)

The strangest thing is, that Pillow gets recognized, if you type:

help("modules")

pillow will work again, but will fail again, if you restart blender.

On Windows this bug doesn't exist.
Is this a bug on Linux builds, when blender tries to load its python site-packages?

Exact steps for others to reproduce the error
Open blender and go to the python console and type this:

import os

import sys

os.system(f'{sys.executable} -m ensurepip')

os.system(f'{sys.executable} -m pip install Pillow')

installation sould work fine, but if you try:

import PIL

you get an error

help("modules")

import PIL

now Pillow works like intended

System Information Operating system: Linux-6.0.12-76060006-generic-x86_64-with-glibc2.35 64 Bits Graphics card: NVIDIA GeForce RTX 2080 SUPER/PCIe/SSE2 NVIDIA Corporation 4.5.0 NVIDIA 510.108.03 Blender Version Broken: version: 3.4.1, branch: blender-v3.4-release, commit date: 2022-12-19 17:00, hash: 55485cb379 Worked: (3.0.0, not 100% shure) **Short description of error** I have an add-on that uses Pillow, so I would install Pillow to blenders Python. This stopped working recently. The add-on is installed (I checked, by looking into the site-packages folder and by executing blenders Python in a terminal -> outside of blender the import PIL works, in blender it doesn't) The strangest thing is, that Pillow gets recognized, if you type: ``` help("modules") ``` pillow will work again, but will fail again, if you restart blender. On Windows this bug doesn't exist. Is this a bug on Linux builds, when blender tries to load its python site-packages? **Exact steps for others to reproduce the error** Open blender and go to the python console and type this: ``` import os ``` ``` import sys ``` ``` os.system(f'{sys.executable} -m ensurepip') ``` ``` os.system(f'{sys.executable} -m pip install Pillow') ``` - > installation sould work fine, but if you try: ``` import PIL ``` - > you get an error ``` help("modules") ``` ``` import PIL ``` - > now Pillow works like intended

Clemens Beute commented

2023-01-19 13:34:52 +01:00

Added subscriber: @ClemensBeute

Philipp Oeser commented

2023-01-19 14:53:16 +01:00

Added subscriber: @lichtwerk

Philipp Oeser commented

2023-01-19 14:53:16 +01:00

Dont forget the following (for someone that doesnt have pip yet), will include in the report.

os.system(f'{sys.executable} -m ensurepip')

Anyways, I cannot reproduce here (in both 3.0.0 and 3.4.1, also 3.5, I can import PIL right adter getting it...)

Dont forget the following (for someone that doesnt have pip yet), will include in the report. ``` os.system(f'{sys.executable} -m ensurepip') ``` Anyways, I cannot reproduce here (in both 3.0.0 and 3.4.1, also 3.5, I can import PIL right adter getting it...)

Sebastian Koenig commented

2023-01-19 16:02:47 +01:00

Added subscriber: @sebastian_k

Sebastian Koenig commented

2023-01-19 16:02:47 +01:00

I can kind of confirm this.
Linux-6.0.12-76060006-generic-x86_64-with-glibc2.35 64 Bits
3.4.1, branch: blender-v3.4-release, commit date: 2022-12-20 08:50, hash: ef9ca44dee

Fresh install (download from buildbox, extract, ensurepip, pip install gspread), go to console, type "import gspread" -> module not found.
Type "help("modules")", type "import gspread" again and it works.

However, when I do the exact same thing on our server, it works!
Linux 5.4.0-125-generic #141-Ubuntu SMP Wed Aug 10 13:42:03 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

It's so weird! So, could it be an OS kind of thing?

I can kind of confirm this. Linux-6.0.12-76060006-generic-x86_64-with-glibc2.35 64 Bits 3.4.1, branch: blender-v3.4-release, commit date: 2022-12-20 08:50, hash: `ef9ca44dee` Fresh install (download from buildbox, extract, ensurepip, pip install gspread), go to console, type "import gspread" -> module not found. Type "help("modules")", type "import gspread" again and it works. However, when I do the exact same thing on our server, it works! Linux 5.4.0-125-generic #141-Ubuntu SMP Wed Aug 10 13:42:03 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux It's so weird! So, could it be an OS kind of thing?

Campbell Barton commented

2023-01-23 10:01:58 +01:00

Added subscriber: @ideasman42

Campbell Barton commented

2023-01-23 10:01:58 +01:00

While I can't redo this, it seems likely the sys.path changes before & after running help("modules") could someone check if this is the case.

Also, can this problem be reproduced from a Python instance running outside of Blender?

While I can't redo this, it seems likely the `sys.path` changes before & after running `help("modules")` could someone check if this is the case. Also, can this problem be reproduced from a Python instance running outside of Blender?

Campbell Barton commented

2023-01-23 10:03:13 +01:00

Changed status from 'Needs Triage' to: 'Needs User Info'

Clemens Beute commented

2023-01-23 10:35:16 +01:00

I checked it. In Blender sys.path changes after help("modules"), outside blender (running the blenders python executable) sys.path doesn't change.

But one other thing i noticed, is that numpy throws a warning:

- ! /home/silke/blender/blender_aktuell/3.4/python/lib/python3.10/pkgutil.py:92: UserWarning: The numpy.array_api submodule is still experimental. See NEP 47.
- !   __import__(info.name)

Here are the full console logs
blender_console.txt
system_console_blender_python.txt

I checked it. In Blender sys.path changes after help("modules"), outside blender (running the blenders python executable) sys.path doesn't change. But one other thing i noticed, is that numpy throws a warning: ``` - ! /home/silke/blender/blender_aktuell/3.4/python/lib/python3.10/pkgutil.py:92: UserWarning: The numpy.array_api submodule is still experimental. See NEP 47. - ! __import__(info.name) ``` Here are the full console logs [blender_console.txt](https://archive.blender.org/developer/F14186886/blender_console.txt) [system_console_blender_python.txt](https://archive.blender.org/developer/F14186887/system_console_blender_python.txt)

Campbell Barton commented

2023-01-23 11:51:07 +01:00

This is likely caused by Python not using the local environment by default: see 7c2f0074f3

Passing --python-use-system-env to Blender on startup should make Blender behave like regular Python.

This was an intentional change though, so we'd need to consider if including user site-packages by default is worth adding back, or if there are other alternatives.

This is likely caused by Python not using the local environment by default: see 7c2f0074f3 Passing `--python-use-system-env` to Blender on startup should make Blender behave like regular Python. This was an intentional change though, so we'd need to consider if including user site-packages by default is worth adding back, or if there are other alternatives.

Clemens Beute commented

2023-01-23 13:34:01 +01:00

Ok, thank you. Starting blender with --python-use-system-env works for us.
But it seems like a workaround to me. As I understand, this gives Blender access to the system python modules.

I'm curious now, because I program add-ons for our company, and sometimes we need external modules...
Is there an official/correct way, how to use external python modules like Pillow in a blender add-on?

My approach was to install them with a command like this inside blender:

os.system(f'{sys.executable} -m pip install Pillow')

Ok, thank you. Starting blender with **--python-use-system-env** works for us. But it seems like a workaround to me. As I understand, this gives Blender access to the system python modules. I'm curious now, because I program add-ons for our company, and sometimes we need external modules... Is there an official/correct way, how to use external python modules like Pillow in a blender add-on? My approach was to install them with a command like this inside blender: ``` os.system(f'{sys.executable} -m pip install Pillow') ```

blender-admin commented

2023-01-25 02:41:59 +01:00

This issue was referenced by 72c012ab4a

This issue was referenced by 72c012ab4a3d2a7f7f59334f4912402338c82e3c

Campbell Barton commented

2023-01-25 02:53:16 +01:00

Changed status from 'Needs User Info' to: 'Resolved'

Campbell Barton closed this issue

2023-01-25 02:53:16 +01:00

Campbell Barton self-assigned this 2023-01-25 02:53:16 +01:00

Sign in to join this conversation.

No Label

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

python site-packages are not recognized after install (bug on linux / workes fine on Windows) #104000