Smoke and Fluid effects cannot be sent to Shaman #104259

New Issue

Tarik-Delic · 2023-10-16T09:49:05+02:00

Tarik-Delic commented

2023-10-16 09:49:05 +02:00

We're seeing a very odd behaviour with a file, when we add the smoke effect and try to submit to Flamenco. It fails immediately upon clicking "Submit to Flamenco" with the following error:
Error performing BAT pack: Error transferring C:....\cache_fluid_32697ac3 to X:\cache_fluid_32697ac3

To replicate the problem:
Create a sphere
Click object -> Quick Effects -> Quick Smoke
Add Noise and Adaptive Domain
Submit to flamenco

Upon further investigation, this seems to be a general problem even with Fluid effect in Blender. Specifically it's trying to submit to an X: drive which seems to be hardcoded.

Traceback (most recent call last):
File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\bat\shaman.py", line 90, in execute
super().execute()
File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack__init__.py", line 394, in execute
self._perform_file_transfer()
File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack__init__.py", line 405, in _perform_file_transfer
self._copy_files_to_target()
File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack__init__.py", line 447, in _copy_files_to_target
self._check_aborted()
File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack__init__.py", line 210, in _check_aborted
raise Aborted(reason)
blender_asset_tracer.pack.Aborted: Error transferring C:\Users\Admin\Downloads\cache_fluid_32697ac3 to X:\cache_fluid_32697ac3
INFO:blender_asset_tracer.pack.transfer:Aborting
ERROR:blender_asset_tracer.pack:A transfer error occurred
WARNING:blender_asset_tracer.pack:Aborting
ERROR:flamenco.bat.interface:Error packing with BAT: Error transferring C:\Users\Admin\Downloads\cache_fluid_32697ac3 to X:\cache_fluid_32697ac3
ERROR:flamenco.operators.flamenco.submit_job:Error performing BAT pack: Error transferring C:\Users\Admin\Downloads\cache_fluid_32697ac3 to X:\cache_fluid_32697ac3
INFO:flamenco.operators.flamenco.submit_job:Removing temporary file C:\Users\Admin\Downloads\lambo1.flamenco.blend
Error: Error performing BAT pack: Error transferring C:\Users\Admin\Downloads\cache_fluid_32697ac3 to X:\cache_fluid_32697ac3

ERROR:blender_asset_tracer.pack:A transfer error occurred WARNING:blender_asset_tracer.pack:Aborting ERROR:flamenco.bat.shaman:Error communicating with Shaman Traceback (most recent call last): File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack__init__.py", line 438, in _copy_files_to_target self._file_transferer.done_and_join() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\transfer.py", line 141, in done_and_join raise FileTransferError( blender_asset_tracer.pack.transfer.FileTransferError: 10 files couldn't be transferred

We're seeing a very odd behaviour with a file, when we add the smoke effect and try to submit to Flamenco. It fails immediately upon clicking "Submit to Flamenco" with the following error: Error performing BAT pack: Error transferring C:\....\cache_fluid_32697ac3 to X:\cache_fluid_32697ac3 To replicate the problem: Create a sphere Click object -> Quick Effects -> Quick Smoke Add Noise and Adaptive Domain Submit to flamenco Upon further investigation, this seems to be a general problem even with Fluid effect in Blender. Specifically it's trying to submit to an X: drive which seems to be hardcoded. ``` Traceback (most recent call last): File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\bat\shaman.py", line 90, in execute super().execute() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack__init__.py", line 394, in execute self._perform_file_transfer() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack__init__.py", line 405, in _perform_file_transfer self._copy_files_to_target() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack__init__.py", line 447, in _copy_files_to_target self._check_aborted() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack__init__.py", line 210, in _check_aborted raise Aborted(reason) blender_asset_tracer.pack.Aborted: Error transferring C:\Users\Admin\Downloads\cache_fluid_32697ac3 to X:\cache_fluid_32697ac3 INFO:blender_asset_tracer.pack.transfer:Aborting ERROR:blender_asset_tracer.pack:A transfer error occurred WARNING:blender_asset_tracer.pack:Aborting ERROR:flamenco.bat.interface:Error packing with BAT: Error transferring C:\Users\Admin\Downloads\cache_fluid_32697ac3 to X:\cache_fluid_32697ac3 ERROR:flamenco.operators.flamenco.submit_job:Error performing BAT pack: Error transferring C:\Users\Admin\Downloads\cache_fluid_32697ac3 to X:\cache_fluid_32697ac3 INFO:flamenco.operators.flamenco.submit_job:Removing temporary file C:\Users\Admin\Downloads\lambo1.flamenco.blend Error: Error performing BAT pack: Error transferring C:\Users\Admin\Downloads\cache_fluid_32697ac3 to X:\cache_fluid_32697ac3 ``` `ERROR:blender_asset_tracer.pack:A transfer error occurred WARNING:blender_asset_tracer.pack:Aborting ERROR:flamenco.bat.shaman:Error communicating with Shaman Traceback (most recent call last): File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack__init__.py", line 438, in _copy_files_to_target self._file_transferer.done_and_join() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\transfer.py", line 141, in done_and_join raise FileTransferError( blender_asset_tracer.pack.transfer.FileTransferError: 10 files couldn't be transferred`

Sybren A. Stüvel commented

2023-10-16 10:35:20 +02:00

Please attach a minimal example blend file + the fluid cache (ZIP them together so it's one file to attach).

Tarik-Delic commented

2023-10-20 16:16:32 +02:00

Please find attached. When I attempt to submit to Flamenco server from Blender desktop

Error transferring C:\Users\Admin\Desktop\New folder\cache_fluid_4b85f272 to X:\cache_fluid_4b85f272
Traceback (most recent call last):
  File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\bat\shaman.py", line 218, in _create_checkout_definition
    checksum = cache.compute_cached_checksum(src)
  File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\bat\cache.py", line 139, in compute_cached_checksum
    checksum = compute_checksum(filepath)
  File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\bat\cache.py", line 82, in compute_checksum
    with filepath.open("rb") as infile:
  File "C:\Program Files\Blender Foundation\Blender 3.5\3.5\python\lib\pathlib.py", line 1119, in open
    return self._accessor.open(self, mode, buffering, encoding, errors,
PermissionError: [Errno 13] Permission denied: 'C:\\Users\\Admin\\Desktop\\New folder\\cache_fluid_4b85f272'
A transfer error occurred
Aborting
Error communicating with Shaman
Traceback (most recent call last):
  File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\__init__.py", line 438, in _copy_files_to_target
    self._file_transferer.done_and_join()
  File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\transfer.py", line 141, in done_and_join
    raise FileTransferError(
blender_asset_tracer.pack.transfer.FileTransferError: 3 files couldn't be transferred

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\bat\shaman.py", line 90, in execute
    super().execute()
  File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\__init__.py", line 394, in execute
    self._perform_file_transfer()
  File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\__init__.py", line 405, in _perform_file_transfer
    self._copy_files_to_target()
  File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\__init__.py", line 447, in _copy_files_to_target
    self._check_aborted()
  File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\__init__.py", line 210, in _check_aborted
    raise Aborted(reason)
blender_asset_tracer.pack.Aborted: Error transferring C:\Users\Admin\Desktop\New folder\cache_fluid_4b85f272 to X:\cache_fluid_4b85f272
A transfer error occurred
Aborting
Error packing with BAT: Error transferring C:\Users\Admin\Desktop\New folder\cache_fluid_4b85f272 to X:\cache_fluid_4b85f272
Error performing BAT pack: Error transferring C:\Users\Admin\Desktop\New folder\cache_fluid_4b85f272 to X:\cache_fluid_4b85f272
Error: Error performing BAT pack: Error transferring C:\Users\Admin\Desktop\New folder\cache_fluid_4b85f272 to X:\cache_fluid_4b85f272

Please find attached. When I attempt to submit to Flamenco server from Blender desktop ``` Error transferring C:\Users\Admin\Desktop\New folder\cache_fluid_4b85f272 to X:\cache_fluid_4b85f272 Traceback (most recent call last): File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\bat\shaman.py", line 218, in _create_checkout_definition checksum = cache.compute_cached_checksum(src) File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\bat\cache.py", line 139, in compute_cached_checksum checksum = compute_checksum(filepath) File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\bat\cache.py", line 82, in compute_checksum with filepath.open("rb") as infile: File "C:\Program Files\Blender Foundation\Blender 3.5\3.5\python\lib\pathlib.py", line 1119, in open return self._accessor.open(self, mode, buffering, encoding, errors, PermissionError: [Errno 13] Permission denied: 'C:\\Users\\Admin\\Desktop\\New folder\\cache_fluid_4b85f272' A transfer error occurred Aborting Error communicating with Shaman Traceback (most recent call last): File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\__init__.py", line 438, in _copy_files_to_target self._file_transferer.done_and_join() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\transfer.py", line 141, in done_and_join raise FileTransferError( blender_asset_tracer.pack.transfer.FileTransferError: 3 files couldn't be transferred ``` During handling of the above exception, another exception occurred: ``` Traceback (most recent call last): File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\bat\shaman.py", line 90, in execute super().execute() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\__init__.py", line 394, in execute self._perform_file_transfer() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\__init__.py", line 405, in _perform_file_transfer self._copy_files_to_target() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\__init__.py", line 447, in _copy_files_to_target self._check_aborted() File "C:\Users\Admin\AppData\Roaming\Blender Foundation\Blender\3.5\scripts\addons\flamenco\wheels\blender_asset_tracer-1.15-py3-none-any.whl\blender_asset_tracer\pack\__init__.py", line 210, in _check_aborted raise Aborted(reason) blender_asset_tracer.pack.Aborted: Error transferring C:\Users\Admin\Desktop\New folder\cache_fluid_4b85f272 to X:\cache_fluid_4b85f272 A transfer error occurred Aborting Error packing with BAT: Error transferring C:\Users\Admin\Desktop\New folder\cache_fluid_4b85f272 to X:\cache_fluid_4b85f272 Error performing BAT pack: Error transferring C:\Users\Admin\Desktop\New folder\cache_fluid_4b85f272 to X:\cache_fluid_4b85f272 Error: Error performing BAT pack: Error transferring C:\Users\Admin\Desktop\New folder\cache_fluid_4b85f272 to X:\cache_fluid_4b85f272 ```

Blend with Cache.zip

29 MiB

Sybren A. Stüvel changed title from ~~Smoke and Fluid effects being submitted to X: drive.~~ to Smoke and Fluid effects cannot be sent to Shaman

2023-11-02 14:55:17 +01:00

Sybren A. Stüvel commented

2023-11-02 14:59:02 +01:00

Thanks for the example, this made it considerably easier to trace what's going on. The X: drive is just a workaround that should normally be completely hidden, it's not the cause of this issue. The problem is this:

  File "...", line 82, in compute_checksum
    with filepath.open("rb") as infile:
  File "C:\Program Files\Blender Foundation\Blender 3.5\3.5\python\lib\pathlib.py", line 1119, in open
    return self._accessor.open(self, mode, buffering, encoding, errors,
PermissionError: [Errno 13] Permission denied: 'C:\\Users\\Admin\\Desktop\\New folder\\cache_fluid_4b85f272'

This shows that the Flamenco add-on tries to compute the checksum (which is based on the file contents) of a directory. This doesn't work, of course.

It turned out to be an issue with Blender Asset Tracer, and is fixed in blender/blender-asset-tracer@606377180c. I'll include the fix in the upcoming Flamenco v3.3 release.

Thanks for the example, this made it considerably easier to trace what's going on. The `X:` drive is just a workaround that should normally be completely hidden, it's not the cause of this issue. The problem is this: ``` File "...", line 82, in compute_checksum with filepath.open("rb") as infile: File "C:\Program Files\Blender Foundation\Blender 3.5\3.5\python\lib\pathlib.py", line 1119, in open return self._accessor.open(self, mode, buffering, encoding, errors, PermissionError: [Errno 13] Permission denied: 'C:\\Users\\Admin\\Desktop\\New folder\\cache_fluid_4b85f272' ``` This shows that the Flamenco add-on tries to compute the checksum (which is based on the **file** contents) of a **directory**. This doesn't work, of course. It turned out to be an issue with Blender Asset Tracer, and is fixed in blender/blender-asset-tracer@606377180cd1a3e6e1bf4621a38010966527808b. I'll include the fix in the upcoming Flamenco v3.3 release.

Sybren A. Stüvel closed this issue

2023-11-02 14:59:02 +01:00

Sign in to join this conversation.