Symlinked blend file not reading properly (macOS server, Windows client) #104335

New Issue

Eli-Murphy · 2024-08-17T01:02:19+02:00

Eli-Murphy commented

2024-08-17 01:02:19 +02:00

Operating System(s):
[Manager] macOS Sonoma 14.4
[Worker] Windows 10 Home

Version(s):
Blender 4.2
Flamenco 3.5

Description:
First-time Flamenco user, have read all existing documentation with special attention to the section on Code 1. My shared storage is a shared directory on my Mac to which I've applied a static IP address (192.168.0.9). Before setting up two-way variables due to my mixed setup, I received the "no such file or directory" code 1 error in the second screenshot. I have since modified my flamenco-manager.yaml to account for this (third screenshot) and am now receiving the "invalid argument" code 1 error seen in the first screenshot. Unsure where to begin troubleshooting, please advise.

Error Steps

Download Flamenco 3.5 (macOS ARM) and complete the setup assistant.
Download Flamenco 3.5 (Windows 10) and place both versions inside a shared folder with a static IP address.
Install the Flamenco addon to Blender 4.2 on the Mac.
Set up flamenco-manager.yaml to match the screenshot below, with two-way variables established for Blender and shared storage locations.
Run the manager from the Mac and the worker from the PC and monitor the online interface/task log for this error.

**Operating System(s):** [Manager] macOS Sonoma 14.4 [Worker] Windows 10 Home **Version(s):** Blender 4.2 Flamenco 3.5 **Description:** First-time Flamenco user, have read all existing documentation with special attention to the section on Code 1. My shared storage is a shared directory on my Mac to which I've applied a static IP address (192.168.0.9). Before setting up two-way variables due to my mixed setup, I received the "no such file or directory" code 1 error in the second screenshot. I have since modified my flamenco-manager.yaml to account for this (third screenshot) and am now receiving the "invalid argument" code 1 error seen in the first screenshot. Unsure where to begin troubleshooting, please advise. **Error Steps** 1. Download Flamenco 3.5 (macOS ARM) and complete the setup assistant. 2. Download Flamenco 3.5 (Windows 10) and place both versions inside a shared folder with a static IP address. 3. Install the Flamenco addon to Blender 4.2 on the Mac. 4. Set up flamenco-manager.yaml to match the screenshot below, with two-way variables established for Blender and shared storage locations. 5. Run the manager from the Mac and the worker from the PC and monitor the online interface/task log for this error.

Screenshot 2024-08-16 at 6.45.08 PM.png

74 KiB

Screenshot 2024-08-16 at 6.44.44 PM.png

84 KiB

Screenshot 2024-08-16 at 6.46.45 PM.png

140 KiB

Eli-Murphy added the

labels 2024-08-17 01:02:19 +02:00

Sybren A. Stüvel commented

2024-08-29 13:03:28 +02:00

First-time Flamenco user

Welcome!

have read all existing documentation with special attention to the section on Code 1

Excellent :) Not sure what you mean with "Code 1" though.

Set up flamenco-manager.yaml to match the screenshot below

In the future, please don't attach text as screenshots. It makes it impossible for me (or anyone else) to copy-paste anything from it. See https://stuvel.eu/post/2021-07-11-code-in-markdown/ for more info & instructions.

The error you're seeing is due to the Manager using symlinks, and Windows not understanding those (at least not in the way that macOS serves them right now). https://flamenco.blender.org/usage/shared-storage/shaman/ explains some options on how to deal with those. Alternatively you could turn off the Shaman system and switch to the 1st or 2nd option listed in https://flamenco.blender.org/usage/shared-storage/

> First-time Flamenco user Welcome! > have read all existing documentation with special attention to the section on Code 1 Excellent :) Not sure what you mean with "Code 1" though. > Set up flamenco-manager.yaml to match the screenshot below In the future, please don't attach text as screenshots. It makes it impossible for me (or anyone else) to copy-paste anything from it. See https://stuvel.eu/post/2021-07-11-code-in-markdown/ for more info & instructions. The error you're seeing is due to the Manager using symlinks, and Windows not understanding those (at least not in the way that macOS serves them right now). https://flamenco.blender.org/usage/shared-storage/shaman/ explains some options on how to deal with those. Alternatively you could turn off the Shaman system and switch to the 1st or 2nd option listed in https://flamenco.blender.org/usage/shared-storage/

Sybren A. Stüvel added

Status

Needs Information from User

and removed

Status

Needs Triage

labels 2024-08-29 13:03:41 +02:00

Sybren A. Stüvel commented

2024-09-12 12:44:04 +02:00

Since there hasn’t been a response in a few weeks, I’ll close this report.

Sybren A. Stüvel closed this issue

2024-09-12 12:44:05 +02:00

Eli-Murphy commented

2024-11-04 02:20:03 +01:00

Apologies for the long wait and for the screenshots, not sure what the policy is here on reopening tickets so please let me know if a separate ticket is preferable. Will also be sure to provide copy-pasteable code going forward. Thank you for your help on this issue! After re-reading the Shaman documentation I realized I missed a step while setting up my Windows worker, and have since enabled Developer Mode to make symlinks translate correctly to Windows 10 Home. Unfortunately this hasn't resolved the issue, and I'm curious if there are any additional steps I can take to troubleshoot symlink functionality on my worker machine.

The task log for the error message in the Flamenco interface is as follows:


2024-11-03T20:12:17-05:00 Task assigned to worker VENGEANCE (e437fdb3-e506-4a4a-b276-67b3a49c483d)
2024-11-03T20:12:17-05:00 task changed status queued -> active
going to run:

'C:\Program Files\Blender Foundation\Blender 4.0\blender.exe' -b -y 'Y:\Renders\jobs\tryingagain-y3y4\flamencotestagain.flamenco.blend' --render-output 'Y:\Renders/jobs/tryingagain/2024-11-03_201216/######' --render-format PNG --render-frame 1

pid=16616 > Blender 4.0.0 (hash 878f71061b8e built 2023-11-14 01:20:37)
pid=16616 > Read prefs: "C:\Users\elimu\AppData\Roaming\Blender Foundation\Blender\4.0\config\userpref.blend"
pid=16616 > Error: Cannot read file "Y:\Renders\jobs\tryingagain-y3y4\flamencotestagain.flamenco.blend": Invalid argument
pid=16616 > 
pid=16616 > Blender quit
Failed: command exited abnormally with code 1
2024-11-03T20:13:13-05:00 Task failed by worker VENGEANCE (e437fdb3-e506-4a4a-b276-67b3a49c483d), Manager will fail the entire job as there are no more workers left for tasks of type "blender".
2024-11-03T20:13:13-05:00 task changed status active -> failed

The console for the worker machine is as follows:

2024-11-03T19:55:36-05:00 INF starting Flamenco Worker arch=amd64 git=f7aef5bfc os=windows osDetail="Windows 10 Home (Core)" pid=3548 releaseCycle=release version=3.5
2024-11-03T19:55:36-05:00 INF Blender could not be found. Flamenco Manager will have to supply the full path to Blender when tasks are sent to this Worker. For more info see https://flamenco.blender.org/usage/variables/blender/
2024-11-03T19:55:41-05:00 INF FFmpeg found on this system path="\\\\192.168.0.9\\render\\Flamenco 3.5\\flamenco-3.5-windows-amd64\\tools\\ffmpeg-windows-amd64.exe" version=5.1.2-essentials_build-www.gyan.dev
2024-11-03T19:55:41-05:00 INF auto-discovering Manager via UPnP/SSDP timeout=10m0s
2024-11-03T19:55:42-05:00 INF found Flamenco Manager name=Flamenco url=http://192.168.0.9:8080/ version=3.5
2024-11-03T19:56:03-05:00 INF found Manager url=http://192.168.0.9:8080/
2024-11-03T19:56:03-05:00 INF loaded configuration config={"ConfiguredManager":"","LinuxOOMScoreAdjust":null,"ManagerURL":"http://192.168.0.9:8080/","RestartExitCode":0,"TaskTypes":["blender","ffmpeg","file-management","misc"],"WorkerName":""}
2024-11-03T19:56:03-05:00 INF loaded credentials filename="C:\\Users\\elimu\\AppData\\Local\\Blender Foundation\\Flamenco\\flamenco-worker-credentials.yaml"
2024-11-03T19:56:03-05:00 INF signing on at Manager manager=http://192.168.0.9:8080/ name=VENGEANCE softwareVersion=3.5 taskTypes=["blender","ffmpeg","file-management","misc"]
2024-11-03T19:56:03-05:00 INF manager accepted sign-on startup_state=awake
2024-11-03T19:56:03-05:00 INF opening database dsn="C:\\Users\\elimu\\AppData\\Local\\Blender Foundation\\Flamenco\\flamenco-worker.sqlite"
2024-11-03T19:56:05-05:00 INF state change curState=starting newState=awake
2024-11-03T20:12:16-05:00 INF obtained task task={"commands":[{"name":"blender-render","parameters":{"args":["--render-output","Y:\\Renders/jobs/tryingagain/2024-11-03_201216/######","--render-format","PNG","--render-frame","1"],"argsBefore":[],"blendfile":"Y:\\Renders\\jobs\\tryingagain-y3y4\\flamencotestagain.flamenco.blend","exe":"C:\\Program Files\\Blender Foundation\\Blender 4.0\\blender.exe","exeArgs":"-b -y"}}],"job":"aacdaba1-2c49-4e1a-a5c6-474e97d1bf89","job_priority":50,"job_type":"simple-blender-render","name":"render-1","priority":50,"status":"active","task_type":"blender","uuid":"9911fcff-c4a4-449c-a52a-59f71daed8e3"}
2024-11-03T20:12:16-05:00 INF starting task job=aacdaba1-2c49-4e1a-a5c6-474e97d1bf89 task=9911fcff-c4a4-449c-a52a-59f71daed8e3 taskType=blender
2024-11-03T20:12:16-05:00 INF running Flamenco command command=blender-render parameters={"args":["--render-output","Y:\\Renders/jobs/tryingagain/2024-11-03_201216/######","--render-format","PNG","--render-frame","1"],"argsBefore":[],"blendfile":"Y:\\Renders\\jobs\\tryingagain-y3y4\\flamencotestagain.flamenco.blend","exe":"C:\\Program Files\\Blender Foundation\\Blender 4.0\\blender.exe","exeArgs":"-b -y"} task=9911fcff-c4a4-449c-a52a-59f71daed8e3
2024-11-03T20:12:16-05:00 INF going to run: 'C:\Program Files\Blender Foundation\Blender 4.0\blender.exe' -b -y 'Y:\Renders\jobs\tryingagain-y3y4\flamencotestagain.flamenco.blend' --render-output 'Y:\Renders/jobs/tryingagain/2024-11-03_201216/######' --render-format PNG --render-frame 1 command=blender-render task=9911fcff-c4a4-449c-a52a-59f71daed8e3
2024-11-03T20:13:13-05:00 ERR command exited abnormally command=blender-render exitCode=1 pid=16616 task=9911fcff-c4a4-449c-a52a-59f71daed8e3
2024-11-03T20:13:13-05:00 ERR command exited abnormally command=blender-render exitCode=1 pid=16616 task=9911fcff-c4a4-449c-a52a-59f71daed8e3
2024-11-03T20:13:13-05:00 ERR command exited abnormally error="command exited abnormally with code 1" command=blender-render exitCode=1 task=9911fcff-c4a4-449c-a52a-59f71daed8e3
2024-11-03T20:13:13-05:00 WRN error executing task error="command exited abnormally with code 1" task={"commands":[{"name":"blender-render","parameters":{"args":["--render-output","Y:\\Renders/jobs/tryingagain/2024-11-03_201216/######","--render-format","PNG","--render-frame","1"],"argsBefore":[],"blendfile":"Y:\\Renders\\jobs\\tryingagain-y3y4\\flamencotestagain.flamenco.blend","exe":"C:\\Program Files\\Blender Foundation\\Blender 4.0\\blender.exe","exeArgs":"-b -y"}}],"job":"aacdaba1-2c49-4e1a-a5c6-474e97d1bf89","job_priority":50,"job_type":"simple-blender-render","name":"render-1","priority":50,"status":"active","task_type":"blender","uuid":"9911fcff-c4a4-449c-a52a-59f71daed8e3"}

This may or may not be a factor, but the worker is failing to locate Blender on launch and relies on the two-way variable I established for the Windows Blender path in flamenco-manager.yaml. My worker's Blender installation is stored in the standard location (C:\Program Files\Blender Foundation\Blender 4.0\blender.exe), is there any method for helping the worker find Blender without the two-way variable?

Apologies for the long wait and for the screenshots, not sure what the policy is here on reopening tickets so please let me know if a separate ticket is preferable. Will also be sure to provide copy-pasteable code going forward. Thank you for your help on this issue! After re-reading the Shaman documentation I realized I missed a step while setting up my Windows worker, and have since enabled Developer Mode to make symlinks translate correctly to Windows 10 Home. Unfortunately this hasn't resolved the issue, and I'm curious if there are any additional steps I can take to troubleshoot symlink functionality on my worker machine. The task log for the error message in the Flamenco interface is as follows: ``` 2024-11-03T20:12:17-05:00 Task assigned to worker VENGEANCE (e437fdb3-e506-4a4a-b276-67b3a49c483d) 2024-11-03T20:12:17-05:00 task changed status queued -> active going to run: 'C:\Program Files\Blender Foundation\Blender 4.0\blender.exe' -b -y 'Y:\Renders\jobs\tryingagain-y3y4\flamencotestagain.flamenco.blend' --render-output 'Y:\Renders/jobs/tryingagain/2024-11-03_201216/######' --render-format PNG --render-frame 1 pid=16616 > Blender 4.0.0 (hash 878f71061b8e built 2023-11-14 01:20:37) pid=16616 > Read prefs: "C:\Users\elimu\AppData\Roaming\Blender Foundation\Blender\4.0\config\userpref.blend" pid=16616 > Error: Cannot read file "Y:\Renders\jobs\tryingagain-y3y4\flamencotestagain.flamenco.blend": Invalid argument pid=16616 > pid=16616 > Blender quit Failed: command exited abnormally with code 1 2024-11-03T20:13:13-05:00 Task failed by worker VENGEANCE (e437fdb3-e506-4a4a-b276-67b3a49c483d), Manager will fail the entire job as there are no more workers left for tasks of type "blender". 2024-11-03T20:13:13-05:00 task changed status active -> failed ``` The console for the worker machine is as follows: ``` 2024-11-03T19:55:36-05:00 INF starting Flamenco Worker arch=amd64 git=f7aef5bfc os=windows osDetail="Windows 10 Home (Core)" pid=3548 releaseCycle=release version=3.5 2024-11-03T19:55:36-05:00 INF Blender could not be found. Flamenco Manager will have to supply the full path to Blender when tasks are sent to this Worker. For more info see https://flamenco.blender.org/usage/variables/blender/ 2024-11-03T19:55:41-05:00 INF FFmpeg found on this system path="\\\\192.168.0.9\\render\\Flamenco 3.5\\flamenco-3.5-windows-amd64\\tools\\ffmpeg-windows-amd64.exe" version=5.1.2-essentials_build-www.gyan.dev 2024-11-03T19:55:41-05:00 INF auto-discovering Manager via UPnP/SSDP timeout=10m0s 2024-11-03T19:55:42-05:00 INF found Flamenco Manager name=Flamenco url=http://192.168.0.9:8080/ version=3.5 2024-11-03T19:56:03-05:00 INF found Manager url=http://192.168.0.9:8080/ 2024-11-03T19:56:03-05:00 INF loaded configuration config={"ConfiguredManager":"","LinuxOOMScoreAdjust":null,"ManagerURL":"http://192.168.0.9:8080/","RestartExitCode":0,"TaskTypes":["blender","ffmpeg","file-management","misc"],"WorkerName":""} 2024-11-03T19:56:03-05:00 INF loaded credentials filename="C:\\Users\\elimu\\AppData\\Local\\Blender Foundation\\Flamenco\\flamenco-worker-credentials.yaml" 2024-11-03T19:56:03-05:00 INF signing on at Manager manager=http://192.168.0.9:8080/ name=VENGEANCE softwareVersion=3.5 taskTypes=["blender","ffmpeg","file-management","misc"] 2024-11-03T19:56:03-05:00 INF manager accepted sign-on startup_state=awake 2024-11-03T19:56:03-05:00 INF opening database dsn="C:\\Users\\elimu\\AppData\\Local\\Blender Foundation\\Flamenco\\flamenco-worker.sqlite" 2024-11-03T19:56:05-05:00 INF state change curState=starting newState=awake 2024-11-03T20:12:16-05:00 INF obtained task task={"commands":[{"name":"blender-render","parameters":{"args":["--render-output","Y:\\Renders/jobs/tryingagain/2024-11-03_201216/######","--render-format","PNG","--render-frame","1"],"argsBefore":[],"blendfile":"Y:\\Renders\\jobs\\tryingagain-y3y4\\flamencotestagain.flamenco.blend","exe":"C:\\Program Files\\Blender Foundation\\Blender 4.0\\blender.exe","exeArgs":"-b -y"}}],"job":"aacdaba1-2c49-4e1a-a5c6-474e97d1bf89","job_priority":50,"job_type":"simple-blender-render","name":"render-1","priority":50,"status":"active","task_type":"blender","uuid":"9911fcff-c4a4-449c-a52a-59f71daed8e3"} 2024-11-03T20:12:16-05:00 INF starting task job=aacdaba1-2c49-4e1a-a5c6-474e97d1bf89 task=9911fcff-c4a4-449c-a52a-59f71daed8e3 taskType=blender 2024-11-03T20:12:16-05:00 INF running Flamenco command command=blender-render parameters={"args":["--render-output","Y:\\Renders/jobs/tryingagain/2024-11-03_201216/######","--render-format","PNG","--render-frame","1"],"argsBefore":[],"blendfile":"Y:\\Renders\\jobs\\tryingagain-y3y4\\flamencotestagain.flamenco.blend","exe":"C:\\Program Files\\Blender Foundation\\Blender 4.0\\blender.exe","exeArgs":"-b -y"} task=9911fcff-c4a4-449c-a52a-59f71daed8e3 2024-11-03T20:12:16-05:00 INF going to run: 'C:\Program Files\Blender Foundation\Blender 4.0\blender.exe' -b -y 'Y:\Renders\jobs\tryingagain-y3y4\flamencotestagain.flamenco.blend' --render-output 'Y:\Renders/jobs/tryingagain/2024-11-03_201216/######' --render-format PNG --render-frame 1 command=blender-render task=9911fcff-c4a4-449c-a52a-59f71daed8e3 2024-11-03T20:13:13-05:00 ERR command exited abnormally command=blender-render exitCode=1 pid=16616 task=9911fcff-c4a4-449c-a52a-59f71daed8e3 2024-11-03T20:13:13-05:00 ERR command exited abnormally command=blender-render exitCode=1 pid=16616 task=9911fcff-c4a4-449c-a52a-59f71daed8e3 2024-11-03T20:13:13-05:00 ERR command exited abnormally error="command exited abnormally with code 1" command=blender-render exitCode=1 task=9911fcff-c4a4-449c-a52a-59f71daed8e3 2024-11-03T20:13:13-05:00 WRN error executing task error="command exited abnormally with code 1" task={"commands":[{"name":"blender-render","parameters":{"args":["--render-output","Y:\\Renders/jobs/tryingagain/2024-11-03_201216/######","--render-format","PNG","--render-frame","1"],"argsBefore":[],"blendfile":"Y:\\Renders\\jobs\\tryingagain-y3y4\\flamencotestagain.flamenco.blend","exe":"C:\\Program Files\\Blender Foundation\\Blender 4.0\\blender.exe","exeArgs":"-b -y"}}],"job":"aacdaba1-2c49-4e1a-a5c6-474e97d1bf89","job_priority":50,"job_type":"simple-blender-render","name":"render-1","priority":50,"status":"active","task_type":"blender","uuid":"9911fcff-c4a4-449c-a52a-59f71daed8e3"} ``` This may or may not be a factor, but the worker is failing to locate Blender on launch and relies on the two-way variable I established for the Windows Blender path in flamenco-manager.yaml. My worker's Blender installation is stored in the standard location (C:\Program Files\Blender Foundation\Blender 4.0\blender.exe), is there any method for helping the worker find Blender without the two-way variable?

Eli-Murphy reopened this issue

2024-11-04 02:20:04 +01:00

Sybren A. Stüvel commented

2024-11-04 11:21:22 +01:00

not sure what the policy is here on reopening tickets so please let me know if a separate ticket is preferable.

Reopening the issue is the right approach. That way we don't spread out over too many issues, and keep things a bit more focused. Thanks :)

My worker's Blender installation is stored in the standard location (C:\Program Files\Blender Foundation\Blender 4.0\blender.exe), is there any method for helping the worker find Blender without the two-way variable?

This is not the issue. You can see in the task log that Blender runs, but that it cannot load the blend file.

pid=16616 > Blender 4.0.0 (hash 878f71061b8e built 2023-11-14 01:20:37)
pid=16616 > Read prefs: "C:\Users\elimu\AppData\Roaming\Blender Foundation\Blender\4.0\config\userpref.blend"
pid=16616 > Error: Cannot read file "Y:\Renders\jobs\tryingagain-y3y4\flamencotestagain.flamenco.blend": Invalid argument
pid=16616 > 
pid=16616 > Blender quit

The problem is likely the symlinks, how these are served by your mac, and how they are interpreted by Windows. Windows and symlinks is always tricky. To debug this, you'll likely have to change some settings on your mac and/or on Windows, outside of Flamenco. The good news is that you can test those without Flamenco as well, just try to open the blend file yourself on Windows. That should at least make the testing faster.

Now, how to deal with macOS I don't quite know. @fsiddi did some investigation here -- Francesco, do you have some knowledge to share?

> not sure what the policy is here on reopening tickets so please let me know if a separate ticket is preferable. Reopening the issue is the right approach. That way we don't spread out over too many issues, and keep things a bit more focused. Thanks :) > My worker's Blender installation is stored in the standard location (C:\Program Files\Blender Foundation\Blender 4.0\blender.exe), is there any method for helping the worker find Blender without the two-way variable? This is not the issue. You can see in the task log that Blender runs, but that it cannot load the blend file. ``` pid=16616 > Blender 4.0.0 (hash 878f71061b8e built 2023-11-14 01:20:37) pid=16616 > Read prefs: "C:\Users\elimu\AppData\Roaming\Blender Foundation\Blender\4.0\config\userpref.blend" pid=16616 > Error: Cannot read file "Y:\Renders\jobs\tryingagain-y3y4\flamencotestagain.flamenco.blend": Invalid argument pid=16616 > pid=16616 > Blender quit ``` The problem is likely the symlinks, how these are served by your mac, and how they are interpreted by Windows. Windows and symlinks is always tricky. To debug this, you'll likely have to change some settings on your mac and/or on Windows, outside of Flamenco. The good news is that you can test those without Flamenco as well, just try to open the blend file yourself on Windows. That should at least make the testing faster. Now, how to deal with macOS I don't quite know. @fsiddi did some investigation here -- Francesco, do you have some knowledge to share?

Sybren A. Stüvel changed title from ~~Error: Cannot read file [PATH] Invalid argument (Code 1)~~ to Symlinked blend file not reading properly (macOS server, Windows client)

2024-11-04 11:24:57 +01:00

Eli-Murphy commented

2024-11-09 19:39:42 +01:00

Thank you for the guidance! I've just tested opening the symlink of the Blender file manually from my PC's Blender installation. It recognizes the .blend extension of the file, but fails to open the file and gives the same "Invalid Argument" error message, which supports your theory that Windows isn't properly translating the symlink. Since I've already enabled Developer Mode, are there any other Windows settings I should experiment with to troubleshoot? Would it help to copy and paste the contents of my flamenco-manager.yaml here for context?

Eli-Murphy commented

2024-11-09 19:44:51 +01:00

Update! I found a command online ("fsutil behavior query symlinkevaluation") that I pasted into Command Prompt and it returned the following information:

C:\Users\elimu>fsutil behavior query symlinkevaluation Local to local symbolic links are enabled. Local to remote symbolic links are enabled. Remote to local symbolic links are disabled. Remote to remote symbolic links are disabled.

I'm not sure if this information is helpful, but I thought I'd provide it just in case. From here, I figured out how to enable the latter two remote options through the command line and attempted another Flamenco render, which produced the same result.

Update! I found a command online ("fsutil behavior query symlinkevaluation") that I pasted into Command Prompt and it returned the following information: `C:\Users\elimu>fsutil behavior query symlinkevaluation Local to local symbolic links are enabled. Local to remote symbolic links are enabled. Remote to local symbolic links are disabled. Remote to remote symbolic links are disabled.` I'm not sure if this information is helpful, but I thought I'd provide it just in case. From here, I figured out how to enable the latter two remote options through the command line and attempted another Flamenco render, which produced the same result.

Sybren A. Stüvel commented

2024-11-11 10:30:10 +01:00

Thanks for the investigation. I think for this to work, remote-to-remote symlinks have to be enabled. I found an article that says this command could work:

fsutil behavior set SymlinkEvaluation R2R:1

Thanks for the investigation. I think for this to work, remote-to-remote symlinks have to be enabled. I found [an article](https://neurotechnics.com/blog/fix-symbolic-link-cannot-be-followed/) that says this command could work: ``` fsutil behavior set SymlinkEvaluation R2R:1 ```

Eli-Murphy commented

2024-11-14 21:30:55 +01:00

Remote-to-remote symlinks have been enabled, still receiving the same error message. Could it be something on the Mac side?

This is just another guess, but running the Worker application on my Windows machine sometimes displays an error about having difficulty locating FFmpeg, could this be causing the error?

Remote-to-remote symlinks have been enabled, still receiving the same error message. Could it be something on the Mac side? This is just another guess, but running the Worker application on my Windows machine sometimes displays an error about having difficulty locating FFmpeg, could this be causing the error?

Eli-Murphy commented

2024-11-15 00:56:31 +01:00

For troubleshooting purposes I attempted the same setup without Shaman today (working directly on shared storage) and received a similar error. The worker's task log is as follows:

2024-11-14T18:46:04-05:00 Task assigned to worker VENGEANCE (e437fdb3-e506-4a4a-b276-67b3a49c483d)
2024-11-14T18:46:04-05:00 task changed status queued -> active
going to run:

    'C:\Program Files\Blender Foundation\Blender 4.2\blender.exe' -b -y 'Y:\Renders/2024-11-14-184601.189012-TestWithoutShaman/TestWithoutShaman.flamenco.blend' --render-output '/Users/elimurphy/Public/RENDER/TestWithoutShaman/2024-11-14_184602/######' --render-format PNG --render-frame 1

pid=19296 > C:\Users\elimurphy\Public\RENDER\TestWithoutShaman\2024-11-14_184602\000001.png: No such file or directory
pid=19296 > Blender 4.2.0 (hash a51f293548ad built 2024-07-16 06:29:33)
pid=19296 > Read blend: "Y:\Renders\2024-11-14-184601.189012-TestWithoutShaman\TestWithoutShaman.flamenco.blend"
pid=19296 > Error: Render error (No such file or directory) cannot save: 'C:\Users\elimurphy\Public\RENDER\TestWithoutShaman\2024-11-14_184602\000001.png'
pid=19296 > Time: 00:03.02 (Saving: 00:00.21)
pid=19296 > 
pid=19296 > 
pid=19296 > Blender quit
Failed: command exited abnormally with code 1
2024-11-14T18:46:08-05:00 Task failed by worker VENGEANCE (e437fdb3-e506-4a4a-b276-67b3a49c483d), Manager will fail the entire job as there are no more workers left for tasks of type "blender".
2024-11-14T18:46:08-05:00 task changed status active -> failed

Correct me if I'm wrong, but I have a suspicion that "C:\Users\elimurphy\Public\RENDER\TestWithoutShaman" is the result of a two-way variable being misinterpreted, and may be the cause of our original issue. I'm unclear why it's affixing "C:" to my Windows storage filepath when my storage directory is mounted as "Y:" and specified in my flamenco-manager.yaml as "Y:\Renders". For context, my variables are as follows:

variables:
  my_storage:
    is_twoway: true
    values:
    - platform: linux
      value: /Users/elimurphy/Public/RENDER/Renders
    - platform: windows
      value: Y:\Renders
    - platform: darwin
      value: /Users/elimurphy/Public/RENDER/Renders
  blender:
    is_twoway: true
    values:
    - platform: linux
      value: /Applications/blender.app/Contents/MacOS/Blender
    - platform: windows
      value: C:\Program Files\Blender Foundation\Blender 4.2\blender.exe
    - platform: darwin
      value: /Applications/blender.app/Contents/MacOS/Blender
  blenderArgs:
    values:
    - platform: all
      value: -b -y

My shared storage path near the top of flamenco-manager.yaml is as follows:

shared_storage_path: /Users/elimurphy/Public/RENDER

Please let me know if I'm doing the path prefix replacement incorrectly.

For troubleshooting purposes I attempted the same setup without Shaman today (working directly on shared storage) and received a similar error. The worker's task log is as follows: ``` 2024-11-14T18:46:04-05:00 Task assigned to worker VENGEANCE (e437fdb3-e506-4a4a-b276-67b3a49c483d) 2024-11-14T18:46:04-05:00 task changed status queued -> active going to run: 'C:\Program Files\Blender Foundation\Blender 4.2\blender.exe' -b -y 'Y:\Renders/2024-11-14-184601.189012-TestWithoutShaman/TestWithoutShaman.flamenco.blend' --render-output '/Users/elimurphy/Public/RENDER/TestWithoutShaman/2024-11-14_184602/######' --render-format PNG --render-frame 1 pid=19296 > C:\Users\elimurphy\Public\RENDER\TestWithoutShaman\2024-11-14_184602\000001.png: No such file or directory pid=19296 > Blender 4.2.0 (hash a51f293548ad built 2024-07-16 06:29:33) pid=19296 > Read blend: "Y:\Renders\2024-11-14-184601.189012-TestWithoutShaman\TestWithoutShaman.flamenco.blend" pid=19296 > Error: Render error (No such file or directory) cannot save: 'C:\Users\elimurphy\Public\RENDER\TestWithoutShaman\2024-11-14_184602\000001.png' pid=19296 > Time: 00:03.02 (Saving: 00:00.21) pid=19296 > pid=19296 > pid=19296 > Blender quit Failed: command exited abnormally with code 1 2024-11-14T18:46:08-05:00 Task failed by worker VENGEANCE (e437fdb3-e506-4a4a-b276-67b3a49c483d), Manager will fail the entire job as there are no more workers left for tasks of type "blender". 2024-11-14T18:46:08-05:00 task changed status active -> failed ``` Correct me if I'm wrong, but I have a suspicion that "C:\Users\elimurphy\Public\RENDER\TestWithoutShaman" is the result of a two-way variable being misinterpreted, and may be the cause of our original issue. I'm unclear why it's affixing "C:\" to my Windows storage filepath when my storage directory is mounted as "Y:\" and specified in my flamenco-manager.yaml as "Y:\Renders". For context, my variables are as follows: ``` variables: my_storage: is_twoway: true values: - platform: linux value: /Users/elimurphy/Public/RENDER/Renders - platform: windows value: Y:\Renders - platform: darwin value: /Users/elimurphy/Public/RENDER/Renders blender: is_twoway: true values: - platform: linux value: /Applications/blender.app/Contents/MacOS/Blender - platform: windows value: C:\Program Files\Blender Foundation\Blender 4.2\blender.exe - platform: darwin value: /Applications/blender.app/Contents/MacOS/Blender blenderArgs: values: - platform: all value: -b -y ``` My shared storage path near the top of flamenco-manager.yaml is as follows: `shared_storage_path: /Users/elimurphy/Public/RENDER` Please let me know if I'm doing the path prefix replacement incorrectly.

Sybren A. Stüvel commented

2024-11-18 15:30:33 +01:00

Remote-to-remote symlinks have been enabled, still receiving the same error message. Could it be something on the Mac side?

If the mac is using Samba, you could even configure it so that it doesn't even show the Windows client that there are symlinks. You'd have to dig through the Samba docs to find how to do that, though.

https://flamenco.blender.org/usage/shared-storage/shaman/#enabling-symlinks-on-samba might also help.

This is just another guess, but running the Worker application on my Windows machine sometimes displays an error about having difficulty locating FFmpeg, could this be causing the error?

Is that actually an error? Or a warning? Is it this? https://flamenco.blender.org/faq/#my-worker-cannot-find-blender-what-do-i-do

For troubleshooting purposes I attempted the same setup without Shaman today (working directly on shared storage) and received a similar error. The worker's task log is as follows:

The render output is set to /Users/elimurphy/Public/RENDER/TestWithoutShaman/... but the two-way variable is set to /Users/elimurphy/Public/RENDER/Renders. The render output doesn't match the two-way variable.

> Remote-to-remote symlinks have been enabled, still receiving the same error message. Could it be something on the Mac side? If the mac is using Samba, you could even configure it so that it doesn't even show the Windows client that there are symlinks. You'd have to dig through the Samba docs to find how to do that, though. https://flamenco.blender.org/usage/shared-storage/shaman/#enabling-symlinks-on-samba might also help. > This is just another guess, but running the Worker application on my Windows machine sometimes displays an error about having difficulty locating FFmpeg, could this be causing the error? Is that actually an error? Or a warning? Is it this? https://flamenco.blender.org/faq/#my-worker-cannot-find-blender-what-do-i-do > For troubleshooting purposes I attempted the same setup without Shaman today (working directly on shared storage) and received a similar error. The worker's task log is as follows: The render output is set to `/Users/elimurphy/Public/RENDER/TestWithoutShaman/...` but the two-way variable is set to `/Users/elimurphy/Public/RENDER/Renders`. The render output doesn't match the two-way variable.

Eli-Murphy commented

2024-11-18 22:20:31 +01:00

You were right! Turns out the issue was caused by the discrepancy between the render output and the two-way variable. Problem solved! Thank you so much for all of your help and insight. Also, totally unrelated, just listened to your talk on scripting for artists and thoroughly enjoyed it :)

Sign in to join this conversation.