OSX, network rendering, lcr 2.1 beta 3

Use this forum for general user support and related questions.
Forum rules
Please upload a testscene that allows developers to reproduce the problem, and attach some images.
User avatar
FarbigeWelt
Donor
Donor
Posts: 1046
Joined: Sun Jul 01, 2018 12:07 pm
Location: Switzerland
Contact:

OSX, network rendering, lcr 2.1 beta 3

Post by FarbigeWelt »

This weekend I tried to set up network rendering on my OSX 13 to speed up BiDir renders. The button has niw some functionality and the tips to install PySide2 as described on a Wiki page. Finally I was able to install what was required and lcr addon accepted this after a restart of rhe Mac. The current result is a Window with two options, console or node, both keading to nothing.

Some help would be very appreciated. Thanks.
Light and Word designing Creator - www.farbigewelt.ch - aka quantenkristall || #luxcorerender
MacBook Air with M1
robbrown
Developer
Developer
Posts: 63
Joined: Mon Sep 03, 2018 1:04 am

Re: OSX, network rendering, lcr 2.1 beta 3

Post by robbrown »

Peculiar that it works up to the "PyLuxCore Tools Menu" window and nothing more. Does it look like it crashes? (Window disappears after clicking a button and Python rocket logo in the dock disappears?)

What version and method of python3 do you have installed?

Is this with or without OpenCL? (I just confirmed Non-OpenCL works on my MacBook Pro in 10.13, I can try with OpenCL on another machine tomorrow)
User avatar
FarbigeWelt
Donor
Donor
Posts: 1046
Joined: Sun Jul 01, 2018 12:07 pm
Location: Switzerland
Contact:

Re: OSX, network rendering, lcr 2.1 beta 3

Post by FarbigeWelt »

robbrown wrote: Thu Dec 13, 2018 7:52 am Peculiar that it works up to the "PyLuxCore Tools Menu" window and nothing more. Does it look like it crashes? (Window disappears after clicking a button and Python rocket logo in the dock disappears?)

What version and method of python3 do you have installed?

Is this with or without OpenCL? (I just confirmed Non-OpenCL works on my MacBook Pro in 10.13, I can try with OpenCL on another machine tomorrow)
Hi Rob,
Yesterday, I have tried to start network render in BlenderLuxCore 2.1. With the same result Python luncher shows a window with node and console button but quits after clicking one of them. Unfortunately this Python does not have any information in the screen menu and there is not any information in the terminal if I start Blender in terminal.

Because of an installation with many updates over the last years up to
System Version: macOS 10.13.6 (17G5019)
Kernel Version: Darwin 17.7.0
and probably due to lots of Blender versions during all these years since Mid 2010 my Python 3 installations are a mess and not any version is in the place the wiki notes expects https://wiki.luxcorerender.org/LuxCoreR ... _Rendering.

Do you have any suggestions how to remove and install correct version of Python 3 for network rendering?

Installations
Python:

Version:
Source: 3rd Party
Install Date: 07.01.17, 23:15

Applications
Python:

Version: 2.7.10
Obtained from: Apple
Last Modified: 16.06.18, 08:24
Kind: Intel
64-Bit (Intel): Yes
Signed by: Software Signing, Apple Code Signing Certification Authority, Apple Root CA
Location: /System/Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app
Get Info String: 2.7.10, (c) 2001-2015 Python Software Foundation.

Python:

Version: 3.7.2
Obtained from: Unknown
Last Modified: 24.12.18, 04:41
Kind: Intel
64-Bit (Intel): Yes
Location: /usr/local/Cellar/python/3.7.2_1/Frameworks/Python.framework/Versions/3.7/Resources/Python.app
Get Info String: 3.7.2, (c) 2001-2016 Python Software Foundation.

Python:

Version: 3.7.1
Obtained from: Unknown
Last Modified: 20.10.18, 08:25
Kind: Intel
64-Bit (Intel): Yes
Location: /usr/local/Cellar/python/3.7.1/Frameworks/Python.framework/Versions/3.7/Resources/Python.app
Get Info String: 3.7.1, (c) 2001-2016 Python Software Foundation.

Python:

Version: 3.6.0
Obtained from: Unknown
Last Modified: 07.01.17, 23:15
Kind: Intel
64-Bit (Intel): Yes
Location: /Library/Frameworks/Python.framework/Versions/3.6/Resources/Python.app
Get Info String: 3.6.0, (c) 2001-2016 Python Software Foundation.

Python Launcher:

Version: 3.6.0
Obtained from: Unknown
Last Modified: 07.01.17, 23:15
Kind: Intel
64-Bit (Intel): Yes
Location: /Applications/Python 3.6/Python Launcher.app
Get Info String: 3.6.0, © 2001-2016 Python Software Foundation

Python Launcher 3:

Version: 3.7.2
Obtained from: Unknown
Last Modified: 24.12.18, 04:41
Kind: Intel
64-Bit (Intel): Yes
Location: /usr/local/Cellar/python/3.7.2_1/Python Launcher 3.app
Get Info String: 3.7.2, © 2001-2018 Python Software Foundation

Python Launcher 3:

Version: 3.7.1
Obtained from: Unknown
Last Modified: 20.10.18, 08:25
Kind: Intel
64-Bit (Intel): Yes
Location: /usr/local/Cellar/python/3.7.1/Python Launcher 3.app
Get Info String: 3.7.1, © 2001-2018 Python Software Foundation
Light and Word designing Creator - www.farbigewelt.ch - aka quantenkristall || #luxcorerender
MacBook Air with M1
robbrown
Developer
Developer
Posts: 63
Joined: Mon Sep 03, 2018 1:04 am

Re: OSX, network rendering, lcr 2.1 beta 3

Post by robbrown »

Hmm, let me see if it’s doing that again in my machine tonight and send some instructions of my python setup. I had it working to a point where I needed some network machines to try it on.
User avatar
FarbigeWelt
Donor
Donor
Posts: 1046
Joined: Sun Jul 01, 2018 12:07 pm
Location: Switzerland
Contact:

Re: OSX, network rendering, lcr 2.1 plugin

Post by FarbigeWelt »

robbrown wrote: Thu Jan 31, 2019 7:44 pm Hmm, let me see if it’s doing that again in my machine tonight and send some instructions of my python setup. I had it working to a point where I needed some network machines to try it on.
Improved Python script which info/abot in screen menue could and output step / debug info to some terminal window may be useful and hopefully not much work implementing them.

Because my mixed network, windows and mac os x, it is in my opinion a good setup to test reliability of network rendering.
I wonder if I also get the win 10 home version connected.
Light and Word designing Creator - www.farbigewelt.ch - aka quantenkristall || #luxcorerender
MacBook Air with M1
robbrown
Developer
Developer
Posts: 63
Joined: Mon Sep 03, 2018 1:04 am

Re: OSX, network rendering, lcr 2.1 beta 3

Post by robbrown »

Ah, now I understand what you're looking to do. Reading it on the phone I missed some of the info.

Based on the locations it looks like you have Brew installs and a manual Application folder install going on. The application folder one I think you can just drag to trash. I think brew cleanup python3 will remove all the excess Python3 versions you have floating around.

I have python 3.5.3 installed on mine for the builds, maybe try those to see if the network window shows correctly? I've had that issue before during builds and had to get python 3.5.3 and pyside2 installed.

Yeah, I think it might be worth tracing what versions of python3 and pyside2 it's using since I'm sure everyone has multiple python packages installed. I did as well and eventually had to move to pyenv to set the version.
User avatar
FarbigeWelt
Donor
Donor
Posts: 1046
Joined: Sun Jul 01, 2018 12:07 pm
Location: Switzerland
Contact:

OS X, Python 3.5.3, clean up and installation

Post by FarbigeWelt »

robbrown wrote: Sun Feb 03, 2019 8:28 am
Based on the locations it looks like you have Brew installs and a manual Application folder install going on. The application folder one I think you can just drag to trash. I think brew cleanup python3 will remove all the excess Python3 versions you have floating around.

I have python 3.5.3 installed on mine for the builds, maybe try those to see if the network window shows correctly?
I've had that issue before during builds and had to get python 3.5.3 and pyside2 installed.

I'm sure everyone has multiple python packages installed. I did as well and eventually had to move to pyenv to set the version.
Yes, I used to use homebrew some years ago, (trying to get familiar with simple ruby on rails hoping to learn object oriented programming with zombies on rail. Tutorial was fun, but there is a simpler OO because it seems not to be easy for many procedure-, function-minded hobby coders https://processing.org. Good for coding simple 2D, 3D graphic effects with warranted steep learning curve. It is OO oriented, its scripts run without need of environment setup and one can focus on learning and algorithms, e.g. defining an object like a langton's ant and then instancing a dozen of them.)

Your

Code: Select all

brew cleanup python3
pointed me into the right direction but did not work for my system.

After updating homebrew, how to install or use, see https://docs.brew.sh/Manpage[/url} beca ... in/python3

Code: Select all

[b]brew install pip3[/b]
Updating Homebrew...
Error: No available formula with the name "pip3" 
==> Searching for a previously deleted formula (in the last month)...
Warning: homebrew/core is shallow clone. To get complete history run:
  git -C "$(brew --repo homebrew/core)" fetch --unshallow

Error: No previously deleted formula found.
==> Searching for similarly named formulae...
Error: No similarly named formulae found.
==> Searching taps...
==> Searching taps on GitHub...
Error: No formulae found in taps.
Okay let's follow the warning above.

Code: Select all

git [b]-C "$(brew --repo homebrew/core)" fetch --unshallow[/b]
remote: Enumerating objects: 554173, done.
remote: Counting objects: 100% (551265/551265), done.
remote: Compressing objects: 100% (197687/197687), done.
remote: Total 545274 (delta 350268), reused 539740 (delta 344736), pack-reused 
Receiving objects: 100% (545274/545274), 211.99 MiB | 10.78 MiB/s, done.
Resolving deltas: 100% (350268/350268), completed with 3889 local objects.

And then install python 3.5.3 with pyenv, recommended here https://gist.github.com/Bouke/11261620.

Code: Select all

[b]brew install pyenv[/b]
==> Downloading https://homebrew.bintray.com/bottles/pyenv-1.2.9.high_sierra.bot
######################################################################## 100.0%
==> Pouring pyenv-1.2.9.high_sierra.bottle.tar.gz
🍺  /usr/local/Cellar/pyenv/1.2.9: 619 files, 2.4MB

Code: Select all

[b]pyenv install 3.5.2[/b]
python-build: use openssl from homebrew
python-build: use readline from homebrew
Downloading Python-3.5.2.tar.xz...
-> https://www.python.org/ftp/python/3.5.2/Python-3.5.2.tar.xz
Installing Python-3.5.2...
patching file Lib/venv/scripts/posix/activate.fish
python-build: use readline from homebrew
Installed Python-3.5.2 to /Users/mtroesch/.pyenv/versions/3.5.2
Last step is about PySide2
(looks like this https://formulae.brew.sh/formula/pyside works for both python 2 and 3.)

S T O P here
You may read this, but do not follow the next step, It leads to a lot of conflicts and:
==> Pouring pyside-5.11.2.high_sierra.bottle.tar.gz
Error: The `brew link` step did not complete successfully

Code: Select all

[b]brew install PySide[/b]
Updating Homebrew...
==> Auto-updated Homebrew!
Updated 1 tap (homebrew/core).
==> Updated Formulae
elixir

==> Installing dependencies for pyside: libffi, llvm, python, python@2 and qt
==> Installing pyside dependency: libffi
==> Downloading https://homebrew.bintray.com/bottles/libffi-3.2.1.high_sierra.bo
######################################################################## 100.0%
==> Pouring libffi-3.2.1.high_sierra.bottle.tar.gz
==> Caveats
libffi is keg-only, which means it was not symlinked into /usr/local,
because some formulae require a newer version of libffi.

For compilers to find libffi you may need to set:
  export LDFLAGS="-L/usr/local/opt/libffi/lib"

For pkg-config to find libffi you may need to set:
  export PKG_CONFIG_PATH="/usr/local/opt/libffi/lib/pkgconfig"

==> Summary
🍺  /usr/local/Cellar/libffi/3.2.1: 16 files, 297.0KB
==> Installing pyside dependency: llvm
==> Downloading https://homebrew.bintray.com/bottles/llvm-7.0.1.high_sierra.bott
####                                                                       6.9%
Hoppla, this takes a while...
(submitting post, to be updated soon..)
Last edited by FarbigeWelt on Sun Feb 03, 2019 1:52 pm, edited 1 time in total.
Light and Word designing Creator - www.farbigewelt.ch - aka quantenkristall || #luxcorerender
MacBook Air with M1
User avatar
FarbigeWelt
Donor
Donor
Posts: 1046
Joined: Sun Jul 01, 2018 12:07 pm
Location: Switzerland
Contact:

OS X, conflicts and errors with homebrew PySide

Post by FarbigeWelt »

Finally things going further..

but with errors and notes


(Removed topics with infos to keg-only software, keg-only means macOS already provides this software..)

Code: Select all

######################################################################## 100.0%
==> Pouring[b] llvm-7.0.1[/b].high_sierra.bottle.tar.gz

==> Caveats
To use the bundled libc++ please add the following LDFLAGS:
  LDFLAGS="-L/usr/local/opt/llvm/lib -Wl,-rpath,/usr/local/opt/llvm/lib"

llvm is keg-only

==> Summary
🍺  /usr/local/Cellar/llvm/7.0.1: 5,351 files, 2.8GB

==>[b] Installing pyside dependency: python[/b]
==> Downloading https://homebrew.bintray.com/bottles/[b]python-3.7.2_1[/b].high_sierra.
Already downloaded: /Users/mtroesch/Library/Caches/Homebrew/downloads/4b688300c4845255641b0ca99aed8b26ea490919a30daf618c1a445f7591eb4c--python-3.7.2_1.high_sierra.bottle.1.tar.gz
==> Pouring python-3.7.2_1.high_sierra.bottle.1.tar.gz
[b]Error: The `brew link` step did not complete successfully[/b]
The formula built, but is not symlinked into /usr/local
Could not symlink bin/2to3
Target /usr/local/bin/2to3
[b]already exists.[/b] You may want to remove it:
  rm '/usr/local/bin/2to3'

To force the link and overwrite all conflicting files:
  brew link --overwrite python

To list all files that would be deleted:
  brew link --overwrite --dry-run python

Possible conflicting files are:
/usr/local/bin/2to3 -> /Library/Frameworks/Python.framework/Versions/3.6/bin/2to3
/usr/local/bin/idle3 -> /Library/Frameworks/Python.framework/Versions/3.6/bin/idle3
/usr/local/bin/pydoc3 -> /Library/Frameworks/Python.framework/Versions/3.6/bin/pydoc3
/usr/local/bin/python3 -> /Library/Frameworks/Python.framework/Versions/3.6/bin/python3
/usr/local/bin/python3-config -> /Library/Frameworks/Python.framework/Versions/3.6/bin/python3-config
/usr/local/bin/pyvenv -> /Library/Frameworks/Python.framework/Versions/3.6/bin/pyvenv
==> /usr/local/Cellar/python/3.7.2_1/bin/python3 -s setup.py --no-user-cfg insta
==> /usr/local/Cellar/python/3.7.2_1/bin/python3 -s setup.py --no-user-cfg insta
==> /usr/local/Cellar/python/3.7.2_1/bin/python3 -s setup.py --no-user-cfg insta
==> Caveats
Python has been installed as
  /usr/local/bin/python3

Unversioned symlinks `python`, `python-config`, `pip` etc. pointing to
`python3`, `python3-config`, `pip3` etc., respectively, have been installed into
  /usr/local/opt/python/libexec/bin

If you need Homebrew's Python 2.7 run
  brew install python@2

[b]You can install Python packages with
  pip3 install <package>[/b]
They will install into the site-package directory
  /usr/local/lib/python3.7/site-packages


==> Summary
🍺  /usr/local/Cellar/python/3.7.2_1: 3,833 files, 59.3MB
[b]==> Installing pyside dependency: python@2[/b]
==> Downloading https://homebrew.bintray.com/bottles/python@2-2.7.15_2.high_sier
######################################################################## 100.0%
==> Pouring python@2-2.7.15_2.high_sierra.bottle.tar.gz
==> /usr/local/Cellar/python@2/2.7.15_2/bin/python -s setup.py --no-user-cfg ins
==> /usr/local/Cellar/python@2/2.7.15_2/bin/python -s setup.py --no-user-cfg ins
==> /usr/local/Cellar/python@2/2.7.15_2/bin/python -s setup.py --no-user-cfg ins
==> Caveats
Pip and setuptools have been installed. To update them
  pip install --upgrade pip setuptools

[b]You can install Python packages with
  pip install <package>[/b]

They will install into the site-package directory
  /usr/local/lib/python2.7/site-packages


==> Summary
🍺  /usr/local/Cellar/python@2/2.7.15_2: 4,701 files, 82.7MB
[b]==> Installing pyside dependency: qt[/b]
==> Downloading https://homebrew.bintray.com/bottles/qt-5.12.0.high_sierra.bottl
######################################################################## 100.0%
==> Pouring qt-5.12.0.high_sierra.bottle.tar.gz
==> Caveats
We agreed to the Qt open source license for you.
If this is unacceptable you should uninstall.

[b]qt is keg-only[/b]

==> Summary
🍺  /usr/local/Cellar/qt/5.12.0: 9,689 files, 318.9MB
[b]==> Installing pyside[/b]
==> Downloading https://homebrew.bintray.com/bottles/pyside-5.11.2.high_sierra.b
######################################################################## 100.0%
==> Pouring pyside-5.11.2.high_sierra.bottle.tar.gz
Error: The `brew link` step did not complete successfully
There are many lines with possible conflicts with python3.7 (see
Possible conflicts_pyside-5.11.2.high_sierra.rtf.zip
Possible conflicts_pyside-5.11.2.high_sierra
(2.85 KiB) Downloaded 174 times
).
Why does brew formula not exit after installing python3.7 and let the user decide?
Light and Word designing Creator - www.farbigewelt.ch - aka quantenkristall || #luxcorerender
MacBook Air with M1
robbrown
Developer
Developer
Posts: 63
Joined: Mon Sep 03, 2018 1:04 am

Re: OSX, network rendering, lcr 2.1 beta 3

Post by robbrown »

I vaguely recal having headaches with Python 3.7.x and Pyside2 which is why I did pyenv and a pip install pyside2.

The quick way is probably install the 3.5.3 I’ve been using. If you want to keep digging and figure stuff out, I’m happy to follow along and try to get builds upgraded to 3.7.x
User avatar
FarbigeWelt
Donor
Donor
Posts: 1046
Joined: Sun Jul 01, 2018 12:07 pm
Location: Switzerland
Contact:

Re: OSX, network rendering, lcr 2.1 beta 3

Post by FarbigeWelt »

robbrown wrote: Sun Feb 03, 2019 6:24 pm I vaguely recal having headaches with Python 3.7.x and Pyside2 which is why I did pyenv and a pip install pyside2.

The quick way is probably install the 3.5.3 I’ve been using. If you want to keep digging and figure stuff out, I’m happy to follow along and try to get builds upgraded to 3.7.x
Had the same thought!
And got much deeper into the, let's call it again, mess (of this poison brewed QualiTy side product from the kog-nitiviness of some biten fruit).

Look at this:

Code: Select all

[b]pyenv install 3.5.2[/b]
pyenv: /Users/mtroesch/.pyenv/versions/3.5.2 already exists
continue with installation? (y/N) y
python-build: use openssl from homebrew
python-build: use readline from homebrew
Downloading Python-3.5.2.tar.xz...
-> https://www.python.org/ftp/python/3.5.2/Python-3.5.2.tar.xz
Installing Python-3.5.2...
patching file Lib/venv/scripts/posix/activate.fish
python-build: use readline from homebrew
Installed Python-3.5.2 to /Users/mtroesch/.pyenv/versions/3.5.2

pip install PySide2
Requirement already satisfied: PySide2 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (5.11.2)

Check the python versions now and get familiar with pyenv.

Code: Select all

server:Python.framework mtroesch$ ls
Headers		Python		Resources	Versions
server:Python.framework mtroesch$ cd Versions/
server:Versions mtroesch$ pyenv local 3.5.2
/usr/local/Cellar/pyenv/1.2.9/libexec/pyenv-version-file-write: line 21: .python-version: Permission denied
server:Versions mtroesch$ sudo pyenv local 3.5.2
Password:
server:Versions mtroesch$ pyenv local
3.5.2

server:Versions mtroesch$ pyenv which python3.5
/Users/mtroesch/.pyenv/versions/3.5.2/bin/python3.5
server:Versions mtroesch$ pyenv which python3.6
pyenv: python3.6: command not found
server:Versions mtroesch$ which pip3
/Library/Frameworks/Python.framework/Versions/3.6/bin/pip

server:Versions mtroesch$ cd /Library/Frameworks/Python.framework/Versions/3.6/bin/
server:bin mtroesch$ ls
2to3			idle3.6			pydoc3			python3-32		python3.6-config	pyvenv-3.6
2to3-3.6		pip			pydoc3.6		python3-config		python3.6m
easy_install-3.6	pip3			pyside2-uic		python3.6		python3.6m-config
idle3			pip3.6			python3			python3.6-32		pyvenv

server:bin mtroesch$ pyenv rehash
server:bin mtroesch$ pyenv versions
  system
* 3.5.2 (set by /Library/Frameworks/Python.framework/Versions/.python-version)
server:bin mtroesch$ pyenv global
3.5.2
Looks promising. Now lets test the dependence of blender plugin luxcorerender's network python script.

Code: Select all

There is an easy way to do that.

cd /Applications/Blender/blender.app/Contents/MacOS
server:MacOS mtroesch$ ls
blender

server:MacOS mtroesch$ pyenv local
3.5.2

server:MacOS mtroesch$ blender
Read prefs: /Users/mtroesch/Library/Application Support/Blender/2.79/config/userpref.blend
found bundled python: /Applications/Blender/blender.app/Contents/Resources/2.79/python
pyluxcore version: 2.1
Updating OpenCL device list
Activity monitor Task information
network python script image
network python script image
network python script.rtf.zip
network python script dependencies
(4.84 KiB) Downloaded 181 times

Code: Select all

cwd
/Users/mtroesch/Library/Application Support/Blender/2.79/scripts/addons/BlendLuxCore/bin
txt
/Library/Frameworks/Python.framework/Versions/3.6/Resources/Python.app/Contents/MacOS/Python
txt
/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
txt
/Library/Frameworks/Python.framework/Versions/3.6/Python
..
..
/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/lib-dynload/_heapq.cpython-36m-darwin.so
txt
/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/lib-dynload/zlib.cpython-36m-darwin.so
txt
/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/lib-dynload/_struct.cpython-36m-darwin.so
txt
This cannot be true, does it? :shock:

I have currently not more ideas to solve this. :?:
Light and Word designing Creator - www.farbigewelt.ch - aka quantenkristall || #luxcorerender
MacBook Air with M1
Post Reply