Blender is now a new force in 3D art. Although new but not young, about twenties.
In [Experimental Programming], I generally use Blender as a Python runtime environment out of the box, like:
Using Blender to run Python and visualizing the Fourier Series.
And this time, it is a simple and crude VJ / music visualization / audio-visual interaction software:
Fingers hurt a little, change a prop:
Controlled by mobile of course:
The OSC Controller above is BugOSC, which is based on “Wechat Mini Program” and developed by myself.
The full video only takes a few minutes:
The following is a detailed explanation of the text.
Several core modules:
-Blender Eevee Engine: responsible for real-time rendering
-NodeOSC Blender addon: responsible for OSC data sending and receiving
-MaxMSP: responsible for sound processing
-BugOSC: OSC controller
Step 1, download the Blender Eevee demo “Wasp Bot”
Step 2, download and install NodeOSC addon
Install the addon in Preferences:
After installing and modifying the options, remember to save the settings:
Step 3, config NodeOSC
NodeOSC opens from here:
Firstly make a simple Cube to practice.
Set the IP and port of the PC host in NodeOSC, and bind the OSC address to the Cube’s scale attribute：
Note the two fields datapath and property in Message handlers.
For the default Cube, NodeOSC has already filled it for you:
Just change the location in the property to scale, because here I show the scaling effect.
Step 4, make a simple OSC sender in MaxMSP
/cube/scale corresponds to
address on NodeOSC.
Step 5, got it!
The real-time interaction between MaxMSP and Blender is completed, only two steps more than putting the elephant in the refrigerator.
However, this article is not over, and the excitement has just begun.
Now let’s try Eevee demo：Wasp Bot
1. Open the Wasp Bot file downloaded before, and config NodeOSC
OSC is used to control the eyes, so first find the node of the eye parameter:
Try adjusting the Color parameter in the node. Well, that’s the taste:
How to fill in the parameters of Eye Object in NodeOSC?
Don’t panic, here I have a family heirloom recipe.
Click on the parameters you want to set in Color Node, and then go to the script information window to find the corresponding command line parameters!
Then copy and paste into datapath and property of NodeOSC!
If the script information window is not open, you can refer to the related operations in the video.
2. config MaxMSP
Next, play a piece of rhythmic music in MaxMSP, or collect the sound of the microphone:
3. got it!
Now try to control the model in Blender with mobile phone.
First, in NodeOSC, change the IP from 127.0.0.1 to the IP of the PC in the LAN, such as 10.0.0.11, or 192.168.1.123.
Make sure your phone and PC are in the same LAN.
The OSC message address may also need to be changed to keep consistent with the OSC controller App in the phone.
For OSC App, you can use TouchOSC.
Of course, I use my BugOSC.
I use the first Toggle button in BugOSC, and its address is
BugOSC will send two numbers 1 and 0 to NodeOSC according to the on / off state of the Toggle button.
datapath of NodeOSC has been bound to the parameters of the model eyes, so as to achieve the blinking effect controlled by the mobile phone.
- Blender Eevee demo Wasp Bot
- NodeOSC Blender addon
Development article: BugOSC, an OSC controller based on WeChat Mini Program
Search in Wechat: BugOSC
Talk is cheap. Show me the code!
The entire process is included in the video.
If you still need the source files (MaxMSP and Blender), you can get them from my Patreon.
There are many articles, patches, source code and some advanced Patron-only content there.
You can find more resources in my site floatbug.com.
Your encouragement is my driving energy!