This article introduces how to add the effects on Shadertoy into Spark AR Studio.

It has been several years since Spark AR Studio was launched, and its functions are relatively mature.

Steps:

• Prepare a handsome photo.
• Calculate the depth value of the scene in the photo through machine learning, and get a depth texture.
• Write shader code to implement green scan line effect.

Calculate Photo Scene Depth

Why do we need to calculate the scene depth of the photo?

Because the photo is two-dimensional, if you directly use the color or grayscale of the two-dimensional image to simulate the three-dimensional effect, it often does not match the real world scene:

Last year today, I made a Christmas tree using Bender and Python:

This time I tested another one:

Export the model (Mesh) generated by the Sverchok plug-in or Python script from Blender, and then import it into the web page for rendering.

When the Mac is connected to a high-resolution 2K monitor, for example, the DELL U2518D in my hand has a default resolution of 2560*1440, which is stuffed into a 25-inch screen. The text is actually a bit small.

This project was about robotic arm with multi screens, (by ManaVR ✖ INT++) made in 2017.
In the early stage, I used MaxMSP Jitter with ABB’s RobotStudio to simulate the robotic arm and the large screen.

This article only focuses on how to use MaxMSP to do the simulation of the project prototype, making full use of the very convenient TCP communication, multi-screen motion simulation and other functional modules in MaxMSP Jitter.
In short, you know, in my hands, MaxMSP is not just the MaxMSP🙃.

The key steps of the video above:

• Use the PoseNet of TensorFlow based on web-based machine learning for motion capture;
• Link the PoseNet page to MaxMSP with the Node for Max module provided by MaxMSP;
• Human motion data captured by PoseNet is sent back to MaxMSP through SocketIO;
• MaxMSP sends the received data to Blender via OSC;
• Blender uses the received data to control the deformation animation in real time.

Most about three topic:

• Demonstrate PoseNet motion capture.
• Data transfer between MaxMSP’s Node for Max and web pages (in fact, several previous examples are about this with video tutorials).
• …

These days I’m learning machine learning and trying generating visual things based on StyleGAN, a neural network.

AILog005, was first sent to my wife, she said: “OK, more suppressed.”

Great! This is the feeling I’m looking for. Not only do I specifically mean “suppression”, but I finally have a way of expressing myself, and it is “obscure”.

Blender is now a new force in 3D art. Although new but not young, about twenties.