Realistic
Realistic Advanced Projetion Mapping
GCC Academy
Hello
I am Kim Saet-byeol, the Instructor of the realistic media content lecture
In this lecture, we will discuss an innovative technology that has greatly changed visual art and spatial design
Projection mapping
Projection Mapping
Projection mapping is not simply a technology for projecting images onto a flat surface
but rather onto three-dimensional surfaces such as buildings, sculptures, and even natural elements
to create new visual experiences
This technique maximizes audience immersion
in various fields, such as art, performances, advertising, and events
Today, I will introduce the basic principles of projection mapping
the programs used in mapping
and how to respond to various transmission methods
This will be conducted in this lecture
First, projection mapping is used interchangeably with media façade
Those who have heard of projection mapping may also have heard of media façade
Media façade is a term that combines media and façade
which means the exterior wall of a building
It can be seen as a form that combines architecture and digital media
Through this, buildings go beyond being simple structures
and take on a role as a communicative medium
The technology used in this media façade is projection mapping
This technology creates visual changes by projecting light and images
onto surfaces such as 3D structures, buildings, and sculptures beyond the flat surface
It is characterized by attempting to interact with real space beyond 2D images
Projection mapping basically requires tasks such as space scanning
and surface-fit projection adjustment through mapping software
It is very important to implement an appropriate image that can be projected three-dimensionally onto the actual object
When starting projection mapping, you must first analyze the surface to be mapped
If the surface is made of a non-reflective material or does not project light
it cannot be expressed through mapping
Next, you need to prepare the video content to be mapped
The location and settings of the projector that will broadcast the content are important
Once the settings are complete
you need to use mapping software
to perform precise calibration and create interaction between the content and the surface
Projection mapping is used in various fields
It is used in various fields, such as art and entertainment, commercial advertising, and architecture
You can see mapping installations on the exterior walls of
buildings, festivals, and events
Projection mapping provides an immersive experience
by combining physical space and virtual content
Interactive, immersive experiences that allow
the audience to interact with the environment are increasing in
theme parks, amusement parks, art galleries, and performing arts
It is expected to be widely used in experiential events, travel destinations, and entertainment
Projection mapping can also breathe new life into buildings and sculptures
revolutionizing the cityscape
Through this, the building can be transformed into a fluid and ever-changing digital canvas
used as media art for special events or city promotion
For example, the entire city can be turned into a huge gallery
or used as a public art piece
Examples include the National Heritage Media Art and Seoul Light at DDP
In various educational fields such as science, history, and medicine
Projection mapping can be introduced to realistically reproduce
3D objects or real-world phenomena
For example, it can accurately project the structure of the human body in medical training
or visually reproduce historical events
to help learners understand more easily
In the future, projection mapping can be used in various areas such as interior decoration, furniture design
and media world in homes and commercial spaces
The walls of offices or homes can be transformed into digital spaces
and project real-time information, artwork, and personalized content
This will make smart home systems more intuitive and visually rich
and the range of applications has greatly expanded
as home CineBeams become more widespread
Projection mapping can also be used to try different styles on models at fashion shows
or to visually test various options in real-time
in product design
Consumers can experience how a product will look before purchasing it
which can have a big impact, especially in the props and interior markets
Next, augmented reality
It's the case of convergence with AR
Combining AR devices and projection mapping
can provide a more immersive experience
through digital overlays on physical spaces
For example, people can see virtual objects in indoor spaces
or recreate historical sites in outdoor spaces through AR equipment
This can enrich and creatively transform our daily lives
public environments, and cultural experiences
Projection mapping breaks down the boundaries between art and technology
and enables a new level of interaction
Experts in various fields predict the potential
for convergence with augmented reality, AR, and immersive experiences
This can creatively transform our daily lives, public environments, and cultural experiences
Projection Mapping Program Utilizing MadMapper
I would like to introduce a program used for projection mapping
There are many different programs
Projection mapping provides different functions and interfaces
So you can choose according to your needs and skill level
The following are representative software
Resolution Arena, Mad Mapper
and Touch Designer
Resolution Arena is a program for live visual performances and projection mapping
It has an intuitive UI and powerful functions
It supports multi-projector settings and various output formats
making it excellent for real-time image control and effects
Therefore, it is widely used in performances and events
Mad Mapper is a software specialized in projection mapping and LED mapping
It is widely used in art exhibitions and commercial spaces
because it provides user-friendly, fast, and efficient mapping functions
It suits various 3D mapping tasks, including stage design and building mapping
Touch Designer is a node-based software for media art and interactive installations
with powerful visual programming tools
It is strong in real-time graphics processing and data visualization
and is widely used in audio visualization
It can be especially useful when building complex interaction systems
I would like to introduce Mad Mapper
Such as a demo version, rental subscription
and buy
and purchase, it has various options
and since the demo version is free
I recommend that you try it out
and choose the software that suits you
You can download the demo version
and the download link will be sent to your email from the Mad Mapper official website
Then, you can download the demo version
and if you have a genuine key, you can activate it and use it
If you download the demo version, you can check Mad Mapper and Mad Laser
I will proceed by checking Mad Mapper
Currently, up to 5.6.4 demos are available
and I will also turn on Mad Mapper and proceed with the practice
When you enter Mad Mapper, a project window where you can create a video will pop up
Click OK to open the project
and I will briefly introduce the UI
There is an input window on the left and an output window on the right
The input is where we can set the environment
in the input window before sending by putting in the materials we selected
and the window on the right
is a space where you can preview the screen
where the input entered as input is output as output
This workspace can be changed to suit your user's convenience
and there is an icon with two squares at the top to view the input and output at the same time
and an icon to view only one
You can view both and change them up and down
There is a toolbar on the left
It is intuitively shown as a plus button that can create
squares, lines, triangles, circles, masks, and 3D solids
and on the right, you can insert materials
Currently, the test card is selected
so the test card is shown in the input window on the left
and when this test card is pressed
Madmapper uses this mint-colored key color
This means that it has been selected because it has changed to mint
If you open a square quad in this state
the image shown in the input will be sent to the output
and this screen will be applied to the production as much as the input is adjusted
A shortcut key allows you to see the corresponding input and output
First, let me explain it in the tool window, not the shortcut key
If you click on the output part
you will see desktop and full-screen modes
The shortcut keys are Ctrl+T and Ctrl+U
and yo have to check this to exit the full-screen mode
When you switch to full-screen mode
the entire screen will be displayed as the projector's screen being transmitted
Right now, we are in the Edit section
Next to it, the section where you can edit the DMX that controls the lighting
the section where you can control the projector video output
the section where you can web in 3D
and the icon where you can set the overall master environment
five icons can be clicked
We will proceed to the first Edit window
When you always look at Madmapper, you should look at the columns on the left and right
Both have simple environment settings at the bottom
and since these parts can adjust to different environment settings
it would be good to pay close attention to which part you are using
Looking at the window on the right, you will see Generator, Material
ISF, Image, Movie, Folder, Spout, Live Input, etc.
You can put the materials you want here
The materials provided by default are on the left
and the play button looks like a reversed triangle shape
Through this, you can see what shape each material is provided in
and some of them are looped like a video
but some materials are fixed as images
so I think it would be good to click on them and use them
First, I will explain Solid Color
The quad is white
and if you look to the right, there's the size and color
You can select the chip in a convenient way
and if you enter a color on this screen, the color of the input itself will change
I'll return this to white again
There is also a color window on the left
If you select red in the color window on the left
the output color will change, not the input
In other words, if you change the color on the right
the nature of the basic material will change
If you want to leave the basic material as is but change the output settings
you can use the environment settings window on the left
In the realistic media content, we provide a basic mapping
especially the basic usage called box mapping
and you can try box mapping in advance here
If you click on the circle drawn on the mint-colored vertex here
you can distort the corresponding paper
Then, when you project it on the wall that fits the scene
you can catch the distortion and create it like a box
First, change it to white
and copy this quad 3 times
to create a box shape
When I move the mouse, you can see that each vertex snaps
This snapping function works when the magnet shape at the top is turned on
and if it's turned off, it won't stick even if you get close
When you want to create an environment where you're intentionally separated
turn off this snapping
and when you need to create a perfect vertex, turn on the magnet and work
Here, I will explain how to change the color again
The entire input will change if you change the color on the right
However, if you click on the corresponding quad in mint color
and change the color
the three will be expressed differently
Learning the difference between input and output
would be by looking at the color
This time, I will put in different materials
They are all white
but changing the output color
can make the colors diverse
and you can go back
Once you have finished mapping the box, press multi-select
and copy it to create another one
I will select the entire thing
and make it about three
All the points must be clicked to make it like this
and I will change the corresponding points
to create a scene where the boxes are piled up
This point can be moved together
by holding down the shift key
Let's connect all the small lines
and finish the box mapping to a certain degree
Let's mix some other materials on top of the completed materials
If you look at the corresponding materials used on the right
there is an icon indicating that they were used once
so I think it would be good to check
Those who were used twice are listed as 2 here
and let's try putting them in various ways
Here, I'll add some of my images
and do blending
I added the video by dragging and dropping it
you can do it with the plus button
But drag and drop is easier
If you create a quad with the corresponding material selected
a shape that covers the entire area will appear
and here, we'll change the blend mode
The transparency, called opacity, is now 100%
meaning that the back is not fully visible
and through opacity, you can see an image where two are mixed
and the blend mode is set to over by default
If you set it to add mode, it will add
If you set it to multiply, it will multiply
So you can use the images you want in various ways
You can use it by utilizing the blend mode
and you can also add a folder here
and organize the corresponding group to create it
As you can see now, when the order of the layers changes
the multiplied blend mode affects the lower layer
If the order of the layes is not organized, it will be shown as a completely different image
so it is important to organize the relationship between the layers well
and continuously check the form of the final output
If you look at the blend mode now
there is also a function called Flip
I will show you this by mixing it in add mode so that you can see it well
When the white part is added, the projector light shines brighter
and if you press Flip, the corresponding image will be flipped
You can freely express it by flipping it left, right, up, and down
of course, you can also create a mask
I will roughly print only the corresponding part by pressing the line
The input is entered as a square, but if you connect the line in the output
and after connecting it like this
if you right-click and exit, this mask part will be created
The masked part is not being transmitted right now
and if you want to check this in detail at once
there is an eye button next to the magnet button
If you press the eye button, only the corresponding layer will be changed to a visible state
If you press the part called invert mask at the bottom left
the input is now entered as a square
but only the masked part is multiplied and comes out
You can see it better if you look at it like this
This mask was done roughly
so you can click on it and move the point
to modify it to your desired location
This function also has to snap
so you can select it roughly and proceed
There is also a function to add a mask here
If I show you in the window before the shortcut key
there is a Project tab that says Add Mask to Surface
Alt-A
If you click this part, you can add another mask
Like a window
if I add this part
a layer is created within the corresponding mask
You can continue
to add masks within the corresponding quad
not the entire upper part, the projector layer
I will change this material
If you look, the mask is like this
If you invert the mask again, it will be shown like this
showing only the opposite part
Masks also have a feathering function
If you feather the corresponding mask
you can transform it into one that blends naturally
If the feathering work
makes the slightly faint edge part fall cleanly
it is rather unnatural
so you can use the feathering function to create a natural look
Since you can change the feathering to the center, outside, inside
and various other options below
it would be good to use it well
I got out like this by removing the feathering
I will explain the warping function, which is also the most important in mapping
Erase the entire thing
and I will bring the photo again with the test card selected
I asked the AI ​​to create a photo of a building
and there is a building like this
I will proceed with mapping the part of the facade of this building
The warping function is the most important in mapping
I will add one more photo
and add it to Quad
It would be good always to leave the input as it is and adjust the output
so that the corresponding part can be mapped
without damaging the original image
If this part is inconvenient to keep moving
you can lock it to prevent it from moving
making mapping easier
Like before, you can also warp by increasing each point
If you do this, you can see it to some extent
You can check if it is well mapped to the exterior wall
of the building while lowering the opacity a little
and you can adjust the small movements in detail with the arrow keys
If I want to map by distorting the part next to this
I will try mesh warping
If you look at the bottom of the mask part, there is a corner called mesh warping
You can activate it through this Enable
I will create a grid
If you make too many, there will be too many lines, called subdivision
When there are too many lines, the distortion of the image can become rough
so it is important to put in subdivisions at an appropriate size and interval
I will put in about five
If you put it in, a grid pattern will appear
I'll add a little more vertically
I'll add it horizontally
Now
should I add a little more?
If you add it like this to create
a small 'ㄱ' here
the corresponding points will move independently
You can create it by moving these points
The disadvantage of having many points is that
you have to capture the corresponding points as a whole
and as this whole moves,
the whole flow can be broken
so it's the end
You can see the corner where two circles are formed
It's important to move the whole part through
and individually
so that the warping doesn't look awkward
I'll add this part like this and proceed
Since the photo's resolution is not very good
you can proceed
by moving it slightly
and the corresponding warping can also be moved as a line
This operation is often used when very detailed work is required
Overall, this part is proceeding awkwardly
so you can proceed with natural warping through detailed adjustments
By warping this way
you can check the projection phenomenon in advance
Simulation
If this is a video
I'll put the video in
If you put two in and change the strobe effect to head mode
you can see the corresponding light coming out
You can also put this in the siren operation to see the corresponding mapping situation
It looks like this because I copied and pasted it
as it was warped
, and this image can be expressed by slightly multiplying it like this
So you can express the feeling of compositing it with the original image
Next, let's try curved warping
Delete the existing quad
change it to a test card
and bring in a curved image
This facade format
I brought in a facade
but it's the same for any object
So, it would be good
to create a quad here
and give it a little opacity
to see if it's the image you want
When creating the corresponding image in a curved shape, warping is also used
I will only put in about 5
I think it would be good to proceed like this so that it can move naturally on this screen
When the screen starts to distort
there are times when it is difficult to handle the points
In that case, it would be good to proceed
while checking
if there are too many grids and if the grid is expressed in accordance
with the message you want to convey
This process creates smooth curves
If this edge part does not match, it would be good to use the feathering function
You may feel that it is very crooked now
but after a certain amount of progress
if you activate the Bezier part at the bottom of the mesh warping, it will change into a curved shape
The curve has handles like Illustrator
so you can adjust the shape of the curve as you want
and finish the mapping you want
After the curves are created, you can map them a little more freely
so if you design it like this, it would be good
Its great advantage is that it can cover various types of mapping
Since almost nothing can be done
it is naturally connected to everything you think of in your head
so it would be good to practice
and proceed with mapping while looking at it
Next, to explain the line part
I will remove the photo
and start with a single quad created with a solid color
In this state, I will slightly reduce the color
You can add a line
You can also add a line within this quad
and you can add this line like this
If you continue from this state, the line will continue
and if you use Alt-A
you can create separate lines
I created a line that seems to express a slightly shining sun
and if you do this, you can erase the part where you made a mistake with the Delete key
This line is now tied as a single object
You can see that
it is added as a layer
You can select the entire thing, adjust its thickness
and add specialized materials for the line I explained earlier
For example, if you add a line pattern, it will become a moving line
This is a line repeat
I will explain it again with the line pattern
On the right card, you can adjust various components for this input value
and create the desired material format
by adjusting the corresponding parameters
The most used ones are the speed part, cell size
and rotation
I will use the bottom part here
Since the input value is adjusted on the right
I will leave this as the default
and adjust the output on the left
Here's an interesting feature
In the texturing section, there's a section called Media Line Change
When this is selected, this line pattern moves clockwise
If you change this to geometry
it follows the line in the input image
If you press the segment, light comes in from each line
You can create three scenes like this
and create them with the Scene and Queue functions
that I haven't explained yet
You can change them using shortcut keys
in the case of scenes, it's a concept of saving the current situation
Here, I'll put another scene outside in the quad
If you save it like this and press Scene
the basic solid screen will appear as it is in Scene 1
and in Scene 2, you can simply press the plus button
to save the output window that I'm currently seeing in the scene
I'll put the texture of the line I showed you in the Queue at the bottom
The Queue is activated by pressing the Edit button
In this state, if you press Queue and Media Line Changes
the texture will be stored in the Queue
If you can't check this, open the information window on the right
and it will show you the values ​​I saved in this queue
The values ​​are media line changes
Move to the side and check the same thing
and I'll change this to geometry
Then, it says this has changed to yellow
Click on one more cue and put the changes in segments instead of geometry
Then, when you exit Edit
you can see that the texture changes through the play button
just like when you play the scene
This cue and scene can be received again as a keyboard or MIDI controller input
You can add this in the Edit window
I'm going to proceed with the keyboard edit
assuming that you're all using a keyboard
but since you can also cue MIDI control by holding down a button
I think it would be good to practice with the keyboard first
When you click on the keyboard, all the items that can be used with the keys are selected in purple
In cue, in number one, put 1, two, 2, three, 3
You can press any button on your keyboard
and it will show you which key was pressed in the upper left corner
This window should be exited without being purple
and now, when you press 1, 2, or 3, you can see that the corresponding cue changes
Because of this advantage, various VJings are possible through real-time mapping
Lastly, I would like to explain multi-display
In this case, you can organize it with the quad-layer concept
as before by adding a projector video output
If there are multiple outputs
you can set the destination
for two like this
Right now, I can set two outputs
and you can also send
the outputs by
linking the same scene
If you set the destination
and open the corresponding desktop window
you can preview which part of the output
is being sent
You can use it in various ways by connecting the corresponding projectors
Even in very special environments,
you can proceed with all the adjustments through the mapping program
and in the field, you can find
the corresponding location
through the test pattern and express it by linking it
Since the resolution is automatically captured
you can proceed with multi-display linkage through this mapping program
The projection mapping, mapping program
and method of responding to the transmission introduced today
are essential for creating realistic media content and final transmission
I hope this will inspire your project and be a useful resource for your future creative process
Thank you
Projection Mapping A technology that projects light and images onto surfaces of 3D structures, buildings, and sculptures beyond the flat surface to create visual changes
Basic Projection Mapping Operations: Space Scanning, Surface Alignment through Mapping Software, Projection Adjustment, etc.
Projection Mapping Operation Principles: Surface Analysis to be Mapped - Preparing Image Content - Setting Up the Projector - Using Mapping Software - Precise Correction - Interaction of Content and Surface
Projection Mapping Use Cases Immersive experiences: theme parks, art museums, performing arts, travel destinations, entertainment, etc. Urban spaces and public art: national heritage media art, city promotion media art, etc.
Education and training: human body projection, visual representation of historical events, etc. Smart homes and commercial spaces: interior decoration, furniture design, media walls, etc.
Fashion and product design: props, interiors, etc. Fusion with augmented reality: virtual objects, historical site experiences, etc.
Use of the projection mapping program Madmapper Projection mapping program Resolum Arena: Real-time image control program supporting multi-projector setup and various output formats
MadMapper: Program suitable for various 3D mapping tasks including stage design and building mapping Touch Designer: Node-based software for media art and interactive installations
Madmapper_UI View panel in the center of the screen: Consists of input window on the left and output window on the right Layer management toolbar on the left of the screen: Select a layer to map
Media panel on the right of the screen: Consists of built-in sources and various media art sources Project panel on the left of the screen: Layer management, lighting management, project management, extended module management, master settings
Madmapper_Box Mapping Select a solid color in the media panel Use the circles on the vertices to distort the shape to fit the scene and create a box
Create a new quad and then import the video source to apply Implement various blend effects with the opacity option and blend mode option
Use of projection mapping program Madmapper Madmapper warping settings After adding a facade building image, keep the original image in the input window as it is Proceed with work in the output window
Lock and fix the lock of the building image layer After adjusting the opacity, move the vertices to map them to the exterior wall of the building Check the ENABLE item of the left mesh warping to activate it
Click on the generate grid to enter the appropriate values ​​for each sub-vision item Move the generated points individually to adjust their positions to fit the building's exterior
Madmapper curved warping settings Load a curved display building image After creating a new quad, adjust the opacity, and adjust the vertex positions to fit the facade area
Click on the generate grid to enter the appropriate values ​​for each sub-vision item When the Viz item of the left mesh warping is activated, it changes to a smooth curve shape
Madmapper line settings Add a line layer on the left toolbar to add a line, and then use ALT+A to create multiple straight lines Select the entire line layer and then use the line pattern source
Click the Edit button to activate the cue Click the cue frame and set Media Line Changed in the Texturing item Click the cue frame 2 and set Match Output Geometry in the Texturing item
Click the cue frame 3 and set Media Line Per Segment in the Texturing item After completing the settings, click the Edit button to deactivate the cue
Madmapper Input Key Setting Select Edit Edit Keyboard Control and click the keyboard button to be applied to each cue Select Edit Edit Keyboard Control and deactivate it, then press the applied key to check the output of the cue
Madmapper Multi-Display Set the target display to the destination of the video output and check the output in advance
You can select the location through a test pattern on site and direct it by linking it