Realistic Basics The industry and trend of Realistic Contents
GCC Academy
Learning Goals Can explain the history of 3D solids Can explain the mechanism of 3D solid formation and its technical factors Can explain the instances of contents in which 3D solids were applied
Learning Contents History of 3D solids Mechanism of formation and the technical factors of 3D solids Examples of 3D solids application
CEO Jiwon Jeong Career: Current director of T.OZ Former director of WYSIWYG STUDIOS General Manager of TaekwonV VR for Lotte World General Manager of GyeonggiVR AR for Gyeonggi Content Agency
General Manager of Realistic Video for Jeju National Museum General Manager of Realistic Content Production for Sokcho City Museum
I am Jeong Jiwon, here for the lecture of Realistic Contents
During this time, out of Realistic Contents, we are going to explore the history of 3D solids
We are going to explore the history of 3D solids and the means of forming them, as well as the technical aspects
Then, we are going to explore the factors that cause stereoscopic effect, as well as the mechanism and techniques
I'm going to talk about solids because
solids were the initial part of realistic contents
This is because it's the first thing we experience visually
It's important that we perceive something as a solid
Since it's important for the content to show how far or how close an object is,
out of the realistic contents, 3D solids were the visual part
that triggered our curiosity.
So out of the 3D objects in realistic contents, we are going to talk about the factors and techniques that give this stereoscopic effect
and talk about the examples in which these factors were applied.
History of 3D solids
3D solids are what express movement
It was formed in order to create movement and make images come alive
In order to observe the history of 3D solids,
We can see that still images were animated by being transformed into videos
These desires existed since a while ago.
So in 1646, Athanasius Kircher, the German priest,
used a candle lantern in order to make an image look bigger.
You can say that this is a form of magic lantern
In order for priests to deliver a message widely to the public,
they needed a more dramatic effect.
Therefore, in terms of this, using the effects of shadows to show an object
makes the objects look bigger than they actually are.
They had a desire to effectively deliver the message using these techniques
And in 1825, Paris and Mark Roget
made something called Thaumatrope.
What this is, is that there are two images on either side of a card, and by quickly flipping this back and forth,
the two images appear like one image due to Persistance of Vision.
Through things like these, making a still image into a moving image
has been developed through the works of many people since long ago.
In 1832, Joseph Plateau made something called Phenakistoscope
He made Phenakistoscope, and what this is, is that
there are repetitive images drawn on a circle
Draw the pictures on a circle, and spin this while reflecting it on a mirror
If it's spun while being reflected on a mirror, the gap makes it look like these images are moving.
What you guys can probably see a lot
is if you go to an animation museum or an animation-related exhibition,
there are probably a lot of Phenakistoscopes.
So if you look at them, the circles spin
The spinning makes it seem like the video is animated.
In 1833, William Horner makes something called zoetrope.
This zoetrope spins a cylinder, and you look between the gaps.
You look through the gaps, and in each gap, the separate images merge into one.
between the gaps, the images flicker
Though this flickering, they make the images look like a video
Praxinoscope is a more developed version of Zoetrope
This was made by Emile Reynaud in 1877.
Praxinoscope is zoetrope with a mirror in the middle
Through the mirror, the passing images are sequentially reflected
By doing this, compared to the zoetrope, it is more comfortable
to view the moving images.
Recently, we often use smartphones to take pictures
Before, there was digital camera
But even before that, there was film camera.
Some of you may know,
Some of you may not
This film camera was used to take still pictures
as well as movies
In 1888, George Eastman
released a film-included Kodak camera that contains 100 films
Many of you have probably heard of Kodak film
He is very famous
Using this film-containing camera made by George Eastman,
they had to show something
In order to show something, in 1893,
Edison makes something called Kinetograph.
Kinetograph uses George Eastman's film
than allows an individual to view a video
As for this, it was made to view indoors
And back then, it was made usually for the viewing of sports videos
It's a very big machine, and one person can view it
Inside, it's made possible for many films to move
Also, as many of you know, in 1895,
thehe Lumière brothers made cinematograph,
film made for movie shooting.
As techniques improved for making still images into videos,
people began to have more interest in
the concept of solids.
Before, 2D images such as pictures and drawings
were restored as-is
and recorded accordingly
But afterwards, since moving images were formed,
they wanted to express this in a stereoscopic way
We wanted to feel the stereoscopy visually as well
So there are desires for visual performance
Because of this, 3D, 3-Demensions are created
Something that can easily be confused about 3D is
3D Stereoscopic and just 3D.
3D is made with the techniques of computer graphics
It refers to the 3D character and 3D environment
3D stereoscopic is through the screen
It's a dimensional movie that can make you feel a sense of presence and depth.
In 1838, Charles Wheatstone makes the Mirror Stereoscope
You have probably seen this Mirror Stereoscope a lot.
By showing two images on two mirrors placed in different angles,
we feel a stereoscopic effect.
In 1856, they used lens instead of mirrors
and this is called Lenticular Stereoscope.
Then in 1889, the Mirror Stereoscope is implemented into movies
and this is the first experiment.
Then, the Lumière brothers'
This was screened in 1903, in a stereoscopic way.
There's also something called Paris Exposition
In 1900, at the Paris Exposition,
Video using the method of anaglyph 3D was first introduced.
We view stereoscopy as
something that was made recently
but the concept started before 1900
The fact that they even tried stereoscopy in 1900
shows that there's a long history to it
In 1922, the very first commercial 3D movie came out
The title of this movie is
It's recorded as the first commercial 3D movie
but achievements have not been that great.
Now you can see the methods in which 3D solids are formed
When you see a 3D solid,
There's the anaglyph method, which uses red and blue
It was invented in 1850
You probably have seen it the most
They're 3D glasses made of red and blue celluloid film
These glasses give the stereoscopic effect
It's a form of expressing 3D videos
Red and blue, the anaglyph method is the very first
method of expressing a 3-dimensional movie
1950 is the peak of stereoscopic movies
This is because in the 1950s and the 1960s, the TV comes in
Before the TV came in, everyone watched videos
and all in the movie theaters.
But after the TV came in, people stopped watching movies
Because before, they could only get the visual experience in the theaters
But after the TV using cathode ray tube came in,
they were able to have new visual experience.
Because of this, the content creators
thought about things that can give an even newer visual experience
and what they came up with was 3D movies.
Since these 3D movies had to be shown in theaters,
there came about more filming techniques related to 3D movies.
In 1952, Director Arch Oboler - the name is a bit hard to pronounce -
made the first long movie suing polarized color, called Bwana Devil
After this movie came out, many people
were able to feel the stereoscopy that they couldn't feel through TV
so they go crazy over this 3D effect.
In 1980, the movie Jaws comes out
Jaws is a movie where the shark is the main character
It was a movie made by Steven Spielberg
This movie was very successful
And in order for producers to make it even more successful,
They re-processed it into 3D and released it again
But the results were not very good
It's because in order to convert a video taken by a single camera into a 3D video,
They have to separate one image into two
And during the process of combining the images, the quality of the video may drop
Also, when you actually watch it, you don't feel the stereoscope
You may rather feel motion sickness and dizziness as side effects
Successful movies that were filmed with single cameras
gradually stop to be re-produced as 3D movies.
However, the actual successful areas are
the special theaters such as in theme parks and IMAX
3D movies became very popular there.
The thing with 3D movies is that
if you watch it in bigger theaters like IMAX,
visually, for the IMAX theaters,
the screens are very big.
The screen not only covers the front,
but also the sides and the top and the bottom
The immersive feeling that we are actually inside
magnifies the visual effect.
And when these are shown stereoscopically,
if there's a person stabbing towards us,
the blade seems like it's really coming right in front of our eyes
Because of this effect,
it has been very successful in IMAX and theme parks
and draws in many people through its attraction effect.
3D movies have been frequently produced not only in other countries,
but in Korea as well.
It even happened very early, actually
You might be surprised
Year 1968, Director Gyu-Woong Lee's
And the director that represents our country -
Director Kwon-taek Im's was made
For these two movies, in 1967, Cinematographer Seok-jun Jang
made the camera himself.
He took 600 equipment pieces
and made the camera called Panscope
Normally, in order for us to make a 3D movie,
we need two camera lenses
And since we need two lenses,
of course we need two cameras.
So Director Seok-jun Jang used examples from Japan and the U.S.
and made the Panscope camera himself
It was a type of camera that was different from the Hollywood's
and it was used to produce those movies.
Pieces of work like these, to the people viewing them in theaters,
were a new level of experience.
There were TVs and many theaters in Korea,
but 3D movies gave a new visual experience
They added to the amount of realistic experience that people got
and opened a new world of experience
When we look at 3D movies, the most widely used method is the Film Patterned Retarder (FPR)
The FPR method uses polarized film
to view the content
It makes up for the loss of color caused by the anaglyph method
If you look through the polarized film, the colors are conveyed very well
Also, when you use the polarized film,
the screen itself is called silver screen
A special silver paint is sprayed on the screen
and this magnifies the stereoscopic effect
That's how it came to be
When you use the polarized film and silver screen,
the quality and depth is enhanced
Compared to the original anaglyph method,
where the color wasn't effectively depicted,
where the color was a bit out-of-place,
it is now well-depicted here.
Earlier, when we were talking about methods of 3D expression,
we talked about the cathode ray tube TV
In 1897, the German physicist Brown
invented the electronic display
and this is called the Cathode Ray Tube
CRT for short
You have probably seen those fat TVs a long time ago
Especially Samsung or LG that displays the monitors,
when you go to the places that display these monitors, long ago,
there's probably these TVs with big cathode ray tubes,
the small and volumetric TVs that are easily found.
Because of these inventions,
a wide variety of contents came out
Because of these cathode ray tube TVs,
3D solids also came out
They were the cause
Because of the emergence of cathode ray tubes and CRT monitors,
the TV programs expanded into new types of media
It later developed into LCD, PDP, and today's OLED display
And now, it has developed into very thin displays.
3D solids are something
that were only shown in theaters long ago,
but once various displays were invented,
it has grown into something that we can even view at home.
[Methods of 3D solid expression and technical factors]
When we talk about solids,
we talk about technical aspects
but there are many psychological factors that cause the 3D effect as well
It will be very useful to talk about these
First, the basic one that everyone may know: perspective
Perspective is actually something that goes inward like this
Through perspective, you can feel the distance
How far or close the distance is
Then there's the shadow effect
When you shine a light on an object,
and there's a shadow,
according to the bright and dark spots formed by the shadow,
the parts that are in the front and the parts that are in the back
can be told.
Next, when objects are overlapped,
the front objects will be fully shown,
and the objects in the back will not be seen.
Like this, in a basic space as well,
there are psychological factors that cause the 3D effect.
Based on these psychological factors,
we analyze the physical factors that feel stereoscopy.
When you talk about stereoscopy,
you often feel the depth due to the difference in the two eyes
The average distance between the two eyes of a person is 65 mm
It ranges from 65 mm to 70 mm
So when filming with 3D camera,
they usually put a distance of 65 to 70 mm between the lenses
They do make some changes accordingly
So as for the physical factors that cause stereoscopy,
there are convergence and disparity between the two eyes observing an object
As for the binocular disparity, the retina on each eye
have differences at the top, and this is what causes stereoscopy
And as for the binocular convergence,
the eyes are made to converge towards an object
so the eyeball spins.
For example, when I'm looking at the camera,
my eyes will come inward
This is binocular convergence
Binocular disparity is when I just face forward
these two eyes view at different angles
So in my brain, it forms stereoscopy with each other
and I can tell which is in the front and which is in the back
I would be able to feel that.
Also, while you adjust the focus,
you can also feel the stereoscopy
Also, when I'm sitting down and something passes by faster,
this makes me feel something called Motion Parallax
So there are physical factors that cause stereoscopy
Binocular Disparity, Binocular Convergence, Focus Adjustment, Motion Parallax
These four things give stereoscopic effects
They are the physical factors
It's best to consider the human eye as a camera lens
Based on the distance that is perceived,
our eyes can adjust the focus
And based on the movement in front of us,
we can also feel the motion parallax that shows the other side.
Consider all of these
for the best depiction of stereoscopy
When we talk about the polarization method,
we don't make the color differences with filters
so the good part is that we can keep all the natural colors.
This is something that has been talked about earlier
so it's very good to keep in mind
There's the patterned-retarder method and the shutter in panel method
for the retarder and shutter methods,
each of them have positives and negatives
As for the shutter glass method,
it quickly shows the left video on the left
and alternately shows the right video on the right, back and forth
Long ago, in Samsung Electronics,
the shutter glass method was more frequently used
For the 3D TV made by LG,
the patterned-retarder method was more widely used.
The positives of patterned retarder is that
the glasses are light-weighted
The only thing on the glasses is the polarized film
so the glasses are light and cheap.
Also, the brightness is excellent in 3D
The negative is that the resolution is lower
That's a little problem
Also, the polarized film is added on the TV,
so for certain 3D TV production,
there's a little extra cost
And those were the negatives of patterned-retarder method
On the other hand, the shutter glasses method has no 2D quality decrease
and the 3D resolution is excellent
Also, the usage on TV is very cheap
However, the shutter glasses method needs battery in the glasses
On top of the battery, it also connects by cable
So the price of the glasses is
more expensive than the glasses used by polarized glasses of the patterned retarder method
Also, due to the electromagnetic radiation,
there's a little flickering happening
Because of things like these, when watching the content,
fun aspects and visually appealing parts
have to be very good.
Also, when we make a 3D solid,
the most important thing is the camera rig
So when we made 3D movies, the most mentioned aspect
was the state of the camera rig
That was the biggest issue
So first, two cameras are lined up next to each other
This is called the parallel rig method
And then, there's the perpendicular method
As for the parallel method, where the two cameras are next to each other,
it's a commonly-used method for mid- to far-distance filming
As for the perpendicular method, when filming in close distance,
it's the type of method that gives more stereoscopy
as you can understand.
When we talk about 3D camera rigs,
the most frequently mentioned company is 3Ality.
3Ality's rig for filming is very well-known
So in Korea, for 3D movies or dramas,
as well as 3D advertisement,
3Ality staff come in
and use their own equipments, rigs, and cameras
to produce the content, in many instances.
Not only the 3D cameras,
but also after the 3D filming,
equipments are needed to edit the video afterwards.
During 3D filming, not only the camera was used,
but also various equipments additionally,
so they were the cause of the increase of production costs.
And as for the 3D cameras,
well for regular cameras,
there's film cameras and digital cameras,
but they sometimes weren't in sync.
So when using the 3D camera rigs,
the problem was that
the vertical and horizontal line-up has to match up.
Also, when there's mismatching when it zooms in and spins,
it is visually dissatisfying to people.
And the filming angle is very important as well
And if the color temperature - the white balance - is off between the cameras,
when people view the final product,
the color scheme looks different
and because of this, the level of stereoscopy drops.
So aspects like these,
when we're watching 3D movies,
if we felt dizziness or motion sickness,
these aspects might have caused them.
For the 3D cameras,
as I mentioned earlier,
there's the parallel version and the perpendicular version
for these, you guys
only need to know their methods
Sometimes the cameras are placed intersecting with each other,
and they're sometimes placed parallel to each other
Once you just understand this, later when you use 3D solids
and get the opportunity to film realistic contents,
you can make use of the staff
accordingly with these helpful understandings.
The best thing for making 3D movies is
of course, using two cameras to film.
This is because when you use two cameras,
you get two separate sources, the left and the right,
and these make it more convenient to work with afterwards.
But in the content-creators' or the investors' point of view,
the downside is the cost.
It first needs the two cameras,
but additionally, in order to convert them stereoscopically,
more equipments are needed
Then they need more staff to handle these equipments
So compared to the original method of using a single camera,
there's a continuous increase of production cost.
This is why 3D conversion was made
3D conversion is taking an image
and automatically converting it into 3D
In TV companies such as Samsung and Sony,
they released TV that automatically converts to 3D.
Since the cost of making 3D content is expensive,
they can't make a lot of them.
So for the consumers, even if they buy a 3D TV,
there aren't many contents they can watch with it.
Because of this, they converted a single-camera-filmed content
into a 3D content with the push of a button
and allowed them to view it stereoscopically
Actually, for this 3D TV, in the case of sports content,
it worked pretty well, but for entertaining content,
they have so many different shots and angles
And therefore, some of them
wouldn't have the full 3D effect
And some of them would have too much of a 3D effect
So when I tried out this 3D TV at a store,
when watching soccer or football games,
so the ones filmed with a single camera,
it had the greatest effect.
During this time, the U.S. invented
the Dynamic Digital Death method,
which recognizes the background and the human as separate data.
So when this technique recognizes them,
they change the contrast of the things located between the human and the background
or separate the layers to give stereoscopy
And this is called 3D conversion.
Before, they would use software editing tools
to convert them to 3D.
Earlier, it was converted to 3D using a 3D TV
Software editing works can also
convert the contents into 3D
For this, they need to acquire the human and the background layers.
They need to take the layers and expand them
as well as change the size
Long ago, when they were converting a single Hollywood movie,
it took 3 months for 300 people to work on it.
Because when they convert this Hollywood movie,
they used domestic production technicians.
So 300 people were used,
and that all adds to the production cost
That's how the conversion process went
In 2012, Professor Jun-young No
invented a software that converts a 3D into a 3D video
This is called NAKiD
This separates the objects, creates depth,
then uses stereo rendering, optimizing at each level of object conversion.
And that was an example of inventing a software conversion tool
So rotoscoping is used to separate the people and objects,
then after they're separated,
there's a separation gap
the separated area is replaced with video
and by giving depth accordingly,
the size itself has to be altered.
After this change,
the altered product is rendered
to finish off the converting process.
So at this time, 3D conversion
required a lot of man work
Nowadays, generative AI is widely used
and many techniques are being used through this generative AI
So I'm expecting that these generative AI
may make 3D conversion easier
in high hopes.
Actual examples of 3D application
Next, we're going to take a look at examples
of when 3D movies were applied
In 2005, in Las Vegas, U.S.,
there was something called Show West 2005
This is when 3D movie academic conference was made
Many famous directors came
Steven Spielberg, George Lucas, Robert Zemeckis
as well as Rodriguez, Randal Kleiser
Famous directors gather
and declare the 3D Hollywood movie
So the 3D animation Chicken Little came out
As for this, in the U.S.,
the 3D video itself earned 8 million dollars
of additional profit
Due to this new style
of 3D movies coming out,
many more 3D movies were released afterwards
In 2006, Director Robert Zemeckis
made the movie
During this time, they used performance capture, or motion capture in other words
This performance capture is used in Avatar
and in various other movies these days.
So for this too,
in the U.S., the 3D video itself
reached the profit of 49 million dollars
And later, 3D movie
is the most publicized through this person
It's Director James Cameron
Director James Cameron and Cinematographer Vince Pace
founded a company together
called Pace
In Pace, they invented an something called Fusion Camera System
This Fusion Camera System,
for many 3D movies,
was used for its content production.
During this time, Korea also released 3D movie
called Tidal Wave
and Director Je-kyoon Yoon made the movie Sector 7
But this movie, domestically,
didn't receive a lot of interest and failed
When I talk about 3D movies, the example I mention the most
is the 3D version of The Terminator 2.
As for this 3D Terminator 2,
James Cameron created it in 1996
as an attraction in Universal Studios
When you go to Universal Studios,
you definitely have to watch Terminator 2
I always recommend this
I'm pretty sure they still have it today
For this Terminator 2,
the show, the video, and the stereoscopy
are very well-mixed and presented
So at first, the actors do a real-live acting
They do the actual acting, then go into the screen on their bikes,
then it switches over to the 3D video
These real actors riding the motorcycle and going inside
this part and the video itself
matches up so smoothly
So it really looks like they went into the screen
That's how it feels like
When you take a look at this movie,
the production cost back then was 60 million
and the running time was 12 minutes
The video itself was 12 minutes,
but if you combine the real-life action of the stunt performers,
it had a total running time of 24 minutes
At this time, James Cameron,
after the success of The Terminator 2,
when he made this in 3D at Universal Studios,
He founded Digital Domain,
a company specializing in computer graphics.
So the earlier-mentioned
camera company that made 3D camera
and this computer graphics company worked together
And later, True Lies and Titanic
were few of the various contents that they produced.
And when you go to theme parks,
you can watch many contents
They especially have various techniques
that are used for the production of realistic content
As for the Simpson Ride as well, 3D solids
and a type of simulator were well-synced in presentation
In this instance, it's presented through the IMAX dome screen
As I mentioned earlier,
the dome screen itself surrounds the sides, the top, and the bottom
of the audience, so the immersiveness is greater.
In regular theaters, we only watch a rectangular screen
but this surrounds all sides of us
So the stereoscopy and immersiveness that comes from this
is greatly magnified during its presentation
And in 2009, James Cameron finally releases
the movie Avatar
Avatar was very popular worldwide
It was successful as a 3D movie as well
So after Avatar, even in Korea,
there were more active production of 3D movies
Investment companies, especially
begin investing a lot in 3D movies
As for James Cameron,
especially in realistic contents,
he was the representative director
who used many various techniques in his contents
Through the release of Avatar,
3D movies were successful all around the world,
and 3D TVs were produced
So these technical aspects
are very important aspects of creating content
So when you watch movies, dramas, webtoons
and have interest in a variety of media,
it would be good to think about
how to mix in these aspects in contents
What I've been the most interested lately
is Star Wars: Galaxy's Edge, which was made in 2019,
a Star Wars area of the theme park.
The total cost was 10 billion dollars
In Korean won, it was about 1 trillion
Here, there's the Free Show area
and the Main Show area
In the Free Show area, there's the Resistance Headquarters in the cave,
the inside of the transport ship, as well as the prison of First Order,
like the actual scenes of the movie
It felt like I was truly experiencing it
There's also Dark Ride,
it's Dark Ride made with RFID
It allows you to travel around the inside of the Resistance
For this instance as well, the Industrial Light & Magic
did the computer graphics
There's also a company called Walt Disney Imagineering
Walt Disney Imagineering
is a company that I am very interested in
This is actually the place that made
all the techniques needed for realistic content production
Animetrics, as well as solids
And even the robots that are produced
recently were all made through imagineering
And lastly, I participated in this production
and carried it on as a producer
Made in April 2010, when you go to Gwanghwamun,
there's something called The Story of King Sejong
So this
located in B2 floor of Sejong Center for the Performing Arts,
21350 sq. ft. big,
it was a 4D experience center for the story of King Sejong
That was there
And when you go here, there's the Turtle Ship,
shrinked to 55% of its original size
There's also activities such as archery and rowing
What I participated in
was producing the 3D video
It was a 7 minute video about the Battle of Myeongnyang
There were stereoscopic aspects and 4D, the experiencing aspects
4D is usually water, air, smell,
and vibration, and these are used
to experience with the five senses
It was frequently called 4D experience center
It was called 4D experience center or 5D experience center
So it was 7 minutes long,
but it was made to realistically experience
the Battle of Myeongnyang
as a type of content
It was produced in such a short time frame,
but through smooth communication between the production team and the orderer,
it was successfully carried out.
We looked at a lot of aspects of 3D solids
I talked about 3D solids first because
when presenting realistic content,
the visual aspects are the biggest,
and the first things that carried this out
were the stereoscopic parts
and that's why I talked about stereoscopy
Through this, you guys
can see that the advancement of technology and hardware
allows the creation of various contents
Those can be your observations
Later, as you take more realistic content classes,
I hope you acquire more information
Good work today, everyone
Summary History of 3D solids Creation of movement, 3D caused by efforts to animate images Many methods were studied in order to animate a still image
Magic lantern, thaumatrope, zoetrope, praxinoscope, kinetograph, stereoscope, cinematograph After the emergence of TV, the golden age of 3D movies began
Later, development of display allowed the viewing of 3D at home as well
Methods and technology of creating 3D solids Psychological aspects that cause stereoscopy Perspective, shadow effect, overlapping and shielding Physical aspects that cause stereoscopy Disparity, convergence, focus, motion parallax
Method of a 3D solid movie Film Patterned Retarded method: doesn't use a filter, so natural colors are preserved Shutter Glasses method: switches quickly between left video on the left eye and right video on the right eye
Technical aspects of 3D solids Camera rig, 3D conversion
Actual examples of 3D application Chicken Little (2005): 3D animation with high profits The Polar Express (2006): the movie that used performance(motion) capture
Avatar: James Cameron's movie that contributed to publicizing 3D movies 3D videos were later used in theme park attractions and 4D experience centers to provide greater immersiveness