Hello
This is Haehyun Jeong of NEWJAK that will be doing today's lecture on new technology and
realistic content
Today I will introduce new technologies like XR, AR, and VR
and I will talk about the reality and virtual reality integrating
and interacting in virtual reality
I am going to talk about how new technologies change
and what new possibilities these are showing
and how it can be used in realistic content
Realistic content provides users a
immersive experience
I will also tell you how these technologies are used
We will also take a look into some cases in various spaces and fields
Through production, construction, education, national defense, and medical field
how these technologies are used
It would be great to see how
new technologies are being used in
realistic contents
Today I will introduce new technologies
and how they are used
and then some cases of it being used
I will follow this order
Introducing new technologies
I will first talk about new technologies
There are many new technologies emerging like XR, AR, VR, interaction, and hologram
These virtual integration technologies can be implied
in everyday life from their own industry
It would be good to think of it as
the big industry experiencing change together
You have heard of 5G right?
You might have heard of 5G or 6G
This shows how realistic contents are
being integrated into our everyday life
I am sure that you have experienced communicating images
through Cyworld before
Before Cyworld, there was Hi-Tel and Nownuri
where text communication was done
Developing from text communication > image communication > virtual and realistic fields These things and now, virtual and realistic
content are being communicated
in many different network speed
So before, what we could only enjoy on computers
are now available on mobile phones
That mobile devices are an expression of the realistic aspects
of virtual and integration
And with COVID-19 and social distancing
the online culture has developed even more
This was in fact initially speeding up
But COVID-19 accelerated it
So in our life now
Online culture cannot disappear
Just like how you and I are learning online like this
Now these online things will happen even more in the future
If you broke your wrist
Then in your wrist area
Normal doctors don't know what ligaments are there
But they can perform procedures
When you think about it, Korea isn't too far away from each other
Most places take an hour by helicopter
And less than 5 hours by car
But let's say it's in America or in China
If your wrist ligament is ruptured, and you are very far away from a hospital? Your wrist ligament is ruptured
To get to a place where they have a specialized doctor
It takes 20 hours, 10 hours by car
Or 5 hours by plane, then it would affect your life
But if it can be done online connected by metaverse
it can show the virtual environment where the doctor is there
and the procedure can be done simply
These increased experiences of reality and virtual connected
new culture
and new environment are formed
So before if new technology simply meant increase of metaverse,
increase of XR, increase of AR, increase of VR
if these were taken as just games before
now it is about everyday life, new technologies
and industries make change in our
everyday life
Using needed functions through PC in fixed places If in the early 2000s with the generalization of the internet
text and images were delivered
Functions used anytime, anywhere using smartphones and mobile apps in 2010 with Iphone and Galaxy A
smartphones were popularized and
videos were shared until now
Largely YouTube and Netflix
were the main representatives
and now in 2020s
Everyday life integrated with virtual environment through avatars it would be the generalization of the metaverse
This generalization of metaverse can bring back a dead person back to life
and also create a nonexistent person
What I expect the most from
the generalization of metaverse would be
I love the movie Harry Potter
But what I was disappointed when watching the movies is
Harry grows up so fast
What the book and the movie tells
can't catch up the speed Harry grows
These things can be solved using meta human
If the movie is remade, metaverse can replace the actor
and even now in Jeju MBC
Virtual newscaster hosting a news show A meta newscaster is replacing a real newscaster
By these, with the emergence of metaverse
In the 20s, this emergence of metaverse is
not just in metaverse games, Zepeto
or Roblox
If you take these into connection with industries
It is leading to a completely different
and new worlds
"The next 20 years to come will look just like a sci-fi novel" The CEO of NVIDIA said the emergence of metaverse
"The are of metaverse is coming" can make a new future
Metaverse has in total of 5 characteristics
First, cannon, and creator, currency,
and continuity
and connectivity
As I mentioned previously
If you think of metaverse as only games where we communicate
Or space for communication, it can be considered a very limited resource
But metaverse, in the future
will grow into very diverse fields
Will you take your wallet out for a second?
How much money do you have in your wallet?
I actually don't carry any cash at all
I can pay with my phone
And with a single credit card
and I have all my ID cards in my phone
so we have come to a world where we don't need wallets
And before we used to carry a lot of coins in our pockets
But now we don't
Then where are all your money?
They are in virtual spaces
It is in metaverse space that your money is in
These things are also very closely related to Bitcoins
Bitcoins are virtual currency
And have you traveled abroad recently?
Not only currency exchange
But you usually use a single credit card
That can handle 'travel money'
Like this, metaverse is
now in our daily life
There are four types
of metaverse, and they are
augmented reality, life logging, mirror world, and virtual world
First, let's talk about augmented reality
What do you think is the most popular content of augmented reality?
In fact, after we experienced COVID-19
Even 60, 70 year old people are able to
use augmented reality contents
How is that?
It is QR check in
A good example of augmented reality content would be QR codes
It is using a camera to open a new world
Then the most successful content
In terms of the industry
It would be Pokemon GO
This Pokemon Go is
You would also have
Walked around a lot to catch the characters in Pokemon GO
It is a very successful case of augmented reality
It is a successful case in terms of the industrial aspects as well
And next, life logging is
that it can recognize your life
Your life is all logged with data
What would that include?
Everything is turned into data
Smart watches using life logging The pattern that I'm living in and the movements
These are all turned into data
and visualized through apps
A lot of people miss that this is also through
augmented reality and new technology of metaverse
Next is mirror world
What do you think mirror world is?
You are already using it a lot
Do you know what the most used mirror world
in Korea is?
Have you thought of it?
I brought Google Earth as an example
Maps&road views using mirror world In Naver as well, there is Roadview
Do you use Roadview a lot?
You can see virtually where you actually haven't been
like a world of mirrors
This is also connected with other new technologies
These are based on digital twin
To compound the new virtual reality and the real world
Based on this
I expect contents on mirror world
to expand even more in the future
When I talk about culture
Culture contents of Korea
I will touch on this more specifically later on
Next is virtual world
In fact, the metaverse you knew
is actually just a type of
A virtual world among the metaverse types
There is Roblox in virtual world
Zepeto as well, also Fortnite
Various, the ones that we thought of
and knew are metaverse games
If we say that you know quite a lot about
metaverse worlds
You are, from my view
Saying that you are in your early to mid 20s
or to early 30s
You are not very familiar with
Virtual world and metaverse worlds
What would the virtual world and
metaverse space be to you?
In a way, Facebook, Instagram
and these worlds would be another world
And the ones a bit older than you would be
the generation of Cyworld and such
Above that is Nownuri and Hi-Tel generation
who experienced another
worlds of the metaverse
I just talked about the generation above you
then what about the ones after you?
They would be ones
using Zepeto, Roblox and such
in the virtual world
When I was preparing this lecture
I thought about the perspectives on
various worlds
As I was studying it
about Roblox and
about Zepeto
I found out that from elementary school students
to middle school students, almost all of them used Zepeto
So when I asked my niece as well
It can be said that almost
everyone is using it
Before, I said depending on generations
As I was doing some more research on
other generations and
how it was for them
before, when smartphones were new
if you went to a town office
there were lectures teaching how to use smartphones for elder people
But now if you visit silver center
they are teaching them metaverse
So in the Roblox or Zepeto world
it is mostly teenagers
and people in their 60s and 70s are also coexisting
It is a space where you don't see each others' faces
It's just virtual avatars and messages
and the virtual space
A lot of avatars
and characters also make friends
and also fight
In that space, you don't see each others' faces
so I was that they also fight
They fight through direct messages
And later if you see
'How old are you?' and then 'I'm twelve'
These things also come up
in the conversations
And then the people that come across virtual worlds first
When they are young
before their identity is fully formed
and contact the virtual world first
we need ethics for the virtual world
I thought that this aspect
should be defined better
Violence happening in the virtual world
and stabbing someone with a knife in the virtual world
being natural
and thinking that this isn't problematic ethically
is what people usually think
so it would be good if you could
pay more interest in these ethical aspects
in the virtual world
And in the metaverse
governance per type
In fact, what I told you before
are in the augmented reality
U.S. Department of Homeland Security
EDGE is using a virtual platform EDGE
to train on emergencies
happening
When an incident happens in a public building such as schools
the emergency rescue and reaction
are virtually trained with VR devices
supported by the Department of Homeland Security
It would be better to understand that
how countries approach the virtual world
are different form one another
In the US, in terms of VR
they are developing it into a platform for disasters for
virtual training and security training
in the virtual world
but in Korea it is being developed for
culture and art fields
And in Europe
they are developed for scientific
technologies
It is focused on medical fields
and simulation-centered
in Europe
but Korea also has similar developments as the US and Europe
as well
and we are also trying
to try other fields out
as well
Now here, let me ask you a question
Let's say you made a map of Gwangju-si
in the metaverse
Then, before
when we were talking about mirror worlds and Naver
and the Roadview using mirror world
who has the copyright of that?
It is considered a derivative work
and the copyright is given to the person who made the map
So if you create a digital Roadview
on Naver with mirror world
it is you that has the copyright
But to tell you about a case in Japan
Japan gives the copyright of this metaverse
to the constructor of the building
Isn't it weird?
So in Japan
in the market of metaverse and new technology
I saw what firms were there
and I saw Mitsubishi Elevator company come up
And we asked why
and they said that the ones with most buildings
also have strength in metaverse world
Recently, about virtual spaces
and real estate platforms
there were news articles about this
But in Korea, it was considered as fraud
legally
and it is in the process of lawsuits
but in Japan, it is not fraud
and it is the ownership going to
the original work's owner
for real estate as well
These things, about international copyright
and about patent rights
are actively discussed internationally
and the US is taking a neutral stance
while Korea is giving the copyright
to the owner of the derivative work
so I don't know how the outcome will be
internationally for Japan and Europe
but until now, when talking about new technologies and the metaverse market
and about realistic content
in Korea where you can create derivative work
it is easier for you to make one
and also easier to make your value
and that is what I want to tell you
I also told you that in Korea it is
being developed in the culture and arts field
so they are supporting that
a lot in part of that
and also one's for technology development
And from that
like the ones you just saw
virtual training platforms are
being implemented as well
So in the case of the US, the army, national fire agency, and the police
various fields, those on disasters
are all turning into
virtual training platforms
Next what I will tell you
is life logging in metaverse
It can be said as a big data platform of everyday life data
information from wearable devices
are all turned into big data and visualized
into what you can see
Here, the data
it will save all of my movements
using GPS
and my health information
will be saves as number datas
Those being visualized
and the one flow, the flow about the whole thing
is all in this life logging you could say
These information are
all visualized through
the big data platform
So in fact, all these data are
just numbers that you can easily hande
with Excel that you use
If you ask Naver what 'digital' is
it says that it is construction range of 0 and 1
And also AI phone call platforms
that are popular these days
are also based on data
and just organizing them well
In fact, artificial intelligence phone call platforms as well
most of it are
also implemented in platforms like
Naver or Google
What makes all these more accessible
is the big data artificial intelligence phone call platform
in a large scale
So you could say that the technology of realistic content is
in fact in all industries
that it is connected among
every industry
and these technologies
are what express the realistic content visually
and it is not just one technology
and its development
Another thing I'd like to stress
about this realistic content and new technoogy is
that it is an integrated study
All technologies in the world and in all industries
they can all be used here
Before, when studying about these
it was very inconvenient
because you would have to study from the very early works on that industry
But now with data technology
we're in an era where we can
bring everything like a library
These new technologies
that can help us bring it industrially
are very platformized and
simplified
making the range available for you in XR, new technology
and metaverse are so much wider
and everything that I mentioned from national defense
to medical care and disaster managements are manageble
and that these are all accessible
through and as data
Next is mirror world
I think this mirror world will become better and better
Not only in Gwangju
but also all over the world
they are developing mirror world
What can mirror world do?
It is recreating a virtual world identical to the real world
So I think that it can be used in
many different fields
In the game Simcity Games
this was also done
but unlike the metaverse that were all in games
now it an be taken to industrial levels
and also in history fields
If we take reality
into metaverse space with mirror world
we can record the present
and restore the past
recording it for the future generation
and also predict the future
We an imagine the future
This way, we can do simulations on city planning
and through this, such as floods
or other disasters and
amount of sunlight
these things can be simulated virtually
So this mirror world is a new tool
that can predict past, present, and future
And lastly for case examples
it is virtual world
These virtual worlds are actually
made possible with COVID 19
it was accelerated with COVID
Then taking on from the virtual world
and Zepeto, and avatars
in terms of the virtual world
we have been talking about the game aspects
that you now well
It could be said that these are existing
with VR, AR, and MR mixed together
The existing ones
in terms of device concepts
XR is
what makes the devices a bit freer
without buying new devices
it can be used in freer forms
which means that it can be expanded more
Arte Museum
and these virtual aspects
in museums are, with Arte Museum in the center of it
expanding in these immersive
exhibitions
So these are expanding and
even going beyond XR content
like this
If these were before just content to be viewed
now it is more of an interaction
where you can interact
in the metaverse space
Now there are people who watch movies in metaverse
who work in a bank in a metaverse
and many other things are being
expanded in the metaverse
I'm sure you use open banking a lot
These, and the development of these
if the security of banks before
were very strict
with the technology of open banking
it was reached the metaverse world
as well
In some countries, they have confirmed the Bitcoin
as their official national currency
These
people saying that Dollar or Yuan will be the international currency
but who knows?
Maybe in 10 years we might be using Bitcoins all around the world
without the need to exchange currency when traveling abroad
and just use the Bitcoin that I have now
That world could come
So I could say that
we are living in a metaverse space
You could imagine it that way
inside your head
How you are using metaverse
it would be nice for you to define that
and this metaverse
is about interaction
and how you interact with it
it is the expression of that
Next is hologram
Hologram is
continuously being used
and also continuously developing
but I don't want to say that
hologram is generalized yet
In terms of hologram,
I think it must be more liberalized
in terms of devices
and I will also say that hologram
will also develop gradually
What we can see
in Avengers movies with holograms
aren't far away
from where we are now
with hologram contents
If these hologram contents develop
many realistic contents
will change from a display content
to a spatial content
So the Arte Museum is also
in fact using the technology projection mapping
that is a expanded display technology
But if digital content with hologram
and realistic content is created
now from there it becomes spatial content
And then, the 3D content that we are creating
will all be based on space
so if 2D based content is the current one
3D content and spatial content
will need a new coordinate system
What's disappointing about current realistic contents is that
the production is in 3D
The production is in 3D in XYZ
but it's all expressed in 2D
And only when it is projected as XR through devices
it is expressed as 3D content
with more integration with it
but I think that it will be much better with hologram
and more 3D expressions
Use of new technology by realistic content
In realistic content
it can be said that all developments
of technologies are expressed together
Like I mentioned before
the use of new technology in realistic content
isn't something that only we can do
Medical development is needed
and scientific development is needed
and the transportation needs to develop
devices need to develop
and display needs to develop
We are just using these
Some of you might have majored engineering
but even if you didn't
using new technology in realistic content is so easy
If you have just a little bit of interest
about technology
it is possible to master within a week
just through some research on Youtube or Naver
Lectures on GCC Academy that you are watching right now
also have many of those
so that can also help
Next is the integration of realistic content
and new technology
Based on the concept of presence
it is experiencing something
as if it is real
through media
Virtual spaces, and non existent spaces
are expressed as realistic contents
and something that you can experience
and these are as previously mentioned
often talked about together with
digital twin
Digital twin is
when we are making a planned community
we could first make it as a digital twin
Once you complete it
you can find what should be fixed
and find out what's impossible in the virtual world
Another example would be CJ logistic center and Coupang logistic center
where they have
realistic content and artificial intelligence, and
algorithm applied
to use digital twin
as a part of their content
But how is logistic center connected with content?
Virtual simulator is being connected
What we are making
are all parts of industrial simulators
which can make them into contents
In the existing industries
contents were worthelss
if it did not have virtual
celebrities in it
it was not worth putting money in
and it was just that
it is possible to do something of that sort
But now
realistic contents are
what can make content based on simulators
and something that is connected with potentially
everything industrially
Next is digital human
Digital human is what can
generate what looks like humans
and artificial intelligence characters
It can also create non existent characters
or it can scan the current look of me
or you through 3D scanning
to make digital human
This is also about the past
so these days we usually record with photos
but if you turn these into digital human
what you recorded now
can do storytelling on
what I didn't do in the future
which will make it useful
I thought of this
If we recorded
celebrities from when they were young
to their 60s as digital humans with 3D scanning
Then making a movie with this human
even when this person dies, wouldn't this movie
last for the future generation
So this is how it can be used
And like this
KFC's founder Colonel Sanders
is active as a virtual influencer
and virtual influencer Rozy
is also used in many aspects
in Korea
Case studies on space use
Next is
case studies on spaces
and how they were applied
First is National Theater of Korea
It is 'Star star realistic theater' in National Theater of Korea
Here, contents on dancing
from ballet to traditional Korean dancing
can be seen in the theater
in National Theater of Korea
These, I think
like the case of Pyeongchang Olympic Winter Games
musicals and other stuffs
are usually
seen from the front
But if realistic content is changed into spatial content
I think that most theaters will be
changed into circular arena like this
and in Las Vegas of the US
there have been continuous efforts for
arena type theaters
and in Korea as ell
there seem to be many exhibit halls in progress
And this is media cinema 360 from Etri
and these are from the Las Vegas
Sphere, a 360 degree wall
where you can virtually experience
where you cannot actually visit
So this is how they are
variously applied
And about characters that elementary school students
like a lot, 'Shinbi's Haunted House'
was created in a virtual space as realistic content
and these are cases where
control through media
that you are learning can be seen
These are aspects of interaction
where various cases are
joint together
and these are not only inside
but also outside to created outside content
with a theme-part format
and that it is also developing in that way
And these, as I told you before
can be used in many fields like disaster, national defense, and medical fields
being used as simulators
and it can also be used in
esports fields
Each of these fields
are almost inseparable
from realistic content
Also life sports
and indoor sports as well
During COVID it was hard to do indoor sports
but with problems like fine dust
indoor sports are becoming popular
and with the society
going towards individualism
even for group sports indoor sports facilities
for individuals are seemed to have much potential
IOC in fact
in 2023 used digital content
in the Olympics as well
We have talked about VR, AR, XR cases
and the industrial cases
that can derive from them
on today's lecture
and I hope that you can
think about how realistic content
can be applied in what fields as well
Thinking of how you experienced
the metaverse and
virtual, realistic content
in your daily life
I would like to wrap up
this lecture here
Thank you
Introduction of new technology Emergence of metaverse Started to be integrated in everyday life centered around industries with the virtual integration technology developing With 5G service and device calculation speed raised and technology developed
Increased experience of real world and virtual world connected New culture formed with COVID-19 and social distancing
2000s' popularization of the internet 2010s' popularization of smartphones 2020s' popularization of metaverse
5C of metaverse Cannon Creator Currency Continuity Connectivity
Types of metaverse Augmented reality, life logging, mirror world, virtual world
Augmented reality Environment creating 2D/3D virtual image in the real world Ex) Pokemon GO, HUD, room escape games, social media using 3D avatars
Life logging Environment recording and sharing various events and information of daily life Ex) Nike running, dashcams, social media, vlogs
Mirror world Digital environment where the information of the real world is realistically reflected Ex) Google Earth, Naver Map, Air BnB, Zoom meetings, Baemin, Zigbang, Dabang
Virtual world 3D environment created with computer simulation of the real or an alternative world Ex) Fortnite, Minecraft, Roblox, Animal Crossing, Zepeto
Case studies on each types of metaverse Augmented reality: Edge(virtual training platform for emergencies) Life logging: T3Q.ai(big data platform for daily life information)
Mirror world: Virtual Singapore(3 dimensional virtual city model) Virtual world: Zepeto avatar event(promoting climate change week)
Interaction IN metaverse Technology enabling users to communicate and interact in the metaverse space
Hologram 'Complete image' in Greek Hologram=holo(whole) gram(message or information)
Use of new technology of realistic content Realistic content Digital content using realistic technologies like VR, AR, hologram Time and space of the physical world
Presence Experiencing as if it is real without media Concept that makes one forget of the technology connecting it
Digital twin Creating a twin of a real world object in the virtual world and having it do the activities in the virtual world
Digital human 3D AI character that looks and acts like a human generated by computers
Case studies Star star realistic theater of National Theater of Korea Pyeongchang Winter Olympics(projection mapping) Mediafront Cinema360(360 degree realistic content)
Dot-mill 'Shinbi's Haunted House' media adventure Dot-mill Lunafall(outdoors digital theme park) Realistic VR firefighter training Smart sports experience center_SPORTS 360º SMART