WEBVTT 1 00:00:04.574 --> 00:00:09.050 Realistic Basics Realistic contents and new technologies 2 00:00:09.050 --> 00:00:11.663 GCC Academy 3 00:00:11.663 --> 00:00:14.963 Learning Goals Can explain hologram types and materializing technologies Can explain what is needed for XR content production through content application cases 4 00:00:14.963 --> 00:00:18.304 Learning Content Hologram materializing technology XR content application cases 5 00:00:18.624 --> 00:00:21.224 CEO Jeong Jiwon Career Current board member of T.OZ corporate Former board member of Wysisyg Studios corporate General director of Lotte World theme park TaekwonV VR General director of Gyeonggi Content Agency Gyeonggi VR AR 6 00:00:21.224 --> 00:00:23.812 General director of Jeju National Museum realistic videography General director of Sokcho Museum realistic content production 7 00:00:23.812 --> 00:00:27.639 Hello this is Jeong Jiwon for realistic content lectures 8 00:00:27.639 --> 00:00:31.821 Today we will learn about holograms 9 00:00:31.821 --> 00:00:38.121 As you took the realistic content lectures, you saw many technologies 10 00:00:38.121 --> 00:00:44.439 and I think that hologram is the final stage of realistic contents 11 00:00:44.439 --> 00:00:53.211 When hologram is well shown in a real space 12 00:00:53.211 --> 00:00:58.439 the immersiveness will be very big 13 00:00:58.439 --> 00:01:00.901 But the hologram now 14 00:01:00.901 --> 00:01:05.739 are not yet shot on actual spaces 15 00:01:05.739 --> 00:01:09.112 So that's too bad but 16 00:01:09.112 --> 00:01:13.040 I think that when hologram is well produced 17 00:01:13.040 --> 00:01:17.544 it will be the perfect realistic content 18 00:01:17.544 --> 00:01:22.919 and so today, we are going to take a look into hologram materializing technologies among realistic contents 19 00:01:22.919 --> 00:01:29.811 And XR content, that is, extended reality, 20 00:01:29.811 --> 00:01:36.685 and cases of contents made with extended reality is another thing we will learn in this lecture 21 00:01:37.465 --> 00:01:41.188 Hologram materializing technologies 22 00:01:41.188 --> 00:01:45.771 Hologram can be seen on Star Wars 23 00:01:45.771 --> 00:01:49.849 When first seeing that movie, you can see a lot of hologram 24 00:01:49.849 --> 00:01:53.141 Hologram technology is 25 00:01:53.141 --> 00:01:56.958 most effective when it is shot in a space 26 00:01:56.958 --> 00:02:01.959 I've mentioned that 3D video is due to stereoscopy 27 00:02:01.959 --> 00:02:05.663 3D is produced using stereoscopy 28 00:02:05.663 --> 00:02:10.944 so when making these 3 dimensional videos distortion or 29 00:02:10.944 --> 00:02:14.279 dizziness happens 30 00:02:14.279 --> 00:02:20.563 And also you had to put glasses on for the stereoscopy method 31 00:02:20.563 --> 00:02:27.559 But if hologram is perfectly done, no glasses are needed 32 00:02:27.559 --> 00:02:31.888 and there will also be no dizziness since stereoscopy isn't used 33 00:02:31.888 --> 00:02:37.960 So these 3 dimensional video technology is called holographic technology 34 00:02:37.960 --> 00:02:41.465 and this holographic technology is, as I mentioned, 35 00:02:41.465 --> 00:02:46.587 free of the issues that stereo 3D or multi-point of view 3D videos had 36 00:02:46.587 --> 00:02:51.455 from the discordance of focus and convergence angle 37 00:02:51.455 --> 00:02:53.922 So there will be no dizziness from visual fatigue 38 00:02:53.922 --> 00:02:59.880 making the 3D video watching much more comfortable 39 00:02:59.880 --> 00:03:05.001 In the filming process as well using object wave and reference wave 40 00:03:05.001 --> 00:03:11.384 all information wave and phase of the light logging these in a wave interference format 41 00:03:11.384 --> 00:03:16.399 visual fatigue can be eliminated, which is a strength 42 00:03:16.399 --> 00:03:23.919 There are analog holography and digital holography in hologram 43 00:03:23.919 --> 00:03:26.876 Analog holography, to put it easily, 44 00:03:26.876 --> 00:03:33.279 is 3 dimensional video image generating technology filmed with lasers in general 45 00:03:33.279 --> 00:03:36.087 and digital holography is made with 3 dimensional digital data 46 00:03:36.087 --> 00:03:42.486 acquired through CCD camera or CMOS sensor image 47 00:03:42.486 --> 00:03:47.199 referring to technology generating and saving hologram in such methods 48 00:03:47.199 --> 00:03:53.870 So hologram is recording media via holography 49 00:03:53.870 --> 00:03:58.720 and a case of the use of holography technology would be hologram 50 00:03:58.720 --> 00:04:02.026 Hologram, looking into the term, 51 00:04:02.026 --> 00:04:06.479 'holos' means 'whole' in Greek 52 00:04:06.479 --> 00:04:09.361 and meaning and information 53 00:04:09.361 --> 00:04:13.143 so 'gramma' which means 'message' 54 00:04:13.143 --> 00:04:18.720 So these together makes 'record the whole's information' 55 00:04:18.720 --> 00:04:25.160 and in a way it is a technology that records all information about the subject 56 00:04:25.160 --> 00:04:31.452 Hologram considers the light that is reflected off an object from the laser source 57 00:04:31.452 --> 00:04:36.079 through reflection and rotation as a wave 58 00:04:36.079 --> 00:04:42.959 So all information about this wave is recorded as wave interference 59 00:04:42.959 --> 00:04:49.357 As I kept mentioning, there will be no issues with glasses that the existing 3D videos had 60 00:04:49.357 --> 00:04:53.359 or visual fatigue like dizziness 61 00:04:53.359 --> 00:04:58.777 and with the space distortion due to stereoscopic camera filming being resolved 62 00:04:58.777 --> 00:05:01.760 a complete 3 dimensional video can be produced 63 00:05:01.760 --> 00:05:08.959 making it a perfect 3 dimensional method in any logical background 64 00:05:08.959 --> 00:05:13.951 Analog hologram 65 00:05:13.951 --> 00:05:17.320 separates light into two paths 66 00:05:17.320 --> 00:05:22.034 The object beam that was reflected from the object 67 00:05:22.034 --> 00:05:25.559 and reference beam reflected from the mirror interfere each other 68 00:05:25.559 --> 00:05:27.817 The pattern made with the interference is 69 00:05:27.817 --> 00:05:31.760 recorded on the photographic plate 70 00:05:31.760 --> 00:05:36.598 and with the same reference beam shot on the photographic plate 71 00:05:36.598 --> 00:05:41.987 the object image is played as a hologram video 72 00:05:41.987 --> 00:05:45.079 which is the analog hologram method 73 00:05:45.079 --> 00:05:50.596 Analog hologram uses optical phenomenon through light 74 00:05:50.596 --> 00:05:53.480 which makes it very similar to photos 75 00:05:53.480 --> 00:05:59.040 So analog hologram is also referred to as laser 3 dimension photography 76 00:05:59.040 --> 00:06:04.040 Analog optical holography uses laser as the light source 77 00:06:04.040 --> 00:06:09.119 and uses hologram film or photo polymer as the recording medium 78 00:06:09.119 --> 00:06:12.961 So it's the method of recording the object's wave interference 79 00:06:12.961 --> 00:06:17.239 and playing this 80 00:06:17.239 --> 00:06:19.619 Analog hologram is 81 00:06:19.619 --> 00:06:24.000 usually used in exhibitions, advertisement, and arts 82 00:06:24.000 --> 00:06:28.869 Viewing the recording content 83 00:06:28.869 --> 00:06:33.519 Photos can be developed ans scanned from films 84 00:06:33.519 --> 00:06:37.440 and optical hologram just needs to be developed from the holography film 85 00:06:37.440 --> 00:06:41.643 If the same light source is shot on the developed film 86 00:06:41.643 --> 00:06:44.440 the 3 dimensional video will be generated 87 00:06:44.440 --> 00:06:51.320 and only parts of the film could be attained as 3 dimensional videos as well 88 00:06:51.320 --> 00:06:56.200 While analog hologram used light source, digital hologram 89 00:06:56.200 --> 00:07:00.359 plays the image using computers 90 00:07:00.359 --> 00:07:05.935 So instead of photographic plates, it uses SLM, spacial light modulator 91 00:07:05.935 --> 00:07:10.679 that can control light's wave's amplitude or phase 92 00:07:10.679 --> 00:07:13.239 to generate 3 dimensional videos 93 00:07:13.239 --> 00:07:17.393 This method uses computer 94 00:07:17.393 --> 00:07:22.359 calculation to record the aimed 3D object indirect pattern image 95 00:07:22.359 --> 00:07:25.480 on an SLM 96 00:07:25.480 --> 00:07:30.480 Then this is played as a hologram image 97 00:07:30.480 --> 00:07:35.160 SLM can continuously change the pixel information 98 00:07:35.160 --> 00:07:39.200 so it can generate not only images but also videos 99 00:07:39.200 --> 00:07:42.799 and LCD is an example of SLM 100 00:07:42.799 --> 00:07:50.720 LCD can control the light's phase or color information by controlling the liquid crystal molecules 101 00:07:50.720 --> 00:07:54.320 Digital holography, as previously mentioned, 102 00:07:54.320 --> 00:08:04.399 generates hologram by acquiring 3 dimensional digital data filmed with CCD camera or CMOSS image sensor 103 00:08:04.399 --> 00:08:10.009 These are also able to be saved and edited as well 104 00:08:10.009 --> 00:08:14.279 While analog hologram recorded on film with optical holography 105 00:08:14.279 --> 00:08:16.959 cannot be compressed or sent 106 00:08:16.959 --> 00:08:20.720 but digital holography is good with compressing and sending 107 00:08:20.720 --> 00:08:25.279 So what we saw in movies 108 00:08:25.279 --> 00:08:28.799 and what we experience analog and digital in everyday life 109 00:08:28.799 --> 00:08:32.159 the digital data itself can be sent in emails 110 00:08:32.159 --> 00:08:35.880 and such 111 00:08:35.880 --> 00:08:41.559 Another strength of digital hologram is that it is possible to record the phase information of the object and 112 00:08:41.559 --> 00:08:46.559 3 dimensional information and to analyze the object 113 00:08:46.559 --> 00:08:51.840 Another thing is that there is no developing required 114 00:08:51.840 --> 00:08:55.799 making it very convenient in the production 115 00:08:55.799 --> 00:09:00.880 Also, digital hologram can make a not existing object 116 00:09:00.880 --> 00:09:04.400 with computer graphic technology 117 00:09:04.400 --> 00:09:11.119 and film these and generate these 118 00:09:11.119 --> 00:09:14.039 Digital hologram's objective is 119 00:09:14.039 --> 00:09:19.640 making 3D video data that is identical to the real one in real time 120 00:09:19.640 --> 00:09:25.919 And through vast calculations, turn this into an algorithm 121 00:09:25.919 --> 00:09:30.419 and making a sped-up graphic processing algorithm 122 00:09:30.419 --> 00:09:36.960 would be the final goal of digital hologram generation 123 00:09:36.960 --> 00:09:41.359 Next is volumetric display 124 00:09:41.359 --> 00:09:45.799 Volumetric display is a technology that 125 00:09:45.799 --> 00:09:49.320 creates image right onto a 3 dimension space 126 00:09:49.320 --> 00:09:54.000 So this uses voxel, 127 00:09:54.000 --> 00:09:58.000 volumetric piel 128 00:09:58.000 --> 00:10:03.479 to make a 3 dimensional image in a physical 3 dimensional space 129 00:10:03.479 --> 00:10:07.679 There are 3 to 4 ways to make this 3 dimensional image 130 00:10:07.679 --> 00:10:11.359 There are screen movement method, plasma luminescence method, 131 00:10:11.359 --> 00:10:15.159 changeable focus method and particle trap method 132 00:10:15.159 --> 00:10:17.239 Volumetric display is 133 00:10:17.239 --> 00:10:23.440 in a way, the complete version of hologram 134 00:10:23.440 --> 00:10:27.464 Volumetric display is, 135 00:10:27.464 --> 00:10:28.840 taking Star Wars as an example 136 00:10:28.840 --> 00:10:34.664 in Star Wars, when sending a message to the princess 137 00:10:34.664 --> 00:10:37.280 an image is shot in the space 138 00:10:37.280 --> 00:10:44.239 These being materialized is the final goal in my view 139 00:10:44.239 --> 00:10:50.119 because in VR, AR, or 3D movies 140 00:10:50.119 --> 00:10:57.039 there are screen surfaces where the images are screened 141 00:10:57.039 --> 00:11:01.479 There is a surface where a video is shot 142 00:11:01.479 --> 00:11:05.239 or the video is played so that we can sense an object 143 00:11:05.239 --> 00:11:07.679 and acquire information 144 00:11:07.679 --> 00:11:09.880 but this volumetric display 145 00:11:09.880 --> 00:11:14.919 generates image in an actual space 146 00:11:14.919 --> 00:11:19.840 So this by itself is a very complex technology 147 00:11:19.840 --> 00:11:23.479 and it will take much more time to actually make this 148 00:11:23.479 --> 00:11:27.719 Currently in many labs in and out of Korea 149 00:11:27.719 --> 00:11:32.080 volumetric display technologies are being developed 150 00:11:32.080 --> 00:11:37.799 but the videos made have short running time 151 00:11:37.799 --> 00:11:39.200 The running time is short 152 00:11:39.200 --> 00:11:42.039 and the videos made are 153 00:11:42.039 --> 00:11:46.159 For example a star forming or a sphere forming 154 00:11:46.159 --> 00:11:50.479 Like these, simple things 155 00:11:50.479 --> 00:11:53.880 are generated in a short time mostly 156 00:11:53.880 --> 00:11:57.000 But these videos 157 00:11:57.000 --> 00:11:59.880 even through Youtube or other materials 158 00:11:59.880 --> 00:12:04.320 gives much 3 dimensional and spatial senses 159 00:12:04.320 --> 00:12:09.919 and if this was a longer content 160 00:12:09.919 --> 00:12:11.760 it will be ground breaking 161 00:12:11.760 --> 00:12:13.239 I think it will be ground breaking 162 00:12:13.239 --> 00:12:16.960 and it will turn all the previous hologram methods 163 00:12:16.960 --> 00:12:22.119 into very outdated ones 164 00:12:22.119 --> 00:12:23.640 with it 165 00:12:23.640 --> 00:12:30.000 And for this volumetric hologram display to be done 166 00:12:30.000 --> 00:12:36.080 currently, the devices needed are very large in sizes 167 00:12:36.080 --> 00:12:40.119 and many technological equipment are needed 168 00:12:40.119 --> 00:12:44.119 So I think that it will take more time to 169 00:12:44.119 --> 00:12:48.200 make these devices smaller 170 00:12:48.200 --> 00:12:52.000 Volumetric display 171 00:12:52.000 --> 00:12:55.760 and especially screen movement method 172 00:12:55.760 --> 00:12:59.320 moves the screen in rotation or back and forth in high speed 173 00:12:59.320 --> 00:13:04.159 and a 3D object's section images synchronized to the movement speed are 174 00:13:04.159 --> 00:13:07.640 continuously shot to the screen, making it possible 175 00:13:07.640 --> 00:13:11.960 to view a 3 dimensional video due to afterimage effect 176 00:13:11.960 --> 00:13:15.960 And particle trap method 177 00:13:15.960 --> 00:13:21.479 traps a very small and light particle 178 00:13:21.479 --> 00:13:25.159 with a laser and move them 179 00:13:25.159 --> 00:13:30.799 Then external light is irradiated in sync to the movement creating an afterimage effect 180 00:13:30.799 --> 00:13:32.960 to make an 3 dimensional video 181 00:13:32.960 --> 00:13:37.760 in a space 182 00:13:37.760 --> 00:13:41.400 This particle trap method is the hologram screening method 183 00:13:41.400 --> 00:13:46.400 seen in Star Wars 184 00:13:46.400 --> 00:13:50.400 Volumetric display has no limit in viewing angle 185 00:13:50.400 --> 00:13:55.039 and there is no dizziness in the natural 3 dimensional video 186 00:13:55.039 --> 00:13:59.895 but there will be spatial limits and noises 187 00:13:59.895 --> 00:14:02.799 which are big weaknesses 188 00:14:02.799 --> 00:14:06.840 of volumetric display 189 00:14:06.840 --> 00:14:09.400 The next hologram method is 190 00:14:09.400 --> 00:14:11.159 pseudo hologram 191 00:14:11.159 --> 00:14:14.880 Pseudo hologram is also called pseudo(in Korean) hologram 192 00:14:14.880 --> 00:14:18.520 and also as floating hologram 193 00:14:18.520 --> 00:14:23.719 Floating hologram started from 194 00:14:23.719 --> 00:14:27.400 Pepper's ghost by Henry Dircks, 195 00:14:27.400 --> 00:14:30.719 an English inventor in 1862 196 00:14:30.719 --> 00:14:34.919 I am sure that you have seen pseudo hologram a lot 197 00:14:34.919 --> 00:14:42.840 Where you saw it is Psy's hologram show at Dongdaemun 198 00:14:42.840 --> 00:14:47.280 and YG Entertainment singers' hologram shows 199 00:14:47.280 --> 00:14:50.719 and SM Entertainment hologram shows 200 00:14:50.719 --> 00:14:54.039 These were all done using the 201 00:14:54.039 --> 00:14:57.359 pseudo hologram method 202 00:14:57.359 --> 00:15:02.039 I also thought that pseudo hologram was a new technology when it was out 203 00:15:02.039 --> 00:15:05.159 But as I did some research 204 00:15:05.159 --> 00:15:10.200 it was easy to find out that it started from a stage illusion 205 00:15:10.200 --> 00:15:16.159 in England in 1862 206 00:15:16.159 --> 00:15:22.119 and thought that we were using it well now 207 00:15:22.119 --> 00:15:26.559 Examples of pseudo hologram in Korea 208 00:15:26.559 --> 00:15:31.280 are the mentioned hologram performance of Psy 209 00:15:31.280 --> 00:15:36.440 or SM Entertainment's show 210 00:15:36.440 --> 00:15:37.919 Let's see how it worked 211 00:15:37.919 --> 00:15:42.239 How it was done is, you put a projector above 212 00:15:42.239 --> 00:15:45.679 and play a pre-recorded video 213 00:15:45.679 --> 00:15:48.640 on the floor where there is a reflective surface 214 00:15:48.640 --> 00:15:53.200 Once it is screened, the reflected video is 215 00:15:53.200 --> 00:15:56.520 reflected on the set-up transparent film 216 00:15:56.520 --> 00:15:58.119 in a 45 degree angle 217 00:15:58.119 --> 00:16:01.359 Then the pseudo hologram is 218 00:16:01.359 --> 00:16:03.880 just like it was done in England 219 00:16:03.880 --> 00:16:08.239 screened as if it is floating to the audience 220 00:16:08.239 --> 00:16:11.280 So when you think about it 221 00:16:11.280 --> 00:16:14.559 you will remember that the background 222 00:16:14.559 --> 00:16:18.200 of Psy's hologram show being very dark 223 00:16:18.200 --> 00:16:23.640 This is because only when the background is dark, when the object is screened 224 00:16:23.640 --> 00:16:27.200 it looks like it is floating in the air 225 00:16:27.200 --> 00:16:29.080 and in a way, the layers are separated 226 00:16:29.080 --> 00:16:32.640 There's the 45 degree transparent film in the front 227 00:16:32.640 --> 00:16:34.799 and the background in the back 228 00:16:34.799 --> 00:16:37.599 creating layers in the space itself 229 00:16:37.599 --> 00:16:41.799 making the audience feel perspective and floating effect 230 00:16:41.799 --> 00:16:46.599 So it looks like it is 3 dimensional 231 00:16:46.599 --> 00:16:49.479 If you try to remember 232 00:16:49.479 --> 00:16:51.440 in the 45 degree one, 233 00:16:51.440 --> 00:16:55.119 there were a lot of objects or effects 234 00:16:55.119 --> 00:16:59.840 and the back layer had the background projected 235 00:16:59.840 --> 00:17:02.000 having two layers 236 00:17:02.000 --> 00:17:05.599 combined into one 237 00:17:05.599 --> 00:17:10.119 So the floating method, pseudo hologram method 238 00:17:10.119 --> 00:17:11.839 makes it possible for 239 00:17:11.839 --> 00:17:16.248 the hologram video and the performer and host 240 00:17:16.248 --> 00:17:17.800 to interact 241 00:17:17.800 --> 00:17:20.760 So the 3D objects or effects are 242 00:17:20.760 --> 00:17:23.560 screened on the 45 degree film 243 00:17:23.560 --> 00:17:27.119 and actual performers stand on the stage 244 00:17:27.119 --> 00:17:29.479 And lastly at the back 245 00:17:29.479 --> 00:17:31.880 a background is screened 246 00:17:31.880 --> 00:17:34.119 separating the stage into three layers 247 00:17:34.119 --> 00:17:36.400 which creates perspective 248 00:17:36.400 --> 00:17:40.199 And also from the actual performer and the background only 249 00:17:40.199 --> 00:17:44.439 to another video in the front being screened 250 00:17:44.439 --> 00:17:49.400 more perspective and 3 dimensional feeling is created 251 00:17:49.400 --> 00:17:53.680 So if you re-watch 252 00:17:53.680 --> 00:17:57.119 videos from that time 253 00:17:57.119 --> 00:18:00.880 you will be able to see 254 00:18:00.880 --> 00:18:02.548 what I had just explained 255 00:18:03.159 --> 00:18:07.476 XR content application cases 256 00:18:07.479 --> 00:18:12.560 Next we'll learn about XR contents 257 00:18:12.560 --> 00:18:16.400 XR is extended reality 258 00:18:16.400 --> 00:18:22.839 It isn't far different from VR, AR, and MR 259 00:18:22.839 --> 00:18:27.479 VR, AR, MR, XR are better 260 00:18:27.479 --> 00:18:31.719 explained as one whole concept 261 00:18:31.719 --> 00:18:35.560 XR, extended reality is 262 00:18:35.560 --> 00:18:39.160 referred to as extended reality(in Korean) 263 00:18:39.160 --> 00:18:43.520 Some also call it MR, mixed reality 264 00:18:43.520 --> 00:18:47.680 Recently XR was more commonly used 265 00:18:47.680 --> 00:18:51.760 Let's see how XR contents were used 266 00:18:51.760 --> 00:18:55.959 and how these are being incorporated 267 00:18:55.959 --> 00:18:58.479 these days 268 00:18:58.479 --> 00:19:02.560 XR is used a lot in Korean medicine 269 00:19:02.560 --> 00:19:05.040 or in the medical field 270 00:19:05.040 --> 00:19:09.599 QuadRutcher made a Korean medicine XR 271 00:19:09.599 --> 00:19:13.400 What it is is, students do acupuncture 272 00:19:13.400 --> 00:19:18.520 When they do it on real person 273 00:19:18.520 --> 00:19:21.439 it could cause a medical accident 274 00:19:21.439 --> 00:19:24.400 when it is done wrong 275 00:19:24.400 --> 00:19:27.479 so they make a part of a human body into a sculpture, 276 00:19:27.479 --> 00:19:29.400 a dummy 277 00:19:29.400 --> 00:19:31.680 And make this sculpture's texture 278 00:19:31.680 --> 00:19:36.760 identical to actual human skin 279 00:19:36.760 --> 00:19:42.800 And with this dummy, and putting on hololens 280 00:19:42.800 --> 00:19:45.319 you can see the muscles in the leg 281 00:19:45.319 --> 00:19:50.640 And when you do acupuncture on the muscles 282 00:19:50.640 --> 00:19:51.959 there are what looks like needles 283 00:19:51.959 --> 00:19:56.119 and it shows how deep the 284 00:19:56.119 --> 00:19:57.280 needles go in 285 00:19:57.280 --> 00:20:02.680 So in a way, to maximize the effect of 286 00:20:02.680 --> 00:20:05.520 XR contents 287 00:20:05.520 --> 00:20:09.400 there must be an analog object 288 00:20:09.400 --> 00:20:11.199 And when digital information is added 289 00:20:11.199 --> 00:20:14.239 on top of that analog object 290 00:20:14.239 --> 00:20:16.439 the effect is maximized 291 00:20:16.439 --> 00:20:22.680 So at that time, when the company made this content 292 00:20:22.680 --> 00:20:26.199 they first made a dummy leg 293 00:20:26.199 --> 00:20:28.920 With that dummy leg 294 00:20:28.920 --> 00:20:33.560 they screened the images of the 295 00:20:33.560 --> 00:20:36.199 muscles in the leg 296 00:20:36.199 --> 00:20:39.280 And what's important here is that 297 00:20:39.280 --> 00:20:41.599 when doing the XR experience 298 00:20:41.599 --> 00:20:44.319 when you just put in on the muscle 299 00:20:44.319 --> 00:20:46.520 you know that the needle is going in 300 00:20:46.520 --> 00:20:48.880 But it is hard to see 301 00:20:48.880 --> 00:20:52.680 how deep or how shallow it is reaching 302 00:20:52.680 --> 00:20:55.189 But this content 303 00:20:55.189 --> 00:20:57.920 showed how deep it went in 304 00:20:57.920 --> 00:21:04.680 and how this affects the muscles and blood vessels 305 00:21:04.680 --> 00:21:09.560 So if you want to know more about this 306 00:21:09.560 --> 00:21:13.640 you can search Quadrature Korean Medicine on Youtube 307 00:21:13.640 --> 00:21:15.640 and it will help a lot 308 00:21:15.640 --> 00:21:18.560 Also when producing these 309 00:21:18.560 --> 00:21:21.239 extended reality conent 310 00:21:21.239 --> 00:21:24.238 it would be good to incorporate it into many fields 311 00:21:24.238 --> 00:21:27.760 Especially when creating this Korean medicine content 312 00:21:27.760 --> 00:21:31.760 what's more important is cooperation with experts 313 00:21:31.760 --> 00:21:34.959 The companies making contents 314 00:21:34.959 --> 00:21:36.680 cannot do this all 315 00:21:36.680 --> 00:21:40.920 So at the end, how the information from the experts 316 00:21:40.920 --> 00:21:44.719 are materialized is very important 317 00:21:44.719 --> 00:21:48.400 So these contents are 318 00:21:48.400 --> 00:21:51.119 developed into a cloud based system, 319 00:21:51.119 --> 00:21:53.800 so that students can study it 320 00:21:53.800 --> 00:21:58.599 anytime, anywhere 321 00:21:58.599 --> 00:22:00.599 Next is 322 00:22:00.599 --> 00:22:01.920 XR bus 323 00:22:01.920 --> 00:22:07.199 XR bus is what Suwon-si made 324 00:22:07.199 --> 00:22:10.000 Suwon-si made XR bus 325 00:22:10.000 --> 00:22:16.119 XR bus was made with the title of 1795 326 00:22:16.119 --> 00:22:20.858 Jeongjo, on his mother Lady Hyegyeong's 60th birthday, 327 00:22:20.858 --> 00:22:23.520 marched to the grave of Crown Prince Sado 328 00:22:23.520 --> 00:22:26.839 for 8 days 329 00:22:26.839 --> 00:22:28.959 which is called Eulmyowonhaeng 330 00:22:28.959 --> 00:22:32.520 This was recreated realistically 331 00:22:32.520 --> 00:22:35.760 So this, 332 00:22:35.760 --> 00:22:40.280 starting at Hwaseong Yeonmudae, a military training ground of Joseon 333 00:22:40.280 --> 00:22:44.719 for 30 minutes, it went from the south gate Paldalmun, 334 00:22:44.719 --> 00:22:48.479 to west gate Hwaseomun, and main gate Janganmun, 335 00:22:48.479 --> 00:22:51.040 then the north gate, Buksumun Hwahongmun 336 00:22:51.040 --> 00:22:54.160 coming back to Yeonmudae at the end 337 00:22:54.160 --> 00:22:56.239 XR bus had 338 00:22:56.239 --> 00:23:01.280 12 55 inch T OLED on both sides 339 00:23:01.280 --> 00:23:04.800 340 00:23:04.800 --> 00:23:07.560 they also made a different seating plan 341 00:23:07.560 --> 00:23:10.040 So instead of having 342 00:23:10.040 --> 00:23:12.439 seats on both sides, 343 00:23:12.439 --> 00:23:13.880 there were seats in the middle 344 00:23:13.880 --> 00:23:15.040 Because that way, 345 00:23:15.040 --> 00:23:19.479 people would be able to see the images in the T OLED 346 00:23:19.479 --> 00:23:22.479 so they put the seats that way 347 00:23:22.479 --> 00:23:25.319 And the transparent OLED 348 00:23:25.319 --> 00:23:28.479 going a step ahead of a normal OLED 349 00:23:28.479 --> 00:23:33.439 had been divided into a self-luminous WRGB pixel area 350 00:23:33.439 --> 00:23:35.680 and a transparent area 351 00:23:35.680 --> 00:23:37.760 and these were closely intersected with each other 352 00:23:37.760 --> 00:23:40.959 The strength of a transparent OLED is 353 00:23:40.959 --> 00:23:45.959 First, when riding the bus, 354 00:23:45.959 --> 00:23:47.319 you can see out the window 355 00:23:47.319 --> 00:23:51.199 But if the screen switches to the video 356 00:23:51.199 --> 00:23:56.040 the real outside and the video becomes translucent 357 00:23:56.040 --> 00:23:57.479 being able to see both 358 00:23:57.479 --> 00:24:00.160 So when the pixel area lights up 359 00:24:00.160 --> 00:24:01.800 it acts as a display 360 00:24:01.800 --> 00:24:04.800 but normally, it acts as a window with 40% transparency 361 00:24:04.800 --> 00:24:07.760 being able to see outside as well 362 00:24:07.760 --> 00:24:13.000 So this XR bus' production itself 363 00:24:13.000 --> 00:24:14.959 actually is considered 364 00:24:14.959 --> 00:24:20.479 to be made after seeing the content Field Trip to Mars 365 00:24:20.479 --> 00:24:24.640 which will be explained next 366 00:24:24.640 --> 00:24:27.800 This XR bus is in a way 367 00:24:27.800 --> 00:24:33.839 the process of marching through the Suwon Hwaseong 368 00:24:33.839 --> 00:24:35.400 being screened on both left and right 369 00:24:35.400 --> 00:24:38.640 while moving in the bus 370 00:24:38.640 --> 00:24:40.319 It is screened 371 00:24:40.319 --> 00:24:45.359 If the XR bus was to give a bit more realistic feeling 372 00:24:45.359 --> 00:24:50.119 then when moving 373 00:24:50.119 --> 00:24:56.000 if it showed images that matched the spaces 374 00:24:56.000 --> 00:25:00.719 the effect of that experience would have been maximized 375 00:25:00.719 --> 00:25:05.920 but at the time it was played on both sides 376 00:25:05.920 --> 00:25:08.719 like a video being 377 00:25:08.719 --> 00:25:10.400 seen on both sides 378 00:25:10.400 --> 00:25:13.800 So with the seats in the middle 379 00:25:13.800 --> 00:25:15.800 audience, the experiencers were sat there 380 00:25:15.800 --> 00:25:20.520 and watching the walls on both sides, they would see 381 00:25:20.520 --> 00:25:23.199 how the Eulmyohaengcha was done 382 00:25:23.199 --> 00:25:28.160 At that time, this content was produced 383 00:25:28.160 --> 00:25:31.959 as a part of the smart city project 384 00:25:31.959 --> 00:25:34.439 with a lot of companies in consortium 385 00:25:34.439 --> 00:25:36.439 This XR bus 386 00:25:36.439 --> 00:25:41.239 can be used a lot in other local governments 387 00:25:41.239 --> 00:25:44.439 and the real space and content 388 00:25:44.439 --> 00:25:46.119 being matched interactively 389 00:25:46.119 --> 00:25:48.920 maximizes the effect of 390 00:25:48.920 --> 00:25:51.719 delivering the information 391 00:25:51.719 --> 00:25:53.640 or the things you can see in the real space 392 00:25:53.640 --> 00:25:55.880 So XR bus, 393 00:25:55.880 --> 00:25:58.199 in the case of Italy 394 00:25:58.199 --> 00:26:01.280 had VR bus, which when you ride this bus 395 00:26:01.280 --> 00:26:03.920 moving around the tourist attractions 396 00:26:03.920 --> 00:26:08.719 you could see the information there 397 00:26:08.719 --> 00:26:13.880 Another example I often give for realistic content is 398 00:26:13.880 --> 00:26:17.439 a project called Field Trip to Mars 399 00:26:17.439 --> 00:26:19.520 This project was 400 00:26:19.520 --> 00:26:23.040 done by Lockheed Martin 401 00:26:23.040 --> 00:26:28.599 with marketing purposes 402 00:26:28.599 --> 00:26:32.439 For Field Trip to Mars 403 00:26:32.439 --> 00:26:35.319 the production process and 404 00:26:35.319 --> 00:26:38.000 promotion video for Field trip to Mars is on Youtube 405 00:26:38.000 --> 00:26:39.920 First of all, it's a school bus 406 00:26:39.920 --> 00:26:44.400 Students get on the school bus 407 00:26:44.400 --> 00:26:48.599 And the students are told 408 00:26:48.599 --> 00:26:52.000 that they are going on a field trip by their teacher 409 00:26:52.000 --> 00:26:54.280 We're going here for a field trip 410 00:26:54.280 --> 00:26:55.719 Let's have fun 411 00:26:55.719 --> 00:27:00.719 The kids are excited getting on the school bus 412 00:27:00.719 --> 00:27:04.239 As it goes through the road 413 00:27:04.239 --> 00:27:07.000 the screen suddenly changes 414 00:27:07.000 --> 00:27:12.560 and shows the perspective of a car running on the surface of Mars 415 00:27:12.560 --> 00:27:16.359 So the title Field trip to Mars means 416 00:27:16.359 --> 00:27:18.959 a field trip to Mars(in Korean) 417 00:27:18.959 --> 00:27:21.719 So at first, the kids 418 00:27:21.719 --> 00:27:24.839 were excited thinking they were going to play outside 419 00:27:24.839 --> 00:27:28.079 They were happy just by that thought 420 00:27:28.079 --> 00:27:31.359 but with the image of Mars 421 00:27:31.359 --> 00:27:34.119 on both sides 422 00:27:34.119 --> 00:27:37.160 And they are not just still images 423 00:27:37.160 --> 00:27:40.479 Videos are playing 424 00:27:40.479 --> 00:27:43.079 and they interact with the real environment 425 00:27:43.079 --> 00:27:44.760 So how it works is 426 00:27:44.760 --> 00:27:49.160 if the bus shakes while it takes a turn or goes over something 427 00:27:49.160 --> 00:27:53.479 the Mars space also shakes 428 00:27:53.479 --> 00:27:59.160 And there are also scenes where an agent in the 429 00:27:59.160 --> 00:28:03.520 Mars station talks to them 430 00:28:03.520 --> 00:28:07.000 When Lockheed Martin did this project 431 00:28:07.000 --> 00:28:10.079 it was they that paid and 432 00:28:10.079 --> 00:28:12.560 the company who made it was a separate company 433 00:28:12.560 --> 00:28:16.079 And they bought a school bus 434 00:28:16.079 --> 00:28:19.040 They bought it and completely renovated it 435 00:28:19.040 --> 00:28:21.719 Because as I told you before 436 00:28:21.719 --> 00:28:25.400 when they're running on the road 437 00:28:25.400 --> 00:28:27.280 the images would show accordingly 438 00:28:27.280 --> 00:28:32.280 So GPS, 3-axis accelerometer, magnetometer 439 00:28:32.280 --> 00:28:36.239 or laser surface velocimeter was needed to be installed 440 00:28:36.239 --> 00:28:39.880 So the bus was completely remodeled 441 00:28:39.880 --> 00:28:44.359 and 4K resolution transparent LCD display 442 00:28:44.359 --> 00:28:45.959 was installed on both sides 443 00:28:45.959 --> 00:28:48.439 So what the students didn't realize was 444 00:28:48.439 --> 00:28:51.040 when they were getting on the bus 445 00:28:51.040 --> 00:28:52.319 they could see the window 446 00:28:52.319 --> 00:28:53.839 and see what's outside, 447 00:28:53.839 --> 00:28:55.760 the things passing by outside 448 00:28:55.760 --> 00:29:00.359 So they thought 'we're passing by here' 449 00:29:00.359 --> 00:29:04.520 but when it suddenly changes to Mars, they were very surprised 450 00:29:04.520 --> 00:29:09.640 But if this was just played as a video 451 00:29:09.640 --> 00:29:12.040 then the shock wouldn't have been as big 452 00:29:12.040 --> 00:29:16.199 But with real magnetometer or 3-axis accelerometer 453 00:29:16.199 --> 00:29:18.400 and surface velocimeter, 454 00:29:18.400 --> 00:29:20.640 everything was coordinated 455 00:29:20.640 --> 00:29:24.439 so the experience of the children would have been maximized 456 00:29:24.439 --> 00:29:27.920 So this Field trip to Mars, 457 00:29:27.920 --> 00:29:34.760 I consider it to be the best case among realistic contents that were 458 00:29:34.760 --> 00:29:36.560 done in real physical spaces while being on an object 459 00:29:36.560 --> 00:29:39.560 Because how immersed the kids were were 460 00:29:39.560 --> 00:29:41.199 pretty good 461 00:29:41.199 --> 00:29:43.959 So through this 462 00:29:43.959 --> 00:29:48.239 the kids could resolve their curiosities about Mars 463 00:29:48.239 --> 00:29:51.439 or how the surface of Mars looks 464 00:29:51.439 --> 00:29:55.040 These things would have been limited when 465 00:29:55.040 --> 00:29:57.000 it was taught just in class 466 00:29:57.000 --> 00:29:58.680 but since they're feeling like they are 467 00:29:58.680 --> 00:30:01.079 actually going to that place in a bus 468 00:30:01.079 --> 00:30:03.599 the educative effect would have been bigger 469 00:30:03.599 --> 00:30:05.959 This educative effect was generated 470 00:30:05.959 --> 00:30:08.599 with the screen showing them taking a turn 471 00:30:08.599 --> 00:30:11.479 when the bus took a turn, and when the bus shook 472 00:30:11.479 --> 00:30:14.640 the screen also shook making the experience 473 00:30:14.640 --> 00:30:17.319 more effective 474 00:30:17.319 --> 00:30:20.959 Next, where the concept of XR is most used is 475 00:30:20.959 --> 00:30:23.359 XR studios recently 476 00:30:23.359 --> 00:30:24.880 XR studios are 477 00:30:24.880 --> 00:30:28.119 before, they would film with 478 00:30:28.119 --> 00:30:30.479 blue screens or silver screens as a background 479 00:30:30.479 --> 00:30:34.839 And then they would add the background 480 00:30:34.839 --> 00:30:40.199 Recently, having LED display on the background and on the floor 481 00:30:40.199 --> 00:30:44.359 or sometimes even on the ceilings 482 00:30:44.359 --> 00:30:47.719 so even without going to a specific location 483 00:30:47.719 --> 00:30:49.680 they would be able to film 484 00:30:49.680 --> 00:30:52.839 with high quality end product 485 00:30:52.839 --> 00:30:54.959 XR studios are actively used not only in Korea 486 00:30:54.959 --> 00:30:57.239 but also in other countries as well 487 00:30:57.239 --> 00:31:00.439 Especially when COVID-19 hit 488 00:31:00.439 --> 00:31:03.079 when it was hard to film abroad 489 00:31:03.079 --> 00:31:07.439 XR studios could make it possible to make it look like 490 00:31:07.439 --> 00:31:11.199 it was filmed abroad and the costs would be cut as well 491 00:31:11.199 --> 00:31:14.880 so that the production was much more effective 492 00:31:14.880 --> 00:31:16.959 These things are possible with 493 00:31:16.959 --> 00:31:20.719 the videos screened on LED, 494 00:31:20.719 --> 00:31:23.000 materializing them, 495 00:31:23.000 --> 00:31:24.719 the camera that captures it, 496 00:31:24.719 --> 00:31:27.760 and real-time rendering 497 00:31:27.760 --> 00:31:29.040 becoming one 498 00:31:29.040 --> 00:31:31.800 which makes this possible 499 00:31:31.800 --> 00:31:35.239 In The Mandalorian 500 00:31:35.239 --> 00:31:37.839 they used this XR studio 501 00:31:37.839 --> 00:31:40.839 to minimize the process 502 00:31:40.839 --> 00:31:43.959 and cut costs 503 00:31:43.959 --> 00:31:47.599 So the strengths of XR studio is 504 00:31:47.599 --> 00:31:50.160 using real time engine 505 00:31:50.160 --> 00:31:53.599 and enlarging the display itself 506 00:31:53.599 --> 00:31:55.479 the space is covered with it 507 00:31:55.479 --> 00:32:01.599 So in a way, a scene that was impossible to make before, 508 00:32:01.599 --> 00:32:04.359 constantly changing the space and environment 509 00:32:04.359 --> 00:32:06.920 has become possible to do in real time 510 00:32:06.920 --> 00:32:09.319 and that way, when actors are acting 511 00:32:09.319 --> 00:32:13.680 the flow would also be 512 00:32:13.680 --> 00:32:15.880 much more connected 513 00:32:15.880 --> 00:32:17.520 Taking a look into cases of use, 514 00:32:17.520 --> 00:32:18.560 XR studios have 515 00:32:18.560 --> 00:32:21.640 used unreal engines as well 516 00:32:21.640 --> 00:32:24.400 and in there, virtual scenes, 517 00:32:24.400 --> 00:32:27.079 lighting, effecting would be done all at once 518 00:32:27.079 --> 00:32:29.040 So in a way 519 00:32:29.040 --> 00:32:33.479 post process is shortened 520 00:32:33.479 --> 00:32:37.640 And this part can 521 00:32:37.640 --> 00:32:41.160 also be used in bringing up the density 522 00:32:41.160 --> 00:32:45.479 So this virtual production workflow 523 00:32:45.479 --> 00:32:48.959 can eliminate outside fliming 524 00:32:48.959 --> 00:32:51.040 and complex VFX scenes 525 00:32:51.040 --> 00:32:54.800 can be generated within the camera 526 00:32:54.800 --> 00:32:56.319 which are strengths of it 527 00:32:56.319 --> 00:33:00.719 And making 3 to 4 sets simultaneously 528 00:33:00.719 --> 00:33:02.400 actors could move from one to another 529 00:33:02.400 --> 00:33:06.000 and film at different locations at the same time 530 00:33:06.000 --> 00:33:08.520 which is another strength 531 00:33:08.520 --> 00:33:10.439 The last thing is 532 00:33:10.439 --> 00:33:15.479 where XR technology is used 533 00:33:15.479 --> 00:33:17.880 These days, XR technology is 534 00:33:17.880 --> 00:33:20.280 also used in mobility field a lot 535 00:33:20.280 --> 00:33:23.599 Sony and Honda 536 00:33:23.599 --> 00:33:26.079 working together in Sony Honda Mobility 537 00:33:26.079 --> 00:33:30.760 made the car AFEELA 538 00:33:30.760 --> 00:33:34.479 In this car, AI technology 539 00:33:34.479 --> 00:33:37.800 and entertainment VR AI 540 00:33:37.800 --> 00:33:40.040 were equipped 541 00:33:40.040 --> 00:33:43.920 so that in that mobility car 542 00:33:43.920 --> 00:33:47.239 one could experience all 543 00:33:47.239 --> 00:33:48.680 visual entertainments 544 00:33:48.680 --> 00:33:51.920 experiences 545 00:33:51.920 --> 00:33:54.599 So here 546 00:33:54.599 --> 00:33:58.439 they integrated 5G, WiFi, GPS, 547 00:33:58.439 --> 00:34:01.640 cloud, wireless updating 548 00:34:01.640 --> 00:34:04.160 and everything like this 549 00:34:04.160 --> 00:34:07.079 so that everything could be done 550 00:34:07.079 --> 00:34:10.159 in the car 551 00:34:10.159 --> 00:34:11.639 And not only Sony 552 00:34:11.639 --> 00:34:14.399 but many domestic car brands 553 00:34:14.399 --> 00:34:17.639 like Hyundai and Kia 554 00:34:17.639 --> 00:34:20.879 are incorporating this XR technology 555 00:34:20.879 --> 00:34:23.959 to make it possible to do these 556 00:34:23.959 --> 00:34:27.100 various experiences 557 00:34:27.100 --> 00:34:29.639 Today we learned about hologram 558 00:34:29.639 --> 00:34:32.479 and XR 559 00:34:32.479 --> 00:34:34.639 Hologram, 560 00:34:34.639 --> 00:34:37.879 especially volumetric display 561 00:34:37.879 --> 00:34:40.280 did not have limitations in the viewing angle 562 00:34:40.280 --> 00:34:43.719 and was free of dizziness and natural 3 dimension screening was possible 563 00:34:43.719 --> 00:34:46.239 which are its strengths 564 00:34:46.239 --> 00:34:51.224 but also had limitations in spaces and generated noise 565 00:34:51.224 --> 00:34:55.320 XR technology was used in Korean medicine 566 00:34:55.320 --> 00:34:59.600 filming sites and in cars 567 00:34:59.600 --> 00:35:01.800 This technology was incorporated 568 00:35:01.800 --> 00:35:04.120 in these fields 569 00:35:04.120 --> 00:35:06.760 Thank you for taking this lecture 570 00:35:08.771 --> 00:35:12.021 Summary Hologram materializing technology Analog hologram Laser-filmed 3-dimensional video image-generating technology A method of recording and playing the wave interference of the object 571 00:35:12.021 --> 00:35:13.621 Digital hologram Generating holograms with the 3-dimensional digital data acquired with image sensor filming, a technology that can be saved and edited 572 00:35:13.621 --> 00:35:15.246 Generate 3-dimensional videos using spacial light modulator that controls light's amplitude or phase 573 00:35:15.249 --> 00:35:17.462 Hologram materializing technology Volumetric display Technology that generates image right into a 3 dimension space Using voxel to make 3 dimensional image in physical 3 dimension space 574 00:35:17.462 --> 00:35:19.974 No limit in viewing angle and generates natural 3 dimensional image free of dizziness Has limits in spaces, generates noise Pseudo hologram Floating method 575 00:35:19.974 --> 00:35:22.259 Started from Pepper's ghost in 1862 Interaction possible between the hologram image and the actual performer on stage 576 00:35:22.259 --> 00:35:24.652 XR content application cases Korean medicine Make a body part into a dummy sculpture Effect maximized when digital information is screened on an analog object 577 00:35:24.652 --> 00:35:26.987 Quadrature XR showed the depth needles went it, reactions of blood vessels and muscles XR bus Suwon-si XR bus to 1795: recreated the 8-day-long Eulmyowonhaeng where Jeongjo marched to the grave of 578 00:35:26.987 --> 00:35:28.137 Crown Prince Sado for Lady Hyegyeong's 60th birthday Transparent OLED: intersect self-luminous WRGB pixel area and transparent area 579 00:35:28.137 --> 00:35:29.269 Field trip to Mars Renovated a school bus to show as if they were on Mars Installed GPS, 3-axis accelerometer, magnetometer, laser surface velocimeter on the bus 580 00:35:29.269 --> 00:35:32.769 XR content application cases XR studios Installing LED display in the place, possible to film without moving to locations Production cost is cut and production efficiency is maximized 581 00:35:32.769 --> 00:35:36.229 Sony Honda Mobility's AFEELA Everything can be done in a car