Let’s look at the definition of VR
And look into examples of VR apps
That are in service
Next, to create VR content with Unreal Engine
We will install the SDK necessary
And practice-related environment settings
Let's learn how to implement
Unreal's PIE method in a VR Preview method
Suitable for VR
From this lesson, we will learn about
VR content development
VR Definition and Examples
Now, let’s take a look at the definition of
What virtual reality is
If you look at the wiki
This is how virtual reality is explained
It is sometimes expressed as referring to a specific environment or situation
Similar to reality but not real
Or the technology itself
Created through artificial technology using computer systems, etc.
In addition, users are not only immersed in virtual reality
But by using existing devices
Such as operating or executing commands
You can interact with things implemented in VR
It is expressed this way
It may seem a bit difficult just to look at the text
But if you think about it
Within the limited size of a monitor
Based on the size of the monitor
In proportion to its size
We visually see content
Equipping a device on our head
No matter where we turn our heads
Makes it appear as if we are within our field of vision
So, I think content with more visual scalability
Can be considered virtual reality content
So, than a computer monitor
The advantage is that it has a wider 360-degree viewing angle
And using a controller
You can interact
So making the content
More immersive and realistic
It can be the advantage
So, what kind of content is created
Using VR technology
Regarding VR, there is a game called Beat Saber on the left
That everyone has probably seen at least once
This is a game where you cut a box by swinging a knife
Toward the arrow indicated on the box to the music
That we use our bodies
To avoid the red and blue boxes flying from all directions
While moving our bodies
This can be seen as a very good representation of
The specific movement effects of VR
In addition, such as VR's Astronauts
And Steam's Half-Life Alyx
There are many successful VR game content
What those contents have in common is that
Using a conventional keyboard, mouse
Or pad to playing games
Through a wider viewing angle
And more three-dimensional body movements
To enjoy the game content
The sense of immersion is much higher
In that you can enjoy the game content
Next, there are VR meeting apps
Such as Spatial or VR Chat
Gather real people's voices and motions in a space
Through network play
Giving the same effect as
Multiple people meeting directly in one space
VR-type Office apps
These things were very famous
So, in particular, these content
Began to become common due to COVID-19
VR meeting apps can be seen as one of the contents
That suddenly increased a lot as non-face-to-face meetings
In addition, such as VR movies
And VR animations
Many genres of content related to VR
The same goes for architectural simulations
And there are a lot of space exploration simulations
That have come out as VR content
Therefore, it is expected that VR will
Continue to establish itself as content
That enhances a certain sense of immersion and presence in the future
Setting Up a VR Development Environment
To develop Oculus content
You will first need Unreal Engine
In addition to Unreal Engine
You need a program called
Oculus Link that connects Oculus and your PC
In the case of Oculus, it has Android OS
The same OS as Android phones
So, since it is made in a mobile format
You will need Oculus Link Software
Also, as I mentioned, since the Android OS is used
When packaging it as an actual service app later
It must be developed using the Android method
So, you have to install it as an APK file
This is the same as installing
SDK, NDK, JDK, etc.
When creating AR content
However, the contents that need to be set
In some project settings windows
May differ slightly from those in AR
Next, inside Oculus
There is something called the Oculus Store
So, in the Oculus Store
To purchase content sold by others
Or display your avatar
During multiplayer
Using a mobile app called Meta
You must connect your account
The account for the Meta app on your phone
And the VR head-mounted display device
You are wearing
Must be set to the same account
So first
Let's install Oculus Link
When installing Oculus Link, on Google
Oculus Quest link software
Search this
Then the first thing is
Called Setup Your Quest
When this page opens
The one currently used in the course is
Based on Quest 2
I will install Quest 2
To connect Oculus to a PC via USB
Let's first download
The software needed
Once the download is complete, proceed with the installation
And click Start to agree to the terms and conditions
To install the software
Simply specify the path you want
And then install it
If you look here, it says that
At least 3.4 GB of space is required
So I think you just need to make sure that
The drive where you want to install the hard disk
Has enough space for more than this
Without making any changes
I will install it to that path
Once installation is complete, click the Next button
When asked to add Quest2 to your PC
To access Rift App games and VR experiences
Just press the button to continue
There is a way to connect via Bluetooth
And there is a way to connect via USB
In the case of Bluetooth, if Bluetooth is not supported
In the computer environment
Or if there are many people around using Bluetooth
There may be some confusion
So I recommend
Connecting the link safely during development
Please select a link (cable)
I'll press continue
To connect the headset, just click Continue
I'll try clicking the connection test once
It is connected now
But it is said that the connection is unstable
So that I will finish the setup in this state for now
It may be because the USB is not connected properly
The Devices tab says that OpenXR runtime is
Not set as default
Click the Set this as default button
And go to General in Settings
Many people probably have Unknown Sources turned off
So click this once and click Allow
Please turn on unknown sources
Next, OpenXR Runtime
The one above is
For OpenXR Runtime
If you press the Set button
The warning window above will disappear
And after a while, the indication that
Meta Quest is set will be disabled
There is no need to change anything else after that
On the beta side, there is something called a developer runtime feature
Since we are now using it for development as developers
To use this VR device for development
We will turn on this developer runtime feature
There are several options below
Which I will explain later
Let's leave it like this for now
Some people may not have
The Developer Runtime feature here
I have the developer runtime turned on
To use the runtime function
Most people doing it for the first time will
Probably only have the demo mode here
And there will be no developer runtime features
Or anything below this
In the future, there will be cases where this part is not present
So for this developer runtime function to appear
When we first
Turned on Oculus
We would have installed Meta app
And connected
By linking your account to your phone
You can only turn on the Oculus headset
I think you will have already
Installed the phone app
So, we probably installed an app called Meta Quest
From PlayStore or, in the case of iPhone
From the App Store, this Meta Quest
Will be installed
Then, open this Meta Quest app
Here, the device
Select the device we are currently connected to
Select the menu tab
And enter the device here
In my case
If you go from our device to the currently connected device
And go into the headset settings
There is a thing called developer mode
If you go into it, I probably have a button like this
But most of you probably don't have a button
So, to create this button
You need to register this account on the Meta homepage
So, let’s search for
An Oculus developer on Google
Then, on the first page
There will be something called Oculus Developer Center
Go to this page
When the page opens like this, wait a moment
And you will be logged in to your account
If you are not logged in
Please log in
If you're logged in
There will be a button like this here called My Apps
So, let me click this button once
Then, you still don't have the Developer Tools tab
There will be no such thing as an Org Manager
I have this now
But you probably don't have this at all
So, if you click here, you will see a Create button
By clicking the create button here
You need to create a new organization
It asks you to enter a company name or something like that
In my case, I'm using my company account
But if you are not associated in any company
You can just enter any name
You can temporarily put in your company name
So you can just put in any name
And there won't be any problems or anything like that
Until it is serviced
There are no problems during development
I'll add something like
Hunet to the group name
It looks like the name Hunet already exists
Then, I will create a group
Name as HunetVR
Please check, I understand
That you have read the terms and conditions below
Then I'll hit submit
Confidentiality Agreement
Please read this carefully
Check the box to agree, and click the submit button.
Then, you will see a developer tab
Called HunetVR
Then, there should be an app here
That says we are developing an app
But there is currently no app
So, let me click on
The button here called Create New App
The name of the app will be HunetVRApp
Then
Since we are now building for Meta Quest
Please check Meta Quest
After you create it
A screen like this will appear
Now, when we actually create an app
Upload the packaged
Build file here
Then submit it
And if the Oculus server checks it
And says there are no problems
It will be approved
And if approved, it will be released
This means you can use it as an app
That can be downloaded from the Oculus Store
However, for now
We are only practicing development
So we will not submit the app
However, you need this to
Open the developer app and account
So create one
So, if this part is complete
Return to your phone
And there will be a menu at the bottom
Which is common for Android and iPhones
Please click the menu tab
If you look inside the menu button, you will see a device button
Device
So, please select the connected device
It will say Device Management like this
If you look at the bottom of the device management page
You will see headset settings
In the headset settings, there is a developer mode
In developer mode
If you have made an app
There will be a button here
Called debug mode
If you touch this button once
Debug mode will now turn on
Right now, I'm having trouble connecting my cell phone well
So it's like this, but if you press this
You'll see a motion where the button turns on like this
Then, again
Turn on the Meta Quest Link software
From here, go to the Settings tab
And go to Beta
You will now be able to turn on the developer runtime
This item will be created and when you press the button
It will turn on like this
I said I don't have anything to touch on the ones below
But here
You can turn on and off a few features
That developers can use for testing purposes
For example, Paththrough
Camera, I mean, there is an AR camera
In the case of the AR camera
That we use to specify the range
We can now turn it on and off
Directly
Or turn on this function
Or a function called Eye Tracking
That tracks the position of our eyes
And moves the cursor
To match your voice or turn on these features
To change your avatar's expression
There are many experimental features
Allowing you to turn these functions on
However, rather than experimental functions
We are now focusing on learning
The basic functions of VR
I think you only need to turn on the developer runtime function
If you come back to Devices
The USB cable was plugged in loosely
So it wasn't recognized before
But now it will be displayed like this
It is said that a USB3 connection is recommended
But, even if it is not necessarily a USB3 cable
There is no problem with connecting to a USB2 cable
However, it is said that the stuttering is slightly improved
But there is no significant difference
So I will just leave it connected to USB2
And if you press the button on both your right and left hand once
The button will be recognized
And appear here
Right-hand Touch, left-hand Touch
Then here on the computer
On Quest2 and Touch
If you press the right arrow
Here in the settings, at the bottom
There is listening to VR audio on the computer
And listening to computer audio in VR
So, when a sound comes out of the computer
The VR device also has speakers that can be used
Are you going to make the sound come out of that as well?
If both are played simultaneously, it will be a bit noisy
So it would be better if the sound comes from only one side
I decided to listen to the audio on my computer for now
I'll turn off listening to audio in VR
If there is no sound from the device
And I need to make sound from the device in the future
I will set it to turn on occasionally
Then
The Oculus Quest Link settings
Will appear like this on Quest
So, among them
If we click the Activate button
It will be connected to Quest's Link
If you wait a little while
A white screen like this will appear
At the bottom, there is a menu board that we can choose from
With a semicircle on the bottom and an oval shape
If you have reached this point, this white screen
Indicates that your PC and Oculus are connected
From now on
We will use the Unreal app to turn it on
Turn on Unreal Editor
We will create a new VR project for you
First, go to the Games tab
Among the various templates in the Games tab
There is one called Virtual Reality
Virtual Reality
Select the Virtual Reality tab
At the bottom
I will run the project
With the name HunetVR in the Project Name
Wherever you want
You can specify the route
Let's just name the project
HunetVR
And if you look at the top
There is an item called Starter Content of Virtual Reality
First, check to include
The necessary Starter Contents
And click the Create button
To create a project
What you need to pay attention to at this time is
VR Oculus Link, that white screen from before
You have to be careful that
The white screen has to be on
While the link is connected to the white screen
You must turn on Unreal Engine
For Unreal Engine to recognize VR
Once the project is running
Click the play button at the top
To play it
If you play using the traditional play method
You cannot connect to any VR
To connect to VR
You need to change the play mode
So, next to this Play mark
There are three dots
If you click this three-dots symbol
A pop-up window will open like this
If you click VR Preview in this pop-up window
The screen of the VR device
Will look like this on the screen
You can see the screen clearly like this
If you use VR now
If this window
This VR Preview window
It is disabled and cannot be selected
For those who say that selection is impossible
Please close the editor completely
And Oculus Link
Whether the Oculus Link screen appears properly
And whether it is activated with this white screen first
Those should be checked
You must turn on Unreal Engine
With a white screen like this
To turn on VR Preview mode
So, like this
If you look at the controller in front
You will see your hands like this
If you lightly place your hand on the button on the controller
You will see your fingers moving
In accordance with it
When you press the button
You will see your fingers moving like this
To hold and unfold it like this
First, there will be a Thumb Stick on the right-hand controller
And a stick-like stick on the joypad
The one moving with the thumb
If you push it forward
A line will appear like this
If you aim well at the place you want to go with this line
And release the Thumb Stick from there
You will be teleported
And move instantly like this
In this state, to the box you want to hold
You put your hand close
Then bend your middle finger to reach the button
Called a Hand Grip
If you press the Hand Grip button
The object will be grabbed like this
Objects can be caught
And if you throw them like this and let go, they can also be thrown
Shall we pick up the gun in front of us?
If you pick up a gun like this
And press the index finger button, a bullet will be fired like this
Also, if you draw a teleportation line with your thumb
And go near the bonfire over there like this
You will hear a little noise nearby
And if you shoot a bullet
You can remove these glowing sticks like this
If you turn to the left like this
You can turn the screen
Or your head directly
Then I move over there again
And pick up a box
If we throw it here like this
Or as just as before
Pick up a gun
And fire it like before
We can try things like moving the ball
In this way
By moving little by little in this way
I think it would be good for you to be able to experience
Little by little how VR moves
When you press the VR Preview button
The editor is completely turned off and minimized
And a Preview window appears
If you do not like this and want to leave the editor window as is
And open a separate Preview window
Go to Editor Preferences in Edit
Please select Editor Preferences
Here
If you search for VR
VR
Should Minimize Editor on VRPIE
In other words, PIE stands for Play In Editor
In VR play mode
There will be a check on whether or not to minimize the editor
Let me uncheck it
Now
Even when you open the VR Preview window
While the editor remains in place
You can see that only the VR Preview window is created separately
By pressing Shift+F1
You can still make the mouse cursor appear now
In this state, you can maximize it
And display it in full screen
Then go to Edit-Project Settings…
Go to and scroll down to the bottom
And select Android from Platforms at the bottom
If you select Configure Now
The red window will turn blue
And you will see that the platform is available
This is now Android
In the case of VR Oculus Quest
The OS is Android
So you can set it up the same way as your Android phone
So Android Package Name
Android Package Name is
Like we did last time, in AR time
Hunet
The company name must be in the middle
So, let's put Hunet as the company name
And HunetVR as
The project name
Next, in the case of SDK Version
We will install from version 23 to version 32
Which we currently have installed
For AR, it started at 25
But for VR, it started at 23, which is one level lower than that
You can specify from 23 to 32
The latest version currently installed
Next, check Package game data inside .apk?
If possible, when testing
It is best to check this
So that all data can be compressed into one file
After that, there isn't much to do with the rest
What's a little important is that when doing AR last time
You only checked OpenGL
Or Support x86_64 above
But in the case of VR
You cannot use OpenGL
And you must use Vulkan
So, AR and VR are opposites of each other
It would be better to know that
Different graphics frameworks are being used
After that, there is nothing special to check, as shown below
Android SDK
Go back to the Android SDK tab on the left at the bottom
You can also set the SDK
NDK, and then JBR paths set last time
To be the same as for AR
And it's all the same below here
The settings related to build packaging
Can be considered almost similar
As mentioned earlier
There is a difference between the graphics framework Vulkan and OpenGL
Next, the minimum SDK allowed starts from 23
I think you can see that this is the only difference
In the case of Target Hardware
Let's go into Target Hardware
In the case of Target Hardware
You must set it to Mobile
And then Scalable
Other existing apps would often
Use Scalable for Desktop
But this time, the optimization method
Will be Scalable for Mobile
You probably know the difference between Desktop and Mobile
But the difference between Scalable and Maximum is
Whether you will optimize for the maximum efficiency
That the graphics engine can produce
Or whether you will use
A slightly more simplified graphics display method
No matter how well the mobile is made
Because the graphics card on the mobile
Has a completely different performance
From the graphics card on the desktop
It is a bit difficult to use Maximum
Especially in the case of VR, since the display of the device is
Displayed right in front of the eyes
Even a small drop in the frame can
Cause significant motion sickness
So it must be optimized very well
To achieve a frame rate of 70 or more
At least 70, or 75 frames per second
It must be maintained like that
So, it is a good idea to optimize as much as possible
So Scalable
Even if there is a slight loss in quality
It is much more important in VR to optimize
And not drop frames as much as possible
Then, it's all done for this time
Next time, we will create a new level
To create a VR-related phone
And receive input from the device
To implement things
Thank you for your hard work in taking the class for a long time
Thank you
I will summarize what we learned in this lesson
First, the Oculus Quest
Which is equipped with Android OS
To link with Unreal Engine, which is based on Windows OS
We installed Meta Quest Link Software
And use it
Second, with the OpenXR feature enabled
We found that only when Unreal Engine is loaded
VR Preview files are
Only available
Third, we learned that unlike AR, when developing VR content
As a graphics framework for project settings
Vulkan must be used
Fourth and finally
Due to the nature of VR headsets where the display is close to the eyes
To reduce dizziness
It should be noted that
High rendering frames of 70 frames per second or more are required
VR Definition and Examples
What is Virtual Reality(VR)?
With artificial technology using a computer system
A specific environment or situation created, that is similar to reality but is not real, or the technology itself
Users are not only immersed in virtual reality, but can also interact with things implemented in virtual reality
Such as operating or executing commands using real devices
Virtual Reality (VR) App Examples
Beat Saber Spatial
Set up VR development environment Essential software for developing content for Oculus Quest
Oculus Link Software Android development environment (SDK, NDK, JDK)
Meta app (mobile)
Install Meta Quest Link
Download and install Meta Quest Link software Select ‘Link (cable)’ as the connection method
Click ‘Settings-General’ to allow unknown sources Go to the Beta tab and enable developer runtime features
Register as a developer in Oculus Developer Center
Access Oculus developer page Click the ‘My Apps’ button at the top right
Click the ‘Create’ button in Org Manager
Click the ‘Create New App’ button and select the Meta Quest (App Lab) platform
Set up VR development environment Create a VR project
Select the ‘Virtual Reality’ template in the ‘Games’ tab Select VR Preview in the Play Modes selection window
Android Settings
By selecting 'Edit-Project Settings...', activate the Project Settings window
Click the 'Configuration' button in the Android tab to activate the Android platform
Set the Minimum SDK version to 23 and the Target SDK version to 32. 'Support Vulkan' must be checked
The SDK path is specified according to each installation location, like the AR settings
Select ‘Scalable’ of ‘Mobile’ as the project optimization setting to suit the Android OS
The End