KR20170079502A - virtual reality system to control vertical position of player using pressure proportional controller - Google Patents

virtual reality system to control vertical position of player using pressure proportional controller Download PDF

Info

Publication number
KR20170079502A
KR20170079502A KR1020150190162A KR20150190162A KR20170079502A KR 20170079502 A KR20170079502 A KR 20170079502A KR 1020150190162 A KR1020150190162 A KR 1020150190162A KR 20150190162 A KR20150190162 A KR 20150190162A KR 20170079502 A KR20170079502 A KR 20170079502A
Authority
KR
South Korea
Prior art keywords
virtual reality
user
display device
virtual
player
Prior art date
Application number
KR1020150190162A
Other languages
Korean (ko)
Inventor
황광일
Original Assignee
한국해양대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국해양대학교 산학협력단 filed Critical 한국해양대학교 산학협력단
Priority to KR1020150190162A priority Critical patent/KR20170079502A/en
Publication of KR20170079502A publication Critical patent/KR20170079502A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • H04M1/72522—

Abstract

The system of the system capable of controlling the vertical posture of the player using the pressure proportional control in the virtual reality according to the embodiment of the present invention is a system for experiencing and training a virtual environment spanning the same space as a real world space, A display device 100 that implements a scene map including a plurality of display devices 100 and a display device 100 and a pressure proportional control device 300 for controlling operation in a vertical and horizontal direction in a virtual environment, A motion controller 200 having a button; A program for realizing a virtual reality is connected to the display device 100 and an operation controller 200 through wired or wireless lines and the virtual reality information is displayed on the display device 100 according to data transmitted from the operation controller 200. [ And a central processing unit (300) for transmitting the vertical control signal to the player.

Description

In this paper, we propose a virtual reality system that can control the vertical position of player using pressure proportional control.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system capable of controlling a player's vertical posture using pressure proportional control in virtual reality using a head-mounted display (HMD) or a smart device.

In general, a head-mounted display (HMD) refers to various image display devices that allow an image to be worn on the head like a pair of glasses. 2. Description of the Related Art [0002] Various wearable computers (wearable computers) have been developed in accordance with the trend of weight reduction and miniaturization of digital devices, and such HMDs are also widely used. The HMD can be combined with augmented reality technology, N screen technology, etc., beyond the simple display function, to provide various convenience to the user.

The HMD can be used in conjunction with various digital devices. The HMD can be connected to a digital device via a network to output the content of the digital device, receive user input for the digital device, or perform an operation linked to the digital device.

As such, the head-mounted display is lightweight, so that the user can wear the head-mounted display like a pair of glasses. The user can receive digital information using the head-mounted display. Digital Information

And may include each information and auditory information. The user can control the visual information or auditory information according to the situation while viewing the visual information and auditory information by using the head-mounted display.

However, the head-mounted display may have low operability due to the characteristics of the apparatus. It is difficult to have various buttons on the surface of the head-mounted display. Accordingly, when viewing digital information using a head-mounted display, a method of controlling time information or auditory information through a simple operation is required. In particular, it is difficult to provide a sufficient touch sensitive area for controlling each information due to weight reduction and miniaturization of the head mounted display. Therefore, there is a problem that the head-mounted display must provide a method of controlling the selected control target information after selecting the control target information first.

On the other hand, mixed reality is a technology that enables virtual images to be mixed with the physical environment of the real world. A see-through, head mounted, mixed reality display device 100 may be worn by a user to view a mixed image of real objects and virtual objects displayed in the user's field of view . The head-mounted display device 100 can generate virtual objects and a three-dimensional map of the surroundings where real objects can be seen. The user can interact with the virtual objects, for example, by looking at the virtual object by selecting the virtual objects. Once selected, the user can then manipulate or move the virtual object, for example, by grabbing and moving a virtual object or by performing some other predefined gesture on that object.

This type of indirect interaction has drawbacks. For example, the position of the user's hand in the scene map generated by the head-mounted display device 100 may be estimated, and the estimated position may drift over time. As a result, the holding virtual object may be displayed off the user's hand. Choosing an object using head movements can also sometimes be counterintuitive.

With regard to the operation of the system for experiencing the mixed reality or the virtual reality as described above, there is a limitation in realistically experiencing the relative left / right or up / down motion with respect to the virtual object in direct interaction with the virtual object by the user .

Also, since 2016, disaster response education is included in the regular education contents at elementary and junior high schools, and education contents are strengthened. However, there is a real problem that current teaching materials and education tools deal only with the general contents of disasters, and it is difficult to respond to actual fire and disaster situations in actual situations.

In order to solve the above problems, in a system for experiencing and training a virtual environment that spans the same space as a space in a real world, a display device that implements a scene map including one or more virtual objects A motion controller coupled to the display device and including a pressure proportional control button for grasping a user and controlling operations in a vertical and a horizontal direction in a virtual environment; And a central processing unit that is connected to the display device and the operation controller by wired / wireless lines and includes a program for implementing a virtual reality and transmits the virtual reality information to the display device according to data transmitted from the operation controller, The present invention provides a configuration of a system capable of controlling the player's vertical posture using pressure proportional control.

The system capable of controlling the player's vertical attitude using pressure proportional control in a virtual reality according to an embodiment of the present invention is characterized in that in a configuration of a system for experiencing and training a virtual environment spanning the same space as a real world space, A display device (100) for implementing a scene map including objects, and a display device (100) for controlling the operation in the vertical and horizontal directions in a virtual environment A motion controller 200 having a control button; A program for realizing a virtual reality is connected to the display device 100 and an operation controller 200 through wired or wireless lines and the virtual reality information is displayed on the display device 100 according to data transmitted from the operation controller 200. [ And a central processing unit (300) for transmitting the control signal to the player.

On the other hand, the operation controller 200 is capable of controlling operations in up and down and left and right directions in a virtual environment, which the user grasps, proportional to the amount of force the user grasps and presses with the finger, And transmits the converted information to the central processing unit 300. The central processing unit 300 controls the movement speed, horizontal and vertical movement distance, and rotation angle of the user according to the transmitted numerical value And a control unit for controlling the vertical posture of the player using the pressure proportional control in the virtual reality.

The display device 100 can be applied to a head-mounted display (HMD) or a smart phone to be worn on a user's head.

At this time, a gyroscope and an accelerometer are mounted on the smartphone, and a microcontroller (MCU) having a gyroscope and an accelerometer is installed on one side of the HMD, .

Through the above-described configuration, the user operates the pressure proportional button provided with the grip force sensor which detects proportionally the amount of force applied by each finger provided to the operation controller 200, The data sensing the vertical height, the moving speed, and the angular variation of the user is transmitted to the central processing unit 300 to realize the virtual reality.

As another embodiment of the present invention, there is provided a system for experiencing and training a virtual environment that spans the same space as a real world space, comprising: a display device 100 that implements a scene map including one or more virtual objects; And the display device (100), the user can grasp and control the operation in the vertical and horizontal directions in the virtual environment, and the user senses the force proportionally with the amount of force that the user presses with the finger, Converts the pressure amount into a numerical value, and transmits the converted information to the central processing unit 300. The central processing unit 300 can control the moving speed, horizontal and vertical movement distance, and rotation angle of the user according to the transmitted numerical value A motion controller 200 having a pressure proportional control button;

A program for realizing a virtual reality is connected to the display device 100 and an operation controller 200 through wired or wireless lines and the virtual reality information is displayed on the display device 100 according to data transmitted from the operation controller 200. [ And a central processing unit (300) for transmitting the control signal to the player.

Meanwhile, the display device 100 may be a head-mounted display (HMD) or a smart phone that is worn on a user's head.

A gyroscope and an accelerometer are mounted on the smartphone, and a microcontroller (MCU) equipped with a gyroscope and an accelerometer is provided on one side of the HMD .

Through the above-described configuration, the user operates the pressure proportional button provided with the grip force sensor which detects proportionally the amount of force applied by each finger provided to the operation controller 200, It is possible to transmit data obtained by sensing the user's vertical height, moving speed, and angle change amount to the central processing unit 300, thereby realizing a virtual reality.

In a virtual reality system according to an embodiment of the present invention, when data is acquired from a gyroscope, an accelerometer, and a pressure control controller in a system capable of controlling the vertical posture of a player using pressure proportional control, To provide a system capable of experiencing and training various virtual realities by having the system operate independently (at the time of individual experience) or by transmitting the data to the server (when experiencing a group) so as to continuously change the viewpoint .

FIG. 1 is a configuration diagram showing a configuration of a system capable of controlling a vertical posture of a player using pressure proportional control in a virtual reality according to an embodiment of the present invention.
FIG. 2 is a diagram showing a configuration of a motion controller 200 in a configuration of a system capable of vertical orientation control of a player using pressure proportional control in a virtual reality according to an embodiment of the present invention.
3 is a diagram illustrating a state in which a system capable of controlling a player's vertical posture using a pressure proportional control in a virtual reality according to an embodiment of the present invention is applied.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. It is to be understood, however, that the spirit of the invention is not limited to the embodiments shown and that those skilled in the art, upon reading and understanding the spirit of the invention, may easily suggest other embodiments within the scope of the same concept.

For example, in the case of an elementary school, an elementary school with 900 students per class and 5 classes per grade is assigned to an elementary school which can control the player's vertical attitude using the pressure proportional control in the virtual reality according to the embodiment of the present invention. Try it. Students will receive similar disaster response training, even as the surrounding environment, such as the number and location of classrooms, will increase as students move up from grade 1 to grade 6. In other words, personalized education about how to cope in the classroom and place is impossible in the current situation. The contents of education about disaster and fire which we are currently receiving are all informing only designated evacuation routes and moving them accordingly.

If there is a short-circuit fire in the virtual lobby on the first floor of the school, there is a difference in the individual sense of the students' occurrence of the fire in the 1st grade and the 6th grade in totally different classrooms. It is very likely that evacuation routes should be changed according to the development situation, so evacuation training of various scenarios according to grade and class location is necessary.

From an individual evacuation point of view, when a fire occurs, the smoke expands from the top to the bottom. The evacuee (trainee) cuddles as the smoke falls in the aisle to avoid being disturbed by the visibility, A situation in which the user must gradually move his / her body down should be generated.

In the end, the most important thing in the fire response training is to identify the type of disaster (using virtual reality to fire, for example, in a specific space within a building), identify its location ) And disaster (fire in this case) according to the situation of the player moving body (body height and movement speed) at the same time evacuation route to determine the success of the escape, so that the training experience is needed to increase the level of training.

In order to experience such a virtual reality, there is a technique of sensing a human's position (dynamic behavior) in order to adjust the vertical height of the body in a virtual reality, but it is possible that all of them are expensive, In order to control the height of individual viewpoints at the same time, as described above, several hundreds of people participate at the same time, and the height of the individual viewpoints is controlled by the level of the user who is proposed in the practice of the present invention from the viewpoints of ease of operation, ease of operation, And the configuration of a pressure-proportional controller to control the vertical posture.

Meanwhile, in the embodiment of the present invention, the vertical control of the body height is used in the same sense as the camera position control in the virtual reality.

The virtual reality is implemented by a game engine such as Unity and Unreal, and the output value (height, movement, etc.) of the pressure proportional control controller converted into a digital value, the gyroscope, the accelerometer (For adjusting the angle) of the camera to convert the viewpoint of the camera.

In addition, the virtual reality in the embodiment of the present invention is implemented as a smart phone (Android, iPhone) or HMD. Gyroscope and Accelerometer are basically built in the smartphone, so it is possible to connect the pressure proportional controller to the smartphone by Bluetooth and collect the height, movement speed and angle change in the smartphone so that they operate independently (during personal training) And the data is transmitted at a time of group training to continuously change the viewpoint.

In this case, when using the HMD, a gyroscope and an accelerometer are mounted on separate MCUs such as Arduino and Raspberry Pie, and the MCU is attached to the side of the HMD. The MCU and the pressure control controller are wired or wireless.

On the other hand, data acquired from a gyroscope, an accelerometer, and a pressure control controller is transmitted to a PC connected to the HMD to be operated independently (during personal experience) or transmitted to a server (during a group experience) And has a configuration that continuously changes the viewpoint.

FIG. 1 is a configuration diagram showing a configuration of a system capable of controlling a vertical posture of a player using pressure proportional control in a virtual reality according to an embodiment of the present invention. FIG. 2 is a diagram showing a configuration of a motion controller 200 in a configuration of a system capable of vertical orientation control of a player using pressure proportional control in a virtual reality according to an embodiment of the present invention. 3 is a diagram illustrating a state in which a system capable of controlling a player's vertical posture using a pressure proportional control in a virtual reality according to an embodiment of the present invention is applied.

In the configuration of a system for experiencing and training a virtual environment that spans the same space as a real world space, a display device 100 that implements a scene map including one or more virtual objects, A motion controller (200) provided with a pressure proportional control button for interlocking with the device (100) and controlling the operation of the user in the vertical and horizontal directions in a virtual environment; A program for realizing a virtual reality is connected to the display device 100 and an operation controller 200 through wired or wireless lines and the virtual reality information is displayed on the display device 100 according to data transmitted from the operation controller 200. [ And a central processing unit (300) for transmitting the control signal to the player.

On the other hand, the operation controller 200 is capable of controlling operations in up and down and left and right directions in a virtual environment, which the user grasps, proportional to the amount of force the user grasps and presses with the finger, And transmits the converted information to the central processing unit 300. The central processing unit 300 controls the movement speed, horizontal and vertical movement distance, and rotation angle of the user according to the transmitted numerical value And a control unit for controlling the vertical posture of the player using the pressure proportional control in the virtual reality.

The display device 100 can be applied to a head-mounted display (HMD) or a smart phone to be worn on a user's head.

At this time, a gyroscope and an accelerometer are mounted on the smartphone, and a microcontroller (MCU) having a gyroscope and an accelerometer is installed on one side of the HMD, .

Through the above-described configuration, the user operates the pressure proportional button provided with the grip force sensor which detects proportionally the amount of force applied by each finger provided to the operation controller 200, The data sensing the vertical height, the moving speed, and the angular variation of the user is transmitted to the central processing unit 300 to realize the virtual reality.

As another embodiment of the present invention, there is provided a system for experiencing and training a virtual environment that spans the same space as a real world space, comprising: a display device 100 that implements a scene map including one or more virtual objects; And the display device (100), wherein the user can grasp and control the operation in the vertical and horizontal directions in a virtual environment, and the user senses the amount proportional to the amount of force that the user presses with the finger, Converts the pressure amount into a numerical value, and transmits the converted information to the central processing unit 300. The central processing unit 300 can control the moving speed, horizontal and vertical movement distance, and rotation angle of the user according to the transmitted numerical value A motion controller 200 having a pressure proportional control button; A program for realizing a virtual reality is connected to the display device 100 and an operation controller 200 through wired or wireless lines and the virtual reality information is displayed on the display device 100 according to data transmitted from the operation controller 200. [ And a central processing unit (300) for transmitting the control signal to the player.

Meanwhile, the display device 100 may be a head-mounted display (HMD) or a smart phone that is worn on a user's head.

A gyroscope and an accelerometer are mounted on the smartphone, and a microcontroller (MCU) equipped with a gyroscope and an accelerometer is provided on one side of the HMD .

Through the above-described configuration, the user operates the pressure proportional button provided with the grip force sensor which detects proportionally the amount of force applied by each finger provided to the operation controller 200, It is possible to transmit data obtained by sensing the user's vertical height, moving speed, and angle change amount to the central processing unit 300, thereby realizing a virtual reality.

In summary, in a virtual reality system having the above-described configuration, when a player can control the vertical posture of the player using pressure proportional control, a gyroscope, an accelerometer, a pressure control controller (Personal experience) by transferring the data acquired from the HMD to the PC connected to the HMD, or by transmitting data to the server (when experiencing a group), the time is continuously changed, And education.

100. Display device 200. Operation controller
300. Central Processing Unit

Claims (9)

As a system for experiencing and training virtual environments that span the same space as real world space,
A display device 100 that implements a scene map including one or more virtual objects;
A motion controller 200 interlocked with the display device 100 and equipped with a pressure proportional control button for grasping a user and controlling operations in a vertical and a horizontal direction in a virtual environment;
A program for realizing a virtual reality is connected to the display device 100 and an operation controller 200 through wired or wireless lines and the virtual reality information is displayed on the display device 100 according to data transmitted from the operation controller 200. [ And a central processing unit (300) for transmitting the virtual position control signal to the player.
The method according to claim 1,
The operation controller 200,
It is possible for the user to grasp and control the operation in the vertical and horizontal directions in the virtual environment,
The central processing unit 300 senses the amount of force that the user grasps and presses with the finger in proportion to the sensed amount of pressure, converts the detected amount of pressure into a numerical value, and transmits the converted information to the central processing unit 300, Wherein the user can control the movement speed, the horizontal and vertical movement distances, and the rotation angles according to the numerical values, so that the player can control the vertical posture of the player using the pressure proportional control in the virtual reality.
The method according to claim 1,
The display device (100)
A head-mounted diplay (HMD) worn on the user's head, or a smart phone, which can control the player's vertical posture using pressure proportional control in a virtual reality.
The method of claim 3,
The smartphone is equipped with a gyroscope and an accelerometer, and a microcontroller (MCU) having a gyroscope and an accelerometer is provided on one side of the HMD. A system capable of vertical position control of a player using pressure proportional control in a virtual reality.
The method according to claim 2 or 4,
The user operates a pressure proportional button provided with a grip force sensor that detects the amount of force applied by each finger provided on the operation controller 200 to determine the vertical height of the user in the virtual reality, And transmits data obtained by sensing an angle change amount to the central processing unit 300 to realize a virtual reality.
As a system for experiencing and training virtual environments that span the same space as real world space,
A display device 100 that implements a scene map including one or more virtual objects;
The display device 100 is operable to interlock with the display device 100 so that the user can grasp and control the operation in the vertical and horizontal directions in the virtual environment. The user senses the detected pressure proportionally to the amount of force applied by the user, And transmits the converted information to the central processing unit 300. The central processing unit 300 controls the movement speed, horizontal and vertical movement distance, and rotation angle of the user according to the transmitted numerical value A motion controller 200 having a pressure proportional control button;
A program for realizing a virtual reality is connected to the display device 100 and an operation controller 200 through wired or wireless lines and the virtual reality information is displayed on the display device 100 according to data transmitted from the operation controller 200. [ And a central processing unit (300) for transmitting the virtual position control signal to the player.
The method according to claim 6,
The display device (100)
A head-mounted diplay (HMD) worn on the user's head, or a smart phone, which can control the player's vertical posture using pressure proportional control in a virtual reality.
8. The method of claim 7,
The smartphone is equipped with a gyroscope and an accelerometer, and a microcontroller (MCU) having a gyroscope and an accelerometer is provided on one side of the HMD. A system capable of vertical position control of a player using pressure proportional control in a virtual reality.
9. The method according to claim 7 or 8,
The user operates a pressure proportional button provided with a grip force sensor that detects the amount of force applied by each finger provided on the operation controller 200 to determine the vertical height of the user in the virtual reality, And transmits data obtained by sensing an angle change amount to the central processing unit 300 to realize a virtual reality.
KR1020150190162A 2015-12-30 2015-12-30 virtual reality system to control vertical position of player using pressure proportional controller KR20170079502A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150190162A KR20170079502A (en) 2015-12-30 2015-12-30 virtual reality system to control vertical position of player using pressure proportional controller

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150190162A KR20170079502A (en) 2015-12-30 2015-12-30 virtual reality system to control vertical position of player using pressure proportional controller

Publications (1)

Publication Number Publication Date
KR20170079502A true KR20170079502A (en) 2017-07-10

Family

ID=59355830

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150190162A KR20170079502A (en) 2015-12-30 2015-12-30 virtual reality system to control vertical position of player using pressure proportional controller

Country Status (1)

Country Link
KR (1) KR20170079502A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190045532A (en) * 2017-10-24 2019-05-03 (주)플레이솔루션 Experience system of virtual reality contents based on motion simulator

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190045532A (en) * 2017-10-24 2019-05-03 (주)플레이솔루션 Experience system of virtual reality contents based on motion simulator

Similar Documents

Publication Publication Date Title
JP7049393B2 (en) Automatic placement of virtual objects in 3D space
Mapes et al. A two-handed interface for object manipulation in virtual environments
US20230093676A1 (en) Virtual reality system and method
US9779550B2 (en) Augmented reality system
US20160363997A1 (en) Gloves that include haptic feedback for use with hmd systems
US20160019808A1 (en) Aircraft pilot training system, method and apparatus for theory, practice and evaluation
JP6558839B2 (en) Intermediary reality
WO2016159461A1 (en) Augmented-reality-based interactive authoring-service-providing system
US20170358280A1 (en) Method of controlling head-mounted display system
CN103635891A (en) Massive simultaneous remote digital presence world
US11340697B2 (en) System and a method to create extended reality using wearables and virtual environment set
KR102647544B1 (en) Information processing system and information processing method
KR20160020136A (en) Training system for treating disaster using virtual reality and role playing game
KR20140011688A (en) Virtual reality simulation apparatus and method using motion capture technology and
CN107403566A (en) Educational system using virtual robot
Livatino et al. Intuitive robot teleoperation through multi-sensor informed mixed reality visual aids
JP2021009673A (en) Virtual reality system, program, and computer-readable storage medium
US20220155881A1 (en) Sensing movement of a hand-held controller
WO2021261595A1 (en) Vr training system for aircraft, vr training method for aircraft, and vr training program for aircraft
KR20170079502A (en) virtual reality system to control vertical position of player using pressure proportional controller
Butnariu et al. DEVELOPMENT OF A NATURAL USER INTERFACE FOR INTUITIVE PRESENTATIONS IN EDUCATIONAL PROCESS.
WO2021261594A1 (en) Aircraft vr training system, aircraft vr training method, and aircraft vr training program
Spiss et al. Comparison of tactile signals for collision avoidance on unmanned aerial vehicles
Menezes et al. Touching is believing-Adding real objects to Virtual Reality
Walker et al. User-centered design of an attitude-aware controller for ground reconnaissance robots

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application