KR20190131756A - Systme and method for providing co-job exerience service using virtual reality - Google Patents

Abstract

The present invention provides a method for providing a co-existing job experience using virtual reality (VR) which can assist in a decision-making process for selecting a job. The method for providing a co-existing job experience using virtual reality comprises: a step of connecting at least one user VR device and a supervisor VR device; a step of streaming job experience virtual reality content selected by the at least one user VR device to be shared in real time by the at least one VR device and the supervisor VR device; a step of collecting input data of the at least one user VR device interacting in response to a virtual object or a virtual event in the job experience virtual reality content; a step of comparing the collected input data and preset reference data to evaluate suitability between selected job of at least one user to transmit feedback data to the at least one user VR device and the supervisor VR device; and a step of transmitting data to a display device to be shared to display job experience virtual reality content changed in real time by the supervisor VR device or the at least one user VR device.

Description

System and Method for Providing Coexistence Job Experience Using Virtual Reality {SYSTME AND METHOD FOR PROVIDING CO-JOB EXERIENCE SERVICE USING VIRTUAL REALITY}

The present invention relates to a method for providing coexistence job experience using virtual reality, and provides a platform for a plurality of users to experience a job in a job experience virtual reality content set by a supervisor.

In recent years, fast and diverse changes in the social environment have a great impact on the career design as well as the environment of children and adolescents. Factors that play a big role in career decisions include many factors such as one's own talents, aptitude, and advice from others. Planning the life and realizing self through proper career setting is not only an individual growth but also social and national This is an important task. In addition, as career activities are positioned among the four areas of creative experience activities in the revised curriculum, various vocational experience program classes are being implemented as the proportion of career education is increasing in school education.

At this time, a platform for developing a virtual job experience was developed in relation to the actual experience in the virtual world online. In this regard, Korean Patent Publication No. 2012-0103373 (published on September 19, 2012) The user terminal connects to the virtual world service server, executes a first event in which the user terminal selects an experience process of any one of baking, confectionery, and cooking, and executes an event of purchasing an item in a store of the virtual world. When the first event execution is completed, the game mission execution step of manufacturing virtual food sequentially using a graphical user interface with respect to any one item of baking, confectionery, and cooking according to predetermined recipe information. To execute a second event that runs a game mission to measure and evaluate metering elements, time elements, and score elements Initiate.

However, up to now, the vocational experience program classes are mainly operated based on the site visit program, which limits the time and space. In particular, the lecture contents are not the interactive experiences depending on the aptitude of individuals. Even though the above-mentioned virtual experience content is used, it tends to be biased toward injectable education as a general game type of mission performance process, and the content of the vocational experience forms various vocational views by allowing students to experience various jobs more easily and in an interesting way. You have to discover your talents and aptitudes and give them the opportunity to grow your dreams in the future. However, in reality, it is very rare to choose a job after actually experiencing it because of the lack of education manpower and cost. .

One embodiment of the present invention, by providing the experience of indirect hands-on experience to the infants and adolescents in the virtual space to choose after having fully experienced the job, and observed by presenting the task to the virtual reality environment and the selected content set by the supervisor A series of thought and action processes—working, discovering yourself, thinking logically, and engaging in collaboration with others—can help you make career choices while stimulating imagination, enhancing creativity, and expanding the world of experience. It is possible to provide a coexisting job experience providing method using virtual reality. However, the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, an embodiment of the present invention, the step of connecting between the at least one user VR device and the supervisor VR device, it is possible to select a job experience virtual reality content selected from the at least one user VR device Streaming input to be shared in real time by the at least one VR device and the supervisor VR device; collecting input data of at least one user VR device interacting in response to a virtual object or virtual event in the occupational experience virtual reality content, collected input Comparing the data with preset reference data to evaluate suitability between the selected occupation of the at least one user and transmitting feedback data to the at least one user VR device and the supervisor VR device, and the supervisor VR device or at least one user VR device Occupation changed in real time by VR content comprises the step of transferring data to be shared with the display device to be displayed.

According to another embodiment of the present invention, a user receives a type of job experience virtual reality content selected from a user and drives the same, and inputs an event according to a user's voice or motion interacting with a virtual object or a virtual event in the job experience virtual reality content. Receive at least one user VR device corresponding to the event and output the job experience virtual reality content through the wired / wireless network, and at least one user experience VR reality content of at least one user VR device. A voice of a user provided to be driven by at least one user VR device, controlling the job experience virtual reality content to correspond to an event according to a voice or motion input from the at least one user VR device, and interacting with a virtual object or a virtual event. Or performance data according to motion It includes a virtual reality service providing server to collect and calculate the fitness of the occupation of the type selected by the at least one user to feed back to the at least one user VR device, and updates the events occurring in the at least one user VR device to be shared in real time. .

According to any one of the above-described means for solving the problem of the present invention, the virtual reality environment and the content selected by the supervisor set the opportunity to give a realistic indirect experience to the infants and adolescents to select after fully experiencing the job in the virtual space A mindset that stimulates imagination, enhances creativity, and expands the world of experience through a series of thought and action processes: observing, discovering, thinking logically, and engaging in collaboration with others by presenting assignments Can help with the decision making process.

1 is a view for explaining a coexistence job experience providing system using a virtual reality according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a virtual reality service providing server included in the system of FIG. 1.
FIG. 3 is a diagram illustrating an embodiment in which a coexistence job experience providing service using virtual reality is implemented according to an embodiment of the present invention.
4 is a diagram illustrating a process in which data is transmitted and received between each component included in the coexistence job experience providing system using the virtual reality of FIG. 1 according to an embodiment of the present invention.
5 is a flowchart illustrating a method of providing a co-existence job experience using virtual reality according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components, unless specifically stated otherwise, one or more other features It is to be understood that the present disclosure does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, parts, or combinations thereof.

As used throughout the specification, the terms "about", "substantially", and the like, are used at, or in close proximity to, numerical values when manufacturing and material tolerances inherent in the meanings indicated are intended to aid the understanding of the invention. Accurate or absolute figures are used to assist in the prevention of unfair use by unscrupulous infringers. As used throughout the specification of the present invention, the term "step of" or "step of" does not mean "step for".

In the present specification, the term 'unit' includes a unit realized by hardware, a unit realized by software, and a unit realized by both. In addition, one unit may be realized using two or more pieces of hardware, or two or more units may be realized by one piece of hardware.

Some of the operations or functions described as being performed by the terminal, the apparatus, or the device may be performed instead in the server connected to the terminal, the apparatus, or the device. Similarly, some of the operations or functions described as being performed by the server may be performed by the terminal, apparatus or device connected to the server.

In the present specification, some of the operations or functions described as mapping or matching with a terminal mean that a unique number of a terminal or identification information of an individual, which is identification data of the terminal, is mapped or matched. Can be interpreted as

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining a coexistence job experience providing system using a virtual reality according to an embodiment of the present invention. Referring to FIG. 1, the coexistence job experience providing system 1 using virtual reality includes at least one user VR device 100, a virtual reality service providing server 300, a supervisor VR device 400, and a display device 500. ) May be included. However, since the coexistence job experience providing system 1 using the virtual reality of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1.

In this case, each component of FIG. 1 is generally connected through a network 200. For example, as shown in FIG. 1, at least one user VR device 100 may be connected to the virtual reality service providing server 300 through the network 200. In addition, the virtual reality service providing server 300 may be connected to the at least one user VR device 100, the supervisor VR device 400, and the display device 500 through the network 200. In addition, the supervisor VR device 400 may be connected to the virtual reality service providing server 300 through the network 200. The display apparatus 500 may be connected to the virtual reality service providing server 300.

Here, the network refers to a connection structure capable of exchanging information between respective nodes such as a plurality of terminals and servers. Examples of such a network include RF, 3rd Generation Partnership Project (3GPP) network, and long term (LTE). Evolution network, 5th Generation Partnership Project (5GPP) network, World Interoperability for Microwave Access (WIMAX) network, Internet, Local Area Network (LAN), Wireless Local Area Network (WLAN), Wide Area Network (WAN) , PAN (Personal Area Network), Bluetooth (Bluetooth) network, NFC network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network and the like, but is not limited thereto.

In the following description, the term “at least one” is defined as a singular and plural term, and each component may exist in the singular or plural, even though the term “at least one” does not exist, and may mean the singular or plural. It will be self explanatory. In addition, the singular or plural elements may be changed according to embodiments.

The at least one user VR device 100 may be a terminal of a user who experiences a job on a virtual reality using a web page, an app page, a program, or an application related to a coexisting job experience service using a virtual reality. In this case, the at least one user VR device 100 receives a voice for interaction with a virtual object in the job experience virtual reality content, or transmits at least one sensor detection value to the virtual reality service providing server 300 or at least one. It may be a device for processing in the user VR device 100 of the output, and outputs the job experience virtual reality content corresponding thereto. In addition, the at least one user VR device 100 may provide vocational experience virtual reality content based on ARCS theory, which includes a learner's motivation model, and the four elements of the motivation model are attention, relevance, and the like. (Relevance, Confidency, Satisfaction). First, attention focuses on keeping learners' attention as an element of motivation and relevance rather than results in a way that helps them give pleasure and value to the question of why they should study. The focus is on the process. Confidence is the process of helping you believe that you can succeed by controlling yourself to the extent you expect to succeed. Strategies are presented to provide a challenging learning environment to reward satisfaction with intrinsic and extrinsic reinforcement. In addition, at least one input event or interaction event generated by the at least one user VR device 100 is transmitted to the virtual reality service providing server 300 to provide input data for providing feedback of the job experience result. Can be. In addition, the at least one user VR device 100 may be configured to share virtual content in an augmented reality or virtual reality environment by a user who is located at a distance or a short distance in a virtual environment set from the supervisor VR device 400, and may perform a motion such as a hand gesture. It may be a device that can control the content. In addition, the at least one user VR device 100 may include a head mounted display (HMD) including a camera that tracks gestures of the user's whole body or a part of the human body at one node, and the user may view a video (Video see-through) It may be a device that allows the user to see the content to work on the avatar of the opponent through the HMD. In addition, the at least one user VR device 100 may be a device for performing a task of moving or selecting a virtual object jointly with a remote user by using a hand gesture. It may be a device for completing a task set in a game or educational content using a user, an avatar, and a hand gesture.

Here, the at least one user VR device 100 may be implemented as a computer that can access a server or terminal in a remote place through a network. Here, the computer may include, for example, a navigation, a laptop equipped with a web browser, a desktop, a laptop, and the like. In this case, the at least one user VR device 100 may be implemented as a terminal that can access a server or a terminal in a remote place through a network. The at least one user VR device 100 is, for example, a wireless communication device that guarantees portability and mobility, and includes navigation, personal communication system (PCS), global system for mobile communications (GSM), and personal digital cellular (PDC). , Personal Handyphone System (PHS), Personal Digital Assistant (PDA), International Mobile Telecommunication (IMT) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wireless Broadband It may include all kinds of handheld based wireless communication devices such as an Internet terminal, a smart phone, a smart pad, a tablet PC, and the like.

The virtual reality service providing server 300 may be a server providing a coexisting job experience providing service web page, an app page, a program, or an application using virtual reality. At this time, the virtual reality service providing server 300, if the type of occupation is selected in the at least one user VR device 100, at least one user VR virtual reality content that can experience the selected type of occupation Output the device 100 and collect the result of the interaction or interaction with the virtual object or the virtual event in the job experience virtual reality content in real time at least one user VR device 100 to provide feedback on the job experience result Can be used as an input to generate. In addition, the virtual reality service providing server 300 controls the data transmission / reception direction of the at least one user VR device 100 and the supervisor VR device 400 according to a collaboration state, Connect and share a task with at least one user VR device 100 and the supervisor VR device 400, and the object in the occupational experience virtual reality content by the sensed value detected by the sensor of the at least one user VR device 100. It may be a server that transforms and changes, updates the database using the sensed detection value, and is shared in real time.

Here, the virtual reality service providing server 300 may be implemented as a computer that can access a server or a terminal in a remote place through a network. Here, the computer may include, for example, a navigation, a laptop equipped with a web browser, a desktop, a laptop, and the like.

The supervisor VR device 400 may be a terminal of a supervisor using a web page, an app page, a program, or an application related to a coexistence job providing service using virtual reality. In addition, the supervisor VR device 400 selects the occupational experience virtual reality content through the virtual reality service providing server 300, sets the environment of the occupational experience virtual reality content, and transmits the at least one user VR device 100 to the user. It may be a device for assigning a task, a task, or the like, and may be a device for selecting whether each collaboration relationship should be equal, how to set the data direction, and the like. In this case, the supervisor VR device 400 may basically have the same function or configuration as the user VR device 100, but since only the control authority is given, the detailed description thereof overlaps with the user VR device 100. The description will be omitted.

Here, the supervisor VR device 400 may be implemented as a computer that can access a server or a terminal in a remote place through a network. Here, the computer may include, for example, a navigation, a laptop equipped with a web browser, a desktop, a laptop, and the like. In this case, the supervisor VR device 400 may be implemented as a terminal that can be connected to a server or terminal in a remote place through a network. The supervisor VR device 400 is, for example, a wireless communication device that ensures portability and mobility. The supervisor VR device 400 includes navigation, personal communication system (PCS), global system for mobile communications (GSM), personal digital cellular (PDC), and PHS ( Personal Handyphone System (PDA), Personal Digital Assistant (PDA), International Mobile Telecommunication (IMT) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wireless Broadband Internet (WBRO) terminals , Handheld-based wireless communication devices such as smartphones, smartpads, tablet PCs, and the like.

The display apparatus 500 may be a device that outputs the occupational experience virtual reality content output from the at least one user VR device 100 in 2D, 3D, or hologram. In this case, it will be apparent that the display apparatus 500 as well as the display may output the voice input from the at least one user VR apparatus 100 and the supervisor VR apparatus 400 through a speaker or the like. At this time, the type of the output format is not limited, it will be obvious that not limited due to the listed.

FIG. 2 is a block diagram illustrating a virtual reality service providing server included in the system of FIG. 1, and FIG. 3 is a diagram illustrating an embodiment in which a virtual reality service is implemented according to an embodiment of the present invention. .

Referring to FIG. 2, the virtual reality service providing server 300 may include a connection unit 310, a streaming unit 320, a collection unit 330, a transmission unit 340, and a sharing unit 350.

Virtual reality service providing server 300 according to an embodiment of the present invention or another server (not shown) operating in conjunction with at least one user VR device 100, supervisor VR device 400 coexist using the virtual reality When transmitting a job experience providing service application, a program, an app page, a web page, or the like, the at least one user VR device 100 and the supervisor VR device 400 may use a coexistence job experience providing service application, program, or the like using virtual reality. You can install or open app pages, web pages, and more. In addition, the service program may be driven in at least one user VR device 100 and the supervisor VR device 400 using a script executed in a web browser. Here, the web browser is a program that enables the use of the World Wide Web (WWW) service, and refers to a program that receives and displays hypertext described in HTML (hyper text mark-up language), for example, Netscape. , Explorer, chrome and the like. In addition, an application means an application on a terminal, and includes, for example, an app running on a mobile terminal (smartphone).

The major themes of the Consumer Technology Association (CES) in 2017 were virtual reality, autonomous vehicles, and drones.At last year's CES, as virtual reality became the next-generation platform, interest in it has increased worldwide. Research on technology and platform related to virtual reality has been continuously conducted, but in recent years, attempts are being made to utilize virtual reality in various fields such as entertainment, games, museums, military, rehabilitation, and education. Overseas, they are experiencing cost savings by applying virtual reality technology in various fields such as applying virtual reality technology to aircraft assembly and painting processes or using virtual reality technology for automobile repair. In comparison, in Korea, pilot training and fighter simulations are used for virtual reality, but the scope of application is still limited. The advantage of virtual reality is that it enables users to experience high immersion and realism. From this perspective, if virtual reality is combined with education and training, it can be expected to improve the learning effect through high immersion and individualized interactions, learning contents that are difficult or insufficient to explain in text and 2D materials, and high-risk and expensive equipment education. Very effective in the area. In the technical engineering vocational training, the development and utilization of virtual training contents for experience and practice-oriented learning is increasing, and virtual training can be repeatedly and safely taught in a learning environment similar to the actual equipment and work environment. It has the advantage of helping to run the machine on the job site. Recently, a study on the development of virtual reality-based steel process training system was carried out in a virtual facility that simulates the production facilities required for the steel process, a virtual HMI that simulates a driver human machine interface (HMI), and a virtual control panel that simulates a driver control panel. We have developed a steel process virtual reality operation simulator consisting of a steel process virtual reality operation simulator, which has been used in actual educational institutions, and an automobile maintenance training system has been developed through virtual reality-based step-by-step learning that operates on PCs and smart pads. The study on the effect of augmented reality-based car manual contents on user learning confirmed that augmented reality-based contents were more effective for users' immersion, physical presence, and active participation than manual books. Accordingly, an embodiment of the present invention provides a method for providing a platform for experiencing a job and enabling adolescents or young people to find a job suitable for themselves due to the job experience.

Referring to FIG. 2, the connection unit 310 may connect at least one user VR device 100 and the supervisor VR device 400. In this case, the at least one user VR device 100 and the supervisor VR device 400 control the job experience virtual reality content by equal-role collaboration or unequal-role collaboration. Can share Here, the data transmission and reception of the supervisor VR device 400 and the at least one user VR device 100 is a multi-directional one-way data transmission from the supervisor VR device 400 to the at least one user VR device 100, the supervisor VR device 400. ) And multi-way bidirectional data transmission between at least one user VR device 100, and multi-party multi-directional data between supervisor VR device 400 and at least one user VR device 100 and between at least one user VR device 100. It may consist of any one or a combination of at least one of the transmissions. In addition, whether users in the collaboration can share a VR workspace at the same location or remotely, how many users can share the VR space, and some users' VR spaces are shared as AR spaces to remote users. Can be set individually. In addition to images, voices, and gestures in addition to space, the connection unit 310 generates a connection so that three-dimensional modeling of an object in reality can be shared as a virtual object having physical properties in a VR / AR space. Remote collaboration technology can be classified according to the degree of sharing of emotional information among users participating in the / AR collaboration space, and in addition to directly affecting information such as human's biometrics and emotions in the work, it also varies in providing contents such as education. It can be used to form a channel that can connect the above-described information.

The streaming unit 320 may stream the vocational experience virtual reality content selected by the at least one user VR device 100 to be shared in real time by the at least one VR device and the supervisor VR device 400. In this case, the at least one user VR device 100 receives and drives a selected type of job experience virtual reality content from the user, and interacts with a voice or motion of the user interacting with a virtual object or a virtual event in the job experience virtual reality content. It is possible to output the job experience virtual reality content corresponding to the event by receiving the event according to. In addition, the supervisor VR device 400 may output a command signal for controlling the job experience virtual reality content output from the at least one user VR device 100 and set an environment variable value of the job experience virtual reality content.

The streaming unit 320 may stream the job experience virtual reality content selected by the supervisor VR device 400 to be shared in real time by the at least one user VR device 100 and the supervisor VR device 400. At this time, if there is a supervisor, it consists of a master server that manages the whole network communication, a host client that leads the whole process for registration, and a client who participates in network communication from the observer's or participant's point of view. As with other network communication, in order to obtain the effect of sharing virtual space in real time, there is a need to correct the inconsistency caused by the network time delay inevitably occurring between users participating in the network communication. Accordingly, the streaming unit 320 according to an embodiment of the present invention may use a synchronization method. In other words, a real-time interactive system typically operates at 60 frames per second (60 fps) and processes all user input to determine one frame in 1/60 seconds (16 ms) to complete synchronization of all operations while maintaining this frame rate. You have to finish with physics, rendering, and so on. However, in a typical network environment, the network communication time delay is much larger than this, and thus a deviation occurs between multiple users who share the same virtual space. Therefore, if the user who created the leaf object, that is, the supervisor, a routine to control the movement of the leaf is executed. If the user (student), the linear interpolation (in order to match the leaf object's position and velocity information with the leaf loaded by the supervisor) is executed. You can execute routines that apply linear interpolation. At this time, it is impossible to accurately resolve the discrepancy caused by the actual network communication time delay, but in this way, it is possible to obtain the effect of sharing the same virtual space among multiple users at the same time.

In this case, the virtual reality service providing server 300 controls the job experience virtual reality content output from the supervisor VR device 400 and the at least one user VR device 100 by a command signal input from the supervisor VR device 400. And virtually modify the occupational experience virtual reality content to correspond to the environment variable value set by the supervisor VR device 400 to control streaming in real time from the supervisor VR device 400 and at least one VR user device, and the supervisor VR. An event occurring in the device 400 and the at least one user VR device 100 may be updated to be shared in real time. Accordingly, in real time, the user and the supervisor located at the remote site can share the same screen without delay.

The collector 330 may collect input data of at least one user VR device 100 that interacts in response to a virtual object or a virtual event in the occupational experience virtual reality content. In this case, the virtual reality service providing server 300 may provide a type of job experience virtual reality content selected by the at least one user VR device 100 to be driven by the at least one user VR device 100, and at least one user. The VR device 100 controls the occupational experience virtual reality content to correspond to an event according to the voice or motion input, collects performance data according to the voice or motion of the user who interacts with the virtual object or the virtual event, and collects at least one user. May calculate a fitness of the selected type of job, feed back to at least one user VR device 100, and update an event occurring in at least one user VR device 100 to be shared in real time.

In this case, the supervisor VR device 400 and the at least one user VR device 100 may include a head mounted display (HMD) for displaying a job experience virtual reality content, a sound on a job experience virtual reality content or a supervisor of at least one remote location or a remote place. Headphones that output the user's voice, a motion controller that senses movement by sensing acceleration, rotation, and position with at least one type of sensor, and transmits / receives data to and from the virtual reality service providing server 300 and experiences virtual reality contents It may include a terminal for controlling the output and the event input.

The transmitter 340 compares the collected input data with preset reference data to evaluate suitability between the selected occupations of at least one user, and transmits feedback data to the at least one user VR device 100 and the supervisor VR device 400. Can be sent to. Through this, waiting participants can be shared how the current participant experiences a job in a virtual environment and moves or creates a virtual object. In addition, assuming that a task for completing a tree, for example, is given in the vocational experience virtual reality content, by outputting the completed tree on the vocational experience virtual reality content that is a virtual object to the real world, for example, 3D printer, It can be observed, discovered, and deduced to cooperate voluntarily. At this time, the theme of the vocational experience virtual reality content may be fields such as art, art, biology, nature, solar system, science, technology, culture, travel, history, physical education, sports, but is not limited to listed. At this time, the career group that students can experience can be formed through the contents suggested by the students, and problem-based learning models in which students actively participate in solving problems and answering questions, play roles in the background of interesting stories, and perform tasks. It can be constructed by combining GBS (Goal Based Scenario) theory, dynamic memory theory that provides the theoretical framework for GBS, and digital storytelling techniques. .

For example, the vocational experience virtual reality content may include a configuration such as personality test, information search, activity (mission, task), storage of learning information, and the like. First, the personality test enables the learner to determine the learner's disposition prior to the job experience through the aptitude test for the job, and may include a predetermined number of personality tests per job. Next, the information search (quiz) may be a platform in which the learner learns information about the corresponding job and learns the acquired information through a quiz, and the activity (mission, task) is a content searched for information search. Based on the job experience, and after all the processes, the learning results can be checked and printed, and the user's learning information can be stored. As described above, the present invention may further include a process for interacting with the virtual object existing in the vocational experience virtual reality content as well as the content for the vocational education. For example, a firefighter's occupational experience, where people are trapped in a building, but the fire is not burning, and the colleagues are still on the water, what they will do, how to persuade their colleagues, and their reactions (interaction) After creating a scenario of what to do, it can be provided to provide an experience like a real user (experiencer) acting as a firefighter on site.

The sharing unit 350 may be configured to transmit data to the display apparatus 500 so that the occupational experience virtual reality content that is changed in real time by the supervisor VR device 400 or the at least one user VR device 100 is displayed. Can be. In this case, in order to perform a function of the user interacting with the object of the content by using the user's body, an interface technology that tracks the user's body movement in addition to the head and eyes and reflects it in the virtual space may be applied. In the past, gloves were used, but they became more sophisticated and developed to track the movement of the finger.In early VR, HMD was used to track the direction of head movement in a fixed posture to adjust the 360-degree image. Although it was at the show level, the development of motion tracking technology and 3D scanning technology made it possible to move freely in the real space. Accordingly, the VR devices according to an embodiment of the present invention detect the user's head movement through the HMD device worn on the face so that the screen moves along the actual head, and shows only the screen before the eyes. Unlike the HMD, camera tracking and optical tracking can improve the viewing angle to improve immersion. In addition, the two-handed input tool enables more intuitive interaction with VR content.

In addition, indoor location recognition may be required. For example, the RSSI value according to the distance of the BLE appears to be fading (Fading) phenomenon compared to the Wi-Fi appears to have a lot of errors, but the RSSI value of the BLE is within a certain distance As it has the typical fading value, it is stable and simple because it gives reliability to the change rate between cells. Using this, a position recognition technique combining a relative position recognition method using AHRS and an absolute position recognition method using BLE Fingerprint can be used. In order to improve the cumulative error of the inertial sensor-based position recognition method, which is a relative position recognition method, the position recognition technique using Bluetooth RSSI-based fingerprint can be used as an absolute position recognition method. For example, AHRS based on 9-axis sensor. It may be based on a method of recognizing a location through walking information such as the number of steps and the stride length of a user who has a device attached. At this time, in the relative position recognition method using the walking information, a cumulative error occurs over time. To correct this, a BLE fingerprint map may be constructed, and the information about the corresponding position and the walking-based position information may be matched. Of course, it does not limit the use of Wifi or other networks or the use of sensors to those listed, and it will be apparent that various types of networks or sensors can be used.

Hereinafter, an operation process according to the configuration of the virtual reality service providing server of FIG. 2 described above will be described in detail with reference to FIG. 3. However, the embodiment is only any one of various embodiments of the present invention, but is not limited thereto.

Referring to FIG. 3, (a) the virtual reality service providing server 300 may perform a corresponding job experience with a plurality of participants and a supervisor in order to give the same effect as having both a job experience platform and a job experience of a remote image. It can provide a virtual experience content that can experience. To this end, it examines job experience preferences, builds a database related to the job derived based on the survey, interacts with virtual objects along with actual storytelling scenarios, and provides a sense of reality that exists in the field. This can facilitate the decision-making process of choosing a job.

(b) In addition, the virtual reality service providing server 300 may provide a coexistence reality platform, among which (c) the multi-way communication method, the interaction between the teacher and the students during the course in the virtual reality space This multi-way teaching method is a cooperative reality education platform type where the teacher communicates to students in one direction, and the multi-way communication method is perfect for interactive communication between teacher and students during class in virtual reality space. The most maximizing coexistence reality education platform type (teacher-student, student-student), and the multi-way-multi-directional communication method is a multi-way communication between teachers and students in the virtual reality space. Teachers can communicate with all students But communication between the student may be impossible to coexist real training platform type. (d) In addition, the coexistence reality job experience service model allows an experienced person and a teacher or a professional (supervisor) to remotely access from outside to share a job experience virtual reality content in real time, and to virtually experience a desired job.

The matters that are not described for the coexistence job experience providing method using the virtual reality of FIG. 2 and FIG. 3 are the same as or described above with respect to the coexisting job experience providing method using the virtual reality through FIG. 1. Since it can be easily inferred, a description thereof will be omitted.

FIG. 4 is a diagram illustrating a process in which data is transmitted and received between each component included in the coexistence job experience providing system using the virtual reality of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of a process in which data is transmitted and received between each component will be described with reference to FIG. 4, but the present disclosure is not limited to the above-described embodiments, and is illustrated in FIG. 4 according to the various embodiments described above. It is apparent to those skilled in the art that the process of transmitting and receiving data may be changed.

Referring to FIG. 4, the virtual reality service providing server 300 may set and synchronize a type or interaction method of collaboration when connecting the user VR device 100, the supervisor VR device 400, and the display device 500 ( In step S4100, the user VR device 100 or the supervisor VR device 400 selects a job type virtual content by selecting a job type (S4200), and implements real-time networking so that the supervisor and the user can share it. Similarly, in the case of setting or controlling the environment in the VR device 400, the user VR device 100 shares the same so as to check in real time (S4300 and S4400).

In addition, the virtual reality service providing server 300 monitors and evaluates input data or interaction data input by the at least one user VR device 100 in real time (S4500). An evaluation will be performed. For example, if the service job experience, assuming that the user emotionally responded to the needs of the customer, it may be a method such as lowering the score of the job in the service field, but is not limited thereto. In addition, the virtual reality service providing server 300 is a real-time job experience virtual reality content streamed in real time, control data, interaction data, and the like input from the at least one user VR device 10 and the supervisor device 400 in real time. Each other is shared (S4600), and the database is updated by mapping and storing values input from the devices 100 and 400 to each user (S4700).

In addition, the virtual reality service providing server 300 controls the display apparatus 500 so that external viewers can see (S4800), and repeats the steps S4300 to S4800 until the job experience is completed (S4900). In step S4920, the feedback data is transmitted.

The order between the above-described steps S4100 to S4920 is merely an example, and the present invention is not limited thereto. That is, the order between the above-described steps S4100 to S4920 may be mutually changed, and some of the steps may be executed or deleted at the same time.

The matters that are not described for the coexistence job experience providing method using the virtual reality of FIG. 4 are the same as or described above with respect to the coexisting job experience providing method using the virtual reality through FIGS. 1 to 3. Since it can be easily inferred, a description thereof will be omitted.

5 is a flowchart illustrating a method of providing a co-existence job experience using virtual reality according to an embodiment of the present invention. Referring to FIG. 5, the virtual reality service providing server connects at least one user VR device and a supervisor VR device (S5100), and displays at least one VR device content selected from at least one user VR device. And streams to be shared in real time in the supervisor VR device (S5200).

In addition, the virtual reality service providing server collects input data of at least one user VR device interacting in response to a virtual object or a virtual event in the occupational experience virtual reality content (S5300), and collects the input data and preset reference data. The comparison is performed to evaluate suitability between the selected occupations of the at least one user and transmits the feedback data to the at least one user VR device and the supervisor VR device (S5400).

Finally, the virtual reality service providing server is configured to transmit data to the display device so that the occupational experience virtual reality content that is changed in real time by the supervisor VR device or the at least one user VR device is shared (S5500).

The matters that are not described for the coexistence job experience providing method using the virtual reality of FIG. 5 are the same as or described above with respect to the coexisting job experience providing method using the virtual reality through FIGS. 1 to 4. Since it can be easily inferred, a description thereof will be omitted.

The coexistence job experience providing method using virtual reality according to an embodiment described with reference to FIG. 5 may be implemented in the form of a recording medium including instructions executable by a computer, such as an application or a program module executed by a computer. Can be. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

Coexistence job experience providing method using a virtual reality according to an embodiment of the present invention described above, by the application (this may include a program included in the platform or operating system basically installed in the terminal) It may be executed by an application (ie, a program) installed by the user directly on the master terminal through an application providing server such as an application store server, an application, or a web server associated with the corresponding service. In this sense, the above-described method for providing a coexistence job experience using virtual reality according to an embodiment of the present invention is implemented as an application (that is, a program) that is basically installed in a terminal or directly installed by a user, It can be recorded on a readable recording medium.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the above description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

Claims (10)

In the coexistence job experience provision system,
Receives and drives the selected type of job experience virtual reality content from the user, and receives an event according to the voice or motion of the user interacting with the virtual object or the virtual event in the job experience virtual reality content and corresponds to the event. At least one user VR device outputting virtual reality content and transmitting the job experience virtual reality content through a wired or wireless network; And
The vocational experience virtual reality content of the type selected by the at least one user VR device to be driven in the at least one user VR device, and corresponding to the event according to the voice or motion input from the at least one user VR device The at least one user VR may be controlled by calculating a job experience virtual reality content, collecting performance data according to voice or motion of a user who interacts with the virtual object or a virtual event, and calculating a fitness of a kind selected by at least one user. A virtual reality service providing server for feeding back to the device and updating an event occurring in at least one user VR device to be shared in real time;
Coexistence job experience providing system using a virtual reality including a.
The method of claim 1,
Supervisor VR device for outputting a command signal for controlling the job experience virtual reality content output from the at least one user VR device and setting an environment variable value of the job experience virtual reality content
To further include, the coexistence job experience providing system using virtual reality.
The method of claim 2,
The virtual reality service providing server controls and shares the job experience virtual reality content output from the supervisor VR device and the at least one user VR device with a command signal input from the supervisor VR device, and sets the supervisor VR device. By modifying the vocational experience virtual reality content to correspond to the environment variable value to control to be streamed in real time from the supervisor VR device and at least one VR user device, the event occurred in the supervisor VR device and at least one user VR device in real time Updating to share, coexisting job experience providing system using virtual reality.
The method of claim 2,
Wherein the at least one user VR device and the supervisor VR device control and share the vocational experience virtual reality content in equal-role collaboration or unequal-role collaboration. Coexistence job experience provision system using reality.
The method of claim 2,
Data transmission and reception of the supervisor VR device and the at least one user VR device,
Multi-way unidirectional data transfer from the supervisor VR device to the at least one user VR device, multi-way bidirectional data transfer between the supervisor VR device and the at least one user VR device, and the supervisor VR device and the at least one user VR device The system of any one or at least one of the multi-way multi-directional data transmission between the at least one user VR device, the coexistence job experience providing system using virtual reality.
The method of claim 1,
A display device configured to display the vocational experience virtual reality content output from the at least one user VR device;
To further include, the coexistence job experience providing system using virtual reality.
The method of claim 2,
The supervisor VR device and the at least one user VR device,
HMD (Head Mounted Display) for displaying the job experience virtual reality content, headphone outputting the sound of the experience or the experience of the remote supervisor or at least one user, the acceleration, rotation by at least one kind of sensor And a motion controller for detecting a motion by detecting a location, and a terminal for transmitting and receiving data to and from the virtual reality service providing server and controlling output and event input of the job experience virtual reality content. Coexistence job experience provision system.
In the virtual reality service providing method running on the virtual reality service providing server,
Connecting at least one user VR device and the supervisor VR device;
Streaming the vocational experience virtual reality content selected by the at least one user VR device to be shared in real time by the at least one VR device and the supervisor VR device;
Collecting input data of the at least one user VR device interacting with the virtual object or the virtual event in the job experience virtual reality content;
Comparing the collected input data with preset reference data to evaluate suitability between the selected occupation of the at least one user and transmitting feedback data to the at least one user VR device and the supervisor VR device;
Sending data to a display device such that the vocational experience virtual reality content that is changed in real time by the supervisor VR device or at least one user VR device is shared;
Coexistence job experience providing method using a virtual reality comprising a.
The method of claim 8,
Wherein the at least one user VR device and the supervisor VR device control and share the vocational experience virtual reality content in equal-role collaboration or unequal-role collaboration. How to provide coexisting job experience using reality.
A computer-readable recording medium having recorded thereon a program for performing the method of providing a co-existing job experience using the virtual reality according to claim 8.

Images