KR102225193B1 - Virtual reality experience device in the form of cradle comprising multiple display and virtual reality experience method using the same - Google Patents

Abstract

A large-sized virtual reality experience device including a plurality of displays and a virtual reality experience method using the same are provided. The cradle-type virtual reality experience device including the plurality of displays stores content, provides the stored content according to user input, receives a user input through an external output type display unit, synchronizes with the external output type display unit, and synchronizes The head mounted display unit that provides the displayed content, stores the same content as the head mounted display unit, provides the stored content according to a user input, and receives a user input through the head mounted display unit to mount the head The external output type display unit that synchronizes with the type display unit and provides synchronized content, and the headmount type display unit and the external output type display unit enable transmission and reception of user inputs inputted through each of the other, It includes the communication unit.

Description

A large-sized virtual reality experience device including multiple displays and a virtual reality experience method using the same {VIRTUAL REALITY EXPERIENCE DEVICE IN THE FORM OF CRADLE COMPRISING MULTIPLE DISPLAY AND VIRTUAL REALITY EXPERIENCE METHOD USING THE SAME}

The present invention relates to a large-sized virtual reality experience device including a plurality of displays and a virtual reality experience method using the same.

Virtual Reality (VR) is a virtual space created through a computer, and a space that gives reality through 3D visual effects. The technology for realizing virtual reality is a technology that allows users to feel as if they are in the real world by processing user input in real time, and is a next-generation technology that goes beyond multimedia.

The virtual reality environment provides users with a sense of immersion so that they can simulate real objects and experience objects or situations that don't actually exist.

Meanwhile, a virtual reality realization device that provides virtual reality typically has a head mounted display (HMD) type that can be viewed like glasses by being inserted into a head. The head mounted display can communicate with a mobile terminal to reproduce a virtual reality image.

However, when reproducing a virtual reality image, the head mounted display and the mobile terminal are used as independent devices, so that each device must be operated separately in order to control the virtual reality image.

Unexamined Patent Publication No. 10-2009-0002259, 2009.01.09

The problem to be solved by the present invention is that a plurality of display units, that is, a head mounted display and an external output type display, are provided in one virtual reality experience device. The present invention provides a large-sized virtual reality experience device including a plurality of displays in which the display is synchronized so that the plurality of display units can provide identically changed content, and a virtual reality experience method using the same.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

A cradle-type virtual reality experience device including a plurality of displays according to an aspect of the present invention for solving the above-described problems stores contents, provides the stored contents according to user input, and user input through an external output type display unit. A head mounted display unit that receives and synchronizes with an external output type display unit and provides synchronized content, stores the same content as the head mounted display unit, the head mounted display unit, and provides the stored content according to a user input, and the head The external output type display unit, which receives a user input through the mount type display unit, synchronizes with the headmount type display unit and provides synchronized content, and the headmount type display unit and the external output type display unit, respectively. It includes the communication unit for transmitting and receiving a user input input through each other.

In addition, the head mounted display unit and the external output type display unit each include a controller to control content provision based on the user input.

In addition, the head-mounted display unit is characterized in that the user input selects and manipulates content using movement of the user's gaze.

In addition, the external output type display unit may select and manipulate content using a user's touch input as the user input.

In addition, the head mounted display unit provides content as a 3D image, and the external output type display unit provides content as a 2D image.

In addition, the head mounted display unit is disposed so as to be movable up, down, left and right in the device, the external output type display unit is fixedly disposed at the center of the device, and the head mounted type display unit is higher than the external output type display unit. Is located in

A virtual reality experience method using a plurality of displays according to another aspect of the present invention for solving the above-described problems includes providing content based on a first user input through a head mounted display; Synchronizing an external output type display in the same state as the content provided by the head mounted display; Providing content synchronized with the content of the head mounted display through the external output type display; Changing the content provided through the external output type display based on a second user input, and providing the changed content through the external output type display; Synchronizing the head mounted display in the same state as the content changed based on the second user input and provided through the external output display; And providing content synchronized with the content of the external output type display through the head mounted type display.

In addition, the first user input is input using a movement of a user's gaze, and the head mounted display selects and manipulates content through the first user input.

In addition, the second user input is input by a user's touch, and the external output type display selects and manipulates content through the second user input.

In addition, the head-mounted display provides content as a 3D image, and the external output display unit provides the content as a 2D image.

Other specific details of the present invention are included in the detailed description and drawings.

According to the present invention, a plurality of display units, that is, a head mounted display and an external output type display, are provided in one virtual reality experience device, so that other displays are synchronized when one display is operated without the need to separately operate each display. Thus, the plurality of display units can provide identically changed content.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a block diagram of a large-sized virtual reality experience device according to an embodiment of the present invention.
2 is an exemplary diagram of a large-sized virtual reality experience device according to an embodiment of the present invention.
3 is a flow chart of a virtual reality experience method using a large-sized virtual reality experience device according to another aspect of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms. It is provided to fully inform the skilled person of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements. Throughout the specification, the same reference numerals refer to the same elements, and "and/or" includes each and all combinations of one or more of the mentioned elements. Although "first", "second", and the like are used to describe various elements, it goes without saying that these elements are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used with meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc. It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms including different directions of components during use or operation in addition to the directions shown in the drawings. For example, if a component shown in a drawing is turned over, a component described as "below" or "beneath" of another component will be placed "above" the other component. I can. Accordingly, the exemplary term “below” may include both directions below and above. Components may be oriented in other directions, and thus spatially relative terms may be interpreted according to orientation.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a large-sized virtual reality experience device according to an embodiment of the present invention.

Referring to FIG. 1, a large-sized virtual reality experience device 100 (hereinafter referred to as a'virtual reality experience device') includes a first display unit 120, a second display unit 140, and a communication unit 160. .

The virtual reality experience device 100 provides content to a user using a plurality of display units, that is, the first display unit 120 and the second display unit 140. During content playback, the user may manipulate one of the plurality of display units to change the content. In this case, the other display unit is synchronized with the display unit manipulated by the user to provide the same changed content to the user.

The first display unit 120 stores content provided by a server (not shown) and provides the stored content to a user based on a user's input. In this case, the first display unit 120 includes a controller and controls content according to a user input.

In one embodiment, the first display unit 120 may be a head mounted display (HMD), and a user may receive content by wearing the first display unit 120 on the head. In this case, the first display unit 120 may provide content as a 3D image. The user wears the first display unit 120 on the head and can select the desired content using the gaze, and the first display unit 120 changes the content according to the user's movement (6 degrees of freedom) and provides it to the user. can do. For example, the first display unit 120 may change the direction of the content through the movement of the user's gaze, and if the user’s gaze is stopped at a specific point for a certain period of time, the corresponding point is enlarged or selected to Content can be provided.

The second display unit 140 stores content provided by a server (not shown) and provides the stored content to a user based on a user's input. In this case, the second display unit 140 includes a controller and controls content according to a user input. Here, the content provided from the server and stored in the second display unit 140 is the same as the content stored in the first display unit 120. That is, the first display unit 120 and the second display unit 140 receive content from the same server and provide it to a user.

In an embodiment, the second display unit 140 may be an external output type display, for example, a smart pad, and the user may be provided with content output to an external screen. In this case, the second display unit 140 may provide content as a 2D image. The user may select content by touching the external screen of the second display unit 140, and the second display unit 140 may change the content according to the user's touch input and provide the content to the user. For example, when the user swipes the screen in a specific direction, the second display unit 140 may change content in a specific direction, and when the user selects or enlarges a specific point with a finger, the second display unit 140 may provide detailed content. .

The communication unit 160 enables the first display unit 120 and the second display unit 140 to transmit/receive a user input input through each of the first display unit 120 and the second display unit 140. By transmitting and receiving user inputs of each of the first and second display units 120 and 140 through the communication unit 160, the first display unit 120 and the second display unit 140 synchronize with each other to respond to user input. Accordingly, the same changed content can be provided to the user. In this case, user inputs input to the first display unit 120 and the second display unit 140 are synchronized in real time and provided to other display units.

In one embodiment, when the direction of the content is changed to the right according to the user's gaze input, the first display unit 120 transmits the user gaze input information to the second display unit 140 to the communication unit 160. Thereafter, the second display unit 140 may provide the changed content to the user in the same manner as the first display unit 120 by changing the content of the second display unit 140 based on the received user gaze input information. There will be. For example, user input information input to the first display unit 120 according to the user's movement (6 degrees of freedom) is synchronized to the second display unit 140 in real time, The same screen as the screen being viewed is displayed on the second display unit 140. As synchronized information is displayed on the second display unit 140, a person other than the user can monitor the user's behavior in real time. That is, since the first display unit 120 and the second display unit 140 are synchronized and the same scene is displayed on the screen, people other than the user can view the screen that the user is watching through the first display unit 120. It can be checked through the second display unit 140. At this time, the scene that the user watches through the first display unit 120 is stored in the form of a Json file and transmitted to the server (cloud), after which the server performs machine learning based on the data for each scene (xyz axis). Through this, probability statistics can be calculated.

In another embodiment, while a user is viewing content through the first display unit 120, it is difficult to manipulate the content through the first display unit 120, and thus manipulate the content through the second display unit 140. If desired, the user can take off the first display unit 120 that is wearing and touch the second display unit 140 as desired to manipulate the content. Thereafter, when the user wears the first display unit 120 again, the changed content can be provided in the same manner as that of manipulating the content through the second display unit 140.

In another embodiment, when the user selects the content to be viewed through the second display unit 140 and then switches to the VR view, the first display unit 120 drives the content in the form of 3DVR while the screen is divided into two. , A separate application for viewing 3DVR is driven on the first display unit 120.

In one embodiment, the virtual reality experience device 100 may provide content to a user by wirelessly connecting a head-mounted first display unit 120 and a tablet PC-type second display unit 140.

In addition, in another embodiment, the virtual reality experience device 100 may provide content to a user by connecting the first head-mounted display unit 120 and the second desktop PC-type display unit 140 by wire. At this time, the desktop PC-type second display unit 140 is composed of a PC main body and a touch-type monitor, and as shown in FIG. 2, the touch-type monitor is installed in the center of the virtual reality experience device 100, and the PC main body is It may be fixed and installed in a housing formed under the touch-type monitor installed in the center.

2 is an exemplary diagram of a large-sized virtual reality experience device according to an embodiment of the present invention.

The virtual reality experience device 100 may be installed in an exhibition hall, a performance hall, and an observatory in the form of a cradle to provide information on exhibitions and performances in virtual reality to perform a function of guiding.

Referring to FIG. 2, the first display unit 120 is disposed above the virtual reality experience device 100 to be worn on the user's head, and the second display unit 140 touches the screen using the user's hand. It is disposed in the center of the virtual reality experience device 100 to be able to do so. In addition, the first display unit 120 is arranged to move up, down, left and right according to a change in the user's gaze, and can move up and down according to the height of the user. The second display unit 140 is fixedly arranged so that the user can accurately touch the screen. In this case, the first display unit 120 is positioned above the second display unit 140.

3 is a flow chart of a virtual reality experience method using a large-sized virtual reality experience device according to another aspect of the present invention.

The first display unit 120 is a head mounted display and provides content based on an input (first user input) of a user wearing the first display unit 120 (S10). Here, the first user input means a moving value according to the user's gaze movement, and the first display unit 120 may change and provide content according to the user's gaze movement.

The second display unit 140 is synchronized in the same state as the content changed and provided by the first display unit 120 (S20). That is, the first display unit 120 transmits a first user input to the second display unit 140 through the communication unit 160, and the second display unit 140 provides content based on the received first user input. Change.

The second display unit 140 provides content that is synchronized with the content changed and provided by the first display unit 120 to the user (S30). Here, the second display unit 140 is an external output type display, and may output synchronized content through an external screen and provide it to a user.

The user changes the content provided through the second display unit 140 based on a second user input, and the second display unit 140 provides the changed content (S40). Here, the second user input means a value input by the user touching the screen using a finger, and the second display unit 140 may change and provide content according to the user's screen touch.

The first display unit 120 is synchronized in the same state as the content changed based on the second user input and provided through the second display unit 140 (S50). That is, the second display unit 140 transmits a second user input to the first display unit 120 through the communication unit 160, and the first display unit 120 provides content based on the received second user input. Change.

The first display unit 120 provides content that is synchronized with the content changed and provided by the second display unit 140 to the user (S60). For example, when the user touches the second display unit 140 and selects the content to change the content, the changed content is provided through the first display unit 120 in the same manner.

That is, when the user manipulates the content reproduced by the first display unit 120 through the user's gaze input, the first display unit 120 and the second display unit 140 are synchronized with each other, so that the user can The same content can be provided through the 120 and the second display unit 140. Conversely, when the user manipulates the content played by the second display unit 140 through a user touch input, the first display unit 120 and the second display unit 140 are synchronized with each other, so that the user can The same content can be provided through the 120 and the second display unit 140.

The steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or a combination thereof. Software modules include Random Access Memory (RAM), Read Only Memory (ROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), Flash Memory, hard disk, removable disk, CD-ROM, or It may reside on any type of computer-readable recording medium well known in the art to which the present invention pertains.

In the above, embodiments of the present invention have been described with reference to the accompanying drawings, but those of ordinary skill in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features. You will be able to understand. Therefore, the embodiments described above are illustrative in all respects, and should be understood as non-limiting.

100: virtual reality experience device
120: first display unit
140: second display unit
160: communication department

Claims (10)

As a large-sized virtual reality experience device including a plurality of displays,
A head-mounted display that stores content, provides the stored content according to a first user input, receives a second user input through an external output type display unit, synchronizes with the external output type display unit, and provides synchronized content part;
Stores the same content as the headmount type display unit, provides the stored content according to the second user input, receives the first user input through the headmount type display unit and synchronizes with the headmount type display unit , The external output type display unit for providing synchronized content; And
And a communication unit configured to transmit and receive the first user input and the second user input inputted through the head mounted display unit and the external output type display unit, respectively,
The head-mounted display unit is arranged to be movable up, down, left and right in the device,
The external output type display unit is fixedly disposed in the central portion of the device,
The head mounted display unit is located above the external output type display unit,
The head mounted display unit,
Selecting content by using the user's gaze movement as the first user input,
When the user's gaze stops at a specific point for a predetermined time, preset detailed contents related to the specific point are provided,
The virtual reality experience device,
When a VR view is selected after a specific content is selected through the external output type display unit, a large-sized virtual reality experience device including a plurality of displays for dividing the screen of the head mounted display unit. The method of claim 1,
The head mounted display unit and the external output type display unit each include a controller, and control content provision based on the first user input and the second user input, respectively. A large-sized virtual reality experience device that includes. delete The method of claim 1,
The external output type display unit, characterized in that for selecting and manipulating content using a user's touch input as the second user input, a cradle-size virtual reality experience device including a plurality of displays. The method of claim 1,
The head mounted display unit provides content as a 3D image,
The external output type display unit for providing content as a two-dimensional image, a cradle-type virtual reality experience device including a plurality of displays. delete A virtual reality experience method performed by a large-sized virtual reality experience device including a plurality of displays,
Providing content based on a first user input through a head mounted display;
Synchronizing an external output type display in the same state as the content provided by the head mounted display;
Providing content synchronized with the content of the head mounted display through the external output type display;
Changing the content provided through the external output type display based on a second user input, and providing the changed content through the external output type display;
Synchronizing the head mounted display in the same state as the content changed based on the second user input and provided through the external output display; And
And providing content synchronized with the content of the external output type display through the head mounted display,
The head-mounted display is arranged to be movable up, down, left and right in the device,
The external output type display is fixedly disposed in the central portion of the device,
The head mounted display is located above the external output type display,
The head mounted display,
Selecting content by using the user's gaze movement as the first user input,
When the user's gaze stops at a specific point for a predetermined time, preset detailed contents related to the specific point are provided,
When a VR view is selected after a specific content is selected through the external output type display, a virtual reality experience method using a plurality of displays is divided into a screen of the head mounted display. delete The method of claim 7,
The second user input is input by a user's touch, and the external output type display selects and manipulates content through the second user input. The method of claim 7,
The head-mounted display provides content as a 3D image,
An external output type display is a virtual reality experience method using a plurality of displays that provides content as a two-dimensional image.

Images