KR101287251B1 - Apparatus of providing active virtual reality - Google Patents

Abstract

The present invention discloses an apparatus for providing an active virtual reality service. The apparatus according to the present invention includes a sensor unit for sensing change information according to a user's movement, a main control unit for calculating at least one of a viewing distance and a viewing angle of a display device using the change information, and the viewing distance information and the viewing angle information. And a communication unit for transmitting to the display device, wherein the display device outputs a changed image based on the viewing distance information and the viewing angle information. According to the present invention, it is possible to provide a different image according to the user's field of view has the advantage of increasing the realism.

Description

Active Virtual Reality Service Provision Device {APPARATUS OF PROVIDING ACTIVE VIRTUAL REALITY}

The present invention relates to an apparatus for providing an active virtual reality service, and more particularly, to an apparatus capable of providing a realistic 3D image service using glasses equipped with a sensor.

Conventionally, objects on the screen are displayed the same regardless of the position of the user.

For example, when the front of the mobile phone is displayed on the screen, even if the user changes the position, the side or the back of the mobile phone can not be confirmed at all.

Recently, a technique for displaying an object on a touch screen to provide a sense of reality and changing an object direction so that another part of the object can be checked when there is a user's touch has been proposed.

Since the above method requires an artificial manipulation such as a user's touch, there is a lack in making it feel real.

Recently, a 3D display apparatus has been provided to provide a realistic virtual reality service. The 3D display apparatus projects an image corresponding to binocular parallax to the left and right eyes of a user to feel a 3D effect on an object on a screen.

However, even if the 3D display device provides a three-dimensional effect, since the direction of the object cannot be changed according to the position of the user, there is a problem that the reality is inferior.

In addition, in the conventional 3D display device, since all users can see only one image, for example, in a virtual reality game service in which different characters appear, a plurality of users must see only the same part of an object. There is a problem that is not interesting.

In order to solve the problems of the prior art as described above, an object of the present invention is to propose an apparatus for providing an active virtual reality service that can realistically identify an object on a screen.

In order to achieve the above object, according to an embodiment of the present invention, a device that is worn on the user to provide an active virtual reality service, the sensor unit for sensing the change information according to the user's movement; A main controller configured to calculate at least one of a viewing distance and a viewing angle with respect to a display device using the change information; And a communication unit configured to transmit the viewing distance information and the viewing angle information to the display device, wherein the display device is provided with an active virtual reality service providing apparatus for outputting a changed image based on the viewing distance information and viewing angle information.

The main control unit may calculate the viewing distance and viewing angle using a preset reference point of the display device.

The display apparatus may further include a pair of lenses that respectively receive the left and right parallax images output by the display apparatus.

The display device outputs a left and right parallax image for the first image and a left and right parallax image for the second image through a polarizing film, wherein the pair of lenses are coated with a polarizing film and provided with a shutter, and the first image and A left and right parallax image with respect to one of the second images may be selectively input.

According to another aspect of the invention, a display device for providing an active virtual reality service, the image output unit for outputting an image; A communication unit configured to receive the viewing distance information and the viewing angle information of the user from the spectacles worn on the user; And an image changer configured to change an image to be output based on the received viewing distance information and the viewing angle information, wherein the spectacle device senses change information according to a movement of a user, among the viewing distance and viewing angle with respect to the display device. A display device for calculating at least one is provided.

According to the present invention, since the position of the user is detected by using a sensor and the image is changed according to the detected position, there is an advantage of providing a realistic virtual reality service.

1 is a diagram showing the configuration of a virtual reality service providing system according to an embodiment of the present invention.
2 is a view for explaining a virtual reality service according to an embodiment of the present invention.
3 is a block diagram of a display device according to an embodiment of the present invention.
4 is a block diagram of a spectacle device according to an embodiment of the present invention.
5 is a view for explaining a shutter-type stereoscopic video service.
6 is a view for explaining a polarized stereoscopic video service.
7 is a view for explaining a simultaneous viewing service according to another embodiment of the present invention.
8 is a view for explaining a program viewing service according to another embodiment of the present invention.
9 is a view for explaining a game service according to another embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In order to facilitate a thorough understanding of the present invention, the same reference numerals are used for the same means regardless of the number of the drawings.

1 is a diagram showing the configuration of a virtual reality service providing system according to an embodiment of the present invention.

As shown in FIG. 1, the system according to the present exemplary embodiment may include a display apparatus 100 and an eyeglass apparatus 102 in wireless communication with the display apparatus 100.

The display apparatus 100 according to the present exemplary embodiment may be a TV that decodes and outputs an image received from a broadcasting transmission system, but is not limited thereto and includes all terminals capable of outputting an image such as a desktop, a tablet PC, and a mobile communication terminal. can do.

Preferably, the display apparatus 100 may output two images taken in consideration of binocular parallax of a person, and the spectacle apparatus 102 according to the present exemplary embodiment may be disposed on the left and right sides of the glasses through a shutter method or a polarization method. Allow another video to be input.

According to an embodiment of the present invention, the spectacles device 102 is equipped with a sensor that can detect the movement of the user.

The spectacle apparatus 102 calculates a viewing distance and a viewing angle of the display apparatus 100 and the spectacle apparatus 102 according to a user's movement using a sensor.

The glasses apparatus 102 transmits the viewing distance information and the viewing angle information to the display apparatus 100 through the short range wireless communication, and the display apparatus 100 according to the present embodiment outputs an image based on the received information.

In more detail, when the viewing distance information and the viewing angle information are received from the spectacle device 102, the display apparatus 100 corresponds to the current position (viewing distance and viewing angle) of the user through an image correction process or a pre-stored image selection process. Output the video.

Through the above-described process, the user can check the image changed according to his / her movement and thus have a higher realism.

2 is a view for explaining a virtual reality service according to an embodiment of the present invention.

As illustrated in FIG. 2, when the user moves from the first position 200 to the second position 202 in an environment in which a 3D stereoscopic image service is provided, the spectacles device 102 detects the movement of the user. To transmit the viewing distance and viewing angle information at the changed position to the display apparatus 100. The display apparatus 100 outputs an image corresponding to the changed position of the user based on the received viewing distance information and the viewing angle information.

3 is a block diagram of a display apparatus according to an embodiment of the present invention.

As shown in FIG. 3, the display apparatus 100 according to the present exemplary embodiment includes an image output unit 300, a communication unit 302, an image change unit 304, a memory unit 306, and a controller 308. can do.

The image output unit 300 outputs an image according to a user's request, and outputs two images corresponding to binocular disparity when providing a 3D stereoscopic image service.

The communication unit 302 communicates with one or more eyeglasses 102 located at a short distance, and receives viewing distance information and viewing angle information from the eyeglasses 102.

The image changing unit 304 changes the image based on the received viewing distance information and the viewing angle information.

Here, the change of the image may be a process of correcting an image currently output to an image corresponding to a position where the user moves or selecting another image stored in the memory unit 306.

For example, when a predetermined object is displayed on the screen, the image changing unit 304 changes the current image into an image having an enlarged or reduced object in proportion to the viewing distance, and when the viewing angle is changed, a different portion than before. Change to the included video.

The image output unit 300 outputs the changed image as described above so that the user can check the image corresponding to the moved position.

The controller 308 controls overall processes such as image output and image change.

4 is a block diagram of a spectacle device according to an embodiment of the present invention.

As illustrated in FIG. 4, the spectacle device 102 according to the present exemplary embodiment may include a shutter controller 400, a sensor unit 402, a main control unit 404, and a communication unit 406.

In the spectacle device 102 according to the present exemplary embodiment, shutters that are turned on / off at predetermined cycles may be installed in the left and right lenses, and the shutter controller 400 controls the on / off of the shutters so that different images are input to the left and right lenses. .

As shown in FIG. 5, when the spectacle device 102 is a shutter type, the display apparatus 100 sequentially outputs a left view image 500, a black image 502, and a right image 504. Different images are input to the left lens and the right lens through on / off by the shutter controller 400.

In the above description, the spectacle device 102 is described as being a shutter type. However, the spectacle device 102 may be included in the scope of the present invention.

As shown in FIG. 6, in the polarization type, the display apparatus 100 outputs an image 600 in which left and right view images are mixed. The output image is input to the polarizing lens through the polarizing film, and the left field of view image 602 and the right field of view image 604 are input to the left and right polarizing lenses, respectively.

The sensor unit 402 detects a user's movement.

According to an embodiment of the present invention, the sensor unit 402 may include an acceleration sensor 410 and an angular velocity sensor 412.

The main controller 404 calculates the current user's position using information sensed by the acceleration sensor 410 and the angular velocity sensor 412 according to the user's movement.

The location of the current user may be defined as a viewing distance from the display device 100 and a viewing angle with respect to the display device 102.

Here, the viewing distance and the viewing angle may be determined based on a reference point preset for the display apparatus 100.

The reference point may be a center position (eg, a screen center position) of the display apparatus 100, but is not limited thereto and may be set as a main object displayed on the screen. In this case, the reference point may be dynamically changed. Could be.

The viewing distance of the user may be calculated through the coordinate values of the user's eyes (ie, the spectacle device) in space, which may be calculated through the acceleration values in the vertical and horizontal directions according to the user's movement.

Knowing the acceleration values of the vertical and horizontal movements of the user, the absolute position of the user's field of view may be calculated using Equation 1 below.

By integrating the acceleration values () for all user movements in the x, y, and z directions occurring after the initial time twice, the absolute position () of the current user can be known. The field of view can be calculated.

In addition, the acceleration values (x) in the x, y, and z axis directions of the user's movement may be obtained by subtracting the acceleration due to gravity from the sum of all the accelerations measured by the acceleration sensors 410 in each direction. Further, the direction in which the acceleration sensor 410 is facing may be known through the integration of the angular velocity () sensed by the angular velocity sensor 412 as shown in Equation 2 below.

The viewing angle with respect to the display apparatus 100 may be calculated using the directions calculated as described above.

The communication unit 406 transmits the calculated viewing distance and viewing angle information to the display apparatus 100, and the display apparatus 100 outputs an image corresponding to the viewing distance and viewing angle.

In the above description, the image is changed and output according to the viewing distance and the viewing angle in the 3D stereoscopic image service, but the same may be applied to the 2D image.

According to another exemplary embodiment of the present invention, the plurality of users may view different images by using the glasses device 102.

FIG. 7 is a diagram illustrating a simultaneous viewing service according to an embodiment of the present invention, and illustrates an example of providing different images to two users.

In order to provide a simultaneous viewing service, the display apparatus 100 according to the present exemplary embodiment may perform left and right parallax image 700 for a first image (for a first user) and a second image (for a second user). A left and right disparity image 702 and a black image 704 disposed between each disparity image are output.

The output image is input to the spectacles 102-1 and 102-2 of each user via the polarizing film.

In this case, only the first image is input to the spectacle device 102-1 by the polarizing film and the polarizing lens, and only the second image is input to the spectacle device 102-2 of the second user.

Since the shutters provided in the lenses of the respective glasses devices 102 are turned on / off, images of different parallaxes are input to the left and right lenses of the glasses devices 102-1 and 102-2 of each user, thereby allowing each user different images. Can be confirmed in three dimensions.

As shown in FIG. 8, the simultaneous viewing service according to the present exemplary embodiment enables a plurality of users to watch different channels through one display apparatus 100.

When applied to a virtual reality game, the display device 100 uses the viewing distance information and the viewing angle information calculated by each user's glasses device 102-1, 102-2, respectively, and the glasses device 102-1, 102-2 of each user. It can generate an image corresponding to the.

As each user independently receives an image corresponding to his or her location, as shown in FIG. 9, each user may enjoy a game while viewing a virtual reality object that matches his or her own vision in the virtual reality game.

Preferred embodiments of the present invention described above are disclosed for purposes of illustration, and those skilled in the art will be able to make various modifications, changes, and additions within the spirit and scope of the present invention. Additions should be considered to be within the scope of the following claims.

Claims (5)

A device that is worn by a user and provides an active virtual reality service,
A sensor unit configured to sense change information according to a user's movement;
A main controller configured to calculate at least one of a viewing distance and a viewing angle with respect to a display device using the change information;
A communication unit which transmits the viewing distance information and the viewing angle information to the display device; And
Including a pair of lenses for receiving the left and right parallax images respectively output from the display device,
The display device outputs the changed image based on the viewing distance information and the viewing angle information, and outputs the left and right parallax image for the first image and the left and right parallax image for the second image through the polarizing film,
The pair of lenses are coated with a polarizing film and provided with a shutter, and the active virtual reality service providing apparatus for selectively receiving the left and right parallax image for one of the first image and the second image. The method of claim 1,
The main fisherman,
And an active virtual reality service calculating device configured to calculate the viewing distance and viewing angle using a preset reference point of the display device. delete delete A display device that provides an active virtual reality service,
An image output unit which outputs an image;
A communication unit configured to receive the viewing distance information and the viewing angle information of the user from the spectacles worn on the user; And
And an image changer configured to change an image to be output based on the received viewing distance information and viewing angle information.
The image output unit outputs a left and right parallax image for the first image and a left and right parallax image for the second image through a polarizing film,
The spectacle device includes a pair of lenses that sense change information according to a user's movement, calculate at least one of the viewing distance and the viewing angle of the display device, and receive the left and right parallax images, respectively, the pair The lens of the display device is coated with a polarizing film and provided with a shutter, and selectively receives the left and right parallax image for one of the first image and the second image.

Images