KR101665363B1 - Interactive contents system having virtual Reality, augmented reality and hologram - Google Patents

Interactive contents system having virtual Reality, augmented reality and hologram Download PDF

Info

Publication number
KR101665363B1
KR101665363B1 KR1020150064327A KR20150064327A KR101665363B1 KR 101665363 B1 KR101665363 B1 KR 101665363B1 KR 1020150064327 A KR1020150064327 A KR 1020150064327A KR 20150064327 A KR20150064327 A KR 20150064327A KR 101665363 B1 KR101665363 B1 KR 101665363B1
Authority
KR
South Korea
Prior art keywords
image
pattern
reality
hologram
virtual reality
Prior art date
Application number
KR1020150064327A
Other languages
Korean (ko)
Inventor
김주철
Original Assignee
주식회사 인디고엔터테인먼트
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 인디고엔터테인먼트 filed Critical 주식회사 인디고엔터테인먼트
Priority to KR1020150064327A priority Critical patent/KR101665363B1/en
Application granted granted Critical
Publication of KR101665363B1 publication Critical patent/KR101665363B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/157—Conference systems defining a virtual conference space and using avatars or agents
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Abstract

The present invention relates to a specific pattern or image displayed on an upper surface of a media table;
A personal terminal configured to recognize the specific pattern or image;
And a display unit of a virtual reality (VR) apparatus for displaying the image,
(VR) cases and media tables or general monitors or patterns without the need for dedicated special displays or expensive devices, so that they can be implemented simply And an interactive content system in which a virtual reality, an augmented reality, and a hologram are mixed.

Description

TECHNICAL FIELD [0001] The present invention relates to an interactive contents system having a virtual reality, augmented reality, and a hologram,

The present invention relates to an interactive contents system in which a virtual reality, an augmented reality and a hologram are mixed. More specifically, when a specific pattern or image displayed on a media table is recognized through a virtual reality apparatus equipped with a camera, An augmented reality, and a hologram in which a hologram image or a moving image of a 3d object is imaged on the display of the virtual reality apparatus through the virtual reality system.

The reality displayed through the display device is divided into a real reality (real reality) shot through a camera and a virtual reality (virtual reality) that does not exist in the real world but represents a virtual world created through a computer. Fiction) There is Chroma-Key Reality, which is a combination of virtual reality and actual reality shot in front of blue screen according to predetermined scenarios such as movie. Chroma-key reality belongs to virtual reality in classification.

Recently, the Augmented Reality which displays real-time virtual reality data on real-world objects by the progress of continuous information technology has been proposed. The augmented reality is distinguished from the reality of chroma key in that there is no predefined scene scenario like SF movie and reality reality is not shot in front of blue screen.

As a method of determining an object to display virtual reality data on an actual reality in the augmented reality, there is a method of displaying a marker on an actual reality, then recognizing the marker and displaying a virtual reality data on the marker There are augmented reality and a markerless augmented reality in which virtual reality data is displayed by directly recognizing an actual real object without displaying a marker in actual reality. Currently, a number of trial services are provided using each marker, but there is no standardization of the marker configuration at all. Markerless augmented reality is a case in which realistic reality in which a predetermined object is photographed in a studio is used But it is not demonstrated due to the instability of object recognition.

In addition, as a method of displaying virtual reality data in an actual reality in the augmented reality, there is a method of recognizing an object in a marker / markerless manner from an actual reality photographed through a camera and stored in a storage medium, There is a method of displaying an object in a marker / markerless manner from an actual reality photographed in real time through a camera and displaying virtual reality data on the recognized object. In addition to the above-mentioned method, Using transparent objects (such as glasses, goggles, glass windows, etc.) that look at the actual reality beyond the eyes of the human being as a transparent display without photographing the reality, and the sensor technology allows the human eye to see an object And there is a theoretical way to display the virtual reality data on the transparent display All.

The augmented reality may include displaying a hologram in a real world space. When the augmented reality includes a hologram, the hologram should be displayed in consideration of the environment of the real world. However, it is very difficult to apply the environment of the real world with many indeterminate factors to the hologram.

In addition, in the conventional augmented reality system, the contents are not output even if the target image is partially deviated from the camera range, and the virtual reality system can only drive the viewpoint according to the turning direction of the head. There was a need to prepare the device.

In addition, the conventional hologram system requires a dedicated special display, so that it is inexpensive and portable, making it difficult to implement it universally.

Korean Patent Application Publication No. 10-2011-0136017 Korean Patent Application Publication No. 10-2011-0070210

SUMMARY OF THE INVENTION The present invention has been made to solve the problems of the prior art described above, and it is an object of the present invention to provide a virtual reality apparatus, An object of the present invention is to provide an interactive contents system in which real, augmented reality, and hologram are mixed.

Further, in the present invention, when recognizing a plurality of patterns or images attached on a table, contents can be continuously output on the virtual reality apparatus even if only two or more patterns and 20% or more of images are recognized, The object of the present invention is to provide an interactive contents system in which a virtual reality, an augmented reality, and a hologram, which are freely viewable in all directions desired by the viewer while the apparatus is directed to a specific pattern or image, are mixed.

As a means for solving the above-mentioned problems, in the embodiment of the present invention, a specific pattern or image displayed on the upper surface of the media table; A personal terminal configured to recognize the specific pattern or image; And a display unit of a virtual reality (VR) apparatus for displaying the image,

The personal terminal includes a control unit for displaying a synthesized image on a touch screen in the form of an Augmented Reality (AR) by matching a target image pre-stored in a specific pattern or image recognized through a camera .

In a preferred embodiment of the present invention, the specific pattern is composed of a plurality of patterns, and can be distinguished by the interval between the pattern and the pattern, and the recognition range can be dramatically enlarged by recognizing two or more patterns .

In a preferred embodiment of the present invention, the personal terminal includes a gyro sensor and a compass function, and allows a viewer to freely view output in a corresponding direction according to a direction in which a viewer faces a specific pattern or image .

In a preferred embodiment of the present invention, the personal terminal is capable of embodying a 3D objectized hologram, an image, or a moving image.

In a preferred embodiment of the present invention, the control unit determines whether or not pattern shapes on an input image match; Whether two or more patterns on the input image are visible; And determining whether or not all of the three conditions are matched with whether or not the interval between the table edge and the pattern matches the interval between the pattern and the pattern.

In a preferred embodiment of the present invention, the control unit is configured to match an existing image edge and a target image edge to produce a synthesized image as a side by side image.

According to the present invention, the following effects can be achieved by this configuration.

In the interactive contents system in which the virtual reality, the augmented reality, and the hologram are mixed according to the present invention, since a pattern or an image recognized by the camera is added as a reference point, it is possible to change the viewpoint according to the movement line of the viewer without a separate motion tracking device, It is possible to achieve the effect that the augmented reality realization can be easily realized by only the output paper of smartphone, virtual reality case, media table, general monitor or pattern owned by the spectator.

In addition, since the image outputted through the camera can be freely viewed in any direction desired by the viewer, it can be output as various images such as a building, a character, a chart graph, The present invention can be used as a service for returning various image media such as a virtual exhibition system of a digital display system, a digital auxiliary image system at a meeting, a hologram for an individual, and moving images.

FIG. 1 is a block diagram schematically showing an interactive contents system in which a virtual reality, an augmented reality, and a hologram are mixed according to an embodiment of the present invention.
FIG. 2 is a configuration diagram schematically illustrating an individual terminal included in an interactive contents system in which a virtual reality, an augmented reality, and a hologram are mixed according to an embodiment of the present invention,
FIG. 3 is a flowchart schematically showing a driving method of an interactive contents system in which a virtual reality, an augmented reality, and a hologram are mixed according to an embodiment of the present invention,
FIG. 4 is a diagram illustrating an example in which an interactive content system in which a virtual reality, an augmented reality, and a hologram are mixed according to an embodiment of the present invention,
FIG. 5 is a diagram illustrating an example in which a pattern recognition method is applied through a camera of an interactive contents system in which a virtual reality, an augmented reality, and a hologram are mixed according to an embodiment of the present invention,
FIG. 6 is a diagram illustrating an example in which an interactive content system in which a virtual reality, an augmented reality, and a hologram are mixed according to a direction is applied in different directions according to an embodiment of the present invention.

Hereinafter, an interactive content system in which a virtual reality, augmented reality, and a hologram are combined according to the present invention will be described in detail with reference to the accompanying drawings. It is to be noted that like elements in the drawings are represented by the same reference numerals as possible. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

FIG. 1 is a block diagram schematically showing an interactive contents system in which a virtual reality, an augmented reality, and a hologram are mixed according to an embodiment of the present invention. FIG. 2 is a block diagram of a virtual reality, an augmented reality, and a hologram according to an embodiment of the present invention. 3 schematically shows a driving method of an interactive contents system in which a virtual reality, an augmented reality, and a hologram are mixed according to an embodiment of the present invention. FIG. 3 is a block diagram schematically showing a personal terminal included in a mixed interactive contents system FIG. 4 is a diagram illustrating an example in which an interactive content system in which a virtual reality, an augmented reality, and a hologram are mixed according to an embodiment of the present invention. FIG. 5 is a block diagram illustrating an example of a virtual reality, And a pattern recognition method is applied through a camera of an interactive contents system in which a hologram is mixed, and FIG. FIG. 6 is a diagram illustrating an example in which an interactive content system in which a virtual reality, an augmented reality, and a hologram are mixed according to a direction is applied in different directions according to an embodiment of the present invention.

1, a personal terminal 200 having a pattern or an image 100 and a camera for recognizing the pattern or the image 100 is installed, and the personal terminal 200 is installed, And a virtual reality (VR) device 300 for synthesizing the recognized image and the target image to output an augmented reality image.

The pattern or image 100 may be displayed on the upper side of the media table. The pattern may be arranged in approximately six patterns to recognize two or more patterns. In the case of an image, So that the output of the contents on the virtual VReality (VR) device 300 can be continued. Accordingly, even if the user turns his / her head or the viewpoint changes and the camera moves out of the pattern as shown in FIG. 4, the recognition range can be dramatically enlarged and output, So that it is possible to change the viewpoint according to the movement line of the spectator even if the motion tracking device for providing the viewpoint change according to the step of the spectator is not separately configured.

The personal terminal 200 includes a mobile phone, a smart phone, a PDA (personal digital assistant), a portable multimedia player (PMP), navigation, and the like, .

The personal terminal 200 can download an application using wireless communication, and can drive a downloaded app to output an enhanced or virtualized image.

Here, the personal terminal 200 includes an input unit 210 for receiving a specific pattern or image 100 recognized through the camera, and an input unit 210 for outputting the synthesized image by matching an image received through the input unit 210 with a previously stored target image. A control unit 220 for displaying an image obtained in the form of an Augmented Reality (AR) on the touch screen, an output unit for outputting the image synthesized through the control unit 220 in a side by side manner, 230).

The input unit 210 allows the specific pattern or image 100 recognized through the camera to be converted into data.

The control unit 220 includes an actual reality recognition module 221 for recognizing a real situation and a pattern recognition module 222 for recognizing a specific pattern or image 100 located on the actual reality recognition module 221, A calculation module 223 for determining whether the pattern received by the pattern recognition module 222 can be combined with a target image, a hologram / moving image A target image storage module 224 for storing a target image of the target image stored in the target image storage module 224 and a target image storage module 224 for matching the target image provided by the target image storage module 224 with an existing image recognized by the actual reality recognition module 221, An image providing module 226 for providing the synthesized image provided by the image synthesizing module 225 to the output unit 230 and a display unit 226 for displaying the synthesized image provided by the image synthesizing module 225, So that And a sensor module 227 for sensing the position of the sensor module.

The actual reality recognition module 221 can recognize a reality that is actually photographed through a camera, and the data recognized by the actual reality recognition module 221 is provided to an image synthesis module 225, which will be described later, So that the edge of the target image can be matched.

The pattern recognizing module 222 recognizes the specific pattern or the image 100 and generates data. The specific pattern is composed of a plurality of patterns and can be distinguished by the pattern, The output for the image is not provided.

The calculation module 223 can determine whether the pattern recognized by the pattern recognition module 222 can be synthesized with the target image. Whether or not the pattern can be synthesized can be classified into three conditions as below, So that the target image can be called from the target image storage module 224.

First, whether pattern patterns on the input image match or not;

Second, whether or not two or more patterns on the input image are visible;

Third, it consists of whether or not the edges of the table match the spacing between the pattern and the pattern.

If all three conditions are not met, only the data recognized by the actual reality recognition module 221 can be output through the output unit 230.

The target image storage module 224 stores a hologram / moving image and the like, and stores a target image matching a specific pattern.

The image synthesis module 225 allows the calculation module 223 to synthesize a target image matching a specific pattern or image in accordance with a condition of recognition of a specific pattern or image.

The image providing module 226 is provided to the output unit 230 so that the image synthesized by the image synthesizing module 225 can be provided to the output unit 230. The image providing module 226 can be used for not only a stereoscopic hologram but also a conference material such as a building, And so on.

The sensor unit 227 includes a gyro sensor and a compass function. The sensor unit 227 allows a viewer to freely view an output in a corresponding direction according to a direction in which a viewer faces a specific pattern or image. 100) can be recognized at the same time, it is possible to view the output of the angle corresponding to each viewer's direction

The output unit 230 is configured to image the data received from the image providing module 226 and output the image. The output unit 230 recognizes the direction through the sensor unit 227 according to the viewpoint or the viewpoint of the spectator, The plurality of personal terminals 200 recognizing the same pattern and the image 100 simultaneously output the same output, and the sensor unit 227 outputs the same output, Image, moving image or the like through the output unit 230 according to the direction detected by the output unit 230.

The virtual reality (VR) device 300 is installed on the front side of the personal terminal 200 and includes a lens inside to divide the screen output from the personal terminal 200 into left and right images, One eye, that is, the left and right sides of the image, allows viewers to feel stereoscopic.

Here, the virtual reality (VR) device 300 may be a commercially available card board, and the structure and principle of the card board will not be described in detail with a known technology.

While the applicant has described various embodiments of the present invention, it is to be understood that such embodiments are merely one embodiment of the technical idea of the present invention, and that any changes or modifications as far as implementing the technical idea of the present invention are within the scope of the present invention Should be interpreted as belonging to.

100: pattern or image
200: Personal terminal
300: Virtual VReality (VR) device

Claims (6)

A specific pattern or image displayed on the upper surface of the media table;
A personal terminal configured to recognize the specific pattern or image;
And a display unit of a virtual reality (VR) apparatus for displaying the image,
The personal terminal includes a control unit for displaying a synthesized image on a touch screen in the form of an Augmented Reality (AR) by matching a target image previously stored in a specific pattern or image recognized through a camera,
The specific pattern is composed of a plurality of patterns and can be distinguished according to the spacing between the pattern and the pattern. By recognizing two or more patterns out of the six patterns, the recognition range can be dramatically enlarged. By recognizing more than 20%, the output can be outputted,
The control unit
Whether or not pattern shapes on an input image match;
Whether more than one pattern on the input image is visible or more than 20% of the input image is visible;
And an operation module for determining whether all three conditions are satisfied among the edge of the table and whether or not the interval between the pattern and the pattern coincides with each other.
delete delete The method according to claim 1,
Wherein the personal terminal is capable of embodying a hologram, an image, or a moving image in the form of a 3D object, wherein the hologram, the augmented reality, and the hologram are mixed.
delete delete
KR1020150064327A 2015-05-08 2015-05-08 Interactive contents system having virtual Reality, augmented reality and hologram KR101665363B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150064327A KR101665363B1 (en) 2015-05-08 2015-05-08 Interactive contents system having virtual Reality, augmented reality and hologram

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150064327A KR101665363B1 (en) 2015-05-08 2015-05-08 Interactive contents system having virtual Reality, augmented reality and hologram

Publications (1)

Publication Number Publication Date
KR101665363B1 true KR101665363B1 (en) 2016-10-24

Family

ID=57256510

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150064327A KR101665363B1 (en) 2015-05-08 2015-05-08 Interactive contents system having virtual Reality, augmented reality and hologram

Country Status (1)

Country Link
KR (1) KR101665363B1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018090056A3 (en) * 2016-11-14 2018-08-02 Taqtile Cross-platform multi-modal virtual collaboration and holographic maps
KR20230015800A (en) 2021-07-23 2023-01-31 주식회사 더가람 Method of providing synchronized virtual reality and augmented contents in vehicle such as a bus and a system thereof
KR20230015799A (en) 2021-07-23 2023-01-31 주식회사 더가람 Method of providing movable hologram contents in vehicle such as a bus and a system thereof

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060115023A (en) * 2005-05-03 2006-11-08 (주)아이미디어아이앤씨 Image code and method and apparatus for recognizing thereof
KR20110070210A (en) 2009-12-18 2011-06-24 주식회사 케이티 Mobile terminal and method for providing augmented reality service using position-detecting sensor and direction-detecting sensor
KR20110104243A (en) * 2010-03-16 2011-09-22 에스케이텔레콤 주식회사 Recognition apparatus and method of occluded marker in augmented reality
KR20110136017A (en) 2010-06-14 2011-12-21 주식회사 비즈모델라인 Augmented reality device to display hologram object
KR20140146889A (en) * 2013-06-18 2014-12-29 엘지전자 주식회사 Electric device and operation method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060115023A (en) * 2005-05-03 2006-11-08 (주)아이미디어아이앤씨 Image code and method and apparatus for recognizing thereof
KR20110070210A (en) 2009-12-18 2011-06-24 주식회사 케이티 Mobile terminal and method for providing augmented reality service using position-detecting sensor and direction-detecting sensor
KR20110104243A (en) * 2010-03-16 2011-09-22 에스케이텔레콤 주식회사 Recognition apparatus and method of occluded marker in augmented reality
KR20110136017A (en) 2010-06-14 2011-12-21 주식회사 비즈모델라인 Augmented reality device to display hologram object
KR20140146889A (en) * 2013-06-18 2014-12-29 엘지전자 주식회사 Electric device and operation method thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018090056A3 (en) * 2016-11-14 2018-08-02 Taqtile Cross-platform multi-modal virtual collaboration and holographic maps
US10572101B2 (en) 2016-11-14 2020-02-25 Taqtile, Inc. Cross-platform multi-modal virtual collaboration and holographic maps
KR20230015800A (en) 2021-07-23 2023-01-31 주식회사 더가람 Method of providing synchronized virtual reality and augmented contents in vehicle such as a bus and a system thereof
KR20230015799A (en) 2021-07-23 2023-01-31 주식회사 더가람 Method of providing movable hologram contents in vehicle such as a bus and a system thereof

Similar Documents

Publication Publication Date Title
US10083540B2 (en) Virtual light in augmented reality
US8866848B2 (en) Image processing device, control method for an image processing device, program, and information storage medium
US20180114353A1 (en) Integrating Real World Conditions into Virtual Imagery
CN109478344B (en) Method and apparatus for synthesizing image
US20120274745A1 (en) Three-dimensional imager and projection device
EP2434458A2 (en) Image processing program, apparatus, system, and method for mixed reality
US10792567B2 (en) Terminal device, system, program, and method
KR20140082610A (en) Method and apaaratus for augmented exhibition contents in portable terminal
US9681122B2 (en) Modifying displayed images in the coupled zone of a stereoscopic display based on user comfort
KR102431712B1 (en) Electronic apparatus, method for controlling thereof and computer program product thereof
US11720996B2 (en) Camera-based transparent display
US10748341B2 (en) Terminal device, system, program and method for compositing a real-space image of a player into a virtual space
CN105611267B (en) Merging of real world and virtual world images based on depth and chrominance information
CN110692237B (en) Method, system, and medium for lighting inserted content
WO2014108799A2 (en) Apparatus and methods of real time presenting 3d visual effects with stereopsis more realistically and substract reality with external display(s)
US11961194B2 (en) Non-uniform stereo rendering
KR101665363B1 (en) Interactive contents system having virtual Reality, augmented reality and hologram
US11508130B2 (en) Augmented reality environment enhancement
US11094095B2 (en) Focal length compensated augmented reality
KR102358997B1 (en) The service platform for multi-user supporting extended reality experience
US8767053B2 (en) Method and apparatus for viewing stereoscopic video material simultaneously with multiple participants
JP7403256B2 (en) Video presentation device and program
JP7214926B1 (en) Image processing method, device, electronic device and computer-readable storage medium
JP2023174066A (en) Image processing apparatus, image processing method, and program
KR20210014270A (en) Indivisualizing method for augmented reality contents

Legal Events

Date Code Title Description
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20190826

Year of fee payment: 4