KR20190051443A - Hologram apparatus using hologram box include three­dimensional scanning type and the method thereof - Google Patents

Abstract

The present invention relates to a hologram device using a hologram box including a three-dimensional scanning method for obtaining three-dimensional modeling data from an image of a target object located in the hologram box, and a method thereof. Three-dimensional modeling data for a target object obtained by using at least one camera and a structured light pattern generator in the hologram box can be applied to a three-dimensional hologram image.

Description

[0001] HOLOGRAM APPARATUS USING HOLOGRAM BOX INCLUDE THREEDIMENSIONAL SCANNING TYPE AND THE METHOD THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a hologram apparatus using a hologram box including a three-dimensional scanning method and a method thereof, and more particularly to a technique for obtaining three-dimensional modeling data from an image of a hologram box .

In recent years, a content display device using a similar hologram method has received the spotlight. Content display devices are increasingly expanding from advertising and display to entertainment.

A similar hologram device is a device that reflects and displays an image of an LCD (Liquid Crystal Display) panel using a semi-transparent glass or a reflective plate using a similar material, and displays an optical illusion such as a floating image on the user to provide.

Such a similar hologram apparatus is generally used as a projector apparatus which displays contents displayed on a screen of a computer and a TV in a predetermined area. However, the game development using the similar hologram device in the arcade game market is insufficient.

Oculus Rift, HTC Vive and VR PlayStation have recently been launched in the arcade game market. However, since the introduction of the VR HMD (Head Mounted Display) platform, not.

It is analyzed that the research and development of various games using the newly launched platform is not active and the price of VR equipment due to the increase of R & D cost is burdened to the general public.

In addition, HMD or stereoscopic type games generally suffer from dizziness and eye fatigue.

On the other hand, arcade games using holograms can realize hologram images at an additional cost of less than 10% of existing arcade games, and can utilize the contents of existing arcade games, resulting in more cost competitiveness than games.

Accordingly, game developers are making holograms or 3D equipment to increase the immersion of games, but it takes a lot of time and cost to implement a complete technology, so that they have not been able to launch commercially successful products or services.

Furthermore, game technology using existing holograms or 3D equipment is merely a technology for providing game images of 2D or 3D, and it is difficult to apply realistic objects (for example, dolls, models, toys, etc.) There is no technique for acquiring 3D modeling data.

Korean Patent Publication No. 1020140145498 (Dec. 23, 2014), " Hologram Transparent LCD Media Box &

An object of the present invention is to provide a technique for acquiring an image of a target object located in a hologram box and applying three-dimensional modeling data according to a plurality of images to a three-dimensional hologram image.

It is also an object of the present invention to provide a technique for acquiring three-dimensional modeling data for a target object using at least one camera and a structured light pattern generator in a hologram box.

It is another object of the present invention to provide a technique capable of providing various hologram images according to motion of a target object by applying three-dimensional modeling data on the object to the three-dimensional hologram image.

A hologram apparatus using a hologram box including a three-dimensional scanning method according to an embodiment of the present invention includes a display unit including at least one of a first display and a second display, And a second display for converting a direction of an image irradiated by the at least one of the first display and the second display to provide a three-dimensional hologram image, a camera for acquiring an image of a target object located in the hologram box, Dimensional modeling data for the target object by using the 3D modeling data and converting the information of the object based on the obtained 3D modeling data into a database.

The object may be located on a table in the hologram box, and the table may be rotatable.

The camera is located in at least one of the hologram boxes and is capable of obtaining a plurality of images of the object rotating on the table.

The controller may acquire a depth image using a multi-view image based on the acquired plurality of images, and acquire three-dimensional modeling data on the object from the obtained depth image.

The hologram box may include at least one camera for acquiring an image of the object, and a structured light pattern generator for irradiating a predetermined light to the object.

The structured light pattern generator may generate a structured light of a specific pattern using a projector light source and irradiate the structured light to the object to obtain a structured light pattern image for the object.

The control unit obtains a depth image using the plurality of images obtained from the camera and the structured light pattern image obtained from the structured light pattern generator, and acquires three-dimensional modeling data on the object from the obtained depth image .

The control unit may apply the acquired 3D modeling data to the 3D holographic image to provide an image of an augmented reality using the object in actuality.

The first display may be formed on one side of the hologram box, and the second display may be formed on the other side of the hologram box perpendicular to the first display.

The reflection plate reflects or refracts an image irradiated on the first display and transmits the image irradiated on the second display to provide the three-dimensional hologram image observable from one side.

The reflection plate is included in at least one of the hologram boxes. The reflection plate is positioned at a right angle to the first display to reflect or refract or transmit the image illuminated from the first display and the second display, It is possible to provide the three-dimensional hologram image which is possible.

A method of operating a hologram apparatus using a hologram box including a three-dimensional scanning method according to an embodiment of the present invention includes the steps of acquiring an image of a target object using a camera in the hologram box, Acquiring three-dimensional modeling data (3D Modeling) data of the object using the plurality of acquired images, and acquiring 3D modeling data of at least one of a first display and a second display having different display directions using the reflector included in the hologram box And converting the direction of the image to be irradiated in at least one of the three or more images to provide the three-dimensional hologram image including the three-dimensional modeling data.

Wherein the obtaining of the 3D modeling data includes obtaining a depth image using a multi-view image based on a plurality of images obtained from the camera on the object positioned on the rotatable table, Dimensional modeling data for the object.

The hologram box may include at least one camera for acquiring an image of the object, and a structured light pattern generator for irradiating a predetermined light to the object.

The structured light pattern generator may generate a structured light of a specific pattern using a projector light source and irradiate the structured light to the object to obtain a structured light pattern image for the object.

The obtaining of the 3D modeling data may include obtaining a depth image using the plurality of images obtained from the camera and the structured light pattern image obtained from the structured light pattern generator, Modeling data can be obtained.

The step of applying the 3D hologram image to the 3D hologram image may provide an image of an augmented reality using the 3D object model by applying the 3D modeling data to the 3D hologram image.

According to an embodiment of the present invention, an image for a target object located in a hologram box can be obtained, and three-dimensional modeling data according to a plurality of images can be applied to a three-dimensional hologram image.

According to an embodiment of the present invention, at least one camera and a structural light pattern generator in the hologram box can be used to obtain three-dimensional modeling data for a target object.

In addition, according to the embodiment of the present invention, by applying the three-dimensional modeling data on the object to the three-dimensional hologram image, it is possible to provide various hologram images according to the motion of the object.

1 is a block diagram showing the configuration of a hologram apparatus including a three-dimensional scanning method according to an embodiment of the present invention.
FIG. 2 illustrates an example of a structure of a hologram device including a three-dimensional scanning method according to an embodiment of the present invention.
FIGS. 3, 4A and 4B illustrate a detailed configuration of a hologram device including a three-dimensional scanning method according to an embodiment of the present invention.
5A to 5D show an example of a structure of a hologram box according to an embodiment of the present invention.
6A and 6B illustrate application examples of a hologram apparatus including a three-dimensional scanning method according to an embodiment of the present invention.
FIG. 7 is a flowchart illustrating an operation method of a hologram apparatus including a three-dimensional scanning method according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to or limited by the embodiments. In addition, the same reference numerals shown in the drawings denote the same members.

Also, terminologies used herein are terms used to properly represent preferred embodiments of the present invention, which may vary depending on the viewer, the intention of the operator, or the custom in the field to which the present invention belongs. Therefore, the definitions of these terms should be based on the contents throughout this specification.

The present invention relates to a hologram apparatus using a hologram box including a three-dimensional scanning method and a method thereof. By acquiring three-dimensional modeling data from an image of an object located in a hologram box, And provides a three-dimensional holographic image of the image.

Although the hologram apparatus of the present invention is not limited to the game field, the hologram apparatus of the present invention can be applied to a stereoscopic image, a three-dimensional image, and a general display It is natural that it can be provided as an image. In addition, the present invention is applicable to various fields for providing hologram images such as a billboard, a small display device, and an interior including a game field.

Hereinafter, the present invention will be described in detail with reference to FIGS. 1 to 7. FIG.

1 is a block diagram showing the configuration of a hologram apparatus including a three-dimensional scanning method according to an embodiment of the present invention.

Referring to FIG. 1, a hologram apparatus 100 including a three-dimensional scanning method according to an embodiment of the present invention includes three-dimensional modeling data obtained from an image of a target object located in a hologram box, To be applied.

Accordingly, the hologram apparatus 100 including the three-dimensional scanning method according to an embodiment of the present invention includes a display unit 110, a reflection plate 120, a camera 130, and a controller 140.

The display unit 110 includes at least one of a first display and a second display. For example, the display unit 110 may include only one or a plurality of first displays, and may include only one or a plurality of second displays, and may include a first display and a second display, respectively, You may.

More specifically, the first display may be formed on one side of the hologram box, and the second display may be formed on the other side of the hologram box perpendicular to the first display. For example, the first display may be located at the top or bottom of the hologram box, and the second display may be located at a side orthogonal to the first display.

According to an embodiment, the first display may provide a foreground image of a three-dimensional hologram image and the second display may provide a background image. In this case, the first display may provide a foreground image with a flipped image that is flipped horizontally in consideration of the phenomenon that the image is flipped by the reflection plate 120.

For example, the display unit 110 may provide a menu button, a text image including content and text information, an exhibition image such as a foreground image and a background image, and provide a hologram-based game image and advertisement to the user The first display and the second display.

In general, the display unit 110 may render different images on the first display and the second display according to the dual graphics applied to the three-dimensional hologram image.

According to an embodiment, the display unit 110 may be an LCD panel (TFT LCD) as a panel for outputting an exhibition image, but may be an LED or OLED monitor, or a mobile device of a smartphone and a tablet PC. In addition, the display unit 110 may include a flexible or transparent display.

The reflection plate 120 converts a direction of an image irradiated by at least one of the first display and the second display to provide a three-dimensional hologram image.

For example, the reflector 120 may reflect, refract, or transmit an image illuminated in the first display and the second display.

Depending on the embodiment, the reflector 120 is included as a single within the hologram box and may be installed at an angle to the first display within a range of 45 degrees to 60 degrees. At this time, the reflection plate 120 may reflect or refract the image to be illuminated in the first display and transmit the image to be illuminated in the second display to provide a three-dimensional holographic image that can be observed from one side (single side) .

' 형태로 형성될 수 있다. 이 때, 반사판(120)은 제1 디스플레이 및 제2 디스플레이에서 조사되는 영상을 반사 또는 굴절시키거나, 투과시켜 3측면(다측면)에서 관측이 가능한 3차원 홀로그램 영상을 제공할 수 있다. According to another embodiment, the reflector 120 is included in at least one of the hologram boxes,

May be formed. At this time, the reflection plate 120 can provide a three-dimensional hologram image which can be observed from three sides (multiple sides) by reflecting, refracting or transmitting an image irradiated from the first display and the second display.

Here, the reflection plate 120 may have a shape in which a reflection film is coated on a general glass or tempered glass of 3 mm or more, and the brightness of the image is enhanced and the blurring effect is improved due to the reflection coating. That is, the image irradiated from the first display and the second display can be surface-reflected at the surface of the reflection-coated reflector 120.

However, since the reflection plate 120 may be formed of various glass materials in addition to ordinary glass or tempered glass, the type and thickness of the glass and the material and shape of the reflection film are not limited thereto. Further, the angle and shape of the reflection plate 120 can be changed according to the size and shape of the hologram box or the embodiment to which the invention is applied.

The camera 130 acquires an image for an object located in the hologram box.

For example, the object may be an object such as a figure, a doll, a toy, and may be placed on a table in a hologram box. At this time, the table is rotatable.

For example, the camera 130 may be in the form attached to either side of the hologram box and attached to one or more walls of the hologram box. Here, the camera is characterized by a single camera, but may be a plurality of cameras depending on the embodiment.

According to an embodiment, when using a single camera 130, the camera 130 acquires a plurality of images for the rotatable object, and when using the plurality of cameras 130, the stereo camera 130 may rotate A plurality of images can be obtained for a stationary object.

In addition, the camera 130 may acquire an image according to a predetermined time interval with respect to a rotating object, and may acquire an image from at least one of a shape, a size, and a color .

The control unit 140 acquires 3D modeling data for a target object by using a plurality of images obtained for the target object, and converts the information of the object based on the obtained 3D modeling data into a database.

According to the first embodiment, the control unit 140 may acquire a depth image using a multi-view image based on the plurality of acquired images, and acquire three-dimensional modeling data on the object from the obtained depth image.

For example, the control unit 140 can acquire a multi-view image from a plurality of images for a rotating object. At this time, the viewpoints of objects of the object are different according to the positions of the camera 130, and a plurality of images having different viewpoints are called multi-view images.

Furthermore, the controller 140 may generate a continuous synchronization signal to control synchronization between a plurality of images, and may store a multi-view image obtained by a plurality of images. Thereafter, the control unit 140 acquires depth images by calculating the parallax values of the pixels coinciding with each other in each pixel region of the object based on the multi-view image, using the triangulation method, and acquires the 3D modeling data Can be obtained.

In addition, the hologram apparatus 100 including the three-dimensional scanning method according to the embodiment of the present invention includes at least one camera for acquiring an image of a target object in the hologram box and a structured light pattern generator for irradiating a target light with a predetermined light . At this time, the structured light pattern generator can generate the structured light of a specific pattern using the light source of the projector and irradiate the structured light to the object. Here, the light source of the projector may be a projector such as a generalized LED, an LCD, or a laser.

According to the second embodiment, the control unit 140 of the hologram apparatus 100 including the three-dimensional scanning method according to the embodiment of the present invention projects the second display into a black image, and the structured light pattern generator outputs the light source of the projector When the structure light of a specific pattern is generated and irradiated to a target object, the camera 130 can acquire an image of the target object. At this time, assuming that the projector is a virtual camera, the structure light pattern generator and the single camera depth information estimation method can acquire the depth image by applying the triangulation method on the same principle as the stereo camera.

Thereafter, the controller 140 acquires a depth image using the obtained image and the obtained structured optical pattern image, and acquires three-dimensional modeling data on the object from the obtained depth image.

That is, the control unit 140 can provide the image of the augmented reality using the actual object by applying the three-dimensional modeling data of the object obtained through the first or second embodiment to the three-dimensional hologram image .

In addition, the controller 140 may apply the 3D modeling data to the 3D hologram image provided to the user through the display unit 110 and the reflection plate 120. For example, the controller 140 may apply the size, shape, color, and position of the target object to the 3D hologram image based on the 3D modeling data, and provide the augmented reality content or service in a customized manner to the target object. According to the embodiment, the control unit 140 may provide augmented reality contents in which a fire comes out from a mouth position of a target object, or provide a game service such as jumping rope according to movement such as jump, You can also provide

1, the controller 140 of the hologram apparatus 100 including the three-dimensional scanning method according to the embodiment of the present invention includes a blue screen or a blue screen on the second display, A black image can be applied.

In addition, the controller 140 can position the motor at the bottom of the table on which the object in the hologram box is located according to a specific angle. For example, the control unit 140 may rotate the object by applying a motor displacement angle at the bottom of the table, and may rotate at least one of rotation on / off, rotation pause, rotation direction, Any one of the operations can be controlled.

In addition, the control unit 140 may control the operation of the camera 130 to control image acquisition according to a predetermined time interval.

In addition, the control unit 140 may control the database unit 150 to store and maintain the three-dimensional modeling data on the obtained object. For example, the database unit 150 classifies categories such as dolls, toys, and figures as well as the brand, color, size, and form of the object, stores, maintains, and updates the three-dimensional modeling data for the object, .

FIG. 2 illustrates an example of a structure of a hologram device including a three-dimensional scanning method according to an embodiment of the present invention.

2, a hologram apparatus 200 including a three-dimensional scanning method according to an embodiment of the present invention includes a hologram box including a first display 211 and a second display 212, (10).

The hologram apparatus 200 including the three-dimensional scanning method according to the embodiment of the present invention can use a hologram box in the form of a three-dimensional space composed of the first display 211 and the second display 212, Can be located in a certain area in the hologram box of the three-dimensional space.

At this time, the object 10 may be an object such as a figure, a doll and a toy, and may exist on a table. The table is rotatable 360 degrees.

According to an embodiment, the first display 211 and the second display 212 may be an LCD panel (TFTLCD) as a panel for outputting an exhibition image, but may be an LED or an OLED monitor. In addition, the first display 211 and the second display 212 may be flexible or transparent, and may be at least one of a smartphone and a tablet PC.

2, the hologram apparatus 200 including the three-dimensional scanning method according to the embodiment of the present invention includes a first display 211 and a second display 212 that are orthogonal to each other, 1 display 211 and the second display 212 in a slanted form. Accordingly, the hologram device 200 including the three-dimensional scanning method according to the embodiment of the present invention can increase the stereoscopic effect of the three-dimensional hologram image of the hologram.

FIGS. 3, 4A and 4B illustrate a detailed configuration of a hologram device including a three-dimensional scanning method according to an embodiment of the present invention.

3 illustrates a front view of a hologram apparatus 300 including a three-dimensional scanning method according to the present invention. FIG. 4A illustrates a hologram apparatus 400 including a three- And FIG. 4B is a side view of the hologram device 400 including the three-dimensional scanning method according to the present invention including the structural light pattern generator.

3, 4A and 4B, a hologram apparatus 300, 400 including a three-dimensional scanning method according to an embodiment of the present invention includes a first display 311, 411 in a hologram box, a second display 312 And 412 and reflectors 320 and 420 and cameras 330 and 430 and may include the object 10 located on the table 11.

In this case, the first displays 311 and 411 and the second displays 312 and 412 may be formed in an orthogonal shape and may be an LCD panel (TFT LCD) as a panel for outputting an exhibition image, .

Referring to FIG. 3, the reflector 320 may be formed in a triangle shape located on the bottom surface of the target body 10 and positioned in the shape of '∧' about the target body 10, Referring to 4b, the reflector 420 may be in a tetrahedron form. At this time, the reflection plates 320 and 420 may reflect or refract or transmit the images irradiated by the first displays 311 and 411 and the second displays 312 and 412 to provide a three-dimensional hologram image. Here, the reflection plates 320 and 420 may be formed by coating a general glass with a reflection film, and it is possible to provide an effect of reducing reflection image distortion (blur reduction).

The cameras 330 and 430 that acquire an image of the object 10 may be located at a connection portion connected to the first display 311 and 411 and may acquire a plurality of images of the object 10, (Not shown). In addition, the cameras 330 and 430 can acquire a plurality of images corresponding to the rotation of the object 10 positioned on the table 11. [ At this time, the cameras 330 and 430 may be RGB cameras, image sensors of CCD or CMOS type, and may acquire analog or digital images (images) with respect to the object 10.

Depending on the embodiment, the cameras 330 and 430 may be comprised of a plurality of stereo cameras. For example, the cameras 330 and 430 may include two image sensors, two independent cameras may be arranged, and two cameras may be configured as stereo cameras.

Referring to FIG. 4B, the hologram device 400 including the three-dimensional scanning method according to the embodiment of the present invention may further include a structured light pattern generator 460.

The structured light pattern generator 460 generates a specific structured light pattern using the light source of the projector and scans the object 10, and the project light source is a projector such as a generalized LED, an LCD, or a laser.

As shown in FIG. 4B, the arrangement of the structured light pattern generator 460 and the camera 430 can be variously arranged when the upper and lower structure light pattern generator 460 and the camera 430 are satisfied. The reason why the structured light pattern generator 460 and the single camera 430 are located at the top and bottom is that the occlusion area Occlusion between the structured light pattern generator 460 and a single camera (or two cameras) ).

Referring again to FIG. 3, the motor may be connected to the table 11 in the hologram box and may be controlled by the controller 340. For example, the motor receives the command signal from the control unit 340 and can control the rotation, the rotation direction, the rotation angle, and the rotation speed of the table 11 based on the command signal. Accordingly, the object 10 positioned on the table 11 can be rotated by the motor.

The controller 340 in the hologram apparatuses 300 and 400 including the three-dimensional scanning method according to the embodiment of the present invention includes a first display 311 and a second display 411 connected by a wire / wireless communication method, a second display 312 and 412, And the motor can be controlled.

For example, the control unit 340 may control a foreground image illuminated by the first displays 311 and 411 and a background image illuminated by the second displays 312 and 412, A blue screen or a black image may be applied to the second display 312 and 412. In addition, the control unit 340 can control the rotation of the motor.

The control unit 340 may acquire three-dimensional modeling data of the object 10 using the plurality of images obtained from the camera 330 and acquire three-dimensional modeling data from the camera 330 and the structured light pattern generator 460 Dimensional modeling data for the object 10 can be obtained by using a plurality of image and structured light pattern images.

According to the embodiment, the cameras 330 and 430 acquire a plurality of images for the object 10 located on the rotating table 11, and the control unit 340 acquires a multi-view image based on the acquired image Dimensional modeling data for the object 10 can be obtained from the obtained depth image.

For example, the control unit 340 generates a multi-view image from a plurality of images having different viewpoints, generates a continuous synchronization signal to control synchronization between the plurality of images, The depth image can be acquired by calculating the parallax values of the pixels coinciding with each other in each pixel region of the object 10 using the triangulation method. Then, the controller 340 can acquire three-dimensional modeling data for the object 10 from multi-view images and depth images according to a plurality of images.

According to another embodiment, the structured light pattern generator 460 generates structured light of a specific pattern using the light source of the projector and irradiates the object light 10 to the structured light pattern generator 460. The cameras 330, Of the image. Accordingly, the control unit 340 acquires the depth image using the plurality of acquired image and structured photon pattern images, and acquires the three-dimensional modeling data of the object 10 from the obtained depth image.

In this case, the controller 340 of the hologram apparatuses 300 and 400 including the three-dimensional scanning method according to the embodiment of the present invention projects the second display 312 and 412 onto the black image, 460 to obtain a structured light pattern image for the object 10.

Then, the control unit 340 can provide the image of the augmented reality using the actual object 10, by applying the 3D modeling data on the acquired object 10 to the 3D holographic image.

5A to 5D show an example of a structure of a hologram box according to an embodiment of the present invention.

5A to 5D illustrate a top view of a hologram box 500 according to an embodiment of the present invention. FIG. 5A shows an example of a structure of a hologram box observable from three sides. And Fig. 5B shows a structural example of a hologram box observable from one side.

' 형태로 형성될 수 있다. 이에 따라서, 반사판(520)은 제1 디스플레이(511) 및 제2 디스플레이(512)에서 조사되는 영상을 반사 또는 굴절시키거나, 투과시킴으로써, 홀로그램 박스(500)를 중심으로 좌측에 위치하는 사용자(20), 우측에 위치하는 사용자(20) 및 제2 디스플레이(512) 정면에 위치하는 사용자(20) 모두 3차원 홀로그램 영상을 관측할 수 있도록 제공할 수 있다. Referring to FIG. 5A, a hologram box 500 according to an embodiment of the present invention includes a first display 511 and a second display 512 having different display directions. At this time, the reflection plate 520 is formed of at least one combination in the hologram box 500, and the reflection plate 520 '

May be formed. Accordingly, the reflection plate 520 reflects, refracts, or transmits an image irradiated from the first display 511 and the second display 512, thereby allowing the user 20 The user 20 located on the right side and the user 20 located on the front side of the second display 512 can provide a three dimensional hologram image to be observed.

Referring to FIG. 5B, the hologram box 500 according to the embodiment of the present invention includes a first display 511 and a second display 512 having different display directions. At this time, the reflection plate 520 may be formed to be inclined at about 45 degrees to the first display 511 and the second display 512. Accordingly, the reflection plate 520 reflects or refracts the image irradiated by the first display 511 and transmits the image irradiated by the second display 512, thereby allowing the user (for example, 20 can be provided so that three-dimensional hologram images can be observed.

FIG. 5C shows an example of a structure of a hologram box which can be observed from three sides including a black panel. FIG. 5D shows a structure of a hologram box including a black panel, Fig.

The structure of the hologram box 500 according to the embodiment of the present invention shown in Figs. 5C and 5D is the same as that shown in Figs. 5A and 5B.

For example, FIGS. 5C and 5D illustrate an example in which a hologram apparatus including a three-dimensional scanning method according to an embodiment of the present invention uses a camera and a structured light pattern generator to acquire a plurality of image and structured light pattern images for a target object , The second display 570 is projected onto a blue screen or a black image / panel. Accordingly, the hologram apparatus including the three-dimensional scanning method according to the embodiment of the present invention generates and illuminates structured light of a specific pattern to a target object using a structured light pattern generator, and displays a plurality of images Can be obtained.

In this case, the reflection plate 520 shown in FIGS. 5A to 5D may be formed by coating a reflection film on a general glass or tempered glass of 3 mm or more, and the brightness of the image is enhanced due to the reflection coating, May be improved. In addition, the first display 511 and the second display 512 may display menu images, text images including contents and text information, and foreground images, background images, and the like And may provide a variety of content images for providing hologram-based game images and advertisements to the user.

6A and 6B illustrate application examples of a hologram apparatus including a three-dimensional scanning method according to an embodiment of the present invention.

Referring to FIGS. 6A and 6B, a hologram apparatus including a three-dimensional scanning method according to an embodiment of the present invention can use a showcase-type hologram box including a target object such as a figure, a doll, and a toy.

Accordingly, the hologram apparatus including the three-dimensional scanning method according to the embodiment of the present invention acquires an image of a real object located in a hologram box, and applies three-dimensional modeling data according to a plurality of images to a three-dimensional hologram image .

FIG. 7 is a flowchart illustrating an operation method of a hologram apparatus including a three-dimensional scanning method according to an embodiment of the present invention.

The method shown in FIG. 7 can be performed by a hologram apparatus including a three-dimensional scanning method according to an embodiment of the present invention shown in FIG.

Referring to FIG. 7, in step 710, an image of a target object is acquired using a camera in a hologram box.

For example, the camera may be in the form attached to either side of the hologram box and attached to one or more walls of the hologram box. Here, the camera is characterized by a single camera, but may be a plurality of cameras depending on the embodiment.

According to an embodiment, when using a single camera, the camera acquires a plurality of images for the rotatable object, and if the plurality of cameras are used, the stereo camera 130 may acquire a plurality of images Can be obtained.

At this time, the camera may acquire an image according to a predetermined time interval with respect to the rotating object, and may acquire at least one of a shape, a size, and a color of the object from the acquired image .

In step 720, 3D modeling data for the object is obtained using the plurality of images acquired for the object.

According to the first embodiment, the step 720 obtains the depth image using the multi-view image based on the plurality of images obtained from the camera with respect to the object positioned on the rotatable table, Dimensional modeling data may be obtained.

According to the second embodiment, step 720 obtains the depth image using the structured light pattern image obtained from the structured light pattern generator and the plurality of images obtained from the camera for the object located on the table, Dimensional modeling data for a target object.

At this time, the hologram box may include at least one camera that acquires an image of a target object, and a structured light pattern generator that irradiates a predetermined light to a target object. The structured light pattern generator may use a projector light source, The structured light pattern image for the object can be obtained by generating the structured light and illuminating the object with the generated structured light.

According to the embodiment, in the first or second embodiment, the step 720 further includes a step of providing the image of the augmented reality using the real object by applying the obtained three-dimensional modeling data to the three-dimensional hologram image can do.

In step 730, using the reflection plate included in the hologram box, a direction of an image irradiated by at least one of the first display and the second display having different display directions is converted to provide a three-dimensional hologram image including three-dimensional modeling data do.

At this time, the first display and the second display can display a menu image, a text image including content and text information, and an exhibition image such as a foreground image and a background image, A hologram-based game image, and various content images for providing an advertisement.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical media such as CDROMs and DVDs, magnetic optical media such as floppy disks, magnetooptical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

10: object
11: Table
20: User
100, 200, 300, 400: Hologram device including three-dimensional scanning method
211, 311, 411, 511: first display
212, 312, 412, 512: the second display
570: Second display projected onto a black panel
320, 420, 520: reflector
330, 430: camera
460: Structured light pattern generator
500: holographic box

Claims (18)

In a hologram apparatus using a hologram box including a three-dimensional scanning method,
A display unit including at least one of a first display and a second display;
A reflection plate for converting a direction of an image irradiated by at least one of the first display and the second display to provide a three-dimensional holographic image;
A camera for acquiring an image of a target object located in the hologram box; And
Acquiring three-dimensional modeling data for the object using the acquired image, and applying the obtained three-dimensional modeling data to the three-dimensional hologram image,
And a three-dimensional scanning method including the three-dimensional scanning method. The method according to claim 1,
The object
A hologram unit disposed on the table in the hologram box,
Wherein the table is rotatable. 2. The hologram apparatus of claim 1, wherein the table is rotatable. 3. The method of claim 2,
The camera
And a three-dimensional scanning method for obtaining a plurality of images of the object on the rotatable table, the three-dimensional scanning method being located in at least one of the hologram boxes. The method of claim 3,
The control unit
Acquiring a depth image using a multi-view image based on the acquired plurality of images, and acquiring three-dimensional modeling data on the object from the obtained depth image. The method according to claim 1,
The hologram box
And at least one camera for acquiring an image of the object, and a structured light pattern generator for irradiating a predetermined light to the object. 6. The method of claim 5,
The structured light pattern generator
A three-dimensional scanning method comprising: generating a structured light of a specific pattern using a projector light source; and irradiating the generated structured light to the object to obtain a structured light pattern image for the object. The method according to claim 6,
The control unit
Acquiring a depth image using the obtained image and the obtained structured light pattern image, and acquiring three-dimensional modeling data on the object from the obtained depth image. The method according to claim 1,
The control unit
Dimensional hologram image, and applying the obtained three-dimensional modeling data to the three-dimensional hologram image, thereby providing an image of an augmented reality using the actual object. The method according to claim 1,
Wherein the first display is formed on one side of the hologram box and the second display is formed on the other side of the hologram box perpendicular to the first display. The method according to claim 1,
The reflector
Dimensional hologram image by reflecting or refracting an image irradiated by the first display and transmitting an image irradiated by the second display to provide the three-dimensional hologram image observable from one side. The method according to claim 1,
The reflector
Wherein the hologram box comprises at least one or more hologram boxes, the hologram box being positioned at right angles to the first display and reflecting or refracting or transmitting an image irradiated by the first display and the second display, A hologram device including a three-dimensional scanning method for providing a three-dimensional holographic image. A method of operating a hologram apparatus using a hologram box including a three-dimensional scanning method,
Acquiring an image of a target object using the camera in the hologram box;
Obtaining three-dimensional modeling data for the object using the obtained image and applying the three-dimensional modeling data to the three-dimensional hologram image; And
A step of converting the direction of an image irradiated by at least one of a first display and a second display having different display directions using a reflection plate included in the hologram box to provide the three-dimensional hologram image
Dimensional scanning method. 13. The method of claim 12,
The step of applying to the three-dimensional hologram image
Acquiring a depth image using a multi-view image based on a plurality of images obtained from the camera on the object located on a rotatable table, acquiring three-dimensional modeling data on the object from the obtained depth image A hologram method including a three-dimensional scanning method. 13. The method of claim 12,
The hologram box
And at least one camera for acquiring an image of the object and a structural light pattern generator for irradiating the object with a constant light. 15. The method of claim 14,
The structured light pattern generator
A three-dimensional scanning method comprising: generating a structured light of a specific pattern using a projector light source; and irradiating the generated structured light to the object to obtain a structured light pattern image for the object. 16. The method of claim 15,
The step of applying to the three-dimensional hologram image
Acquiring a depth image using the obtained image and the obtained structured light pattern image, and acquiring three-dimensional modeling data on the object from the obtained depth image. 13. The method of claim 12,
The step of applying to the three-dimensional hologram image
Dimensional hologram image, and applying the obtained three-dimensional modeling data to the three-dimensional hologram image, thereby providing an image of an augmented reality using the actual object. 18. A computer program stored in a computer-readable medium for performing the method of any one of claims 12 to 17.

Images