KR101844843B1 - Apparatus and Method for processing floating hologram - Google Patents

Abstract

A floating hologram image processing apparatus is disclosed. The floating hologram image processing apparatus according to an embodiment of the present invention includes: a background removing unit for obtaining a difference image between a current input image and a previously captured background image, determining that a pixel whose pixel value is within a predetermined threshold value is a background pixel, and generating a target image by removing the background pixel from the current input image; a hologram image generating unit for generating a hologram image by arranging a plurality of target images to be displayed to a viewer as a floating hologram through a projector; and an input unit for receiving a sensitivity adjustment input to increase or decrease sensitivity. Accordingly, the present invention can generate and provide the hologram image by effectively removing a background according to the change of illumination.

Description

[0001] The present invention relates to a floating hologram image processing apparatus and a floating hologram image processing method,

The present invention relates to a floating hologram, and more particularly, to an apparatus and method for generating and processing a floating hologram image.

Recently, display technologies for displaying three-dimensional images have been studied and utilized in various fields.

In particular, an electronic device for displaying a three-dimensional image has been attracting attention by utilizing a technique for displaying a three-dimensional image.

The technique of displaying a three-dimensional image is based on the principle of binocular parallax that an observer perceives a stereoscopic effect in a binocular parallax, and can be classified into a shutter glass method, an eyeglass method, and a full three-dimensional method.

Here, as a complete three-dimensional method, the holography technique reproduces a stereoscopic image based on a real image to provide a natural stereoscopic effect to an observer.

However, although the holographic technology is the ultimate stereoscopic image technology capable of fundamentally solving the limitation of expressing the stereoscopic image in the conventional stereoscopic image, there are many difficulties in the technical implementation.

Thus, at this point, as interest and utilization of holograms increases, alternative techniques that can be implemented are needed.

As an alternative technique, a technology for realizing a floating hologram image is attracting attention.

1 is a view for explaining a general floating hologram.

Referring to FIG. 1, when the semi-transparent mirror 100 is positioned at a 45-degree angle on the display, the viewer 200 can recognize that the fish reflected in the semi-transparent mirror does not come from the display but comes from the opposite side of the semi-transparent mirror . In other words, the screen of the display comes into the human eye through a 45-degree anti-reflection mirror (each side of the projector), but because the human brain feels that the incoming light enters straight ahead, .

Therefore, recently, researches on an apparatus and a method for easily generating and providing a floating hologram image have been actively researched.

Further, in order to generate a floating hologram image, a target to be photographed is photographed in a plurality of directions. Since the influence of illumination is a very large factor in image processing, the influence of illumination in a plurality of directions, reflected light by a target, shadows, and the like must be considered.

Application No. 10-2014-0101500 Floating hologram display device

The present invention provides an apparatus and method for providing a floating hologram image, and a recording medium on which the program is recorded.

The present invention also provides an apparatus and method for generating and providing a hologram image by effectively removing a background in accordance with illumination changes in a plurality of individual shot images, and a medium on which the program is recorded.

Another object of the present invention is to provide an apparatus and method for automatically reducing the sensitivity to the other direction when an input for adjusting the sensitivity to one direction is performed in a process of viewing a floating hologram image by a user, and a recording medium on which the program is recorded.

According to an aspect of the present invention, there is provided an apparatus for processing a floating hologram image by inputting a current input image obtained by photographing a target to be imaged in a plurality of directions, the apparatus comprising: A background removal unit that determines a pixel having a pixel value within a predetermined threshold value as a background pixel and removes the background pixel from the current input image to generate a target image; A hologram image generating unit for generating a hologram image by arranging a plurality of target images to be displayed to a viewer through a floating hologram through a projector; And an input unit receiving the sensitivity adjustment input for increasing or decreasing the sensitivity. If the sensitivity adjustment input is present through the input unit, the background removal unit converts the current input image and the background image into an HSV color model, Wherein a difference image is obtained by dividing a pixel value of a current input image and a background image by N1 (where N1 is a positive rational number), and then a difference image is obtained.

The background removal unit may further receive an illumination value sensed when the target is photographed in a plurality of directions, and determine a difference between a background illumination value input at the time of capturing the background image and a current input illumination value currently input, The difference image can be obtained by converting the current input image and the HSV color model and dividing the pixel value of the converted current input image and the background image by N2 (where N2 is a positive rational number).

Also, the background removal unit may convert the current input image and the HSV color model into the current input image and the background image converted into the HSV color model with respect to the other direction opposite to the one direction of the sensitivity control input, The difference image can be obtained by dividing the value by N3 (where N3 is a positive rational number).

Here, when the sensitivity adjustment input is a sensitivity reduction input for reducing the sensitivity, the number of division of pixel values of the current input image and the background image, which are converted into the HSV color model, may be a positive rational number greater than one.

Also, the background removal unit may use a V value in a pixel value of a current input image and a background image which are transformed into the HSV color model.

In addition, when an image photographed in the front, rear, left, and right rooms of the target is received, the hologram image generating unit vertically symmetrically directs the front image, symmetrically rearranges the rear image, The right side image is rotated 90 degrees clockwise, and then the hologram image is generated to be viewed by the viewer through the inverse pyramid projector.

According to another aspect of the present invention, there is provided a method of generating and processing a hologram image on a display by a floating hologram image processing apparatus so that the hologram image is displayed to a viewer as a floating hologram through a projector, ; (b) receiving a current input image photographed from a plurality of directions, respectively, of a target to be photographed; (c) obtaining a difference image between the current input image and the background image, determining a pixel whose pixel value is within a predetermined threshold value as a background pixel, and removing the background pixel from the current input image to generate a target image ; And (d) generating a hologram image by arranging a plurality of target images so as to be displayed to a viewer with a floating hologram through a projector, wherein when there is a sensitivity control input for increasing or decreasing the sensitivity, In step (c), the current input image and the background image are converted into an HSV color model, and a pixel value of the converted current input image and background image is divided by N1 (where N1 is a positive rational number) A method of processing a floating hologram image can be provided.

Further, the method may further include: receiving a background illuminance value sensed in each of a plurality of directions before the step (c); And receiving a current input illuminance value sensed at the time of the target photographing in a plurality of directions, wherein the step (c) further comprises the steps of: receiving a current illuminance value in a direction in which the difference between the current input illuminance value and the background illuminance value exceeds a specified illuminance threshold value , It is possible to obtain a difference image after converting the current input image into the HSV color model and dividing the pixel value of the converted current input image and the background image by N2 (where N2 is a positive rational number).

If there is the sensitivity adjustment input, the step (c) may convert the current input image and the background image into an HSV color model with respect to the other direction opposite to the one direction of the sensitivity adjustment input, The difference image can be obtained by dividing the pixel values of the current input image and the background image converted into the HSV color model by N3 (where N3 is a positive rational number).

In addition, the V value may be used as the pixel value of the current input image and the background image converted into the HSV color model.

According to another aspect of the present invention, there is provided a computer readable recording medium on which a program for performing any one of the above-described floating hologram image processing methods is recorded.

According to the embodiment of the present invention, there is an advantage that a background can be effectively removed according to a change in illumination in a plurality of individual photographed images, and a hologram image can be generated and provided.

In addition, when the user inputs an input for adjusting the sensitivity to one direction during the process of viewing the floating hologram image, the sensitivity is automatically reduced for the other direction.

1 is a view for explaining a general floating hologram;
2 is an example of an inverted pyramidal type projector.
3 is a diagram illustrating a configuration of a floating hologram image processing system according to an embodiment of the present invention.
4 is a diagram illustrating a detailed configuration of a photographing module according to an embodiment of the present invention;
5 is a diagram illustrating a detailed configuration of a floating hologram image processing apparatus according to an embodiment of the present invention.
6 is an example of a target image generated by a background removal unit according to an embodiment of the present invention;
7 is an example of a hologram image generated by a hologram image generating unit according to an embodiment of the present invention.
8 is an example of an input unit according to an embodiment of the present invention.
FIG. 9 illustrates an example in which a display unit displays a hologram image to provide a floating hologram to a viewer through a projector according to an embodiment of the present invention.
10 is a flowchart illustrating a method of providing a hologram image by a floating hologram image processing apparatus according to the first embodiment of the present invention.
11 is a flowchart illustrating a method of providing a hologram image by a floating hologram image processing apparatus according to a second embodiment of the present invention.
12 is a diagram illustrating a method of providing a hologram image by a floating hologram image processing apparatus according to a third embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention is capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In addition, numerals (e.g., first, second, etc.) used in the description of the present invention are merely an identifier for distinguishing one component from another.

Also, throughout the specification, when an element is referred to as being "connected" or "connected" with another element, the element may be directly connected or directly connected to the other element, It should be understood that, unless an opposite description is present, it may be connected or connected via another element in the middle.

Also, throughout the specification, when an element is referred to as "including" an element, it is understood that the element may include other elements as well, without departing from the other elements unless specifically stated otherwise.

Used throughout this specification may refer to a hardware component such as, for example, software, FPGA or ASIC, as a unit for processing at least one function or operation. However, 'to' is not meant to be limited to software or hardware. &Quot; to " may be configured to reside on an addressable storage medium, or may be configured to play one or more processors. As an example, '~' includes components such as software components, object oriented software components, class components and task components, and processes, functions, attributes, procedures, Routines, segments of program code, drivers, firmware, microcode, circuitry, databases, data structures, tables, arrays, and variables. The functions provided by the components and components may be performed separately by a plurality of components and components, or may be integrated with other additional components.

Hereinafter, in order to facilitate understanding and explanation of the present invention, it is assumed that a target to be photographed is photographed in four directions (i.e., forward, backward, leftward, and rightward) to generate a floating hologram. In this case, the viewer can view the floating hologram through a known inverted pyramid projector, as shown in Fig.

However, the present invention is not limited to this, but it is also possible to capture a target in a plurality of N directions (where N is a natural number of 2 or more), generate a hologram image, and transmit the hologram image to the viewer through a projector having N transflective planes Can be provided to the person skilled in the art through the following description.

3 is a diagram illustrating a configuration of a floating hologram image processing system according to an embodiment of the present invention.

3, the hologram processing system according to the embodiment of the present invention includes a photographing module 400 and a floating hologram image processing device 500 (hereinafter referred to as an image processing device 500) for photographing a target 300 Quot;).

Here, assuming that the photographing module 400 photographs in four directions as assumed above, the photographing module 400 includes a front photographing module 401, a rear photographing module 402, a left photographing module 403, And a photographing module 404.

Hereinafter, the details of the photographing module 400 will be described with reference to FIG. 4, and the image processing apparatus 500 will be described later in detail with reference to FIG.

4 is a diagram illustrating the detailed configuration of the photographing module 400 according to the embodiment of the present invention.

3 and 4, the photographing module 400 according to an exemplary embodiment of the present invention may include a camera unit 410, a rough image sensing unit 420, and a transmission unit 430.

The camera unit 410 may photograph the background image and the target 300 in a specified position and direction to output RGB color model values.

The illuminance detection unit 420 may sense and output the background illuminance value at the time of shooting the background image and the current illuminance value at the time of shooting the target 300 in the designated position and direction.

The transmission unit 430 may transmit the RGB values and illumination values output from the camera unit 410 and the illumination intensity sensing unit 420 to the image processing apparatus 320. The transmission method can be variously known methods such as wire, wireless, infrared communication, and local communication.

5 is a diagram illustrating a detailed configuration of an image processing apparatus 500 according to an embodiment of the present invention.

The image processing apparatus 500 according to the embodiment of the present invention may include a receiving unit 510, an input unit 520, a background removing unit 530, a hologram image generating unit 540, and a display unit 550.

3 to 5, the receiving unit 510 receives a predetermined value from the photographing module 400. [ More specifically, it can receive a predetermined value by various methods such as wired, wireless, infrared communication, and short-range communication with the configuration corresponding to the transmission unit 430 of the photographing module 400.

The receiving unit 510 receives the background image captured by the camera unit 410 of the photographing module 400 from the transmitting unit 430 of the photographing module 400, The input image, the background illuminance value sensed by the illuminance sensing unit 420 during background sensing, and the current illuminance sensed during the target 300 sensing.

The background removal unit 520 may remove the background from the current input image of the target 300 to generate a target image.

More specifically, the background removal unit 520 may obtain a difference image between a current input image and a background image, and may determine a pixel whose difference value is within a predetermined threshold value as a background pixel. In addition, a target image can be generated by removing background pixels from the current input image.

Here, the unit for obtaining the difference image is obtained in pixel units. Various methods such as using an average value of pixels included in a predetermined range can be applied.

Here, either one of the RGB values may be used as a method of obtaining the difference image, or a difference image may be obtained using one or more combinations.

Hereinafter, FIG. 6 will be described in detail with additional reference.

6 is an example of a target image generated by the background removal unit 520 according to an embodiment of the present invention.

3 to 6, when the target is a person striking a guitar, the background removal unit 520 detects the current input image photographed by the imaging modules 401 to 404 in the front, back, left, and right rooms The target image is obtained by obtaining a background image and a difference image with respect to each direction, determining a pixel whose pixel value of the difference image is within a predetermined threshold value as a background pixel, and removing background pixels from the current input image.

6 (a)), a portion where the background is not removed by the reflected light of the target 300 is somewhat visible, and a left-side target image (FIG. 6 (c) (FIG. 6 (d)), it can be confirmed that the background is not smoothly removed by the reflected light and the shadow due to the target 300.

When a plurality of photographing modules 400 consider a change of each illumination, reflected light by the target 300, and shadows in a plurality of current input images photographed in a specified position and direction, the image processing apparatus becomes complicated, The system can be overloaded during the operation.

The present invention simplifies the system so as to reduce the load on the system, and provides a hologram image in real time using the captured image of the target, and a floating hologram processing device And a recording medium on which the program is recorded.

The background removal unit 520 according to the embodiment of the present invention receives a background image and a current input image received through the RGB color model from the imaging module 400 in the HSV color mode when receiving an input from the viewer through the input unit 540 Model can be changed.

The RGB model is the most basic color model. The color is considered as a combination of the three components of red, green and blue. The HSV model has three components of Hue, Saturation and Value , Which is a known model at the time of filing of the present invention, and thus a detailed description thereof will be omitted.

In the embodiment of the present invention explained below, it is explained that V (Value) value of HSV is mainly used. However, it is not limited to this and it is possible to use H (hue) and S (saturation) Will be apparent to those skilled in the art in view of the technical ideas of

When receiving the sensitivity adjustment input for controlling the sensitivity from the viewer through the input unit 540 to be described later, the background removing unit 520 sets the V value of the current input image and the background image converted into the HSV model to N1 Positive rational number), the difference image can be obtained. The background removal unit 520 may generate a target image by determining that a pixel having a pixel value of the difference image is within a predetermined threshold value as a background pixel and removing a pixel determined as a background pixel in the current input image.

According to an embodiment of the present invention, N1 may be a positive rational number greater than 1 if the sensitivity adjustment input is a sensitivity reduction input that reduces the sensitivity, and N1 is a positive amount less than 1 if the sensitivity increase input increases the sensitivity .

Hereinafter, the sensitivity reduction input will be described in detail below.

Hereinafter, it is assumed that N1 is 2 and the threshold is 3. However, this is an example for convenience of understanding and explanation of the present invention, and can be variously changed according to the environment to which the present invention is applied.

If the sensitivity reduction input is input according to the embodiment of the present invention, the background removal unit 520 subtracts the V value of the current input image and the background image converted into the HSV model Is divided by 2, and if the pixel value of the difference image is 3 or less, it is determined as a background image, and the corresponding pixel can be removed from the current input image.

Before the input of the sensitivity reduction input, the background removal unit 520 removes only the pixels whose difference between the V value (0 to 255) of the background image is 3 or less at the V value (0 to 255) of the current input image .

However, when the sensitivity reduction input according to the embodiment of the present invention is input, the background removal unit 520 may convert the current input image and the background image into the HSV model, and divide the V value of each converted image into 2 . A difference image of each image is obtained, and a pixel having a difference of 3 or less can be determined as a background image. In this case, there is an advantage that the threshold value substantially increases to 6, and the portion where the background removal is not performed effectively can be effectively eliminated.

The sensitivity increase input according to the embodiment of the present invention is an opposite effect to the above-described sensitivity increase input when N1 is a positive ration less than 1. In other words. The V value of the current input image and the background image converted into the HSV model may have 256 values ranging from 0 to 255 in the past, but it may be a value of 0 to 510, which is larger than a positive number less than 1, In this case, the threshold value is effectively reduced to 1.5, and the background image can be more finely removed from the current input image

In the embodiment of the present invention, in the case of the sensitivity increase input, the background removing unit 520 divides the V value of the current input image and the background image converted into the HSV with a positive rational number N1 smaller than 1, It is possible to obtain the difference image by multiplying the V value of the current input image and the background image obtained by converting the positive rational number N11 (i.e., N11 = 1 / (N1)) to HSV by N11, It will be self-evident.

Hereinafter, for convenience of understanding and explanation of the present invention, a series of processes performed by the background removal unit 520 when the sensitivity reduction input is inputted once through the input unit 540 described later will be referred to as N1 Quot ;, and the sequence of processes performed by the background removal unit 520 when the input of the sensitivity increase is "N1 (where N1 is 1 or more Quot; small amount of rational number) level ". Similarly, when the sensitivity reduction input is input twice, a series of processes performed by the background removal unit 520 may be performed twice. In this case, the sensitivity can be referred to as "N1 level reduced sensitivity by two steps".

According to another embodiment of the present invention, when the difference between the current illuminance value and the background illuminance value sensed by the illuminance sensing section 420 of the photographing module 400 exceeds a specified threshold value, Sensitivity can be adjusted automatically for the direction exceeding the value.

For example, if the difference between the current illumination value received from the backward photographing module 400 and the previously stored background illumination value exceeds a predetermined threshold value, the background removal unit 520 determines that a change has occurred in illumination It can be judged. In this case, the background removal unit 520 may reduce the sensitivity to N2 (where N2 is a specified number of rational numbers) level in the direction in which the illumination change has occurred, by one time.

Here, N2 may be the same as or different from N1 described above.

In addition, depending on the environment to which the present invention is applied, the background removal unit 520 may reduce the sensitivity to N2 level by one level in the direction in which the illumination change occurs, and decrease the M level (M is a natural number) You can.

Since the conversion of illumination is an important factor to consider in image processing, background removal from the current input image may not be performed smoothly in the direction in which the illumination value changes. In this case, before the viewer inputs the sensitivity increase input or the sensitivity reduction input through the input unit 540, which will be described later, the image processing apparatus 500 according to the embodiment of the present invention automatically reduces the sensitivity, It is advantageous that it can be planned.

According to another embodiment of the present invention, when the background removal unit 520 increases or decreases the sensitivity with respect to the one direction, the image processing apparatus 500 automatically detects the sensitivity Can be adjusted.

As described above, the change of illumination is an important factor in image processing. When a change in the illuminance value occurs in one direction, a change necessarily occurs in a shadow or the like in the other direction.

In view of this point, the present invention can reduce the sensitivity to N3 (where N3 is a positive rational number) level when the background removal unit 520 increases or decreases the sensitivity of the current input image in one direction .

Here, N3 may be the same as or different from N1 or N2, and depending on the environment to which the present invention is applied, the background removal unit 520 may decrease the sensitivity by M2 times to the N1 or N2 level with respect to the other direction.

Therefore, according to another embodiment of the present invention, when an illumination change occurs in one direction, the user may automatically adjust the sensitivity of the other direction before the user inputs the sensitivity adjustment input through the input unit 540 have.

Referring to FIG. 5 again, the hologram image generating unit 530 may generate a hologram image by disposing a target image and removing the background from the current input image.

The method of arranging the target image by the hologram image generating unit 530 may vary according to the number of target images and the shape of the projector.

Hereinafter, Fig. 7 will be further described with reference to the drawings.

7 is an example of the hologram image generated by the hologram image generating unit 530 according to the embodiment of the present invention.

2, 5, and 7, for example, when the target image is four in the front, rear, left, and right chambers as in the present embodiment, the front target image is vertically symmetrical, The left-side target image is rotated 90 degrees counterclockwise, the right-side target image is rotated 90 degrees clockwise, and the hologram image is generated by arranging the left-side target image corresponding to the projector. In the case of the embodiment of the present invention, an inverted pyramidal projector may be used as illustrated in FIG. 2, in which case it is spaced apart from the lower space of the inverted pyramidal projector and is visible to viewers through a transflective mirror in each direction .

Referring again to FIG. 5, the input unit 540 may provide an interface through which a viewer can input a sensitivity increase input or a sensitivity decrease input. The interface may be provided in various ways. Hereinafter, FIG. 8 will be further described with reference to FIG.

8 is an example of an input unit according to an embodiment of the present invention.

For example, the input unit 540 may be provided to a viewer in the form of a computer keyboard. When the target is photographed in four directions as in the present embodiment, the user inputs the sensitivity reduction input for the front, rear, left and right rooms using the XWAD key, or inputs the sensitivity reduction input for the front, rear, And the right side room, the sensitivity reduction input can be input.

It should be apparent to those skilled in the art that the example of FIG. 8 is merely an example and can be provided to viewers by various means such as a mouse, a touch pad, a touch screen, a jog shuttle, and the like.

The display unit 550 may display the hologram image generated by the hologram image generating unit 530.

Below. 9 is further described with reference to FIG.

9 is a view illustrating an example in which a display unit 550 displays a hologram image and provides a floating hologram to a viewer through a projector according to an embodiment of the present invention.

The user can view the hologram image displayed on the display through the projector with the floating hologram.

Although the display unit 550 and the input unit 540 are included in the image processing apparatus 500 in the embodiment of the present invention, the display unit 550 and the input unit 540 may be physically separated and separately provided. Will be apparent to those skilled in the art in light of the technical ideas of the present invention.

The detailed configuration of the image processing apparatus according to the embodiment of the present invention has been described with reference to FIG. However, the configuration illustrated in Fig. 5 is merely an example for facilitating understanding and explanation of the present invention, and is not limited thereto. That is, in order to process the image photographed by the photographing module 400 by the image processing apparatus 500 according to the embodiment of the present invention to generate the hologram image, the above-described constituent unit may be further subdivided, Some of the functions of the configuration unit may be combined with some of the functions of the other configuration unit or may be integrated into one configuration unit.

10 is a flowchart illustrating a method of providing a hologram image by the image processing apparatus 500 according to the first embodiment of the present invention.

As described above, the detailed configuration of the image processing apparatus 500 is not limited to the example shown in FIG. 5, and may be variously configured. Therefore, the main body of each function will be described below as the image processing apparatus 500.

For clarification of the method of processing the floating hologram image according to the present embodiment, the description with reference to FIGS. 3 to 9 will be omitted.

In step S1002, the image processing apparatus 500 can receive and store the background images taken by the imaging module 400 in a plurality of directions, respectively.

Subsequently, in step S1004, the image processing apparatus 500 can receive, from the photographing module 400, the current input image obtained by photographing the target to be imaged in the plurality of directions by the photographing module 400 as an RGB color model.

Subsequently, in step S1006, the image processing apparatus 500 obtains a difference image between the current input image and the background image. In step S1008, it is determined whether the pixel value of the difference image exceeds a specified threshold value. If the difference value is within a threshold value The corresponding pixel can be removed from the current input background by judging as a background in step S1010. If the threshold value is exceeded, it is determined as a target in step S1012 and the corresponding pixel can be maintained in the current input image.

Subsequently, in step S1014, the image processing apparatus 500 may generate a hologram image by disposing a target image whose background is removed.

Although not shown in FIG. 10, the image processing apparatus 500 displays the hologram image, and the viewer can view the floating image through the projector.

11 is a flowchart illustrating a method of providing a hologram image by the image processing apparatus 500 according to the second embodiment of the present invention.

Steps S 1102 to S 1114 in FIG. 11 are the same as steps S 1002 to S 1014 described above with reference to FIG. 10, so duplicated description will be omitted.

If there is a sensitivity adjustment input, that is, a sensitivity increase input or a sensitivity reduction input, of the viewer in step S1116, the image processing apparatus 500 may increase the sensitivity or decrease the sensitivity in step S11118.

Subsequently, the image processing apparatus can perform step S1106, and a duplicate description thereof will be omitted.

According to the second embodiment of the present invention, when the viewer does not want to remove the background from one direction while watching the floating hologram image through the projector, the image processing apparatus 500 can input the sensitivity control input, Depending on the input, the sensitivity can be reduced or increased, so background removal can be done smoothly

11, in step S1116, the image processing apparatus 500 receives the sensitivity adjustment input for one direction, and when the sensitivity is decreased or increased in step S1118 and subsequent steps, the sensitivity is automatically set to N3 ( However, N3 can be reduced to a level of rational number greater than 1, which has been described above with reference to FIG.

12 is a diagram illustrating a method of providing a holographic image by the image processing apparatus 500 according to the third embodiment of the present invention.

Steps S 1202 to S 1212 in FIG. 12 are the same as steps S 1002 to S 1014 described above with reference to FIG. 10, so duplicate descriptions are omitted.

Before step S1214, the image processing apparatus can receive the background illuminance value sensed during the background image sensing and the current illuminance value sensed during the current input image sensing from the photographing module 400, and then, in step S1214, If it exceeds the roughness threshold value, it is judged that a change has occurred in the roughness. Subsequently, in step S1218, the sensitivity can be reduced to N2 (where N2 is a rational number greater than 1).

In FIG. 12, it is described that the image processing apparatus determines the change in illuminance value in step S1218. However, step S1218 is not limited to this and may be performed at any stage.

Although not shown in FIG. 12, when the illuminance value changes in one direction in step S1218 and the sensitivity is reduced to N2 (where N2 is a rational number greater than 1) with respect to one direction, (N3 is a rational number greater than 1) level with respect to the other direction opposite to that of FIG.

The above-described method of providing a floating hologram image according to the present invention can be implemented as a computer-readable code on a computer-readable recording medium. The computer-readable recording medium includes all kinds of recording media storing data that can be decoded by a computer system. For example, it may be a ROM (Read Only Memory), a RAM (Random Access Memory), a magnetic tape, a magnetic disk, a flash memory, an optical data storage device, or the like. In addition, the computer-readable recording medium may be distributed and executed in a computer system connected to a computer network, and may be stored and executed as a code readable in a distributed manner.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the following claims And changes may be made without departing from the spirit and scope of the invention.

300: target 400: photographing module
401: front photographing module 402: rear photographing module
403: Left side photographing module 404: Right side photographing module
410: camera section 420: rough guide section
430: transmitting unit 500: floating holographic image processing device
510: Receiving unit 520: Background removal
530: a hologram image generating unit 540:
550:

Claims (11)

An apparatus for processing a floating hologram image by receiving a current input image obtained by photographing a target to be photographed from a plurality of directions,
A difference image between the current input image and a previously captured background image is obtained to determine a pixel whose pixel value is within a predetermined threshold value as a background pixel and to generate a target image by removing the background pixel from the current input image, Removal;
A hologram image generating unit for generating a hologram image by arranging a plurality of target images to be displayed to a viewer through a floating hologram through a projector; And
And an input for receiving a sensitivity adjustment input for increasing or decreasing the sensitivity,
If there is a sensitivity adjustment input through the input unit, the background removal unit converts the current input image and the background image into a HSV (Hue, Saturation, Value) color model, and converts the pixel values of the converted current input image and background image into N1 (Where N1 is a positive rational number), and then a difference image is obtained,
The background removal unit converts the current input image and the HSV color model into the current input image and the background image that are converted into the HSV color model with respect to the other direction opposite to the one direction of the sensitivity adjustment input, N3 (where N3 is a positive rational number), and then a difference image is obtained.
The method according to claim 1,
Wherein the background removal unit further receives an illuminance value sensed when the target is photographed in a plurality of directions, and when the difference between the input background illuminance value and the currently input current illuminance value exceeds a specified illuminance threshold value And a difference image is obtained by converting the current input image and the HSV color model and dividing the pixel value of the converted current input image and the background image by N2 (where N2 is a positive rational number) Hologram image processing device.
delete 3. The method according to claim 1 or 2,
Wherein the number of divisions between the current input image and the background image pixel value converted into the HSV color model is greater than 1 when the sensitivity adjustment input is a sensitivity reduction input for reducing the sensitivity.
3. The method according to claim 1 or 2,
Wherein the background removal unit uses a V value in a pixel value of a current input image and a background image that are transformed into the HSV color model.
3. The method according to claim 1 or 2,
In the case of receiving an image of the target taken in front, rear, left, and right rooms,
The hologram image generation unit generates a hologram image by vertically symmetricizing the front image, horizontally symmetric the rear image, rotating the left image 90 degrees counterclockwise, rotating the right image 90 degrees clockwise, And a hologram image is generated so as to be displayed.
A method of generating and processing a hologram image on a display by a floating hologram image processing apparatus so that the hologram image is displayed to a viewer by a floating hologram through a projector,
(a) receiving a background image photographed in each of a plurality of directions;
(b) receiving a current input image photographed from a plurality of directions, respectively, of a target to be photographed;
(c) obtaining a difference image between the current input image and the background image, determining a pixel whose pixel value is within a predetermined threshold value as a background pixel, and removing the background pixel from the current input image to generate a target image ; And
(d) generating a hologram image by arranging a plurality of target images to be displayed to a viewer through a floating hologram through a projector,
(C) converts the current input image and the background image into an HSV color model, and if the pixel values of the converted current input image and the background image are N1 (Where N1 is a positive rational number), and then a difference image is obtained,
If there is the sensitivity adjustment input, the step (c) may convert the current input image and the background image into an HSV color model with respect to the other direction opposite to the one direction of the sensitivity adjustment input, Wherein the difference image is obtained by dividing a pixel value of a current input image and a background image converted into a model by N3 (where N3 is a positive rational number).
8. The method of claim 7,
Prior to step (c)
Receiving a background illuminance value sensed in each of a plurality of directions; And
Further comprising the step of receiving a current input illuminance value sensed during the target photographing in a plurality of directions,
The step (c)
The current input image and the HSV color model are converted into the current input image and the background image, and the pixel value of the converted current input image and the background image is converted to N2 ( (Where N2 is a positive rational number), and then a difference image is obtained.
delete 8. The method of claim 7,
And a V value is used as a pixel value of a current input image and a background image which are transformed into the HSV color model.
 A computer-readable recording medium having recorded thereon a program for performing the method of processing a floating hologram image according to any one of claims 7, 8 and 10.

Images