KR100928292B1 - Composite image generating device and method - Google Patents

Abstract

The present invention relates to a synthetic image generating device and a method thereof. The present invention provides a visible light camera for obtaining a visible light image using visible light, an infrared camera for obtaining an infrared light image using infrared ray, and a millimeter wave radiated from an object. An image acquisition unit including a millimeter wave image camera for focusing the image into a square wave image; An image synthesizer configured to receive at least two images of the visible light image, the infrared image, and the millimeter wave image from the image acquirer, and synthesize the input images to generate a synthesized image; A display unit configured to display the synthesized image synthesized by the image synthesizer; A memory for storing the composite image; And a control unit for controlling the image acquisition unit, the image synthesis unit, the display unit, and the memory, and a composite image generation method using the same.

Description

Apparatus For Generating Composite Picture And Its Method

The present invention relates to image synthesis, and more particularly, to generate a composite image that can be provided to a user by synthesizing at least two images of a visible light image, an infrared image, and a millimeter wave image according to a user's selection, time, or weather. An apparatus and a method thereof are provided.

Various cameras are used to obtain image information of surrounding conditions. For example, a visible light camera using visible light, an infrared camera using infrared light, and the like. Visible light cameras are generally used during the day because it is preferable to use mainly sunlight, and infrared cameras are generally used at night. Also, in bad weather such as fog, snow, and rain, a millimeter wave imaging camera that focuses and images a millimeter wave emitted by an object may be used. Millimeter-wave imaging cameras can also be used to detect hidden objects that are not exposed to the outside.

In general, airports and conference halls are equipped with a conventional metal detector to detect metallic materials such as firearms and prohibit the introduction of dangerous goods. The metal detector uses electromagnetic induction and changes depending on the presence or absence of metallic materials. It is a device that detects firearms or other metallic dangerous objects by using.

Metal detectors are portable metal detectors that are carried by security personnel to detect the possession of metals, and gate-type metal detectors that detect metals as they pass through a gate-type structure in turn. However, in the case of such a metal detector, there is a problem that a desired result cannot be obtained by inaccurate detection by nonmetals or external noise.

In addition, a hidden object detection device for an object used in an airport, such as a safety screening, etc. is typically X-ray detector. However, in the case of the X-ray detector, there is a concern that the human body in the clothes is clearly expressed, and there is a concern about infringement on the human rights of the individual.

Another type of hidden object sensing device is a sensing device using a millimeter wave, which uses the following principle. All objects emit a wide band of thermal noise in proportion to their absolute temperature, and a millimeter wave sensing device receives the spectral intensity of the millimeter wave band and forms an image. A millimeter wave is a signal whose wavelength is in millimeters. Since the millimeter wave signal can penetrate clothing, etc., a millimeter wave sensing device can be used to receive a millimeter wave out of thermal noise proportional to the absolute temperature radiated by the human body and belongings inside the garment to form an image. .

In the conventional millimeter wave imaging system or millimeter wave imaging camera, an image sensor scans an image of an object formed through a lens or other method, acquires a signal, and configures it as one image. However, according to such a method, a very precise control is required because the surface of the object must be scanned. Currently, technology development for a system for receiving a millimeter wave signal and constructing an image has been continuously made, but it is still at an early stage in terms of actual commercialization and commercialization.

As described above, according to the prior art, since the cameras corresponding to each situation, such as time and place, must be used or installed separately, it is expensive, and it is active when the weather changes or the situation is frequently moved to another place. There is a problem that can not provide a suitable image to cope with this.

In addition, according to the related art, by providing only each image such as a visible light image, an infrared image, and a millimeter wave image, there is a problem in that a single image cannot provide a lot of information at a time and can provide only limited information.

The present invention solves the above problems and has been proposed in accordance with recent trends and requests, and combines at least two images of a visible light image, an infrared image, and a millimeter wave image according to a user's selection, time, or weather, An object of the present invention is to provide a device and a method for generating a composite image that can be provided to the user.

Another object of the present invention is to provide a synthesized image generating apparatus and method that can provide a lot of information in one image by providing a composite image of at least two images of a visible light image, an infrared image and a millimeter wave image To provide.

As an aspect of the present invention for achieving the above object, the composite image generating apparatus according to the present invention, a visible light camera for obtaining a visible light image using a visible ray, and an infrared ray (infrared ray) An image acquiring unit including an infrared camera for acquiring an infrared image by using an image, and a millimeter wave image camera for acquiring a millimeter wave image by concentrating a millimeter wave emitted from an object; An image synthesizer configured to receive at least two images of the visible light image, the infrared image, and the millimeter wave image from the image acquirer, and synthesize the input images to generate a synthesized image; A display unit configured to display the synthesized image synthesized by the image synthesizer; A memory for storing the composite image; And a controller for controlling the image acquisition unit, the image synthesis unit, the display unit, and the memory.

The apparatus for generating a synthetic image according to the present invention may further include an input unit configured to receive a selection signal for at least two of the visible light image, the infrared image, and the millimeter wave image. The controller may control the image acquisition unit to acquire images according to a selection signal input through the input unit, and control the image synthesis unit to synthesize the obtained images.

The apparatus for generating a synthesized image according to the present invention further includes a timer for acquiring a current time, and the memory includes image selection information and time information in which at least two of the visible light image, the infrared image, and the millimeter wave image are combined. Stores a table matched with, and the control unit searches for image selection information matching the current time with reference to the table, controls the image acquisition unit to acquire images according to the retrieved image selection information, and synthesizes the image. It may be a technical feature to synthesize the obtained images by controlling the unit.

The millimeter wave imaging camera includes: a lens for focusing a millimeter wave signal emitted from at least one external object; A reflection plate rotatably installed in at least one of vertical and horizontal directions and reflecting a millimeter wave signal focused through the lens in a specific direction; A driver including a motor for rotating the reflector in the at least one direction; An antenna for receiving the millimeter wave signal reflected by the reflector; And an image processing unit configured to configure the millimeter wave signal received through the antenna into the millimeter wave image, wherein the controller controls the driving unit to rotate the reflector according to a predetermined rotation rule, thereby rotating the reflector. According to the present invention, the millimeter wave signals received at predetermined time intervals may be configured as the millimeter wave image through the image processor.

The reflective plate may be rotatably installed in an up and down direction and a left and right direction, and the driving unit may include a first motor for rotating the reflector in an up and down direction and a second motor for rotating the reflector in a left and right direction. can do.

The reflecting plate may include a first reflecting plate rotatably installed in an up and down direction, and a second reflecting plate rotatably installed in a left and right direction. The driving unit may include a first motor that rotates the first reflecting plate in an up and down direction. Technical features of the present invention include a first driver including a second driver including a second motor configured to rotate the second reflector in a horizontal direction.

The rotation rule may relate to at least one of a rotation angle, a rotation direction, and a time fixed at a specific position.

In another aspect of the present invention for achieving the above object, the composite image generating method according to the present invention, a visible light camera for obtaining a visible light image using a visible ray, and an infrared ray (infrared ray) Method for generating a composite image to be executed in a composite image generating device having an infrared camera to obtain an infrared image by using a millimeter wave image camera to acquire a millimeter wave image by focusing a millimeter wave emitted from an object The method comprising: receiving a selection signal for at least two of the visible light image, the infrared image, and the millimeter wave image; Acquiring at least two of the visible light image, the infrared image, and the millimeter wave image according to the input selection signal; Generating a composite image by synthesizing the obtained at least two images; And displaying the generated composite image.

As another aspect of the present invention for achieving the above object, the composite image generation method according to the present invention, a visible light camera for obtaining a visible light image using a visible ray, and an infrared ray (infrared ray) Generating a composite image to be executed in a composite image generating apparatus having an infrared camera for acquiring an infrared image and a millimeter wave image camera for collecting a millimeter wave image by focusing a millimeter wave emitted from an object A method, comprising: obtaining a current time; Searching for image selection information matching the acquired current time by referring to a table in which at least two of the visible light image, the infrared image, and the millimeter wave image are combined, and a time matching information; Acquiring at least two of the visible light image, the infrared image, and the millimeter wave image according to the retrieved image selection information; Generating a composite image by synthesizing the obtained at least two images; And displaying the generated composite image.

According to the synthesized image generating apparatus and method thereof according to the present invention, the following effects are obtained.

First, according to the present invention, there is an effect of providing a synthesized image that meets a user's needs by synthesizing at least two images of a visible light image, an infrared image, and a millimeter wave image.

Second, according to the present invention, there is an effect that can provide an individual image or a composite image suitable for the current time, weather, and place.

Third, according to the present invention, when providing a composite image including a millimeter wave image, there is an effect that can detect a hidden object.

Fourth, according to the present invention, by providing a composite image by combining at least two images of a visible light image, an infrared image and a millimeter wave image, there is an effect that can provide a lot of information in one image.

Fifth, according to the present invention, by using a reflector to obtain a millimeter wave image and reflect it on a synthesized image, it is possible to obtain a high speed image in real time and to reduce the volume of the device.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Like numbers refer to like elements throughout. In addition, when it is determined that the detailed description of the known function or configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

1 is a block diagram of an apparatus for generating a synthetic image according to an exemplary embodiment. A synthetic image generating apparatus according to an embodiment of the present invention will be described in detail with reference to FIG. 1. According to an embodiment of the present invention, an apparatus for generating a synthesized image may include an image acquirer 600, a controller 610, an image synthesizer 620, a memory 630, a display 640, an input unit 650, and a timer ( 660).

The image acquisition unit 600 acquires a visible light image, an infrared image, and a millimeter wave image. The image acquisition port 600 is a visible light camera 210 for obtaining a visible light image using visible light and an infrared camera 220 for obtaining an infrared image using infrared light. And a millimeter wave image camera 200 for focusing a millimeter wave radiated from an object to obtain a millimeter wave image.

The visible light camera 210 is a camera capable of acquiring an image using visible light having a wavelength of about 380 to 770 nm. Examples of the visible light camera 210 include a camera using a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.

The infrared camera 220 is a camera photographing using an infrared dry plate, and is generally used for photographing by a distance, photographing thermally by a special thermal element, measuring radiation levels, and detecting a small temperature difference.

The detailed configuration and operation of the millimeter wave image camera 200 will be described later.

The image synthesizing unit 620 receives at least two images of the visible light image, the infrared image, and the millimeter wave image from the image obtaining unit 600, and generates a composite image by synthesizing the input images. do. For example, the image synthesizing unit 620 may generate one composite image by synthesizing the visible light image and the infrared image. In addition, for example, the image synthesizing unit 620 may generate one composite image by synthesizing all of the visible light image, the infrared image, and the millimeter wave image. The image synthesizer 620 may generate a high resolution composite image by applying various image processing algorithms.

The memory 630 stores a predetermined program that controls the overall operation of the composite image generating apparatus according to an embodiment of the present invention, and the overall operation of the composite image generating apparatus is performed by the controller 610. When the data is stored, the data input and output and the various data processed are stored. The memory 630 may temporarily and / or permanently store the visible light image, the infrared image, the millimeter wave image, and the composite image.

The memory 630 may store a table in which at least two of the visible light image, the infrared image, and the millimeter wave image are combined with image selection information and time information. For example, the table is a combination of "visible light image" and "millimeter wave image" for "AM 7:00 to PM 5:00", and "visible light" for "PM 5:00 to PM 8:00". A combination of "infrared image" and "infrared image" and "infrared image" and "millimeter wave image" can be stored for "PM 8:00 to A, M. 7:00".

The display unit 640 displays the state or various information of the composite image generating apparatus according to the exemplary embodiment of the present invention by the control signal output from the controller 610. The display unit 640 may display the visible light image, the infrared image, the millimeter wave image, and the composite image.

The input unit 650 receives a selection signal for at least two of the visible light image, the infrared image, the millimeter wave image, and the composite image. The selection signal may be input from a user.

The timer 660 obtains a current time. The timer 660 may be set by a user, or may receive a current time through a network such as the Internet, a mobile communication network, or a broadcasting network.

The controller 610 controls the components and manages the overall operation of the composite image generating apparatus according to an embodiment of the present invention.

The control unit 610, the image synthesizing unit 620, the memory 630, the display unit 640, the input unit 650, and the timer 660 may be a computing system 60 such as a personal computer (PC). It may be provided as.

Hereinafter, the detailed configuration of the millimeter wave image camera 200 will be described in detail.

As shown in FIG. 1, the millimeter wave imaging camera 200 includes a lens 10, a reflector 20, a driver 30 including a motor 310 and a motor driver 320, and a millimeter wave receiving module. 40, a converter 50, and an image processor 80 may be configured.

The lens 10 focuses a millimeter wave signal emitted from at least one external object.

The reflecting plate 20 is rotatably installed in at least one of up and down directions (Y axis) and left and right directions (X axis), and reflects a millimeter wave signal focused through the lens 10 in a specific direction. .

The motor 310 rotates the reflector in the at least one direction, and the motor driver 320 drives the motor 310. That is, the motor driver 320 drives the motor 310 by the control signal of the controller 610 such that the reflector is rotated in the at least one direction. The motor driver 320 may drive the motor 310 in a pulse width modulation (PWM) manner for high speed and precision control.

The millimeter wave receiving module 40 receives the millimeter wave signal reflected by the reflector and transmits it to the converter 50 in the form of an analog signal.

Meanwhile, the lens 10, the reflector 20, the driver 30, and the millimeter wave receiving module 40 may be configured as one product. One configured product may further include the transducer 50 to be described later.

The converter 50 converts the analog signal received from the millimeter wave receiving module 40 into a digital signal and transmits it to the image processor 80. The converter 50 is generally referred to as an analog-to-digital converter (ADC).

The image processor 80 configures the digital signal received from the converter 50 into a millimeter wave image.

FIG. 2 is a detailed configuration diagram of the millimeter wave receiving module 40 in FIG. 1. As shown in FIG. 2, the millimeter wave receiving module 40 may include an antenna 410, a switch 420, an amplifier 430, and a detector 440.

The antenna 410 receives the millimeter wave signal reflected from the reflector 20.

The amplifier 430 amplifies the millimeter wave signal received through the antenna 410. Since the millimeter wave signal has thermal noise of low signal strength, it is preferable that the amplifier 430 be configured with a high gain and a low noise element. For example, a low noise amplifier (LNA) having a gain of 28 dB with a noise figure of 6 dB may be used in two stages to obtain a performance of greater than 50 dB of super gain. That is, the amplifier 430 may be used by connecting two or more amplifiers having the same or different performances.

The detector 440 converts the millimeter wave signal amplified by the amplifier 430 into a DC voltage and transmits the DC signal to the converter 50. For example, the detector 440 may obtain a DC voltage by rectifying a 94 GHz band signal amplified by the amplifier 430. For example, a 75-110 GHz broadband diode detector having a sensitivity of 500 mV / mW may be used, and the DC output may be configured as an SMA terminal, and may operate without a bias. On the other hand, since the converter 50, the DC voltage output from the detector 440 is very small, satisfies a resolution of 16 bit or more, and measures the signal in synchronization with the reflective plate 20 moving at high speed. It is desirable that it be designed to have a conversion time of at least 1 μsec.

The switch 420 may be installed between the antenna 410 and the amplifier 430 to be used for temperature correction to stabilize the performance of the system according to an external temperature. As shown in FIG. 2, the control signal of the switch 420 may be output from the controller 610.

Hereinafter, a detailed operation of the millimeter wave image camera 200 will be described.

3A, 3B, and 4 are diagrams showing examples in which a reflector and a motor are configured. 3A is a diagram illustrating an embodiment composed of two reflecting plates and two motors. 3B is a diagram illustrating an embodiment composed of one reflector and two motors. 4 is a diagram showing another embodiment composed of two reflecting plates and two motors.

As shown in FIGS. 3A and 4, the reflector 20 may include a first reflector 20a rotatably installed in the left and right directions and a second reflector 20b rotatably installed in the vertical direction. Can be. In this case, the motor 310 includes a first motor 310a for rotating the first reflecting plate 20a in a left and right direction and a second motor 310b for rotating the second reflecting plate 20b in a vertical direction. Can be configured. According to the configuration shown in Figure 3a, the millimeter wave signal corresponding to the left and right directions of a specific object is reflected by the first reflecting plate 20a and transmitted to the millimeter wave receiving module 40, the vertical direction of the specific object The millimeter wave signal corresponding to may be reflected by the second reflector 20b and transmitted to the millimeter wave receiving module 40.

In addition, as shown in FIG. 3B, the reflector 20 may be rotatably installed in both the vertical direction and the left and right directions. In this case, the motor 310 may include a first motor 310a for rotating the reflector 20 in a left and right direction and a second motor 310b for rotating the reflector 20 in an up and down direction.

 In particular, the controller 610 controls the driving unit 30 to rotate the reflector 20 according to a predetermined rotation rule, and receives a millimeter wave signal received at predetermined time intervals according to the rotation of the reflector 20. The image processing unit 80 may configure a millimeter wave image. The controller 610 may rotate the reflector 20 by controlling the driver 30 until the reception of the millimeter wave signal is completed for a preset search range.

The rotation rule may relate to at least one of a rotation angle, a rotation direction, and a time fixed at a specific position.

For example, the first reflecting plate 20a is “left to right” or “right to left” at a predetermined time interval in FIG. 3A to scan a range corresponding to the left and right directions of the search range. The angle of rotation. Also, in order to scan, for example, a range corresponding to the up and down direction of the search range, the second reflecting plate 20b is “up to down” or “up to down” at predetermined time intervals in FIG. 3A. The angle of rotation.

The time fixed at the specific position refers to a time required to receive a millimeter wave signal emitted from the specific position or the specific range in order to scan a specific position or a specific range of the search range and form a millimeter wave image.

As such, the controller 610 may rotate the reflector 20 by controlling the driver 30 according to the rotation rule to obtain a millimeter wave signal for the entire search range.

The controller 610 may control the millimeter wave signal received at predetermined time intervals according to the rotation of the reflector 20 to form a millimeter wave image through the image processor 80. In this case, as described above, the millimeter wave signal radiated from the specific object is passed through the lens 10, the reflector 20, the millimeter wave receiving module 40, and the converter 50 in the form of a digital signal. The image processor 80 may be transferred to the image processor 80.

Hereinafter, the operation of the image processor 80 will be described in detail.

The image processor 80 may configure the received millimeter wave signal as the millimeter wave image by using a voltage difference between the received millimeter wave signal and a preset reference voltage. In addition, the image processor 80 may include a digital filter. For example, the image processing unit 80 may obtain a mean value for 50 samples by converting the digital signal transmitted from the converter 50 into a signal of 20 Hz or less through a digital IIR filter having a third order. 5A and 5B are graphs showing voltage graphs of millimeter wave signals over time. FIG. 5A is a graph showing a digital signal transmitted from the converter 50 over time, and FIG. 5B is a graph showing a filtering signal through which the digital signal of FIG. 5A has passed through a digital filter. In FIG. 5B, reference numeral 70 indicates that a search object (eg, a person) hides an object. For example, suppose a person A is hiding an object B in clothes. The voltage of the millimeter wave signal radiated by A and the voltage of the millimeter wave signal radiated by B will be different. In the graph of FIG. 5B, reference numeral 70 may represent the object B, and the remaining part may represent the person A.

For example, an image having a size of 16 × 16 pixels in which an image of the image configured by the image processor 80 is converted into a gray level using a minimum value-maximum value range. to be.

When the millimeter wave image is configured by the millimeter wave image camera 200, a time point at which the image processor 80 composes the millimeter wave image may vary. Three examples of the viewpoints of the millimeter wave image will be described.

First, the image processing unit 80 may configure the millimeter wave image for the entire search range after the reception of the millimeter wave signal for the search range is completed. For example, the millimeter wave signal is received for the entire search range. The millimeter wave signal for the entire search range is stored in the memory 630. The millimeter wave signal for the entire search range stored in the memory 630 may be transmitted to the image processor 80 to form a millimeter wave image.

Second, the image processing unit 80 may configure the millimeter wave image whenever the millimeter wave signal is received at predetermined time intervals. For example, whenever the reflector 20 is rotated by the driver 30 and receives the millimeter wave signal during the time that the reflector 20 stays at a specific position, the received millimeter wave signal is transmitted to the image. The processor 80 may be composed of millimeter wave images.

Third, the image processor 80 may configure the millimeter wave signals received for the plurality of fixed ranges of the search range into a millimeter wave image. For example, a predetermined region of the search range may be scanned, and the scanned predetermined region may be configured as a millimeter wave image by the image processor 80. The size of the predetermined area to be processed at one time by the image processor 80 may be set or changed according to the capacity of the memory 630 and the processing speed of the image processor 80.

The controller 610 may display the millimeter wave image configured by the image processor 80 on the display unit 640.

Meanwhile, the image processor 80 may reconstruct the millimeter wave image after configuring the millimeter wave image by using the difference between the voltage of the received millimeter wave signal and the reference voltage. The image reconstruction may vary. For example, the configured millimeter wave image may be reconstructed by enlarging / reducing the size of the image and performing negative image processing.

Hereinafter, a detailed operation of the apparatus for generating a synthetic image according to an embodiment of the present invention will be described in detail. The method of generating the composite image may vary.

First, a user selects two or more of the visible light image, the infrared image, and the millimeter wave image to generate the composite image.

The user may select at least two of the visible light image, the infrared image, and the millimeter wave image through the input unit 650. The controller 610 controls the image acquisition unit 600 to acquire images according to a selection signal input through the input unit 650, and controls the image synthesis unit 620 to obtain the acquired images. The synthesized image may be generated by synthesizing.

Second, the composite image is generated according to the current time by referring to the table stored in the memory 630.

The controller 610 searches for image selection information matching the current time obtained by the timer 660 with reference to the table, and controls the image acquisition unit 600 according to the retrieved image selection information. Images may be obtained and the synthesized image may be generated by synthesizing the obtained images by controlling the image synthesizer 620.

6A and 6B illustrate examples of a composite image generated according to an embodiment of the present invention. Referring to FIG. 6A, reference numerals 201, 211, and 221 denote examples of millimeter wave images, visible light images, and infrared images, respectively. Reference numeral 300 denotes an example of the composite image 300 in which the visible light image 211 and the infrared image 221 are synthesized, and reference numeral 310 denotes the synthesis in which the visible light image 211 and the millimeter wave image 201 are synthesized. An example of an image 310 is shown, and reference numeral 320 denotes an example of a composite image 320 obtained by combining a millimeter wave image 201 and an infrared image 221. 6B shows an example of a composite image in which all of the millimeter wave image 201, the visible light image 211, and the infrared image 221 are synthesized.

7 is a flowchart of a composite image generating method according to an embodiment of the present invention. A method of generating a composite image according to an embodiment of the present invention will be described in detail with reference to FIG. 7. The composite image generating method according to an embodiment of the present invention may be executed in the composite image generating apparatus according to an embodiment of the present invention described with reference to FIGS. 1 to 6.

A selection signal for at least two of the visible light image, the infrared image, and the millimeter wave image is received [S700].

According to the input selection signal, at least two of the visible light image, the infrared image, and the millimeter wave image are obtained [S710].

The synthesized image is generated by synthesizing the obtained at least two images [S720], and the generated synthesized image is displayed [S730].

8 is a flowchart of a composite image generating method according to another embodiment of the present invention. Referring to Figure 8 will be described in detail a method for generating a composite image according to another embodiment of the present invention. The composite image generating method according to another exemplary embodiment of the present invention may be executed in the composite image generating apparatus according to the exemplary embodiment of the present invention described with reference to FIGS. 1 to 6.

An image matching the acquired current time by obtaining a current time [S800] and referring to a table in which at least two of the visible light image, the infrared image, and the millimeter wave image are combined with image selection information and time information; The selection information is retrieved [S810].

According to the retrieved image selection information, at least two of the visible light image, the infrared image, and the millimeter wave image are obtained [S820].

The synthesized image is generated by synthesizing the obtained at least two images [S830] and displays the generated composite image [S840].

The foregoing has mainly described an apparatus and method for synthesizing at least two images of a visible light image, an infrared image, and a millimeter wave image to generate a synthesized image. However, the apparatus for generating a synthetic image illustrated in FIG. 1 may be used for other purposes besides the purpose of generating the synthetic image.

First, the controller 610 may acquire a visible light image, an infrared image, and a millimeter wave image according to a user's selection, and display the same on the display unit 640. For example, suppose that the synthesized image generating device is operated as a monitoring device for monitoring the surroundings. The user can monitor the surroundings by selecting a visible light image during the day to be displayed through the display unit 640, and can obtain the surrounding information by selecting an infrared image at night. The user can also select the millimeter-wave image to watch the surroundings in the fog.

Second, a table in which time information is matched with one of the visible light image, the infrared image, and the millimeter wave image is stored in the memory 630, and the controller 610 matches the current time with reference to the table. The image may be retrieved, the image acquirer 600 may be controlled to obtain the retrieved image, and the displayed image may be displayed on the display unit 640. For example, the table may include information that matches "visible light image" for "day" and "infrared image" for "night".

Third, suppose that the synthesized image generating apparatus can obtain weather information.

The synthesis image generating apparatus and method according to the embodiments of the present invention described above may be used for various purposes. At sea, for example, frequent fog and storms can expose you to many risks. In this case, the apparatus and method for generating a synthesized image according to embodiments of the present disclosure may help safe navigation by providing individual images or synthesized images. In addition, for example, the composite image generating apparatus according to the present invention may be mounted on an airplane or an airport control tower, thereby providing safe image information about a runway even in bad weather such as fog, rain, and snow. Also, for example, the composite image generating apparatus and method according to the present invention may be utilized as a military surveillance / reconnaissance apparatus. Since the front of the ceasefire line is large because of the large crossover, it is easy to monitor / reconnaissance by using the composite image generating device according to the present invention because the fog is frequent, and the snow or rain is many. Also, when providing a composite image such as a combination of visible light image / millimeter wave image, infrared image / millimeter wave image, visible light image / infrared image / millimeter wave image, it is hidden from human body or exposed to other outside Even hidden objects can be detected.

The synthetic image generating method according to the present invention described above may be provided by recording on a computer-readable recording medium as a program to be executed by a computer.

The synthetic image generating method according to the present invention can be executed through software. When implemented in software, the constituent means of the present invention are code segments that perform the necessary work. The program or code segments may be stored on a processor readable medium or transmitted by a computer data signal coupled with a carrier on a transmission medium or network.

Computer-readable recording media include all kinds of recording devices that store data that can be read by a computer system. Examples of computer-readable recording devices include ROM, RAM, CD-ROM, DVD ± ROM, DVD-RAM, magnetic tape, floppy disks, hard disks, and optical data storage devices. The computer readable recording medium can also be distributed over network coupled computer devices so that the computer readable code is stored and executed in a distributed fashion.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

1 is a block diagram of an apparatus for generating a synthetic image according to an exemplary embodiment.

FIG. 2 is a detailed configuration diagram of the millimeter wave receiving module 40 in FIG. 1.

3A, 3B, and 4 are diagrams showing examples in which a reflector and a motor are configured.

5A and 5B are graphs showing voltage graphs of millimeter wave signals over time.

6A and 6B illustrate examples of a composite image generated according to an embodiment of the present invention.

7 is a flowchart of a composite image generating method according to an embodiment of the present invention.

8 is a flowchart of a composite image generating method according to another embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

200: millimeter wave video camera 10: lens

20: reflector 30: drive unit

310: motor 320: motor drive unit

40: millimeter wave receiving module 410: antenna

420: switch 430: amplifier

440: detector 50: transducer

80: image processor 210: visible light camera

220: infrared camera 600: image acquisition unit

610: control unit 620: image synthesis unit

630: memory 640: display unit

650: input unit 660: timer

60: computing system

Claims (9)

delete delete A visible light camera that acquires a visible light image using visible rays, an infrared camera that acquires an infrared image using infrared rays, and a millimeter wave emitted from an object An image acquisition unit including a millimeter wave image camera for acquiring a millimeter wave image; An image synthesizer configured to receive at least two images of the visible light image, the infrared image, and the millimeter wave image from the image acquirer, and synthesize the input images to generate a synthesized image; A display unit configured to display the synthesized image synthesized by the image synthesizer; A memory for storing the composite image; A controller which controls the image acquisition unit, the image synthesis unit, the display unit, and the memory; And Includes a timer to obtain the current time, The memory may store a table in which at least two of the visible light image, the infrared image, and the millimeter wave image match image selection information and time information. The controller searches for image selection information matching the current time by referring to the table, controls the image acquisition unit to acquire images according to the retrieved image selection information, and controls the image synthesis unit to obtain the acquired images. Synthetic image generating device characterized in that for synthesizing. A visible light camera that acquires a visible light image using visible rays, an infrared camera that acquires an infrared image using infrared rays, and a millimeter wave emitted from an object An image acquisition unit including a millimeter wave image camera for acquiring a millimeter wave image; An image synthesizer configured to receive at least two images of the visible light image, the infrared image, and the millimeter wave image from the image acquirer, and synthesize the input images to generate a synthesized image; A display unit configured to display the synthesized image synthesized by the image synthesizer; A memory for storing the composite image; And A control unit controlling the image acquisition unit, the image synthesis unit, the display unit, and the memory; The millimeter wave video camera, A lens for focusing a millimeter wave signal emitted from at least one external object; A reflection plate rotatably installed in at least one of vertical and horizontal directions and reflecting a millimeter wave signal focused through the lens in a specific direction; A driver including a motor for rotating the reflector in the at least one direction; An antenna for receiving the millimeter wave signal reflected by the reflector; And An image processor configured to configure the millimeter wave signal received through the antenna into the millimeter wave image; The control unit controls the driving unit to rotate the reflector according to a predetermined rotation rule, and configures the millimeter wave signal received at predetermined time intervals according to the rotation of the reflector as the millimeter wave image through the image processor. A composite image generating device, characterized in that. The method of claim 4, wherein the reflecting plate, It is installed to rotate in the vertical direction and the left and right directions, The driving unit comprises a first motor for rotating the reflector in the vertical direction and a second motor for rotating the reflector in the left and right direction. The method of claim 4, wherein the reflecting plate, A first reflector installed rotatably in the vertical direction and a second reflector installed rotatably in the left and right directions, The driving unit may include a first driving unit including a first motor for rotating the first reflecting plate in a vertical direction, and a second driving unit including a second motor for rotating the second reflecting plate in a horizontal direction. Synthetic image generating device. The method of claim 4, wherein the rotation rule, And at least one of a rotation angle, a rotation direction, and a time fixed to a specific position. delete Focusing the visible light camera to obtain the visible light image using visible ray, the infrared camera to acquire the infrared image using infrared ray, and the millimeter wave radiated from the object In the method for generating a composite image to be executed in the composite image generating apparatus having a millimeter wave image camera for obtaining a millimeter wave image, Obtaining a current time; Searching for image selection information matching the acquired current time by referring to a table in which at least two of the visible light image, the infrared image, and the millimeter wave image are combined, and a time matching information; Acquiring at least two of the visible light image, the infrared image, and the millimeter wave image according to the retrieved image selection information; Generating a composite image by synthesizing the obtained at least two images; And Displaying the generated composite image Synthetic image generation method comprising.

Images