KR101953701B1 - Method and apparatus for processing image of multi-channel - Google Patents

Abstract

Provided is an apparatus for processing a multi-channel image, which comprises: an image selector for receiving an image through multiple channels, outputting image data corresponding to an image of any one selected channel, and outputting a pre-agreed signal when the any one selected channel is changed to another channel; and an image compressor for compressing the image data by synchronizing with the pre-agreed signal.

Description

≪ Desc / Clms Page number 1 > METHOD AND APPARATUS FOR PROCESSING IMAGE OF MULTI-CHANNEL &

The present invention relates to multi-channel image processing, and more particularly, to a multi-channel image processing apparatus and method for compressing image data corresponding to an image input through a plurality of channels.

A seeker, which is an image search device for information processing of a target, is loaded on the target image information based guided missile which captures and tracks the target based on the image information of the target. So that it is possible to improve the tracking and tracking performance of the target.

In addition, the searcher can improve the performance of detection, recognition, identification and tracking of a real-time image target by utilizing a plurality of types of image information on a target input through multiple channels. In general, a visible ray image and an infrared image And the operator can improve the target striking ability of the missile by selecting the relatively useful image among the visible light image and the infrared image.

As described above, the visible ray image information and the infrared ray image information generated by the searcher are large-capacity data, and are transmitted to the operation server through post-processing such as compression. Uncompressed original image information requires a large bit rate, but the bandwidth of the transmission channel is limited, so that the image information is compressed to a small number of bits.

On the other hand, H.264 standard is generally used for compressing image information in a guided car based on target image information, and H.264 is used for compressing image information in I-picture (Intra Frame) and B- The concept of a Predicted Frame is applied. An I-picture is an image that is encoded only in the corresponding image, and a P-picture is an image that is predictively encoded from a previous image. Since the P-image contains only the difference information between the predicted image and the real image, much data can be reduced compared to the original image. This H.264 repetition unit compression procedure of generating a GOP (Group Of Pictures) including one I-picture and a plurality of P-pictures increases the number of P-pictures and increases compression efficiency And the number of P-pictures can be optimized according to the bandwidth of the transmission channel.

According to the related art, as described above, the guide gun based on the target image information utilizes a plurality of kinds of image information inputted through the multiple channels with respect to the target, compresses the image information selected by the operator among the plurality of kinds of image information, Compresses any one piece of image information selected alternately from the type of image information, and transmits the compressed image data to the operation server.

However, when the image information is compressed according to the H.264 standard, when the switching of the image information for selecting one of the plurality of types of image information is performed at the time of generating the P-image of the GOP, the next I- Distortion of the P-picture occurs. This is because the P-picture is generated through the estimation of the current picture from the previous picture, and the P-picture generated when the type of the current picture is different from that of the previous picture can not be normally estimated. At this time, although the number of lost images can be reduced by reducing the size of the GOP, the image compression performance deteriorates and the bit rate becomes large. As a result, the data transmission can not be performed due to exceeding the capacity of the transmission channel.

Korean Registered Patent No. 10-0205019, filed on March 31, 1999.

It is an object of the present invention to provide a multi-channel image processing apparatus and method for compressing image data in consideration of a change in a channel to be compressed among a plurality of channels to which an image is input.

The problems to be solved are not limited to those mentioned above, and another problem to be solved which is not mentioned can be clearly understood by those skilled in the art from the following description.

A multi-channel image processing apparatus according to a first aspect of the present invention receives an image through a plurality of channels, outputs image data corresponding to an image of a selected one of the channels, and when changing the selected one channel to another channel, An image selector for outputting an agreed signal, and an image compressor for compressing the image data in synchronization with the previously agreed signal.

According to a second aspect of the present invention, there is provided an image processing method performed by a multi-channel image processing apparatus including an image selector and an image compressor, comprising the steps of: receiving the image through the plurality of channels by the image selector; Outputting image data corresponding to an image of a selected one of the channels; outputting a signal for which the image selector selects the selected channel when the selected channel is changed to another channel; And compressing the image data by the image compressor in synchronization with the agreed signal.

According to an embodiment of the present invention, when changing a channel to be compressed among a plurality of channels for receiving an image, the image data is compressed.

Therefore, according to an embodiment of the present invention, even when conversion of image information for selecting one of the plurality of types of image information is performed during compression of image data, normal compression is performed to prevent image distortion .

FIG. 1 is a configuration diagram of a guided car operation system including a guided car equipped with a multi-channel image processing apparatus according to an embodiment of the present invention.
2 is a block diagram of a multi-channel image processing apparatus according to an embodiment of the present invention.
3 is a flowchart illustrating a multi-channel image processing method performed by the multi-channel image processing apparatus according to an embodiment of the present invention.
4 is a diagram illustrating an example of a GOP generated according to H.264 in a multi-channel image processing apparatus according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. It should be understood, however, that the invention is not limited to the disclosed embodiments, but may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, To fully disclose the scope of the invention to a person skilled in the art, and the scope of the invention is only defined by the claims.

In describing embodiments of the present invention, a detailed description of well-known functions or constructions will be omitted unless otherwise described in order to describe embodiments of the present invention. The following terms are defined in consideration of the functions in the embodiments of the present invention, which may vary depending on the intention of the user, the intention or the custom of the operator. Therefore, the definition should be based on the contents throughout this specification.

FIG. 1 is a configuration diagram of a guided car operation system including a guided car equipped with a multi-channel image processing apparatus according to an embodiment of the present invention, and FIG. 2 is a block diagram of a multi-channel image processing apparatus according to an embodiment of the present invention .

Referring to FIGS. 1 and 2, the multi-channel image processing apparatus 100 may be mounted on a target image information-based guidance gun 10 that captures and tracks a target based on image information of a target, ) Can be operated as a seeker that plays a role of processing information about the target in the target.

A plurality of kinds of image acquisition devices (for example, a visible light camera or an infrared camera) mounted on the guide car 10 acquire a plurality of kinds of images and provide them to the multi-channel image processing apparatus 100, Are input to the image selector 110 through a plurality of channels.

The multi-channel image processing apparatus 100 compresses image information selected by an operator from a plurality of kinds of image information input through a plurality of channels, alternately selects and compresses any one of the plurality of types of image information, And transmits the compressed image information to the operation server 20.

The multi-channel image processing apparatus 100 includes an image selector 110, an image compressor 120, an interface 130, and an image transmitter 140.

The image selector 110 includes an image input unit 111, an image output unit 112, and a signal output unit 113. The image input unit 111 receives images through a plurality of channels. The video output unit 112 outputs video data corresponding to an image of a channel selected by the video input unit 111. [ The signal output unit 113 outputs a signal assured to the first frame after the change when one of the channels selected for outputting the video data from the video output unit 112 is changed to another channel.

The image compressor 120 includes a data input unit 121, an image compression unit 122, and a reset signal unit 123. The data input unit 121 receives image data output from the image selector 110. The reset signal unit 123 applies a reset signal to the image compression unit 122 when the predetermined signal output from the image selector 110 is input. The image compressing unit 122 compresses the image data input through the data input unit 121.

The interface 130 provides a data transmission path between the image selector 110 and the image compressor 120. The image selector 110 transfers the image data and the pre-determined signal to the image compressor 120 through the interface 130. For example, the interface 130 may utilize a Low Voltage Differential Signaling (LVDS) interface specification. According to the standard, the LVDS interface includes a 1-bit frame data is valid (FVAL) bit, a 1-bit LVAL (Line data is valid) bit, a 1-bit DVAL (Frame and Line data is valid) data bit, a 1-bit header bit, and a 1-bit spare bit. According to an embodiment, the predetermined signal output from the signal output unit 113 of the image selector 110 is LVDS To the reset signal portion 123 of the image compressor 120 through the spare bit of the interface specification. The pre-determined signal serves to terminate generation of a group of pictures (GOP) in progress in the image compressor 120. Therefore, according to the embodiment, the spare bit of the LVDS interface specification can be regarded as a GOP reset bit. Here, the FVAL bit is used to define valid frames, the LVAL bit is used to define valid lines, and the DVAL bit is used to define valid data.

The image transmitter 140 transmits the image data compressed by the image compressor 120 to the operation server 20.

The operation server 20 includes an image receiver 21, an image decoder 22, and a display device 23. The image receiver 21 receives the compressed image data transmitted from the multi-channel image processing apparatus 100, and the image decoder 22 decodes the image data received by the image receiver 21, And the display device 23 reproduces the image data reconstructed by the image decoder 22 so that the image data can be viewed by the operator.

3 is a flowchart illustrating a multi-channel image processing method performed by the multi-channel image processing apparatus according to an embodiment of the present invention.

Referring to FIGS. 1 and 3, a method for processing a multi-channel image according to an exemplary embodiment of the present invention includes receiving an image from an image selector through a plurality of channels (S210). For example, a plurality of types of image acquisition devices (for example, a visible light camera, an infrared camera, or the like) mounted on the missile 10 may acquire a plurality of types of images and provide them to the multi-channel image processing apparatus 100, Type image information may be input to the image selector of the multi-channel image processing apparatus 100 through a plurality of channels.

The method for processing a multi-channel image according to an exemplary embodiment of the present invention includes outputting image data corresponding to an image of a channel selected from image information input through a plurality of channels by an image selector of the multi-channel image processing apparatus 100 ). For example, the image selector of the multi-channel image processing apparatus 100 may select image data selected by the operator from among a plurality of types of image data input through a plurality of channels or any one of images Data can be output.

In addition, in the multi-channel image processing method according to the embodiment, when one channel selected for outputting image data in the image selector of the multi-channel image processing apparatus 100 is changed to another channel, And outputting the committed signal (S230). For example, when outputting the image data acquired by the infrared ray camera while outputting the image data acquired by the visible ray camera, outputting the predetermined signal, or outputting the image data acquired by the infrared ray camera, It is possible to output a pre-determined signal when outputting the video data acquired by the video data acquisition unit.

In addition, the multi-channel image processing method according to the embodiment further includes a step S240 of compressing the image data by the image compressor of the multi-channel image processing apparatus 100 in synchronization with the pre-determined signal. Here, the image compressor outputting the image data by the image selector repeatedly compresses the unit compression procedure according to the specific compression standard. When the image signal is output by the image selector, the unit compression process, which is being performed by the image compressor, Start the unit compression procedure. For example, the image compressor repeatedly performs a unit compression procedure for generating a GOP including one I-picture (Intra Frame) and one or more P-pictures (Predicted Frame) It is possible to start the generation of a new GOP after completing the GOP generation in progress.

In the multi-channel image processing method according to the embodiment, the image transmitter of the multi-channel image processing apparatus 100 transmits the image data compressed by the image compressor of the multi-channel image processing apparatus 100 to the operation server 20 Step S250.

Hereinafter, a multi-channel image processing method performed by the multi-channel image processing apparatus 100 will be described in more detail with reference to FIGS. 1 to 3. FIG.

First, a plurality of kinds of image acquisition devices (for example, a visible light camera or an infrared camera or the like) mounted on the guided vehicle 10 acquire a plurality of kinds of images and provide them to the multi-channel image processing apparatus 100, The image information is input to the image input unit 111 of the image selector 110 through a plurality of channels (S210).

Here, the image input unit 111 of the image selector 110 may select image data corresponding to the image selected by the operator from among a plurality of types of image information input through a plurality of channels, And provides the image data to the video output unit 112. [0034] FIG. For example, the operator can select any one of the image information obtained through the visible light camera and the image information obtained through the infrared camera. In this case, the signal transmitter (not shown) A signal receiver (not shown) that can be included in the multi-channel image processing apparatus 100 receives the image selection command and inputs the image selection command to the image input unit 111 of the image selector 110 (S220).

The signal output unit 113 of the image selector 110 selects one channel selected for outputting image data from the image output unit 112 of the image selector 110 to a first channel And outputs a predetermined signal. For example, when the video output unit 112 outputs the video data acquired by the visible ray camera, outputs a predetermined signal when outputting the video data acquired by the infrared camera, or outputs the video acquired by the infrared camera It is possible to output a predetermined signal when outputting the image data obtained by the visible light camera while outputting the data. For example, the signal output section 113 can output a 1-bit signal having a value of "0" or "1" as a pre-determined signal. The predetermined signal serves as a reset signal to terminate the unit compression process during the compression of the image data performed by the image compressor 120.

The image data and the reset signal output from the image selector 110 are transmitted to the image compressor 120 through the interface 130. Here, 1-bit FVAL bits, 1-bit LVAL bits, 1-bit DVAL bits, 16-bit data bits, and 1-bit header bits are used to transmit image data. Then, a 1-bit GOP reset bit is used to transfer a reset signal.

Next, the data input unit 121 of the image compressor 120 receives the image data through the interface 130 and provides the image data to the image compression unit 122. The reset signal unit 123 of the image compressor 120 receives the reset signal only from the signal output unit 113 and provides the reset signal to the image compression unit 122 of the image compressor 120 in operation S230. .

The image compression unit 122 of the image compressor 120 compresses the image data in synchronization with the reset signal input from the reset signal unit 123. Here, the image compression unit 122 compresses the image data by repeating the unit compression procedure according to a specific compression standard. When the reset signal is input from the reset signal unit 123, the unit compression process is terminated and a new unit compression Begin the procedure. For example, the image compression unit 122 repeatedly performs a unit compression procedure for generating a GOP including one I-picture and one or more P-pictures. When a reset signal is input in the reset signal unit 123, After the generation of the GOP is completed, generation of a new GOP is started (S240).

FIG. 4 is a diagram illustrating an example of a GOP generated according to H.264 in a multi-channel image processing apparatus according to an embodiment of the present invention, wherein (a) is a GOP generated during image compression according to the conventional art, And is a GOP generated at the time of image compression according to an embodiment of the present invention.

The image compression unit 122 repeatedly performs a unit compression procedure for generating a GOP including one I-picture and one or more P-pictures for the image data. Here, the I-picture is an image that is encoded only in the corresponding image, and the P-picture is a predictive-encoded image from a previous image. That is, the P-picture only includes difference information between the predicted image and the real image.

However, when compressing the image data as shown in (A), switching of the image data in which any one of the plurality of types of image information is selected can be performed at the time of generation of the P-picture of the GOP. Then, distortion of the P-picture occurs until the next I-picture is generated. The P-image is generated by estimating the current image from the whole image, and the P-image generated when the type of the current image is different from that of the previous image can not be normally estimated.

According to the embodiment of the present invention as shown in (b), when the image data is compressed, the switching of the image data in which any one of the plural types of image data is selected is made at the time of generation of the P- The generation of a new GOP is started after the GOP generation in progress is terminated. That is, as soon as the image data is switched, it is generated from the I-picture immediately. Therefore, unlike (a), image distortion does not occur.

Next, the image transmitter 140 of the multi-channel image processing apparatus 100 transmits the image data compressed by the image compressor 120 to the operation server 20, and the image receiver 21 of the operation server 20 transmits the image data, The image decoder 22 decodes the image data received by the image receiver 21 to restore the image data before compression, The controller 23 reproduces the image data reconstructed by the image decoder 22 so that the operator can view the reconstructed image data (S250).

As described above, according to the embodiment of the present invention, when changing a channel to be compressed among a plurality of channels for receiving an image, the image data is compressed.

Therefore, regardless of whether the switching of the image information for selecting one of the plurality of types of image information is performed during the compression of the image data, the normal compression is performed to prevent image distortion.

Combinations of each step of the flowchart and each block of the block diagrams appended to the present invention may be performed by computer program instructions. These computer program instructions may be loaded into a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus so that the instructions, which may be executed by a processor of a computer or other programmable data processing apparatus, And means for performing the functions described in each step are created. These computer program instructions may also be stored in a computer usable or computer readable memory capable of directing a computer or other programmable data processing apparatus to implement the functionality in a particular manner so that the computer usable or computer readable memory It is also possible for the instructions stored in the block diagram to produce a manufacturing item containing instruction means for performing the functions described in each block or flowchart of the block diagram. Computer program instructions may also be stored on a computer or other programmable data processing equipment so that a series of operating steps may be performed on a computer or other programmable data processing equipment to create a computer- It is also possible that the instructions that perform the processing equipment provide the steps for executing the functions described in each block of the block diagram and at each step of the flowchart.

Also, each block or each step may represent a module, segment, or portion of code that includes one or more executable instructions for executing the specified logical function (s). It should also be noted that in some alternative embodiments, the functions mentioned in the blocks or steps may occur out of order. For example, two blocks or steps shown in succession may in fact be performed substantially concurrently, or the blocks or steps may sometimes be performed in reverse order according to the corresponding function.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

100: Multi-channel image processing device
110: image selector
120: image compressor
130: Interface
140: Video transmitter

Claims (10)

The image processing method according to claim 1, further comprising the steps of: receiving different images through a plurality of channels and outputting a single image data in which the different images are sequentially arranged according to a sequence of selecting one of the plurality of channels; An image selector for outputting an agreed signal every time the channel is changed to another channel,
And outputting a single compressed image data by repeating a unit compression process according to a specific compression standard, and after completing the unit compression process which is being performed when the predetermined signal is output from the image selector, Comprising an image compressor to initiate a compression procedure
Multichannel image processing apparatus. The method according to claim 1,
The unit compression procedure includes generating a group of pictures (GOP) including one I-picture (Intra Frame) and one or more P-pictures (Predicted Frame)
The image compressor starts generation of a new GOP after completing generation of a GOP that is in progress when the predetermined signal is output by the image selector
Multichannel image processing apparatus. The method according to claim 1,
Further comprising an LVDS (Low Voltage Differential Signaling) interface that provides a signal path through which the image data and the prearranged signals output from the image selector are input to the image compressor
Multichannel image processing apparatus. The method according to claim 1,
Wherein the image selector receives a visible light image through a first channel among the plurality of channels and receives an infrared image through a second channel from the plurality of channels and alternately outputs the visible light image and the infrared image Or outputting any one of the visible light ray image and the infrared ray image based on a command input from the outside
Multichannel image processing apparatus. The method according to claim 1,
The multi-channel image processing apparatus may further include an image transmitter for transmitting the image data compressed by the image compressor to the operation server,
Multichannel image processing apparatus. An image processing method performed by a multi-channel image processing apparatus including an image selector and an image compressor,
The image selector receiving different images through a plurality of channels,
Outputting a single image data in which the different images are sequentially arranged according to a sequence in which the image selector selects one channel selected from the plurality of channels;
Outputting an agreed-upon signal each time the one of the plurality of channels is changed to another channel in the image selector;
Wherein the image compressor repeatedly performs a unit compression process according to a specific compression standard to output a single compressed image data, and when the predetermined signal is output from the image selector, the unit Starting a new unit compression procedure after completing the compression procedure
Multichannel image processing method. The method according to claim 6,
The unit compression procedure includes generating a group of pictures (GOP) including one I-picture (Intra Frame) and one or more P-pictures (Predicted Frame)
When the pre-determined signal is output by the image selector, the image compressor starts generation of a new GOP after finishing the GOP generation in progress
Multichannel image processing method. The method according to claim 6,
Wherein the image selector receives a visible light image through a first channel among the plurality of channels and receives an infrared image through a second channel from the plurality of channels and alternately outputs the visible light image and the infrared image Or outputting any one of the visible light ray image and the infrared ray image based on a command input from the outside
Multichannel image processing method. The method according to claim 6,
The multi-channel image processing method may further include transmitting the image data compressed by the image compressor to the operation server by the image transmitter,
The multi-channel image processing apparatus includes an image capturing unit
Multichannel image processing method. A method for processing a multi-channel image processing method according to any one of claims 6 to 9,
A computer-readable recording medium storing a computer program.

Images