KR101949993B1 - Method and apparatus of generating a multi-format template image in an image processing device, and storage medium there of - Google Patents

Abstract

The present invention relates to a method of generating a multi-format template image in an image processing apparatus, the method comprising the steps of: identifying at least one pre-designated region in a template image of a first format, Format template image by converting a plurality of pixels included in the predetermined area into a second format based on the extracted component information.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and apparatus for generating a multi-format template image in an image processing apparatus, and a storage medium therefor.

The present invention relates to an image processing apparatus, and more particularly, to an apparatus and method for generating a multi-format template image in an image processing apparatus, and a storage medium therefor.

Different applications require processing of images in different formats. Generally, an image of JPEG or other formats is processed by decoding the image into a raw data format (e.g., RGB, YUV, HSV, etc.) based on the application type. It is known that when any component of a raw data format changes, different raw data formats have different characteristics and different influences.

Basically, the RGB components associated with each pixel of an image in RGB format are closely correlated. In other words, when the R component associated with a pixel changes, features such as color and brightness of the associated pixel change. Conversely, HSV is an uncorrelated domain, where H represents a color component. That is, changing the H component changes only the color, and S and V representing the chroma component and the luminance component are maintained unchanged. Similarly, in the YUV format, changing Y changes only the intensity associated with the pixel, and the color remains intact.

Current image processing apparatuses are providing applications such as image merge applications that enable the display of preview frames in one or more pre-designated areas within a template image. These applications require the conversion of template images from a basic format to another format for ease of processing. For example, if the basic format of the predetermined area is the RGB or YUV format, the basic format of the predetermined area is required to be converted to the HSV format for ease of processing, and vice versa. However, since the raw data in the RGB format of the entire template image is closely correlated, the extraction of color information from the raw data in the RGB format is achieved through RGB-HSV conversion, which results in nonlinear computation. As a result, RGB format raw data in predefined areas of the template image when converted to the HSV format may have a significant impact on performance and require high processing time because the conversion operation is a non-linear operation.

The present invention proposes a method and apparatus for reducing the time required for generating a multi-format template image in an image processing apparatus, and a storage medium therefor.

According to an aspect of the present invention, there is provided a method for generating a multi-format template image in an image processing apparatus, the method comprising: identifying at least one predetermined area in a template image of a first format; Format template image by converting a plurality of pixels included in the predetermined area into a second format on the basis of the extracted component information, do.

According to an aspect of the present invention, there is provided an apparatus for generating a multi-format template image in an image processing apparatus, the apparatus comprising: a display; a processor; and a memory, Extracting component information of the identified pre-designated area by decoding the template image, extracting a plurality of pixels included in the pre-designated area based on the extracted component information, 2 format, thereby generating a multi-format template image.

According to an aspect of the present invention, there is provided a storage medium for generating a multi-format template image in an image processing apparatus, the storage medium including at least one pre- Extracting component information of the identified predetermined area by decoding an image and converting a plurality of pixels included in the predetermined area into a second format based on the extracted component information to form a multi-format template image .

The present invention has the effect of reducing the time required for generating a multi-format template image in an image processing apparatus.

1 is a block diagram of an image processing apparatus for generating a multi-format template image from a single format template image according to an embodiment of the present invention;
2 is a flow chart for generating a multi-format template image from a single format template image in an image processing apparatus according to an embodiment of the present invention;
3 is a flow diagram of merging an image or image in one or more pre-designated areas within a template image to form a new image in an image processing apparatus, in accordance with an embodiment of the present invention;
Figures 4A and 4B illustrate a template image having a predefined region of a first format and a template image having a predefined region converted into a second format according to an embodiment of the present invention;
5A to 5B are diagrams showing a template image having predefined areas of a first format and a template image having predefined areas converted into different formats according to an embodiment of the present invention.

The present invention provides a method and system for generating a multi-format template image from a single format template image. In the following detailed description of embodiments of the invention, reference is made to the accompanying drawings which form a part hereof, and in which is shown by way of illustration specific embodiments in which the invention may be practiced. It is to be understood that these embodiments are described in sufficient detail to enable those skilled in the art to practice the invention, and that other embodiments may be utilized and that changes may be made without departing from the scope of the present invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims.

1 is a block diagram of an image processing apparatus for generating a multi-format template image from a single format template image according to an embodiment of the present invention.

Referring to FIG. 1, an image processing apparatus 100 includes a processor 102, a memory 104, and a display 106. Here, the memory 104 includes an image conversion module 108, a template database 110, an image merge module 112, an image capture module 114, and a display module 116.

Looking at each component, the image conversion module 108 converts a single format template image (e.g., RGB, YUV, etc.) into a multi-format template image. To generate the multi-format template image, the image conversion module 108 decodes the input template image of the first format. The image transformation module 108 then identifies the predefined region (s) in the decoded template image and extracts the component information of the identified predefined region (s).

For example, if the template image is an RGB image, the color information (e.g., red, green, blue) in the pre-designated region (s) of the template image will be obtained. In this case, the predetermined area (s) of the RGB format will be converted to the HSV format. In this case, the image conversion module 108 extracts the color and luminance information of the pixels in the predetermined area (s) of the RGB format. The image conversion module 108 compares extracted component information (e.g., color and luminance information) of each of the pixels with reference component information (e.g., color information).

Thus, the image transformation module 108 transforms each of the pixels in each predefined region of the first format into a second format (e.g., HSV format or YUV format, etc.) Thereby generating a multi-format template image. Accordingly, the generated multi-format template image is stored in the template database 110 in a suitable file format.

The image merge module 112 then merges the predefined region (s) of the second format with a newly captured moving window preview frame (e.g., captured by the image merge module 112) Use a multi-format template image to merge with the image. For example, the image merge module 112 obtains a multi-format template image from the template database 110 and references the captured motion window preview frame to the pre-designated region (s) in the multi- ≪ / RTI > The detailed operation of merging the captured preview frame in the predefined region (s) of the multi-format template image is shown in Fig. The display module 116 then displays on the display 106 a template image having the predefined region (s) containing the merged moving window preview frame.

1, the memory 104 is shown to include an image transformation module 108, a template database 110, an image merge module 112, an image capture module 114, and a display module 116, May include an image transformation module 108, an image merge module 112, an image capture module 114, and a display module 116.

2 is a flowchart for generating a multi-format template image from a single format template image in an image processing apparatus according to an embodiment of the present invention.

Referring to FIG. 2, in step 202, the image processing apparatus acquires a template image of the first format from the template database 110, and then proceeds to step 204. For example, the template image may be an RGB format or a YUV format image.

In operation 204, the image processing apparatus identifies a predetermined region (s) of the template image in the first format, and then proceeds to operation 206. Here, the predetermined area of the template image may be a model such as a rectangle, a circle, or the like, and may also be an irregular model that is generally difficult to process. At this time, in the case of an irregular model, reference pixels in a rectangular box are handled in a predetermined area, and a rectangle box is a predetermined effective area. This operation helps to maintain uniformity during processing in real time, saves processing time, and optimizes performance.

In step 206, the image processing apparatus extracts the component information of the identified predetermined area (s) by decoding the template image. In step 208, the image processing apparatus converts each of the pixels in the predetermined region (s) into the second format based on the extracted component information, and then proceeds to step 210. At this time, the pixels in each predetermined region (s) of the template image are converted from the first format to the second format. For example, a multi-format template image may be generated, as shown below, with HSV values replacing RGB values for pixels in a predetermined region (s).

R (Pd) = H (PD)

G (Pd) = S (PD)

B (Pd) = V (PD)

Here, R, G and B represent red, green and blue values of a specific pixel in a predetermined area PD, and H, S and V represent the color, saturation and brightness of a specific pixel in a predetermined area PD .

As another example, as shown below, the difference in image values is directly replaced by one of the RGB components, and the other two components are replaced by constants C1 and C2 for identification during real-time processing of the multi-format image .

R (Pd) = D (? P);

G (Pd) = C1

B (Pd) = C2

Here,? P represents the difference in pixel characteristics, and C1 and C2 are constants.

Similarly, in the YCbCr format, the equation can be derived as follows.

Y (Pd) = D (? P)

Cb (Pd) = C1

Cr (Pd) = C2

Where DELTA P represents the difference in pixel properties, and C1 and C2 are constants.

In the manner described above, a multi-format template image is acquired in step 208 that includes a pre-specified region of the first format and a pre-designated region (s) of the second format. In step 210, the multi-format template image is stored in the template database 110 of the image processing apparatus for further processing. In one embodiment, the multi-format image may be processed by an image merging application of an image processing apparatus for merging an image or an image in a predetermined region (s) of a second format, as shown in Fig.

3 is a flow diagram of merging an image or image in one or more pre-designated areas within a template image to form a new image in an image processing apparatus, in accordance with an embodiment of the present invention.

Referring to FIG. 3, in step 302, the image processing apparatus acquires a multi-format template image including a predetermined region (s) of a second format from the template database 110, and then proceeds to step 304. In operation 304, the image processing apparatus captures a moving window frame of a specific scene, and then proceeds to operation 306. If the merging process is implemented in an image processing apparatus such as a camera, step 304 may be performed selectively.

In step 306, the image processing apparatus merges the moving window preview frame captured in real time with the pre-designated area (s) in the multi-format template image with reference to the extracted component information, and then proceeds to step 308. For example, if a predetermined region (s) are present in the HSV format and an unspecified region is present in the RGB format, the RGB values of each pixel of the moving window preview frame may be stored in the predefined region And may be matched with the color information of the corresponding pixel. Thereafter, the difference in intensity between each pixel of the preview frame and the corresponding pixel in the predefined area (s) is calculated based on the luminance information of the corresponding pixel in the predefined area (s) of the first format. Thus, each pixel of the moving window preview frame is changed by applying the calculated intensity difference and corresponding color information to each pixel of the moving window preview frame. Finally, each pixel of the predefined region (s) in the multi-format template image is merged with the corresponding modified pixel of each moving window preview frame.

In step 308, the image processing apparatus displays on the image display 106 a template image having the predefined area (s) including the merged moving window preview frame. Here, if the merging process is implemented by a merge processing device such as a mobile phone or a personal computer, the image stored in advance in the image processing device can be fetched from the memory for merging with the predefined area (s).

4A and 4B are diagrams showing a template image having a predetermined area of a first format and a template image having a predetermined area converted into a second format according to an embodiment of the present invention.

4A and 4B, the template image 400 includes a pre-designated area 404 and an unspecified area 402, and the pre-designated area 404 and the unspecified area 402 are the same Format (e.g., RGB or YUV). Transforming the template image 400 using the steps shown in Figure 2 results in a predefined region 452 transformed into a second format (HSV or YUV) and an unspecified region 402 maintained in a first format, A dual format template image 450 is obtained.

5A to 5B are diagrams showing a template image having predefined areas of a first format and a template image having predefined areas converted into different formats according to an embodiment of the present invention.

5A to 5B, the template image 500 includes predefined areas 504 and 506 and an unspecified area 502, and includes predefined areas 504 and 506, (E.g., RGB). Converting the template image 500 using the steps shown in FIG. 2 will result in pre-designated areas 552 and 554 converted to a second format (HSV or YUV) and an unspecified area A dual format template image 550 is obtained that includes the template 502.

Through such operation, the present invention can achieve the effect of reducing the time required for generating the multi-format template image in the image processing apparatus.

It will be apparent that the embodiments have been described with reference to specific exemplary embodiments, and that various changes and modifications may be made to these embodiments without departing from the broader spirit and scope of the various embodiments. It will also be appreciated that the various devices, modules, selectors, estimators, etc. described herein may be implemented within hardware circuitry, e.g., complementary metal oxide semiconductor based logic circuitry, firmware, software and / Firmware, and / or software. ≪ RTI ID = 0.0 > For example, various electrical structures and methods may be implemented using transistors, logic gates, and electrical circuits such as application specific integrated circuits.

In the above description of the present invention, a specific embodiment such as a mobile communication terminal has been described, but various modifications may be made without departing from the scope of the present invention. Accordingly, the scope of the patent of the present invention is not limited by the above-described embodiments, and it will be obvious that the patent scope covers not only the claims but also the equivalents.

110: Template database 102: Processor
106: display 104: memory
108: image conversion module 112: image capture module
114: image merging module 116: display module

Claims (17)

A method for generating a multi-format template image in an image processing apparatus,
Identifying at least one predefined region in a template image of a first format, wherein the first format is a raw data format corresponding to elemental information of pixels contained in the identified predefined region,
Extracting component information of pixels included in the identified predetermined area by decoding the template image;
The method comprising the steps of: determining, based on the extracted component information, a format of component information of pixels included in an area other than the identified predetermined area in the first format, Converting the format from the first format to the second format, wherein the second format is a raw data format different from the first format, and
Format template image, wherein an area other than the identified pre-designated area is the first format, and the identified pre-designated area is the second format.
The method according to claim 1,
Wherein the first format is one of an RGB format, an HSV format, and a YUV format.
The method according to claim 1,
Wherein the second format is one of an HSV format, an RGB format, and a YUV format.
The method according to claim 1,
Further comprising the step of storing the multi-format template image in a memory of the image processing apparatus.
5. The method of claim 4,
Acquiring the multi-format template image stored in the memory;
Capturing a moving window preview frame of a specific scene;
Merging the captured moving window preview frame with the predetermined area of the multi-format template image based on the extracted component information;
And displaying the merged template image according to the merged template image.
An apparatus for generating a multi-format template image in an image processing apparatus,
Display,
A processor,
Memory,
Wherein the memory, at run time, identifies at least one predefined area in the template image of the first format, wherein the processor identifies at least one predefined area in the template image corresponding to the component information of the pixels contained in the identified predefined area Extracting component information of pixels included in the identified pre-designated area by decoding the template image, and extracting component information of pixels other than the identified pre-designated area based on the extracted component information, Converting the format of the component information of the pixels included in the identified predefined area from the first format to the second format while maintaining the format of the component information of the pixels included in the area in the first format, Wherein the format is a raw data format different from the first format, an area other than the identified pre-designated area is the first format, The predetermined region is the second format, the multi-format multi-format template image generating unit for storing the instruction to (instructions) that to obtain a template image.
The method according to claim 6,
Wherein the first format is one of an RGB format, an HSV format, and a YUV format.
The method according to claim 6,
Wherein the second format is one of an HSV format, an RGB format, and a YUV format.
The method according to claim 6,
And a template database for storing the multi-format template image.
10. The method of claim 9,
Wherein the memory comprises an image capture module for capturing a moving window preview frame of a particular scene.
11. The method of claim 10,
The memory includes an image merge module that obtains the multi-format template image from the template database and merges the captured moving window preview frame with the predetermined region of the multi-format template image based on the extracted component information Wherein the multi-format template image generating apparatus further comprises:
12. The apparatus of claim 11, wherein the memory further comprises a display module for displaying the template image including the merged moving window preview frame on the display.
A storage medium for generating a multi-format template image in an image processing apparatus,
Identifying at least one predefined region in a template image of a first format, wherein the first format is a raw data format corresponding to elemental information of pixels contained in the identified predefined region,
Extracting component information of pixels included in the identified at least one predetermined area by decoding the template image;
The method comprising the steps of: using the extracted component information to maintain the format of component information of pixels included in an area other than the identified pre-designated area in the first format, Converting the format from the first format to the second format, wherein the second format is a raw data format different from the first format, and
Format template image, wherein the area other than the identified pre-designated area is the first format, and the identified pre-designated area is the second format. Template image creation storage medium.
14. The method of claim 13,
Wherein the first format is one of an RGB format, an HSV format, and a YUV format.
14. The method of claim 13,
Wherein the second format is one of an HSV format, an RGB format, and a YUV format.
14. The method of claim 13,
Further comprising the step of storing the multi-format template image in a memory of the image processing apparatus.
17. The method of claim 16,
Acquiring the multi-format template image stored in the memory;
Capturing a moving window preview frame of a specific scene;
Merging the captured moving window preview frame with the predetermined area of the multi-format template image based on the extracted component information;
And displaying the merged template image on the display unit.

Images