KR100776433B1 - Mobile communication terminal with the improved image composing - Google Patents

Abstract

A mobile communication terminal with improved image synthesis techniques is provided to offer a synthesis file having a data structure of storing sticker images and images, such as still images or moving images, in separate areas, thereby synthesizing plural sticker images with one still image. A still image synthesis file storage(510) consists of a header and a body, and wherein the body stores a synthesis file having a data structure composed of the first area for storing plural image frames and the second area for storing still images. A still image synthesis processor(610) locates the still images stored in the second area of the synthesis file to a lower layer, and sequentially locates the image frames stored in the first area of the same synthesis file to an upper layer to display the located images and frames on a display(200).

Description

Mobile communication terminal with the improved image composing}

1 is a diagram illustrating a conventional image synthesis.

2 is a structure diagram of a conventional video file.

3 is a schematic block diagram of a mobile communication terminal according to the present invention;

4 is a structure diagram of a composite file according to the present invention;

5 is an exemplary view of a still image stored in a second area of the composite file.

6 illustrates an example of a plurality of image frames stored in a first area of a composite file.

7 illustrates a layer.

8 is an exemplary view of a synthesized still image.

9 is a schematic block diagram of a mobile communication terminal according to another embodiment of the present invention.

10 is a schematic block diagram of a mobile communication terminal according to another embodiment of the present invention.

The present invention relates to a mobile communication terminal, and more particularly, to an image synthesis technology in a mobile communication terminal.

Most mobile communication terminals with built-in cameras provide image synthesis. 1 is a diagram illustrating a conventional image synthesis. As shown, the combined image 30 is made by combining the sticker image 20 previously stored in the terminal memory with the still image 10 captured by the camera. The structure of the conventional image file synthesized as described above is shown in FIG. 2. The image file is divided into a header 50 and a body 60. The header has information about a thumbnail image and an original image. The body 60 is divided into two regions. In the first region 61, a thumbnail image of the original image 10 is stored, and in the second region, an image in which the original image 10 and the sticker image 20 are synthesized ( 30) is stored.

However, according to this method, the captured image is damaged. This is because the photographed image and the sticker image are synthesized and stored in the same area. Of course, the composite image file can be generated and stored separately while leaving the captured image file, but this wastes memory.

The present invention is derived from this background, and an object of the present invention is to provide a mobile communication terminal capable of improved image synthesis.

The above object is a display unit according to the present invention; A body including a header and a body, wherein the body comprises: a compound file storage unit for storing a compound file having a data structure including a first area storing a plurality of image frames and a second area storing a still image; A composition processor configured to position a still image stored in a second region of the composite file on a lower layer, and sequentially display a plurality of image frames stored in the first region of the same composite file on an upper layer and display the image on the display unit; Achieved by a mobile communication terminal.

Preferably, the mobile communication terminal further includes a camera unit and an image file generation unit generating the captured image input from the camera unit and a plurality of selected image frames into an image file having the data structure and storing the image file in the image storage unit. .

In addition, the above object is a display unit according to the present invention; A composite file storage unit including a header and a body, wherein the body stores a composite file having a data structure including a first area storing a plurality of image frames and a second area storing a video; A synthesizing unit configured to play back the moving image stored in the second region of the composite file on the lower layer, and to sequentially display a plurality of image frames stored in the first region of the same composite file on the upper layer and display the image on the display unit; Achieved by a communication terminal.

Preferably the mobile communication terminal and the camera unit; And a composite file generator for generating a moving image and a plurality of image frames obtained from the camera unit into a composite file having the data structure and storing the composite file storage unit.

The foregoing and further aspects of the present invention will become more apparent through the preferred embodiments described with reference to the accompanying drawings. Hereinafter, the present invention will be described in detail to enable those skilled in the art to easily understand and reproduce the present invention.

3 is a schematic block diagram of a mobile communication terminal according to the present invention. As shown, the mobile communication terminal includes a keypad 100, a display unit 200 for displaying a menu and an operation state, a wireless communication unit 300 for extracting voice and data signals from a wireless signal transmitted and received through an antenna, A voice input / output unit 400 for inputting / outputting a voice call signal from the wireless communication unit 300 through a microphone and a speaker, a memory 500 for storing control program data for overall control of the operation of the mobile communication terminal, and a whole; It includes the configuration of a typical mobile communication terminal such as the control unit 600 for controlling the system.

First, the keypad 100 and the display unit 200 which is a liquid crystal display device may have a conventional well-known configuration. The wireless communication unit 300 is configured to include an antenna and RF circuit for communication with the base station. The voice input / output unit 400 processes digital voice data into an analog voice signal, or vice versa, and includes an additional circuit such as an audio amplifying circuit or a filter. The baseband circuit of the wireless communication unit 300 and most of the circuits of the control unit 600 are commercially provided as a single integrated circuit. This integrated circuit, commonly referred to as a mobile station modem (MSM) chip, includes dedicated hardware to process communications therein, a digital signal processor and a general purpose microprocessor. Each part constituting the control unit 600 may be configured by dedicated hardware or software or a mixture thereof.

The memory 500 is divided into a ROM region in which control program data for controlling an operation of a terminal is stored, and a RAM region in which data generated during a terminal control operation are temporarily stored. In the present embodiment, the memory 500 includes a still image composite file storage 510. The still image composite file storage unit 510 stores a plurality of composite files for the still image.

The composite file stored in the still image composite file storage unit 510 has a data structure as shown in FIG. 4. As shown in FIG. 4, the composite file is divided into a header 80 and a body 90, and the body 90 is divided into a first region 91 and a second region 93. A plurality of image frames are stored in the first area 91. In one embodiment, the plurality of image frames preferably have continuity of operation. For example, it may be a plurality of image frames representing a sequence of motions such as running, flying a bird.

Still images are stored in the second area 93. Still images can be obtained by camera photography. In an embodiment, the second area 93 is divided into a 2-1 area 95 in which a thumbnail image of a still image is stored, and a 2-2 area 97 in which an original image of a still image is stored. For example, the storage format of the thumbnail image and the original image is JPEG.

The header 80 of the composite file has update time information. The update time is information on a time interval in which a plurality of image frames stored in the first area 91 are sequentially updated to the display unit 200 by one frame.

The controller 600 includes a still image composition processor 610. The still image synthesis processor 610 may be implemented by a program code. The still image synthesis processor 610 sequentially synthesizes a plurality of image frames stored in the first region 91 of the same composite file in the still image stored in the second region 93 of the composite file. This will be described with reference to FIGS. 5 to 8.

5 is an exemplary diagram of still images stored in the second region 93 of the composite file, and FIG. 6 is an exemplary diagram of a plurality of image frames stored in the first region 91. 7 is an exemplary diagram of a layer, and FIG. 8 is an exemplary diagram of a synthesized still image.

When executing a composite file execution command according to a user's key manipulation, the still image composition processor 610 decodes the still image stored in the second area 93 of the composite file and places the same in the lower layer ①. A plurality of image frames stored in one region 91 are sequentially placed on the upper layer ② according to a predetermined order (1, 2, 3 order) and displayed on the display unit 200. That is, a plurality of image frames are overwritten on the still image displayed on the lower layer. Here, the plurality of image frames stored in the first area 91 may be transparent color B for the remaining space except the object A. FIG. Accordingly, as shown in FIG. 8, a plurality of image frames are sequentially displayed on the still image.

In one embodiment, the still image composition processing unit 610 sequentially synthesizes a plurality of image frames stored in the first region 91 of the same composite file to the thumbnail image stored in the 2-1 region 95 of the composite file. Process. The synthesized thumbnail image and the plurality of image frames have the same size. In still another embodiment, the still image composition processing unit 610 sequentially processes the plurality of image frames stored in the first region 91 of the same composite file in the original image stored in the second-2 region 97 of the composite file. Synthetic treatment. In this case, the synthesized original image and the plurality of image frames have the same size.

However, since the thumbnail image and the original image have different sizes, the plurality of image frames may have the same size as the thumbnail image and may not have the same size as the original image. Therefore, when a plurality of image frames are combined with a thumbnail image and when they are combined with an original image, the size of the image frame can be changed variably, and the image must be clear without breaking even when the size is enlarged. Therefore, it is preferable that a plurality of image frames have a vector image format.

As is known, vector images consist of lines and curves defined by mathematical objects. Vector images can be automatically resized at any resolution and are sharp regardless of the resolution. In addition, the capacity is determined by the number of points and lines, thus using less memory resources.

In an exemplary embodiment, the plurality of image frames stored in the first region 91 have the same size as the thumbnail image stored in the 2-1 region 95. In this case, the still image synthesizing unit 610 synthesizes a plurality of image frames without the size conversion when synthesizing the thumbnail image, and when synthesized to the original image is enlarged to fit the original image size.

According to an additional aspect of the present invention, the mobile communication terminal further includes a camera unit 700, and the controller 600 further includes a still image composite file generation unit 620. The camera unit 700 includes one or more lenses, an imaging device of a CCD or CMOS. The camera unit 700 processes an image incident through a lens and formed on the image pickup device as a digital image signal and outputs the digital image signal. Since the camera itself provided in the mobile communication terminal is a known technical configuration, detailed description thereof will be omitted.

The still image composite file generator 620 may be implemented by a program code. The still image composite file generator 620 generates a plurality of image frames and a still image obtained from the camera unit 700 as a composite file having the above-described data structure. That is, the still image composite file generation unit 620 is divided into a header 80 and a body 90, and the body 90 generates a file having a data structure divided into a first area 91 and a second area 93. Create Preferably, the second region 93 is further divided into a 2-1 region 95 and a 2-2 region 97.

The still image composite file generator 620 stores a plurality of image frames in the first region 91 of the body 90, encodes a still image obtained from the camera unit 700, and stores the plurality of image frames in the second region 93. Save to create a composite file. Preferably, the still image composite file generation unit 620 creates a thumbnail image of the still image obtained from the camera unit 700 and encodes it and stores it in the 2-1 region 95 and encodes the original image of the still image itself. To store in the second-2 region 97.

Hereinafter, an embodiment of a process of generating a composite file according to a user operation will be described. The user commands to take a photo by operating the keypad 100. In response to the command, the camera unit 700 acquires a still image. The user selects a plurality of image frames that are desired to be composited into the obtained still image. The user's selection may be made before or after taking the picture. The selected image frames are pre-stored in the sticker storage unit 520 of the memory 500. For reference, the term “sticker” refers to an image file for decorating a photographed image.

The sticker storage unit 520 stores a plurality of stickers, and each sticker includes a plurality of image frames. The user may select one sticker and may select only some image frames of the sticker sub-configuration. The still image composite file generator 620 generates a still image acquired from the camera unit 700 and a plurality of selected image frames into a composite file having a data structure as shown in FIG. 4.

In addition, the control unit 600 further includes an editing unit 630. The editor 630 may be implemented by program code. The editor 630 replaces, deletes, or adds at least some of the plurality of image frames stored in the first area of the composite file stored in the still image composite file storage 510. For example, when a user selects a composite file stored in the still image composite file storage unit 510 through a key operation and performs an editing command, the editing unit 630 allows the user to select a plurality of image frames stored in the first area. Delete, replace or add to the image frame stored in the sticker storage unit 520 can be added.

9 is a schematic block diagram of a mobile communication terminal according to another embodiment of the present invention. Hereinafter, since the configuration having the same reference numerals and terms as in FIG. 3 is the same as described above, a redundant description is omitted.

The video composite file storage unit 550 stores a plurality of composite files for the video. The composite file stored in the video composite file storage 550 has a data structure as shown in FIG. 4. As shown in FIG. 4, the composite file is divided into a header 80 and a body 90, and the body 90 is divided into a first region 91 and a second region 93. A plurality of image frames are stored in the first area 91. In one embodiment, the plurality of image frames preferably have continuity of operation. For example, it may be a plurality of image frames representing a sequence of motions such as running, flying a bird.

The video is stored in the second area 93. The video may be obtained by camera shooting. According to an exemplary embodiment, the second area 93 may include a second area 95 where a thumbnail image of one frame of a video is stored and a second area 97 where an original image of a still image is stored. Divided into The thumbnail image may be the first frame of the video. The thumbnail image may be encoded in JPEG and stored in the 2-1 region 95, and the video image may be encoded in MPEG and stored in the 2-2 region 97.

The header 80 of the composite file has update time information. The update time is information on a time interval in which a plurality of image frames stored in the first area 91 are sequentially updated to the display unit 200 by one frame.

The video synthesis processing unit 650 sequentially processes a plurality of image frames stored in the first region 91 of the same composite file in the video stored in the second-2 region 97 of the composite file. For example, when a video execution command of a composite file is executed according to a user's key manipulation, the video composition processing unit 650 decodes the video stored in the second area 93 of the composite file and plays it on the lower layer ①. A plurality of image frames stored in the first area 91 of the file are sequentially placed on the upper layer ② to be displayed on the display unit 200.

In this case, the video synthesizing unit 650 sequentially positions the plurality of image frames stored in the first region 91 in the upper layer ② by referring to the update time of the header 80. In addition, the plurality of image frames stored in the first region 91 may be transparent in the remaining space except for the object. This is to prevent the video played in the lower layer ① from being completely hidden due to the image frame located in the upper layer ②.

The video synthesis file generator 660 may be implemented by a program code. The moving image synthesis file generator 660 generates a plurality of image frames and a moving image obtained from the camera unit 700 as a composite file having the above-described data structure. That is, the video composite file generator 660 is divided into a header 80 and a body 90, and the body 90 generates a file having a data structure divided into a first region 91 and a second region 93. do. Preferably, the second region 93 is further divided into a 2-1 region 95 and a 2-2 region 97.

The video composite file generator 660 stores a plurality of image frames in the first region 91 of the body 90, encodes a still image obtained from the camera unit 700, and stores the image frames in the second region 93. Create a composite file. Preferably, the video composite file generation unit 660 generates a thumbnail image of one frame of the video obtained from the camera unit 700 and encodes it and stores it in the 2-1 region 95. The data is stored in two areas 97.

Hereinafter, an embodiment of a process of generating a composite file according to a user operation will be described. The user commands video recording through the manipulation of the keypad 100. According to the command, the camera unit 700 acquires a video. The user selects a plurality of image frames to be composited into the obtained video. The user's selection may be made before or after taking the picture. The selected image frames are pre-stored in the sticker storage unit 520 of the memory 500.

The sticker storage unit 520 stores a plurality of stickers, and each sticker includes a plurality of image frames. The user may select one sticker and may select only some image frames of the sticker sub-configuration. The video composite file generator 660 generates a video file obtained from the camera unit 700 and a plurality of selected image frames into a composite file having a data structure as shown in FIG. 4.

According to an additional aspect of the present invention, the control unit 600 further includes an editing unit 630. Since this is the same as described above, redundant description is omitted.

10 is a schematic block diagram of a mobile communication terminal according to another embodiment of the present invention. Hereinafter, since the configuration having the same reference numerals and terms as in FIG. 2 is the same as described above, a redundant description is omitted.

The preview image synthesis processor 680 may be implemented by a program code. In the preview mode, the preview image synthesizing unit 680 continuously updates the image acquired through the camera unit 700 to the lower layer ① and displays the image on the display unit 200. Then, the plurality of image frames selected by the user are sequentially placed on the upper layer ② to be displayed on the display unit 200. Here, the plurality of image frames selected by the user are pre-stored in the sticker storage unit 520 of the memory 500.

When a moving picture photographing command is generated in the preview state, the moving picture synthesis file generation unit 660 generates an image file having a data structure as shown in FIG. 4. In this case, the plurality of frame images stored in the first region 91 become a plurality of frame images displayed in the preview state. The video composite file generation unit 660 designates the frame image displayed on the display unit 200 as the initial image frame when the video shooting command is generated. In one embodiment, the video composite file generation unit 660 stores the index information for the specified initial image frame in the header (80).

As described above, the moving picture synthesis processing unit 650 sequentially synthesizes a plurality of image frames stored in the first area 91 of the same synthesized file in the moving picture stored in the second-2 area 97 of the synthesized file. The image frames are sequentially synthesized. For example, when a video execution command of a composite file is executed according to a user's key manipulation, the video composition processing unit 650 decodes the video stored in the second area 93 of the composite file and plays it on the lower layer ①. Among the plurality of image frames stored in the first area 91 of the file, the display unit 200 displays the display layer 200 by sequentially placing the first image frame on the upper layer ②. Preferably, the video compositing processor 650 sequentially layeres a plurality of image frames stored in the first region 91 with reference to index information and update time of the first image frame included in the header 80. (②).

As described above, the present invention provides a composite file having a data structure for storing a sticker image and an image (still image or a moving image) in a separate area, thereby allowing a plurality of sticker images to be synthesized in one still image, and animated. Create an atmosphere like this, and make it easy to edit the sticker image. In addition, the present invention can preserve the original image as it is without wasting memory resources.

On the other hand, the present invention has been described with reference to the embodiments shown in the drawings, which are merely exemplary, and those skilled in the art will understand that various modifications and equivalent other embodiments are possible therefrom. Therefore, the true technical protection scope of the present invention should be defined only by the appended claims.

Claims (14)

A display unit; A still image composite file storage unit including a header and a body, wherein the body stores a composite file having a data structure including a first area storing a plurality of image frames and a second area storing a still image; A still image synthesizing unit which positions a still image stored in the second region of the composite file in a lower layer and sequentially displays a plurality of image frames stored in the first region of the same synthetic file in an upper layer and displays the display on the display unit; Mobile communication terminal comprising a. The method of claim 1, A camera unit; A still image composite file generation unit generating a plurality of image frames and a still image obtained from the camera unit as a composite file having the data structure and storing the composite image storage unit in the composite file storage unit; A mobile communication terminal further comprising. The method of claim 1, wherein the second area of the still image composite file storage unit is: And a 2-1 region storing a thumbnail image of a still image and a 2-2 region storing an original image. The mobile communication terminal of claim 3, wherein the plurality of image frames stored in the first area is in a vector image format. The method of claim 1, An editing unit for replacing or deleting at least some of the plurality of image frames stored in the first area, or adding one or more other image frames; A mobile communication terminal further comprising. The mobile communication terminal according to any one of claims 1 to 5, wherein the plurality of image frames stored in the first area has a continuity of operations. The mobile communication terminal according to any one of claims 1 to 5, wherein each of the plurality of image frames stored in the first area has a specific color within the frame. A display unit; A video composite file storage unit for storing a composite file including a header and a body, the body having a data structure including a first area storing a plurality of image frames and a second area storing a video; A moving picture synthesizing unit for reproducing the moving picture stored in the second area of the synthesized file on the lower layer, and sequentially displaying a plurality of image frames stored in the first area of the same synthesized file in the upper layer and displaying the image on the display unit; Mobile communication terminal comprising a. The method of claim 8, A camera unit; A moving picture synthesis file generation unit generating a moving picture obtained from the camera unit and a plurality of image frames as a combined file having the data structure and storing the moving picture synthesis file storage unit; A mobile communication terminal further comprising. The mobile terminal of claim 8, wherein the plurality of image frames are in a vector image format. The method of claim 8, An editing unit for replacing or deleting at least some of the plurality of image frames stored in the first area, or adding one or more other image frames; A mobile communication terminal further comprising. The mobile communication terminal according to any one of claims 8 to 11, wherein the plurality of image frames stored in the first area has a continuity of operations. The mobile communication terminal according to any one of claims 8 to 11, wherein each of the plurality of image frames stored in the first area has a specific color within the frame. A display unit; A camera unit; A preview image synthesizing unit configured to position an image input through the camera unit on a lower layer in a preview mode, and sequentially display a plurality of selected image frames on an upper layer and display the image on the display unit; A composite file storage unit including a header and a body, wherein the body stores a composite file having a data structure including a first area storing a plurality of image frames and a second area storing a video; When a video recording command occurs in the preview state, the video obtained from the camera unit and the plurality of selected image frames are generated as a composite file having the data structure and stored in the composite file storage unit. A video composite file generation unit for designating an image frame displayed on a layer as an initial image frame; The moving picture stored in the second region of the composite file is played on the lower layer, and the plurality of image frames stored in the first region of the same composite file are sequentially placed on the upper layer and displayed on the display unit. A video synthesizing processor to sequentially position the upper layer; Mobile communication terminal comprising a.

Images