WO2006049413A1

WO2006049413A1 - Mobile terminal and operating method thereof

Info

Publication number: WO2006049413A1
Application number: PCT/KR2005/003638
Authority: WO
Inventors: Min Chul Jang
Original assignee: LG Electronics Inc
Current assignee: LG Electronics Inc
Priority date: 2004-11-04
Filing date: 2005-10-31
Publication date: 2006-05-11
Anticipated expiration: 2007-05-04
Also published as: KR20060040081A; KR100647953B1; US7986350B2; US20060092294A1

Abstract

A mobile terminal is provided. The mobile terminal includes a shot setting part, an image input part, a meta information extractor, and a meta information inserting part. The shot setting part sets shooting conditions and the image input part photographs an image using an optical zoom lens under the set shooting conditions and processes the photographed image. The meta information extractor extracts the shooting conditions set by the shot setting part as meta information and the meta information inserting part inserts the meta information extracted from the meta information extractor into the image processed by the image input part.

Description

MOBILE TERMINAL AND OPERATING METHOD THEREOF

Technical Field

[1] The document relates to a mobile terminal.

Background Art

[2] A mobile terminal (e.g., a mobile phone, a personal digital assistance (PDA), an iBook phone, and a smart phone), which can be carried by users and provide a variety of functions, is widely used. The mobile terminal provides a variety of functions such as a communication function, a wireless internet function, a diary function, a pho¬ tographing/reproducing function, and an entertainment function. Currently, the mobile terminal attracts mainly young generations by providing a multimedia function.

[3] As is revealed by the fact that the performance of a camera mounted on the mobile terminal approaches that of the digital camera, the image reproduction/photographing function of the mobile terminal is enhanced to a high level. For example, the number of pixels adopted for an LCD of the mobile terminal increases up to the level of five mega pixels and optical technology associated with a lens is integrated into the mobile terminal.

[4] That is, it is possible to take a photograph of high quality by supporting an optical zoom (an image itself is enlarged using an optical principle, so that image quality does not change even when the image is enlarged) as well as supporting a digital zoom (an image is enlarged through an imaging process with the number of pixels unchanged, so that image quality is degraded when the image is enlarged).

[5] However, the current optical zoom camera type mobile terminal does not provide sufficient features associated with meta information set and stored when an image is taken.

[6] Even in the case where the related art camera type mobile terminal (i.e., a camera phone) provides meta information, it deals only an only an image size, a generation date, resolution, and a file name. An optical zoom camera type mobile terminal provides much less features associated with the meta information.

[7] Therefore, a user of a high performance mobile terminal having an optical zoom camera requires a function of extracting and checking meta information, which is set when an image is taken, before the reproduction of the taken image, and a function of inserting the meta information into an image file when storing the image after pho¬ tographing the image so that the meta information can be used afterward.

[8] Accordingly, there is required a method for allowing a user to more efficiently use image meta information in an optical zoom camera type mobile terminal. Disclosure of Invention Technical Problem

[9] Accordingly, the present invention is directed to a mobile terminal and an operating method thereof that substantially obviate one or more problems due to limitations and disadvantages of the related art.

[10] An object of the present invention is to provide a mobile terminal and an operating method thereof that allow meta information corresponding to shooting conditions to be inserted into an image file in the case where photographed image data is stored in the format of an image file. Technical Solution

[11] To achieve these objects and other advantages and in accordance with the purpose of the invention, as embodied and broadly described herein, there is provided a mobile terminal including: a shot setting part for setting shooting conditions; an image input part for photographing an image using an optical zoom lens on the basis of the set shooting conditions and processing the photographed image; a meta information extractor for extracting the shooting conditions set by the shot setting part as meta in¬ formation; and a meta information inserting part for inserting the meta information extracted from the meta information extractor into the image processed by the image input part.

[12] In another aspect of the present invention, there is provided a method for driving a mobile terminal, the method including: setting shooting conditions; photographing an image using an optical zoom lens on the basis of the set shooting conditions and processing the photographed image; extracting the set shooting conditions as meta in¬ formation; and inserting the extracted meta information into the processed image. Brief Description of the Drawings

[13] Fig. 1 is a schematic block diagram of a mobile terminal for providing image meta information according to the present invention.

[14] Fig. 2 is a schematic block diagram of an image input part applied to a mobile terminal of the present invention.

[15] Fig. 3 is an exemplary diagram illustrating a data type of shot setting information applied to a mobile terminal of the present invention.

[16] Fig. 4 is a schematic data diagram illustrating the structure of a JPEG file.

[17] Fig. 5 is a schematic data diagram illustrating the structure of an APPI file.

[18] Fig. 6 is a view of a table illustrating an EXIF tag used for an IFDO in a mobile terminal of the present invention.

[19] Fig. 7 is a view of a table illustrating a data format of an EXIF tag field in a mobile terminal of the present invention. [20] Fig. 8 is a flowchart of a method for extracting, at a mobile terminal of the present invention, image meta information from shot setting information and inserting the extracted meta information into an image file.

[21] Fig. 9 is a flowchart of a method for extracting, at a mobile terminal of the present invention, image meta information from an image file. Mode for the Invention

[22] Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

[23] Fig. 1 is a schematic block diagram of a mobile terminal for providing image meta information according to the present invention, and Fig. 2 is a schematic block diagram of an image input part applied to a mobile terminal of the present invention.

[24] Referring to Fig. 1, the mobile terminal includes an image input part 110, a shot setting part 120, an image input driver 130, an image buffer 150, a meta information inserting part 160, a JPEG encoder 180, a meta information extractor 170 and a JPEG decoder 190.

[25] Referring to Fig. 2, the image input part 110 has an optical zoom camera 112 and photographs an image under shot setting information set by the shot setting part 120. The image input part 110 has a sensor module 114 and a digital signal processor (DSP) module 116 to process a photographed image. In detail, light signal inputted through the optical zoom camera 112 is converted into image data by the sensor module 114, and the DSP module 116 signal-processes the image data to convert the image data into a color signal expressed in a predetermined color space.

[26] The image buffer 150 stores image data outputted from the image input part 110.

The shot setting part 120 sets a plurality of shot setting information. At this point, data inputted through a user interface, existing sensor data, and hardware data of the JPEG decoder 190 can be used.

[27] The above shot setting information includes shooting information, image in¬ formation, file information, and device information.

[28] Fig. 3 is an exemplary diagram illustrating a data type of shot setting information applied to a mobile terminal of the present invention.

[29] Referring to Fig. 3, shooting information 10 may include ISO setting value, an exposure time, a focal length, a shutter speed, a numerical aperture, and whether a flash is used. The image information may include an image size and the resolution of an image.

[30] Also, the file information 30 may include a file generation date and a file name, and the device information 40 may include a manufacturing company and a model name. The information set when an image is photographed is used to generate image meta in- formation.

[31] The image input driver 130 stores the shot setting information. At this point, the in¬ formation is stored in a provided register 140. The image input driver 130 may be connected with the image input part 110 through an interface such as an inter integrated circuit (I2C) and receives an output stream from the image input part 110 through the interface. The I2C provides a serial bus for both directions of two lines that provide a communication link between integrated circuits. That is, the I2C provides an interface between devices having address spaces of different bits and operating under different voltages.

[32] The image input driver 130 controls a stable input/output of data through a clock input of the image input part 110 and the register 140.

[33] The meta information extractor 170 extracts image meta information. In detail, the meta information extractor 170 may extract the meta information from a JPEG file or the shot setting information.

[34] A process for extracting, at the meta information extractor 170, image meta in¬ formation from a JPEG file will be described below.

[35] Fig. 4 is a schematic data diagram illustrating the structure of a JPEG file.

[36] Referring to Fig. 4, the JPEG file includes SOI (A), APPl (B), APP (C) DQT (D),

DHT (E), SOF (F), SOS (G), and EOI (H). Respective data blocks are divided by a marker having a 2-byte size and starting with OxFF. Some data blocks are ended with the marker and other data blocks have data attached after the marker and expressing additional information.

[37] SOI (start of image)(A) represents a start point of a JPEG file, and DQT (define quantization table)(D) defines a quantization table. Also, DHT (define Huffman table)(E) is a table defining a Huffman code, and SOF (start of frame)(F) represents a start point of an image frame. Also, SOS (start of scan)(G) helps to read an image frame, and EOI (end of image)(H) represents the end of an image.

[38] Also, APPl (application marker segment I)(B) is a data block related to meta in¬ formation generated when an image is photographed, and APP (application marker n segment n)(C) is a series of data blocks containing other extension information. [39] The APPl (B) is a data block directly related to image meta information providing function of a mobile terminal according to the present invention. The APPl (B) stores exchangeable image format (EXIF) data used when the image meta information is stored.

[40] Fig. 5 is a schematic data diagram illustrating the structure of an APPI file.

[41] Referring to Fig. 5, an APPl (Bl) file is divided into APPl marker (Bl), APPl size

(B2), EXIF header (B3), TIFF header (B4), IFDO region (B5), and IFDl region (B6). [42] The APPl marker (Bl) having a value OxFFEl is designed for dividing an APPl data block, and the APPl size (B2) represents the entire length of a data block. Also, the EXIF header (B3) prescribes the format of a tag table for recording image meta in¬ formation on the IFD (image format directory) regions (B5 and B6), and TIFF (tag image file format) header (B4) prescribes the data format of each tag field.

[43] In the IFDO region (B5), respective image meta information entries (directories) have unique tag identifiers that meet a TIFF standard, and meta information that corresponds to the respective entries is stored after the tag identifiers. In the IFDl region (B 6), an information of thumbnail image is stored.

[44] The meta information extractor 170 extracts the image meta information according to the APPl structure of the JPEG file. According to the embodiment of the present invention, nine pieces of image meta information are provided.

[45] The reason nine pieces of image meta information are provided among lots of meta information is that increase of an overhead for the JPEG file due to increasing size of the image meta information is prevented and that sufficient image information can be provided to a user of a mobile terminal using only nine pieces of image meta in¬ formation. Of course, the number of image meta information may be increased or decreased depending on the design of the mobile terminal.

[46] The overhead of image meta information has a size of 64KB at the maximum and a size of 5KB in general within a range not exceeding the size of an actual image. According to the present invention, since a data block having a size less than 4KB can be formed, it is not a large overhead for an entire image.

[47] Fig. 6 is a view of a table illustrating an EXIF tag used for an IFDO in a mobile terminal of the present invention.

[48] As described above, the EXIF of the present invention has nine tags, which form tag fields for a manufacturing company (al), a device model (a2), an exposure time (a3), a numerical aperture (a4), an international standards organization (ISO) value (a5), a shutter speed (a6), a lens diameter (a7), whether a flash is used (a8), and a focal length (a9), respectively.

[49] The tag field has a unique tag code and a different data format (type). For example, referring to Fig. 6, a tag (al) "Make" representing a manufacturing company starts with 2-byte value of "OxOlOF" and a data type of an image meta information actually stored is stored in a "string" type.

[50] Fig. 7 is a view of a table illustrating a data format of an EXIF tag field in a mobile terminal of the present invention.

[51] Fig. 7 prescribes in detail data formats for respective tag fields including a manu¬ facturing company (bl), a device model (b2), an exposure time (b3), a numerical aperture (b4), an ISO value (b5), a shutter speed (b6), a lens diameter (b7), whether a flash is used (b8), and a focal length (b9). [52] For example, examination of the tag field of the exposure time (b3) shows that a data format thereof is an "unsigned rational" type and 8-byte is assigned to one component. That is, a data type of a rational function type is used, in which the front four bytes form a numerator value and the rear four bytes form a denominator.

[53] The meta information extractor 170 provides a user interface to receive permission as to generation of image meta information from a user and then generates the image meta information because shot setting information generated into the image meta in¬ formation may expose personal information of a user.

[54] The meta information extractor 170 can generate the image meta information from the shot setting information, or extract the image meta information from an existing JPEG file. In the case where the meta information extractor 170 generates the image meta information from the shot setting information, the meta information extractor 170 generates the image meta information which will be recorded on nine entries from the shot setting information according to the EXIF standard or the TIFF standard and stores the same.

[55] In the case where the meta information extractor 170 extracts the image meta in¬ formation from the existing JPEG file, the meta information extractor 170 analyzes the EXIF header (B 3) and the TIFF header (B4) of the APPl region to extract nine pieces of image meta information.

[56] When the meta information extractor 170 extracts the image meta information from the JPEG file, the mobile terminal of the present invention displays the image meta in¬ formation on a screen to provide the same to a user.

[57] The JPEG encoder 180 reads image data from the image buffer 150 to generate a

JPEG file. That is, the JPEG encoder 180 compresses an image according to a compression standard. Red-green-blue (RGB) data of respective pixels is converted into data on YUV color space (Y: brightness, U: hue, and V: saturation) which is used as a standard, and an entire image is divided into sections having a size of 8x8 pixel, so that discrete cosine transform (DCT) process is performed.

[58] Subsequently, the JPEG encoder 180 encrypts image data through quantization and entropy coding.

[59] When the JPEG encoder 180 generates a JPEG file, the meta information inserting part 160 inserts nine pieces of image meta information extracted by the meta in¬ formation extractor 170 into the header and the entries of the JPEG file. An encoded JPEG file is stored in a storage 200.

[60] The JPEG decoder 190 parses a JPEG file and decompresses a compressed image to display the image. The meta information extractor 170 may extract the image meta in¬ formation independently of the JPEG decoder 190.

[61] Next, a method for providing, at a mobile terminal, image meta information will be described with reference to Figs. 8 and 9.

[62] Fig. 8 is a flowchart of a method for extracting, at a mobile terminal of the present invention, image meta information from shot setting information and embedding the extracted image meta information into an image file.

[63] In the case where a user photographs a new image and stores the image in a JPEG file (SlOO), the meta information extractor 170 receives permission as to generation of image meta information from a user before the JPEG encoder 180 encodes the JPEG file (S 105).

[64] At this point, when a user refuses to generate the image meta information, the JPEG encoder 180 generates the JPEG file in which the image meta information is not embedded without intervention of the meta information embedding part 160 (Sl 10).

[65] In the case where the generation of the meta information is permitted by a user in the operation S 105, the meta information extractor 170 reads the shot setting in¬ formation from the register 140 (Sl 15) and generates the image meta information from the shot setting information (S120). Before the JPEG encoder 180 encodes a JPEG file, the meta information inserting part 160 adds (embeds) the image meta information into a JPEG header (S 125 to S 145). Header data is formed and subsequently entry data is formed through the image meta information.

[66] That is, the meta information inserting part 160 finds out the APPl marker (Bl) to record the size of the EXIF data on a header (B2) (S 125), and then adds the APPl header (S 130). The meta information inserting part 160 adds an EXIF header (B 3) which prescribes an IFD tag table to a next data block of the APPl header (S 135), and then adds a TIFF header (B4) which prescribes a data format of a tag field (S 140).

[67] Last, the meta information inserting part 160 stores the image meta information in respective entries B 5 according to the formats of the EXIF header and the TIFF header (S 145), and stores a JPEG file in which the image meta information is embedded (S 150).

[68] Fig. 9 is a flowchart of a method for extracting, at a mobile terminal of the present invention, image meta information from an image file.

[69] In the case where a user requests checking of the image meta information on a

JPEG file or other existing JPEG file in which the image meta information of the present invention is embedded (S200), the meta information extractor 170 selects and receives a JPEG file generated by the meta information inserting part 160 and the JPEG encoder 180, or other existing JPEG file and then read the same from the storage 200 (S205). At this point, the existing JPEG file can be a JPEG file inputted from other image apparatus such as other mobile terminal and other digital camera.

[70] Next, the meta information extractor 170 reads a marker code B 1 of each data block

(S210) and recognizes an APPl block size B2 (S215). The meta information extractor 170 analyzes tag data according to formats of an EXIF header B 3 and a TIFF header B4 (S220 and S225), and extracts image meta information B5 according to the analysis results (S230).

[71] Finally, the inventive mobile terminal displays the extracted image meta in¬ formation (S235), so that a user can use the image meta information.

[72] As described above, according to the mobile terminal of the present invention, a user photographs an image using an optical zoom camera and can embed variety of image meta information into an JPEG file when storing the image.

[73] Also, a user can extract the meta information from the JPEG file of the pho¬ tographed image to check shot setting information and can share the image meta in¬ formation with the digital camera and the optical zoom camera of the related art.

[74] It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention. Thus, it is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

Claims

[1] A mobile terminal comprising: a shot setting part for setting shooting conditions; an image input part for photographing an image using an optical zoom lens on the basis of the set shooting conditions and processing the photographed image; a meta information extractor for extracting the shooting conditions set by the shot setting part as meta information; and a meta information inserting part for inserting the meta information extracted from the meta information extractor into the image processed by the image input part.

[2] The mobile terminal according to claim 1, wherein the meta information inserting part inserts the meta information extracted from the meta information extractor into a JPEG (joint photographic experts group) file.

[3] The mobile terminal according to claim 2, wherein the meta information inserted into the JPEG file is inserted according to a JFIF (JPEG file interchange format) structure.

[4] The mobile terminal according to claim 2, wherein the meta information inserting part inserts the meta information according to formats of an EXJP (exchangeable image format) header and a TIFF (tag image file format) header within a JPEG file header.

[5] The mobile terminal according to claim 1, wherein the shooting conditions comprise at least one of shooting information, image information, file in¬ formation, and device information.

[6] The mobile terminal according to claim 5, wherein the shooting information comprises at least one of device manufacturing company information, device model information, exposure time information, numerical aperture information, ISO setting information, shutter speed information, lens diameter information, flash use information, focal length information, image size information, image resolution information, file generation date information, and file name in¬ formation.

[7] The mobile terminal according to claim 1, wherein the meta information extractor extracts the embedded meta information from an inputted image file.

[8] The mobile terminal according to claim 7, wherein the inputted image file is a

JPEG file, and the meta information extractor analyzes the JPEG file according to a JFIF structure to extract the meta information.

[9] The mobile terminal according to claim 7, wherein the meta information extractor analyzes tag data according to formats of an EXIF header and a TIFF header of an inputted JPEG file to extract meta information.

[10] The mobile terminal according to claim 1, further comprising an image output part for displaying the meta information extracted from the meta information extractor.

[11] A method for driving a mobile terminal, the method comprising: setting shooting conditions; photographing an image using an optical zoom lens on the basis of the set shooting conditions and processing the photographed image; extracting the set shooting conditions as meta information; and inserting the extracted meta information into the processed image.

[12] The method according to claim 11, wherein the step of inserting the extracted meta information, the extracted meta information inserted into a JPEG file.

[13] The method according to claim 12, wherein the meta information inserted into the JPEG file is embedded according to a JFIF(JPEG file interchange format) structure.

[14] The method according to claim 12, wherein the meta information inserted into the JPEG file is embedded according to formats of an EXIF (exchangeable image format) header and a TIFF (tag image file format) header within a JPEG file header.

[15] The method according to claim 11, wherein the shooting conditions comprise at least one of shooting information, image information, file information, and device information.

[16] The method according to claim 15, wherein the shooting information comprises at least one of device manufacturing company information, device model in¬ formation, exposure time information, numerical aperture information, ISO setting information, shutter speed information, lens diameter information, flash use information, focal length information, image size information, image resolution information, file generation date information, and file name in¬ formation.

[17] The method according to claim 11, further comprising: extracting the embedded meta information from an inputted image file.

[18] The method according to claim 17, wherein the inputted image file is a JPEG file, and the extracting of the embedded meta information comprises: analyzing the JPEG file according to a JFIF structure to extract the meta information.

[19] The method according to claim 17, wherein the inputted image file is a JPEG file, and the extracting of the embedded meta information comprises: reading a marker code of the JPEG file inputted according to a JFIF structure, recognizing an APPl block size, and analyzing tag data according to formats of an EXIF header and a ΗFF header of the JPEG file to extract the meta information. [20] The method according to claim 11, further comprising: displaying the extracted meta information.