JP2008182764A - Imaging apparatus, image data storing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To directly relate image data picked up by an imaging section to address book data under editing. <P>SOLUTION: A CPU 12 displays address book data on a main display unit 2 and when a user selects any arbitrary data from among these data and then activates an imaging unit 71 to pickup an image, the CPU 12 registers the picked-up image in an image memory 19 in association with the selected data, such that the picked-up image can be registered while correspondingly relating it to the selected data of the address book. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, an image data storage method, and a program having a function of displaying, for example, an image captured using a still image capturing function together with contact information such as a telephone number.

  2. Description of the Related Art Conventionally, mobile phones have a so-called address book function, outgoing call history display function, and incoming call history display function for displaying a telephone number received by a caller or caller number display service. In the address book function, information related to a contact specified by the telephone number, such as a telephone number and a name stored in association with the telephone number, is displayed.

  On the other hand, in recent years, some mobile phones are provided with an image display function to display an image such as a corresponding face photograph when displaying an address book (for example, Patent Document 1).

JP 2001-24776 A (page 5, FIG. 8)

  As described above, conventional mobile phone terminals can register captured data in the address book, etc., but it is difficult to directly start the camera while editing the data and shoot on the spot and return to editing as it is It is. Also, only one image data can be registered (linked), which is not convenient. Furthermore, there is inconvenience that only one piece of data is registered and it is not possible to collect images that are related to a certain person. The registered data is only displayed when browsing the data in the address book, etc., and the ringtone is automatically determined based on the image, or the associated image is picked up. There was a problem that it was not used.

  Therefore, the present invention has been made to solve the above-described conventional problems, and an imaging apparatus, an image data storage method, and a program capable of easily associating captured image data with an address book being edited The purpose is to provide.

  To achieve the above object, the invention described in claim 1 is directed to address book storage means for storing address book data including contacts used for communication, imaging means, and activation instruction detection for detecting an activation instruction for the imaging means. And a mode for creating address book data to be stored in the address book storage means or editing the address book data stored in the address book storage means when the activation instruction is detected by the activation instruction detection means A first determination unit that determines whether or not the activation instruction is within the mode, and if the first determination unit determines that the activation instruction is within the mode, the thumbnail image data of the image data captured by the imaging unit And generating means for generating the thumbnail image data generated by the generating means in association with the address book data. Characterized by comprising a 憶 means.

  Further, in the invention described in claim 2, in the invention described in claim 1, a plurality of setting information storage means for storing a plurality of photographing sizes that can be imaged by the imaging means, and a plurality of settings information storage means are stored in the setting information storage means. A selection detection unit for detecting selection of a predetermined shooting size from the shooting size; and a second determination unit for determining whether the shooting size selected and detected by the selection detection unit is greater than or equal to a predetermined value. The generation unit generates thumbnail image data of the image data imaged by the imaging unit when the second determination unit determines that the predetermined value is greater than or equal to a predetermined value.

  According to a third aspect of the present invention, in the first or second aspect of the present invention, an imaging instruction for detecting an imaging instruction when the first determination means determines that the activation instruction is within the mode. An image file including a detection means, and when the imaging instruction is detected by the imaging instruction detection means, the image data captured by the imaging means and the captured image data thumbnail image data generated by the generation means An image file generating means for generating the image data, and a copying means for copying the thumbnail image data included in the image file generated by the image file generating means, wherein the storage means is a thumbnail image copied by the copying means. Data is stored in association with the address book data.

  According to a fourth aspect of the present invention, in the first or second aspect of the present invention, an imaging instruction for detecting an imaging instruction when the first determination unit determines that the activation instruction is within the mode. An image file including a detection means, and when the imaging instruction is detected by the imaging instruction detection means, the image data captured by the imaging means and the captured image data thumbnail image data generated by the generation means Image file generation means for generating the image file, and the storage means stores the storage start position of thumbnail image data in the image file generated by the image file generation means in association with the address book data. And

  In order to achieve the above object, the invention according to claim 5 is a start instruction detecting step for detecting a start instruction for the imaging unit, and a communication stored in the address book storage unit when the start instruction is detected in the start instruction detecting step. A determination step for determining whether or not it is a start instruction in a mode for editing address book data stored in the address book storage unit or creating address book data including a contact used for If it is determined in the step that the instruction is an activation instruction in the mode, a generation step of generating thumbnail image data of the image data captured by the imaging unit, and the thumbnail image data generated in the generation step is the address And a storage control step for controlling to store in the storage unit in association with the book data.

  In order to achieve the above object, the invention described in claim 6 is used for a start instruction detecting unit for detecting a start instruction for the image pickup unit, and for communication stored in the address book storage unit when the start instruction is detected by the start instruction detecting unit. Determination means for determining whether or not it is a start instruction within a mode for creating address book data including a contact address or editing address book data stored in the address book storage unit. If it is determined that the activation instruction is within the mode, a generation unit that generates thumbnail image data of the image data captured by the imaging unit, and the thumbnail image data generated by the generation unit are associated with the address book data. It is made to function as a storage control means for controlling to store in the storage unit.

  According to the present invention, there is an advantage that captured image data can be easily associated with the address book being edited without worrying about the captured size.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

A. First embodiment A-1. Configuration of First Embodiment FIGS. 1A and 1B are external views (an open front view and a rear view) of a mobile phone terminal 100, and FIGS. 2A and 2B are main display units. 2 is a diagram showing a display layout of 2. FIG. Mobile phone terminal 100 in the present embodiment has a two-fold structure including a lid and a main body. The speaker 1 is for outputting the voice of the other party during a voice call. The main display portion 2 is provided on the lid portion and is composed of a color liquid crystal. When used as a mobile phone terminal, the main display unit 2 displays various communication information, and when used as a digital camera, the main display unit 2 displays a viewfinder and edited contents of captured image data. The antenna 3 is provided on the back surface of the main body and is extendable. The operation unit 4 is provided on the front surface of the main unit, and includes various function keys (camera key 41, address book key 42, cross key 43, enter key 44), numeric keypad 45, clear key 46, and the like. Although the camera key 41 will be described later, the camera function (the imaging unit 71 and the image processing unit 18) is activated when operated.

  The address book key 42 is operated when the address book mode is activated. The cross key 43 is for instructing cursor movement when various types of information are displayed on the main display unit 2, and for instructing determination in various selection operations of the determination key 44. The numeric keypad 45 is operated not only for inputting a dial number, but also for inputting character data in the address book or mail creation, and the clear key 46 is operated for canceling the input or selected contents. . The microphone 5 is for inputting a user's voice during a voice call. The sub display unit 6 is provided on the back surface of the cover unit, and displays a status display in the closed state and a caller name at the time of incoming call from the address book data storage area 172. The LED 8 emits light when an incoming call is detected, and the image pickup lens 7 captures an image through this portion when the camera function is activated. The notification speaker 9 outputs a notification sound (melody) when an incoming call is received.

  FIG. 2A shows a display layout of the main display unit 2 when the image pickup unit 71 is activated. In the first embodiment, the camera mode is activated from the address book mode. Is displayed in the layout shown in the figure. Reference numeral 201 denotes an icon indicating the current communication environment state, and always searches the surrounding communication environment even in the camera mode and displays the result in the number of bars. Reference numeral 202 denotes an icon indicating the remaining battery level, and 203 denotes a current time display unit. Reference numeral 204 denotes an arrow icon for indicating zoom-in, and controls the electronic zoom of the imaging unit 71 in the enlargement direction in response to the upward operation of the cross key 43 by the user, and the result is displayed in the monitor display area 206. To reflect. 205 is an arrow icon for clearly indicating the zoom-up, and controls the electronic zoom of the imaging unit 71 in the reduction (wide) direction in response to the downward operation of the cross key 43 by the user, and the result is displayed in the monitor display area. This is reflected in 206. The monitor display area 206 is controlled by the driver 21 and displays the image captured by the image capturing unit 71 in real time at a resolution corresponding to the shooting mode, in addition to the corresponding resolution at the time of image editing work after shooting and saving. Is displayed. Reference numeral 207 denotes a function display area that prompts the user to operate the camera key 41 of the operation unit 4 when the user explicitly executes the function specified in this 207. Reference numeral 208 denotes a function display area that prompts the user to operate the determination key 44 of the operation unit 4 when the user explicitly executes the function specified in 208. Reference numeral 209 denotes a function display area that prompts the user to operate the address book key 42 of the operation unit 4 when the user explicitly executes the function specified in this 209.

  FIG. 2B shows a display layout when the user instructs the list display of the address book mode, the outgoing / incoming call history, and other various data stored in the RAM 17. Reference numeral 210 denotes an arrow icon for clearly indicating the switching of tabs 212, 213, and 214, which will be described later, and switches the tabs 212, 213, and 214 in response to the user's left operation of the cross key 43. Reference numeral 211 denotes an arrow icon for clearly indicating the switching of tabs 212, 213, and 214, which will be described later, and switches the tabs 212, 213, and 214 in response to the user's operation of the cross key 43 in the right direction. The tabs 212, 213, and 214 are provided mainly for setting and specifying detailed display contents in the list display. The tabs 212, 213, and 214 are divided according to the category of the address book or displayed even if the same record exists. It is divided according to. Reference numerals 215, 216, and 217 denote data display areas for displaying various information associated as a set of records, and three sets of 215, 216, and 217 are displayed at one time for one page. These display areas are also provided with areas for displaying images taken in the camera mode. In FIG. 3D, icons 204 and 205 clearly indicate the up / down operation of the cross key 43 by the user, and when the up / down operation is detected, the current data in the list display is focused. Differentiate display by hitting or reverse display.

  In the present embodiment, when the user explains “select”, “instruct”, “open submenu”, and the like with reference to the display example of the main display unit 2, details will be given. Means that the camera key 41, the enter key 44, and the address book key 42 are operated in accordance with the contents displayed in the function display areas 207, 208, and 209.

  FIG. 3 is a block diagram showing a configuration example of the mobile phone terminal 100 according to the first embodiment of the present invention. In the mobile phone terminal 100, the wireless processing unit 10 transmits and receives wireless signals from the antenna 3 in accordance with the control signal of the CPU 12, and performs primary modulation / primary demodulation processing by the CDMA method. The demodulation / modulation unit 11 modulates audio data digitally processed by the CELP method and other text data image data input via the bus B according to the control signal of the CPU 12 by the QPSK method and outputs the modulated data to the wireless processing unit 10. On the other hand, the data input from the wireless processing unit 10 is demodulated and output to the bus B. The CPU performs individual control and overall control. The main display unit 2 and the sub display unit display various data via the driver 21 and the driver 61, respectively, under the control of the CPU 12.

  The notification processing unit 13 controls the driver 14 under the control of the CPU 12, and the driver 14 drives the above-described LED 8, notification speaker 9, and built-in vibrator 20. The operation unit 4 outputs various instructions and data such as input of characters and telephone numbers, scrolling and selection of options. The sound processing unit 15 performs CELP coding on the sound input through the microphone 5 and outputs the sound, and converts the CLEP code input from the bus B into a sound signal and outputs the sound signal from the speaker 1. The ROM 16 includes a terminal ID, a telephone number, user profile data, and a program (background book data browsing / creation / editing program) for achieving the present invention, a program for operating the CPU 1 and a background. And image data such as stamps. The RAM 17 is used as a work area for holding data for the operation of the CPU 1 and has an area for storing address book data and link information described later. The imaging unit 71 includes an image capture device composed of a CMOS or CCD, a DSP, and the like, and digitally processes an image formed through the imaging lens 7. The image processing unit 18 includes a processor for encoding / compressing an image picked up by the image pickup unit 71, and particularly for performing a combining process in the third embodiment. The image memory 19 stores image data captured or received by the imaging unit 71.

  FIG. 4 is a schematic diagram showing a configuration example of the RAM 17 shown in FIG. In addition to the work area 171 of the CPU 12, an address book data storage area 172 including a contact telephone number and a link information storage area 173 are set in the RAM 17.

  FIG. 5 is a schematic diagram showing a configuration example of the image memory 19 shown in FIG. There is an area for storing a record number of the stored image data, a file name, a folder attribute,..., And a flag indicating the presence / absence of a link of the image data. Shall.

A-2. Operation of First Embodiment Next, the operation of the first embodiment will be described with reference to the flowchart of FIG. When the CPU 12 detects an address book mode activation instruction by detecting the operation of the address book key 42 in the incoming call waiting state in step S1, the CPU 12 activates the address book browsing / creating / editing program from the ROM 16 in step S2 (FIG. 7). A new address book data creation or editing screen for existing data as shown in a) is displayed on the main display unit 2.

  When “001 Rei Tanaka's address data” is highlighted and selected for editing on the address book data editing screen, the sub-type as shown in FIG. The menu is displayed on the main display unit 2 and it is determined whether “camera activation” is selected or whether the camera key 41 is pressed (whether the camera is activated).

  In step S3, the CPU 12 determines whether or not the camera is activated. If not, the process proceeds to step S14. If the camera is activated, the process proceeds to step S4. In step S4, the imaging unit 71 is activated, and in order to cause the driver 21 to display the image obtained from the imaging unit 71, the display of the corresponding resolution is set in the monitor display area 206, and the images are sequentially displayed. Next, the CPU 12 determines whether or not the continuous shooting mode is set in step S5. If it is set, the process proceeds to step S9. If not set, the process proceeds to step S6.

  Thereafter, when the CPU 12 detects the operation of the enter key 44 and confirms the photographed image in step S6, the image data of the display image is encoded and compressed by the image processing unit 18 in step S7 and stored in the image memory 19. By storing, a captured image as shown in FIG. 7F can be determined.

  Next, when the user gives an instruction to associate and register this confirmed image with Rei Tanaka's address book area of 001 by operating the enter key 44, the CPU 12 in step S8, the address book data storage area 172 shown in FIG. An image display link “1” is set in the address data area of Mr. Rei Tanaka in 001, and the image data is associated with 001 in the address book data storage area 172 in the link information storage area 173 shown in FIG. Is stored in the image memory 10 and the image based on the image data is temporarily reduced in accordance with the display layout of FIG. The edit screen is displayed as shown in FIG. The CPU 1 returns to the process of step S3 until it is determined in step S13 that the editing process in the address book mode has been completed.

  Accordingly, when returning to the normal address book browsing state from this state, Rei Tanaka's image is displayed together with Rei Tanaka's address data as shown in FIG. 7 (h), and Rei Tanaka's image data is displayed in the address book data. Can be confirmed to be associated and registered.

  By the way, when the pre-determined captured image is displayed on the main display unit 2 as shown in FIG. 10A, the user opens a submenu as shown in FIG. 10B and selects the continuous shooting setting. Further, as shown in FIG. 10 (f), if the continuous shooting speed is selected by “fast / medium / slow” in the continuous shooting setting to shift to the continuous shooting mode, the CPU 12 proceeds from step S5 to step S9. Then, the continuous shooting speed is set, and in step S10, a plurality of image data as shown in FIG. 10C are continuously shot (a plurality of images are shot within a certain time), and the continuous shooting obtained in step S11 is performed. The image data is collectively displayed as shown in FIG.

  As a result, when the user decides to register the continuously shot image in the address book, the CPU 1 sets a flag “1” in the storage location of the memory 19 for a plurality of continuously shot image data in step S12. Write link information of a plurality of images in the link information storage area 173.

  At that time, the CPU 12 sets an image display link “1” in the address data area of Mr. Rei Tanaka of 001 in the address book shown in FIG. 8, and further stores the address book data in the link information storage area 173 shown in FIG. In the storage area 001, a plurality of record numbers of the image memory 10 storing the registered plurality of continuous images are registered, and an image based on the first image data is displayed on the editing screen of the main display unit 2. Is displayed as shown in FIG.

  Therefore, when returning to the normal display of address book data from this state, the first image of Rei Tanaka's continuously shot images together with Rei Tanaka's address data is displayed as the main display as shown in FIG. It can be confirmed that the image data of Mr. Rei Tanaka is associated with the address book data and registered.

  According to the first embodiment, when image data is associated and registered with address book data, the camera is activated during address book data editing to obtain a photographed image, and this photographed image is associated with the address book being edited. It is possible to register and improve the usability of the address book. Also, you can set the shooting mode to continuous shooting while editing data in the address book, and you can register multiple shot images directly to the address book being edited at once, simplifying the registration process. it can.

  When manual is selected with the continuous shooting speed setting shown in FIG. 10 (f), images as shown in FIG. 10 (g) can be taken continuously by manual operation. Similarly to normal camera activation, a special effect can be selected from the menu immediately after shooting (same during shooting), and effects such as monotone, sepia, and stamping can be applied to the shot image. Further, desired image processing is performed on the spot before linking to the address book, and the processed image shown in FIG. 11A, for example, is immediately associated and registered in the address book data being edited by the same operation as described above. It can also be done. A composite image as shown in FIG. 11B is associated with the address book and registered.

  Similarly to normal camera activation, composite shooting is possible during shooting. The first shot is taken, and the second shot is taken in parallel with the first shot, and FIG. As shown in (1), it is possible to combine and confirm as a single photographed image, and then immediately associate and register it in the address book data being edited by the same operation as described above. A composite image as shown in FIG. 12B is displayed in the address book.

  Furthermore, by displaying a bag 111 having the same size as that displayed in the address book data on the preview screen as shown in FIG. 13A immediately after shooting the subject by starting the camera, the position is designated. Images trimmed as shown in FIGS. 13B and 13C can be registered in association with the address book data by the same operation as described above.

  Also, when browsing data such as an address book in which image data is associated and registered by the operation of the above embodiment, the resolution is reduced or the data size is reduced according to the address book data (record). Therefore, the image with the original resolution as shown in FIG. 14A linked to the image memory 19 can be enlarged / reduced on the spot by the cross key 43 or the like. Therefore, it is possible to easily adjust the portion to be displayed after data registration (after confirmation and storage).

  Furthermore, after image data is associated and registered, not only enlargement / reduction, but also the display position can be shifted up, down, left, and right with the cross key 43 so that more flexible positioning can be easily performed. it can. For example, FIGS. 14B and 14C show the address book data again after enlarging / reducing the image in the linked image memory 119 by a predetermined key operation while browsing the address book data. When it is returned, it becomes as shown in FIGS. 14 (d) and 14 (e). Note that the state shown in FIGS. 14D and 14E can be changed to the state shown in FIGS. 14B and 14C.

B. Second Embodiment Next, a second embodiment of the present invention will be described. FIG. 15 is a flowchart showing a browsing operation in the address book mode of the mobile phone terminal according to the second embodiment of the present invention. However, since the configuration of this example is the same as that of the first embodiment described above, the description of the configuration operation of each unit having the same configuration is omitted, and the characteristic part of the operation is described below. .

  In the present embodiment, when a plurality of images are registered in the address data of the address book by continuous shooting or the like, the user displays an animation when browsing the plurality of image data registered in association with the address book. A display operation when the setting is performed will be described. However, the animation display indicates that each image is switched and displayed, for example, every 2 seconds.

  In step S21, the CPU 12 determines whether animation display is set. If the animation display is not set, the process proceeds to another display process in step S25. On the other hand, if animation display is set, the process proceeds to step S22.

  In step S22, it is determined whether or not a plurality of pieces of image data are registered in association with the address book data currently focused on in the address book display mode. If a plurality of pieces of image data are not registered, an error is displayed in step S24 and the process is terminated. On the other hand, if a plurality of pieces of image data are registered, the process proceeds to step S23.

  In step S23, the CPU 12 once reads out the record numbers of the image memory 19 of a plurality of pieces of image data registered in the address data of interest in the link information storage area 173 and stores them in the work area 171, and then records these records. Based on the number, the corresponding plural pieces of image data as shown in FIG. 16 are sequentially read out from the image memory 19, and as shown in FIGS. 17A, 17B, and 17C, the image of the main display unit 2 is read. One by one is displayed on the display portion for a predetermined time.

  According to the second embodiment, since a plurality of image data registered in association with the address book can be viewed in an animation display, it is possible to immediately know what image data is associated and registered, Appearance of the appearance by animation display can be produced.

  In the second embodiment, a plurality of pieces of image data registered in association with the address book are browsed by animation display. However, as shown in FIGS. 18A, 18B, and 18C, the main display unit 2 The same effect can be obtained even if the image display part of the address book data is slid left and right one by one for a predetermined time.

C. Third Embodiment FIG. 19 is a block diagram showing a configuration example of a mobile phone terminal according to a third embodiment of the present invention. However, the same reference numerals are given to the same parts as those in the first embodiment shown in FIG. 1, and the description thereof will be omitted as appropriate.

  The cellular phone terminal 100 includes an antenna 3, a radio processing unit 10, a demodulation / modulation unit 11, a CPU 12, drivers 21, 61 and 14, a main display unit 2, a sub display unit 6, a notification processing unit 13, an LED 8, a vibrator 20, and a notification. In addition to the speaker 9, the sound processing unit 15, the microphone 5, the speaker 1, the ROM 16, the RAM 17, the imaging lens 7, the imaging unit 71, the image processing unit 18, the image memory 19, and the operation unit 4, only the human part is included in the image data. Is included.

  Next, editing of image data in the browsing operation of the address book data of the mobile phone terminal 100 will be described with reference to the flowchart shown in FIG. In the editing of the image data in the browsing operation, the person image portion is extracted from the image data already registered in association with the address book data, etc., and the desired background data is created by synthesizing the selected background. Register again in association with the address book data.

  First, when the user activates the address book data browsing / creating / editing mode, the CPU 12 activates the address book data viewing / creating / editing program in step S31, and displays the main display unit 2 as shown in FIG. indicate. When the user operates the operation unit 4 from this display screen to select image editing of the address book and further selects the extraction process of the person portion, the CPU 12 determines these operations and performs the following processing.

  That is, the CPU 12 receives this and determines whether or not it is image editing of the address book in step S32. If it is not image editing of the address book, the process proceeds to another editing process in step S37. If it is image editing of the address book, the process proceeds to step S33.

  In step S33, it is determined whether the process is a person part extraction process. If it is the process of extracting the person part, the process proceeds to step S34, where the person part is recognized and extracted from the image data as shown in FIG. 21B by the image recognition unit 22, and as shown in FIG. Are displayed on the main display unit 2.

  Here, the image recognizing unit 22 has a plurality of human face patterns, recognizes a human face based on the positional relationship between colors and color chunks, and simultaneously recognizes clothes from the continuity of color information connected to the human face pattern. Only the person including the body part is recognized, and only the part is extracted.

  On the other hand, when the user opens a submenu as shown in FIG. 21D on the main display unit 2 and selects the item “background” in order to create the background of the image data shown in FIG. Since various background patterns and background colors as shown in 21 (e) are displayed, a desired background pattern or background color is selected from these.

  In this selection, the person data recognized by the image recognition unit 22 is covered with a color pattern or pattern on a transparent portion around the person (= superimposed as a background), thereby creating a more favorite image. Here, it is assumed that, for example, white is selected as the background color.

  In response to this, the CPU 12 creates a white background, for example, in accordance with the user selection process described above in step S35, and synthesizes it with the image data shown in FIG. 21C in step S36. The image is displayed on the image display portion of the address book as shown in FIG.

  According to the third embodiment, only the person portion is recognized from the image data registered in the address book or the like, and the other portion of the image data of only this person is colored or synthesized with a pattern, thereby The background of the data can be processed into a desired shape, and the image data registered in association with the address book data can be easily produced.

  By the way, the address book data includes normally registered phone number data and e-mail address data, and when a call is received / received from the phone number, e-mail address, etc., a special melody is set to sound. Although it is possible, setting it one by one is a laborious operation.

  Therefore, the image recognition unit 22 of the third embodiment recognizes the color information of the image data registered in association with the address book data, and automatically selects the melody data in the mobile phone based on the color information. Can be provided.

  Specifically, numbering such as 1, 2, 3,... Is performed in advance on the portable melody data stored in the ROM 16. “1” is, for example, 90% or more of red information in image data, and “2” is an average of 90 to 80% of red information. This association table is held in the table portion of the RAM 17. Thereafter, the ringing tone can be automatically set by averaging the ratio of red occupying the color information of the registered image retrieved by the image recognition unit 22 by dividing it by the number of dots and referring to the table unit. . Note that the color information is an example, and the same can be achieved by using luminance or the like.

  As a result, for image data registered in the address book data, it is not necessary to bother to select a ringtone by automatically setting a ringtone based on color information or luminance information. A ringtone can be automatically added in case of forgetting. In the third embodiment, the automatic selection of the notification sound output from the notification speaker 9 has been described. However, even when the LED 8 detects an incoming call, the emission color, blinking, lighting pattern, and vibration pattern of the vibrator 20 are also used. Good.

D. Fourth Embodiment Next, a fourth embodiment of the present invention will be described. FIG. 22 is a conceptual diagram showing the contents held by the image recognition unit of the mobile phone terminal according to the fourth embodiment of the present invention. However, since the overall configuration of this example is the same as that of the above-described third embodiment, the description of the operation of each unit having the same configuration is omitted, and the characteristic part of the operation is described below. To do.

  The image recognizing unit 22 holds a plurality of coordinate data of a stereoscopic image for a human face portion. This coordinate data has not only the outline but also the coordinates that make up facial features such as eyes, nose, mouth, etc., and a database of minimum necessary coordinate data when viewed from all directions (up, down, left and right 360 degrees) It also has.

  Next, the operation of the fourth embodiment will be described with reference to the flowchart of FIG. In step S41, the CPU 12 reads out and activates the address book data browsing / creating / editing program from the ROM 16, and displays it on the main display unit 2 as shown in FIG. Next, in step S42, the CPU 12 determines whether image editing is performed. If it is not image editing, the process proceeds to another editing process in step S48. If it is image editing, the process proceeds to step S43.

  In step S43, it is determined whether or not the process is a person portion extraction process. If it is not the extraction process of the person portion, the process proceeds to step S48. On the other hand, if it is determined in step S43 that the process is to extract a person portion, the image memory 19 in which the image registered in the address book as shown in FIG. 24A is stored in step S44. The original image data is read out from the image data, and the person portion is recognized and extracted from the image data by the image recognition unit 22 and displayed on the main display unit 2. The steps so far are the same as those in the third embodiment shown in FIG.

  Here, the user operates the operation unit 4 to open a submenu as shown in FIG. 24B on the main display unit 2 and selects, for example, an album item. This is an instruction to search the image memory 19 for image data showing the same person as the image data registered in the address book data, and to display the image data showing the searched person arranged in an album format. Yes, this instruction is input to the CPU 12.

  Receiving this, the CPU 1 determines whether or not the search for the same person has been selected in step S45. If not, the process proceeds to step S48. If selected, the process proceeds to step S46. In step S <b> 46, the CPU 12 searches the image recognition unit 22 for image data in which the same person as the image registered in the address book data is captured using the image data in the image memory 19.

  At this time, the image recognizing unit 22 calculates the closest coordinate data from the three-dimensional image as shown in FIG. 22 held from the positional relationship of the target person's outline, eyes, mouth, nose, and the like. All of the image data held in the image memory 19 is performed, and the coordinate data closest to each image data is determined.

  As a result, if even one piece of image data is registered in the address book data or the like, the coordinate data close to them is determined, and by referring to the respective coordinate data for the image data in the image memory 19, the image data An image showing only the same person can be extracted from the memory 19, and related images can be easily searched.

  In step S47, the CPU 12 arranges the images in which only the searched same person is shown in an album format as shown in FIG.

  According to the fourth embodiment, an image of the same person as the image registered in the address book can be searched from the image memory 19, and a plurality of searched images can be displayed in an album format. You can easily search and browse images of people.

  Therefore, it is possible to easily search for an image of the same person as the image registered in the address book and register the favorite image in the address book by exchanging with the image registered originally. Can improve the efficiency of image editing.

E. Fifth Embodiment Next, a fifth embodiment of the present invention will be described. In the fifth embodiment, in a mobile phone with a camera that supports megapixels, in the normal camera mode, the shooting size can be selected in the submenu so as to correspond to all shooting sizes, while the camera mode from the address book In the start-up, only the normal display size of the mobile phone and the full screen display size of the mobile phone can be selected.

  Here, FIG. 25 shows a table showing the difference in selectable shooting size between the normal camera mode stored in the ROM 16 and the camera mode from the address book in the fifth embodiment. In the figure, the shaded portion is a shooting size (or function) that cannot be selected when the camera mode is activated from the address book. This is because the image registration in the address book is up to the wallpaper size, and therefore image editing such as resizing or trimming is necessary when shooting at a shooting size larger than that. The image editing may be performed manually or automatically, but the image can be registered without image editing in order to easily realize with existing hardware or to reduce the burden on the user. It is desirable to shoot with a different shooting size. For this reason, shooting with a shooting size that can be registered in the address book is restricted.

  In the example shown, when the camera mode is activated from the address book, it can be selected for the normal display size of mobile phones (120 x 160 dots) and for the full screen display size of mobile phones (240 x 320 dots) The shooting size that can be selected in the normal camera mode can be selected from the normal display size (120 × 160 dots) to UXGA (1600 × 1200 dots) of the mobile phone.

  The above-described list of selectable shooting sizes (including functions) shown in FIG. 25 is stored as a camera control processing table, for example, in the ROM 16 or RAM 17 shown in FIG.

  Next, the operation of the camera-equipped mobile phone according to the fifth embodiment will be described. FIG. 26 is a flowchart for explaining the operation of the camera-equipped mobile phone according to the fifth embodiment. FIG. 27 is a schematic diagram showing a display example of a sub menu in the camera mode of the fifth embodiment. In step S50, the CPU 12 determines whether or not the camera mode has been activated. If the camera mode has not been activated, the CPU 12 proceeds to another process in step S65. On the other hand, if the camera mode has been activated, the process proceeds to step S51. move on.

  In step S51, it is determined whether or not the camera mode is activation from the address book. If it is not activation from the address book (for example, activation from the standby screen), the process proceeds to step S66 and the normal camera mode is set. Execute. In the normal camera mode, all the photographing sizes and functions shown in FIG. 25 described above can be selected.

  On the other hand, if the camera mode is activated from the address book, the process proceeds to step S52 to determine whether or not the selection of the shooting item is instructed. If the selection of the shooting item is not instructed, it is currently set. In order to shoot in the shooting mode (shooting size or function), the process proceeds to step S60 described later.

  On the other hand, if the selection of the shooting item is instructed, the process proceeds to step S53, and a camera control processing table in which selectable shooting items are explicitly shown as shown in FIG. 25 is referred to. As shown in a) and (b), a photo shooting item setting screen is displayed. On the photo shooting item setting screen, first, as shown in FIGS. 27A and 27B, frames, shooting effects, macro settings, shooting light settings, self-timer settings, white balance, shooting modes, photo image quality settings, Large items such as GPS information addition and photo settings are displayed in a list. In the example shown in the figure, since all setting items cannot be displayed on one screen, a list of setting items is scroll-displayed by a scroll operation using a cross key or the like. In the setting screen, items that cannot be selected when the camera mode is activated from the address book are displayed in gray. In the illustrated example, the photo image quality setting and GPS information addition are displayed in gray.

  In addition, when any item is selected on the setting screen shown in FIGS. 27A and 27B, a setting screen for small items that can be set by the item is displayed. In the example shown in FIGS. 27A to 27C, a case where the shooting mode item is selected from the large item setting screen is shown. When the shooting mode is selected, as shown in FIG. 27C, items that cannot be selected when the camera mode is activated from the address book are displayed in gray, and a list of shooting sizes as small items is displayed. In this example, since the camera mode is activated from the address book, VGA (640 × 480), SXGA (1280 × 960), UXGA (1600 × 1200), and panorama (1280 × 320) are displayed in gray.

  Next, in step S56, it is determined whether or not any shooting item has been selected. If no shooting item has been selected, the process returns to step S54 to continue displaying the setting screen. On the other hand, when any shooting item is selected on the setting screen, it is determined in step S57 whether the item is selectable by camera mode activation from the address book. Here, when an item that cannot be selected, for example, an item displayed in gray, such as photo image quality or GPS information addition, is selected, the process returns to step S56, the item selection is continued, and the selection operation is ignored.

  On the other hand, if a selectable item is selected, the set contents are set in step S58. For example, when the mobile phone (120 × 160) is selected in the shooting mode, the shooting size is set to 120 × 160 dots. Similarly, when the wallpaper (240 × 320) is selected, the shooting size is set to 240 × 320 dots. Next, in step S59, it is determined whether or not the setting is completed, that is, whether or not “Close” is instructed on the setting screen. If the setting has not been completed, the process returns to step S54, and the photo shooting item is selected. Continue the selection process. On the other hand, when the setting is completed, the process proceeds to step S60.

  In step S60, the imaging unit 71 is activated, and images monitored on the main display unit 2 are sequentially displayed. Next, in step S61, it is determined whether or not the photographed image is confirmed, that is, whether or not the determination key 44 (shutter key) is pressed. If the determination key 44 is not pressed, the process returns to step S60 to monitor The sequential display of the displayed images is continued.

  On the other hand, if the determination key 44 is pressed and the captured image is confirmed, the image data of the display image is encoded and compressed by the image processing unit 18 and stored in the image memory 19 in step S62. Next, in step S63, the confirmed image stored in the image memory 19 is associated with the address book. For example, when an instruction for associating the confirmed image with the address book area of Mr. Rei Tanaka of 001 is performed by the user by operating the enter key 44, the CPU 12 performs Tanaka of 001 in the address book data storage area 172 shown in FIG. The image display link “1” is set up in Rei's address data area. Further, the CPU 12 registers the record number 001 of the image memory 10 storing the image data in the link information storage area 173 shown in FIG. 9 in association with 001 of the address book data storage area 172, An image based on the image data is displayed on the editing screen of the main display unit 2 as shown in FIG. The CPU 12 returns to step S52 and continues the process until it is determined in step S64 that the editing process in the address book mode has been completed.

  According to the fifth embodiment, in a camera phone with a megapixel support, when the camera mode is activated from the address book, it is used for the normal display size of the mobile phone and for the full screen display size of the mobile phone, that is, attached to the address book. Since only possible mobile phones (120 × 160) or wallpaper (240 × 320) can be selected as the shooting size, the user can shoot without hesitation with the shooting size.

F. Sixth Embodiment Next, a sixth embodiment of the present invention will be described. In the sixth embodiment, in order to prevent the user from having a user interface that makes the user feel uncomfortable by starting the camera mode from the address book editing, even in the camera mode starting from the address book editing, All shooting sizes (for normal display size of mobile phone (120 × 160 dots) to UXGA (1600 × 1200 dots)) can be selected. That is, even an image size that cannot be associated with the address book is not displayed in gray. When VGA or higher is selected, only thumbnail images (120 × 160 dots) generated by the DCF standard (according to the Exif standard) from the captured image are linked to the address book, and the original image data is stored in the data folder. It is characterized in that it can be referenced only when it is referenced.

  FIG. 28 is a conceptual diagram showing the configuration of an image file according to the Exif standard used as an image file in the sixth embodiment. The Exif standard image file is a header for identifying that the file is an Exif standard file, image additional information including tag information including various information related to the image data and thumbnail image data, and the original original image data captured Consists of. In the tag information, various types of information such as the number of pixels, compression mode, camera model name, aperture value, shutter speed, shooting date and time, and user information can be recorded. In the Exif standard, thumbnail image data has a size of 120 × 160 dots. Also, the original image data is the shooting size set at the time of shooting (mobile phone: 120 × 160, wallpaper: 240 × 320, VGA: 640 × 480, SXGA: 1280 × 960, UXGA: 1600 × 1200, panorama: 1280 × 320).

  Next, the operation of the above-described sixth embodiment will be described. Here, FIG. 29 and FIG. 30 are flowcharts for explaining the operation of the sixth embodiment. In step S70, the CPU 12 determines whether or not the camera mode has been activated. If the camera mode has not been activated, the CPU 12 proceeds to another process in step S89, while if the camera mode has been activated, the process proceeds to step S71. move on.

  In step S71, it is determined whether or not the camera mode is activation from the address book. If it is not activation from the address book (for example, activation from the standby screen), the process proceeds to step S90, and the normal camera mode is set. Execute.

  On the other hand, if the camera mode is activated from the address book, the process proceeds to step S72, where it is determined whether or not the selection of the shooting item has been instructed. In order to shoot in the shooting mode (shooting size and function), the process proceeds to step S80 described later.

  On the other hand, when the selection of the shooting item is instructed, the process proceeds to step S73, and the camera control processing table in which the selectable shooting item is specified is referred to. In step S74, the processes shown in FIGS. As shown, a photo shooting item setting screen is displayed. In the sixth embodiment, all items, that is, large items such as frame, shooting effect, macro setting, shooting light setting, self-timer setting, white balance, shooting mode, photo image quality setting, GPS information addition, and photo setting are included. It can be selected.

  Further, when any item is selected on the large item setting screen, a small item setting screen that can be set by the item is displayed. Even in this case, all the small items can be selected in the sixth embodiment. For example, if the shooting mode item is selected from the large item setting screen, the mobile phone (120 × 160), wallpaper (240 × 320), VGA (640 × 480), SXGA (1280 × 960), UXGA ( 1600 × 1200) and panorama (1280 × 320) are all displayed in a selectable manner.

  Next, in step S76, it is determined whether or not any shooting item has been selected. If no shooting item has been selected, the process returns to step S74 to continue displaying the setting screen. On the other hand, when any shooting item is selected on the setting screen, the set contents are set in step S78. For example, when the mobile phone (120 × 160) is selected in the shooting mode, the shooting size is set to 120 × 160 dots. Similarly, when VGA (640 × 480) is selected, the shooting size is set to 640 × 480 dots. Next, in step S79, it is determined whether or not the setting is completed, that is, whether or not “Close” is instructed on the setting screen. If the setting is not completed, the process returns to step S74, and the photo shooting item is selected. Continue the selection process. On the other hand, when the setting is completed, the process proceeds to step S80.

  In step S80, the imaging unit 71 is activated, and the images monitored on the main display unit 2 are sequentially displayed. Next, in step S81, it is determined whether or not the photographed image has been confirmed, that is, whether or not the determination key 44 (shutter key) has been pressed. If the determination key 44 has not been pressed, the process returns to step S80 to monitor. The sequential display of the displayed images is continued.

  On the other hand, if the determination key 44 is pressed and the captured image is confirmed, the image data of the display image is encoded and compressed by the image processing unit 18 and temporarily stored in the image memory 19 in step S82. To do. Next, in step S83, a thumbnail (120 × 160) is generated from the original image data in accordance with the DCF standard, and in step S84, a header for identifying the Exif standard file according to the DCF standard, and image data. An image additional information composed of tag information including various information and thumbnail image data, and an Exif standard image file composed of the original original image data taken are generated and stored in the image memory 19.

  Next, in step S85, the CPU 12 sets the image size of the captured original image data to a selectable size, that is, a size that can be linked to the address book (mobile phone: 120 × 160 dots or wallpaper: 240 × 320 dots). Determine whether or not. If the image size of the original image data is a size that can be linked to the address book, the original image data of 120 × 160 dots or 240 × 320 dots is associated with the address book in step S86. Since the association with the address book is the same as in the fifth embodiment described above, the description thereof is omitted.

  On the other hand, when the image size of the original image data cannot be linked to the address book, that is, the image size is VGA (640 × 480), SXGA (1280 × 960), UXGA (1600 × 1200), panorama (1280). × 320), in step S87, the thumbnail (120 × 160) generated in step S83 is associated with the address book. Since the association with the address book is the same as in the fifth embodiment described above, the description thereof is omitted.

  In any case, the CPU 1 returns to step S72 and continues the process until it is determined in step S88 that the editing process in the address book mode has ended.

  Here, the association (link) of the thumbnail image to the address book described above will be described. As a first linking method for associating a thumbnail image with the address book, a thumbnail image created based on the DCF standard is copied, and the copy is made into a separate file and linked to the record being edited in the address book. In this case, there is an advantage that even if decoration processing or the like is performed at the time of editing the address book, this image file is not affected. Further, when registering with different decorations, there is an advantage that it is possible to save the trouble of photographing twice because it is only necessary to copy a thumbnail image of an already stored image file.

  As a second linking method, the storage start address of the thumbnail image in the image file created based on the DCF standard is linked. In this case, there is an advantage that it is not necessary to increase the number of image files carelessly. Which link method is to be used may be appropriately selected at the time of design, or a means for realizing both link methods may be mounted and the user may set which one to use. .

  According to the sixth embodiment, in a mobile phone with a camera that supports megapixels, even if a user selects and shoots an arbitrary shooting size without giving a sense of incongruity to camera mode activation from address book editing, It is possible to automatically associate image data of an image size (thumbnail image) that can be associated with the address book.

  It should be noted that the operation of each of the above-described embodiments can be programmed and executed by a computer. At that time, the computer program can be supplied to the computer through a disk-type recording medium such as a floppy (registered trademark) disk or a hard disk, various memories such as a semiconductor memory or a card-type memory, or various program recording media such as a communication network.

  In addition, the present invention is not limited to the above-described embodiment, and can be implemented in various other forms in specific configurations, functions, operations, and effects without departing from the scope of the invention. The same effect can be obtained by applying the present invention to various portable communication terminals such as a PDA having a function and a portable personal computer.

BRIEF DESCRIPTION OF THE DRAWINGS It is an external view of the mobile telephone terminal which concerns on the 1st Embodiment of this invention, (a) is an open state front view, (b) is an open state rear view. (A), (b) is a figure which respectively shows the display layout of the main display part of the mobile telephone terminal which concerns on the 1st Embodiment of this invention. It is the block diagram which showed the structural example of the mobile telephone terminal which concerns on the 1st Embodiment of this invention. FIG. 3 is a schematic diagram illustrating a configuration example of a RAM illustrated in FIG. 2. FIG. 3 is a schematic diagram illustrating a configuration example of an image memory illustrated in FIG. 2. It is the flowchart which showed the operation | movement procedure which associates and registers image data with the address book data of the mobile telephone terminal which concerns on 1st Embodiment. It is the figure which showed the example of a screen displayed when registering an association image in the address book of the mobile telephone terminal concerning a 1st embodiment. FIG. 2 is a schematic diagram showing a configuration of an address book data storage area set in a RAM shown in FIG. 1. It is the schematic diagram which showed the structure of the link information storage area set in RAM shown in FIG. It is the figure which showed the example of a screen displayed when link-registering several image data collectively with the address book data of the mobile telephone terminal which concerns on 1st Embodiment. It is the figure which showed the example of a process of the image data linked and registered with the address book data of the mobile telephone terminal which concerns on 1st Embodiment. It is the figure which showed the example of a synthesis | combination of the image data registered and linked | related with the address book data of the mobile telephone terminal which concerns on 1st Embodiment. It is the figure which showed the example of trimming of the image data registered in association with the address book of the mobile phone terminal according to the first embodiment. It is the figure which showed the example of expansion and reduction of the image data registered in association with the address book data of the mobile phone terminal according to the first embodiment. It is the flowchart which showed the browsing operation | movement of the address book data of the mobile telephone terminal which concerns on the 2nd Embodiment of this invention. It is the figure which showed the example of several image data in the image memory registered in relation with the address book data of the mobile telephone terminal which concerns on 2nd Embodiment. It is the figure which showed the example of a screen at the time of displaying the animation of several image data shown in FIG. It is the figure which showed the example of a screen at the time of carrying out the slide display of the several image data shown in FIG. It is the block diagram which showed the structural example of the mobile telephone terminal which concerns on the 3rd Embodiment of this invention. It is the flowchart which showed the operation | movement procedure which processes the background of the image data registered in correlation with the address book data of the mobile telephone terminal which concerns on 3rd Embodiment. It is the figure which showed the example of a screen displayed when processing the background of the image data registered and linked | related with the address book data of the mobile telephone terminal which concerns on 3rd Embodiment. It is the figure which showed the example of holding content of the image recognition part of the mobile telephone terminal which concerns on the 4th Embodiment of this invention. It is the flowchart which showed the procedure which searches the same person as the person included in the image data registered in association with the address book data of the mobile phone terminal according to the fourth embodiment. It is the figure which showed the example of a screen displayed when searching the same person as the person contained in the image data linked | related and registered with the address book data of the mobile telephone terminal which concerns on 4th Embodiment. In the fifth embodiment, table data showing a difference in photographing size that can be selected between the normal camera mode stored in the ROM 16 and the camera mode from the address book is shown. It is a flowchart for demonstrating operation | movement of the mobile phone with a camera by this 5th Embodiment. It is a schematic diagram which shows the example of a display of the submenu in the camera mode of the 5th embodiment. It is a conceptual diagram which shows the structure of the image file according to the Exif standard used as an image file in 6th Embodiment. It is a flowchart for demonstrating operation | movement of this 6th Embodiment. It is a flowchart for demonstrating operation | movement of this 6th Embodiment.

Explanation of symbols

2 Main display section (display means)
4 Operation unit 7 Imaging lens (imaging means, continuous photographing means)
8 LED (incoming call notification means)
9 Notification speaker (incoming call notification means)
10 Wireless processing unit (communication means)
11 Demodulation / modulation unit (communication means)
12 CPU (notification setting means, setting means)
13 Notification processor (incoming notification means)
14 Driver (Incoming call notification means)
16 ROM (setting information storage means)
17 RAM
18 Image processing unit (image processing means, copying means)
19 Image memory (image storage means)
20 Vibrator (Incoming call notification means)
21 Driver (resolution setting means)
22 Image recognition unit (image recognition means)
41 Camera key 42 Address book key (instruction means)
43 Four-way controller (selection means, shooting size selection means)
44 Enter key (selection means, shooting size selection means)
71 Imaging unit (imaging means)
100 Mobile phone terminal (imaging device with communication function)
172 Address book data storage area (address book storage means)
173 Link information storage area

Claims (6)

Address book storage means for storing address book data including contacts used for communication;
Imaging means;
An activation instruction detecting means for detecting an activation instruction of the imaging means;
When the activation instruction is detected by the activation instruction detection means, the address book data to be stored in the address book storage means is created or the address book data stored in the address book storage means is edited in a mode. First judging means for judging whether or not it is an activation instruction;
When the first determination unit determines that the activation instruction is within the mode, the generation unit generates thumbnail image data of the image data captured by the imaging unit;
Storage means for storing the thumbnail image data generated by the generating means in association with the address book data;
An imaging apparatus comprising: Setting information storage means for storing a plurality of photographing sizes that can be imaged by the imaging means;
Selection detection means for detecting selection of a predetermined shooting size from a plurality of shooting sizes stored in the setting information storage means;
Second determination means for determining whether or not the photographing size selected and detected by the selection detection means is greater than or equal to a predetermined value;
Further comprising
The imaging apparatus according to claim 1, wherein the generation unit generates thumbnail image data of the image data captured by the imaging unit when the second determination unit determines that the predetermined value is greater than or equal to a predetermined value. An imaging instruction detection unit that detects an imaging instruction when the first determination unit determines that the activation instruction is within the mode;
When an imaging instruction is detected by the imaging instruction detection unit, an image that generates an image file including the image data captured by the imaging unit and the captured image data thumbnail image data generated by the generation unit File generation means;
A duplicating means for duplicating thumbnail image data included in the image file generated by the image file generating means;
Further comprising
3. The imaging apparatus according to claim 1, wherein the storage unit stores the thumbnail image data copied by the copying unit in association with the address book data. An imaging instruction detection unit that detects an imaging instruction when the first determination unit determines that the activation instruction is within the mode;
When an imaging instruction is detected by the imaging instruction detection unit, an image that generates an image file including the image data captured by the imaging unit and the captured image data thumbnail image data generated by the generation unit File generation means;
With
3. The imaging apparatus according to claim 1, wherein the storage unit stores a storage start position of thumbnail image data in the image file generated by the image file generation unit in association with the address book data. . An activation instruction detection step for detecting an activation instruction for the imaging unit;
When the activation instruction is detected in this activation instruction detection step, the address book data including the contact used for communication to be stored in the address book storage unit is created or the address book data stored in the address book storage unit is edited A determination step for determining whether or not it is an activation instruction in a mode for
If it is determined in this determination step that the instruction is an activation instruction in the mode, a generation step of generating thumbnail image data of the image data captured by the imaging unit;
A storage control step for controlling the thumbnail image data generated in this generation step to be stored in the storage unit in association with the address book data;
An image data storage method comprising: A computer included in the imaging apparatus;
An activation instruction detecting means for detecting an activation instruction for the imaging unit;
When the activation instruction is detected by the activation instruction detecting means, the address book data including the contact used for communication to be stored in the address book storage unit is created or the address book data stored in the address book storage unit is edited. Determining means for determining whether or not it is an activation instruction in the mode for
If the determination means determines that the activation instruction is within the mode, the generation means generates thumbnail image data of the image data captured by the imaging unit,
Storage control means for controlling the thumbnail image data generated by the generation means to be stored in the storage unit in association with the address book data;
A program characterized by functioning as

Images