JP2013012933A - Photographic memo creation device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve performance of preparing a format of an album memo.SOLUTION: A CPU 30 detects the name of a person appearing in photographic image data by reference to a person dictionary DIC1, detects the name of a body different from the person appearing in the photographic image data by reference to a body dictionary DIC2, and detects the name of the spot where the photograph is taken based upon output of a GPS device 42 and map data. Then the CPU 30 describes at least one of a person memo representing the detected name of the person and a body memo representing the detected name of the body to create an album memo in which a spot memo representing the detected name of the spot is described. At this time, a postpositional particle of Japanese which should be added to the spot memo in the album memory is specified in a different manner corresponding to description styles of the person memo and body memo. Further, a postpositional particle which should be added to the person memo in the album memo is specified in a different manner corresponding to the number of names appearing in the person memo.

Description

  The present invention relates to a photographing memo creation device, and more particularly to a photographing memo creation device that creates a memo added to a photographed image.

  An example of this type of device is disclosed in Patent Document 1. According to this background art, the CPU generates a cluster including a plurality of image data, and the first cluster name candidate and the second cluster name candidate based on the FAT data or Exif data and the third cluster name candidate input by the user. And create a slideshow table. The image display screen displays a list by combining any two of the first cluster name candidate, the second cluster name candidate, and the third cluster name candidate as cluster names that suggest the contents of the image data.

Japanese Patent No. 4416836

  However, the two cluster name candidates selected from the first cluster name candidate, the second cluster name candidate, and the third cluster name candidate are only displayed in parallel on the screen, and the displayed cluster name, that is, the shooting memo. It cannot be said that the appearance is good.

  Therefore, a main object of the present invention is to provide a photographing memo creating apparatus capable of improving the performance of arranging the appearance of the photographing memo.

  The photographing memo creating device according to the present invention (10: reference numeral corresponding to the embodiment; the same applies hereinafter) includes first detection means (S43 to S61) for detecting the name of a person appearing in the photographed image, and the person appearing in the photographed image. Second detection means (S65 to S69, S49 to S61) for detecting the name of an object different from the third detection means (S75) for detecting the name of the spot where the image was taken, and the name detected by the first detection means Creating means for creating a shooting memo in which one of the person memo representing the name and the object memo representing the name detected by the second detecting means and the spot memo representing the name detected by the third detecting means are described (S115) ~ S117, S131 ~ S137, S141, S145 ~ S47), first designation means for designating the particles to be added to the spot memo in the photographing memo created by the creation means in a different manner depending on the description mode of the person memo and the object memo (S119 to S129) and The second specifying means (S131 to S133, S139, S143) for specifying the particles to be attached to the person memo in the shooting memo created in a different manner according to the number of names appearing in the person memo is provided.

  Preferably, the first holding means (DIC1) that holds the feature amount of one or more persons each assigned with a name, and the feature amount of one or more objects each assigned a name. Second holding means (DIC2) is further provided, the first detecting means detects the name of the person with reference to the feature amount held by the first holding means, and the second detecting means is held by the second holding means. The name of the object is detected with reference to the feature amount.

  Preferably, a measuring means (42) for measuring the current position and a holding means (46) for holding the map data are further provided, and the second detecting means is the position measured by the measuring means and the map held by the holding means. The name of the spot is detected with reference to the data.

  More preferably, the first update means (S173 to S175) for updating the spot memo on the shooting memo created by the creation means in response to the editing operation, and the name on the map data held by the holding means is the first name. Second update means (S183 to S185) for updating by referring to the spot memo updated by the update means is further provided.

  Preferably, the creating means includes a description adjusting means (S131 to S135) that describes the person memo in the shooting memo in preference to the object memo.

  Preferably, the detection target of the first detection means includes the name of a specific person, and the creation means includes person memo creation means (S137, S141) for creating a personal memo by excluding the name of the specific person.

  More preferably, the specific person corresponds to the owner of the photographing memo creating apparatus.

  Preferably, an imaging means (16) for capturing a scene and a creation means (20) for creating a captured image based on the output of the imaging means are further provided.

  The shooting memo creation program according to the present invention is a first detection step (S43 to S61) for detecting the name of a person appearing in a photographed image in the processor (30) of the photograph memo creating apparatus (10), and a person appearing in the photographed image. Second detection step (S65 to S69, S49 to S61) for detecting the name of an object different from the third detection step (S75) for detecting the name of the spot where the image was taken, and the name detected by the first detection step Creating step (S115) for creating a shooting memo in which one of the person memo representing the name and the object memo representing the name detected in the second detection step and the spot memo representing the name detected in the third detection step are described ~ S117, S131 ~ S137, S141, S145 ~ S47), the first to specify the particles to be attached to the spot memo in the shooting memo created in the creation step in a different manner depending on the description mode of the person memo and the object memo A second specifying step (S131 to S133, S139) in which the particles to be added to the person memo in the photographing memo created in the creating step are designated in different ways depending on the number of names appearing in the person memo , S143).

  The shooting memo creation method according to the present invention is a shooting memo creation method executed by the shooting memo creation device (10), and includes a first detection step (S43 to S61) for detecting the name of a person appearing in a shot image, and shooting. Second detection step (S65 to S69, S49 to S61) for detecting the name of an object different from the person appearing in the image, third detection step (S75) for detecting the name of the spot where the image was taken, and first detection step A shooting memo in which one of the person memo representing the name detected by the object memo and the object memo representing the name detected by the second detection step and the spot memo representing the name detected by the third detection step is created. Creation steps (S115 to S117, S131 to S137, S141, S145 to S47), and the particles to be attached to the spot memo in the shooting memo created by the creation step differ depending on the description mode of the person memo and the object memo. A first specifying step (S119 to S129) for specifying in a manner, and a second specifying step for specifying a particle to be added to a person memo in a shooting memo created in the creation step in a different manner depending on the number of names appearing in the person memo (S131 to S133, S139, S143).

  An external control program according to the present invention is an external control program supplied to a photographing memo creating device including a processor (30) that executes processing according to an internal control program stored in a memory (46), and appears in a photographed image. First detection step (S43 to S61) for detecting the name of the person, second detection step (S65 to S69, S49 to S61) for detecting the name of an object different from the person appearing in the captured image, spot where the image was taken The third detection step (S75) for detecting the name of the person, the person memo representing the name detected by the first detection step, and the object memo representing the name detected by the second detection step and the third detection step Creation step (S115 to S117, S131 to S137, S141, S145 to S47) for creating a shooting memo that describes the spot memo representing the detected name, and the shooting memo created by the creation step The first designation step (S119 to S129) for designating the particle to be attached to the spot memo in a different manner depending on the description mode of the person memo and the object memo, and the particle to be attached to the person memo in the shooting memo created by the creation step This is an external control program for causing a processor to execute a second designation step (S131 to S133, S139, S143) that is designated in a different manner depending on the number of names appearing in the person memo in cooperation with the internal control program.

  The photographing memo creating device (10) according to the present invention executes a process according to an importing means (48) for fetching an external control program, and an external control program fetched by the fetching means and an internal control program stored in the memory (46). A photographing memo creating device including a processor (30) that performs a first detection step (S43 to S61) for detecting a name of a person appearing in a photographed image, and an object different from the person appearing in the photographed image A second detection step (S65 to S69, S49 to S61) for detecting the name of the spot, a third detection step (S75) for detecting the name of the spot where the image was taken, and a person representing the name detected by the first detection step Photographing in which one of the memo and the object memo representing the name detected by the second detection step and the spot memo representing the name detected by the third detection step are described The creation step (S115 to S117, S131 to S137, S141, S145 to S47) for creating a model, and the particles to be attached to the spot memo in the shooting memo created by the creation step differ depending on the description mode of the person memo and the object memo A first specifying step (S119 to S129) for specifying in a manner, and a second specifying step for specifying a particle to be added to a person memo in a shooting memo created in the creation step in a different manner depending on the number of names appearing in the person memo This corresponds to a program that executes (S131 to S133, S139, S143) in cooperation with the internal control program.

  According to the present invention, a spot memo is described in the photographing memo, and a person memo or an object memo is described. Here, the particle attached to the spot memo differs depending on the description mode of the person memo and the object memo. In addition, when a person memo is described in a shooting memo, the particle attached to the person memo varies depending on the number of names appearing in the person memo. This improves the performance of adjusting the appearance of the shooting memo.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

It is a block diagram which shows the basic composition of one Example of this invention. It is a block diagram which shows the structure of one Example of this invention. (A) is an illustrative view showing an example of a configuration of a person dictionary, and (B) is an illustrative view showing an example of a configuration of an object dictionary. It is an illustration figure which shows an example of each structure of a person register | resistor and an object register | resistor. (A) is an illustration figure which shows an example of the through image displayed on an LCD monitor, (B) is an illustration figure which shows another example of the through image displayed on an LCD monitor. (A) is an illustrative view showing another example of the through image displayed on the LCD monitor, and (B) is an illustrative view showing still another example of the through image displayed on the LCD monitor. (A) is an illustrative view showing another example of the through image displayed on the LCD monitor, and (B) is an illustrative view showing another example of the through image displayed on the LCD monitor. (A) is an illustration figure which shows an example of the reproduction | regeneration image and imaging | photography memo displayed on an LCD monitor, (B) is an illustration figure which shows an example of the reproduction | regeneration image and imaging | photography memo displayed on an LCD monitor. (A) is an illustrative view showing another example of a reproduced image and a photographed memo displayed on the LCD monitor, and (B) is an illustrative view showing still another example of the reproduced image and the photographed memo displayed on the LCD monitor. It is. (A) is an illustrative view showing another example of a reproduced image and a photographed memo displayed on the LCD monitor, and (B) is an illustrative diagram showing another example of the reproduced image and the photographed memo displayed on the LCD monitor. is there. It is a flowchart which shows a part of operation | movement of CPU applied to the FIG. 2 Example. It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; FIG. 10 is a flowchart showing yet another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; FIG. 10 is a flowchart showing yet another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; FIG. 10 is a flowchart showing yet another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. It is a block diagram which shows the structure of the other Example of this invention.

Embodiments of the present invention will be described below with reference to the drawings.
[Basic configuration]

  Referring to FIG. 1, the photographing memo creating apparatus of this embodiment is basically configured as follows. The first detection means 1 detects the name of a person who appears in the captured image. The second detection means 2 detects the name of an object different from the person who appears in the captured image. The 3rd detection means 3 detects the name of the spot by which imaging | photography was performed. The creating unit 4 selects either the person memo representing the name detected by the first detecting unit 1 or the object memo representing the name detected by the second detecting unit 2 and the name detected by the third detecting unit 3. A shooting memo in which a spot memo to be expressed is described is created. The first designation means 5 designates the particles to be added to the spot memo in the photographing memo created by the creation means 4 in different ways depending on the description mode of the person memo and the object memo. The second designation means 6 designates the particle to be added to the person memo in the photographing memo created by the creation means 4 in a different manner depending on the number of names appearing in the person memo.

In the shooting memo, a spot memo is described, and a person memo or an object memo is described. Here, the particle attached to the spot memo differs depending on the description mode of the person memo and the object memo. In addition, when a person memo is described in a shooting memo, the particle attached to the person memo varies depending on the number of names appearing in the person memo. This improves the performance of adjusting the appearance of the shooting memo.
[Example]

  Referring to FIG. 2, the digital camera 10 of this embodiment includes a focus lens 12 and an aperture unit 14 driven by drivers 18a and 18b, respectively. The optical image that has passed through these members is irradiated onto the imaging surface of the imager 16 and subjected to photoelectric conversion.

  When the camera mode is selected, the CPU 30 instructs the driver 18c to repeat the exposure operation and the charge reading operation in order to execute the moving image capturing process. The driver 18c exposes the imaging surface of the imager 16 in response to a periodically generated vertical synchronization signal Vsync, and reads out the charges generated on the imaging surface in a raster scanning manner. From the imager 16, raw image data based on the read charges is periodically output.

  The signal processing circuit 20 performs processing such as white balance adjustment, color separation, and YUV conversion on the raw image data output from the imager 16. The image data in the YUV format (hereinafter referred to as “photographed image data”) generated thereby is written into the YUV image area 24 a of the SDRAM 24 through the memory control circuit 22. The LCD driver 26 repeatedly reads the captured image data stored in the YUV image area 24a through the memory control circuit 22, and drives the LCD monitor 28 based on the read captured image data. As a result, a real-time moving image (through image) representing the scene captured on the imaging surface is displayed on the monitor screen.

  The CPU 30 repeatedly executes a search process for searching for a partial image satisfying the predetermined condition from the captured image data in parallel with the above-described moving image capturing process. Here, the “partial image satisfying the predetermined condition” means one or more person images stored in the person dictionary DIC1 and one or more object images (object image: person and person stored in the object dictionary DIC2). This corresponds to a partial image that coincides with any one of images representing different objects.

  Both the person dictionary DIC1 and the object dictionary DIC2 are stored in the flash memory 46. The person dictionary DIC1 is configured as shown in FIG. 3A, and the object dictionary DIC2 is configured as shown in FIG. According to FIG. 3A, image feature amounts representing the faces of three persons are stored in the person dictionary DIC1. Identification numbers “1”, “2” and “3” and person names “Akiko”, “Hiroshi” and “Miyuki” are assigned to these three feature amounts. Further, according to FIG. 3B, the feature quantities of the images representing the three objects are stored in the object dictionary DIC2. Identification numbers “1”, “2”, and “3” and object names “cake”, “orange”, and “tea cup” are assigned to these three feature amounts.

  In the search process, first, the person dictionary DIC1 is designated as the reference dictionary, the person register RGST1 shown in FIG. 4 is designated as the registration destination register, and the variable K is stored in the reference dictionary from “1” to “Kmax” (Kmax: The total number of dictionary images) is set in order. When the variable K reaches “3”, the reference dictionary and the registration destination dictionary are changed to the object dictionary DIC2 and the object register RGST2 shown in FIG. 4, and the variable K is sequentially set to each of “1” to “Kmax” again. .

  From the photographed image data stored in the YUV image area 24a, a partial image that matches the Kth dictionary image stored in the reference dictionary is searched. If the reference image is the person dictionary DIC1, a partial image that matches the Kth person image is searched. If the reference image is the object dictionary DIC2, a partial image that matches the Kth object image is searched.

  When a desired partial image is detected, the position and size of the detected partial image are registered in the registration destination register. Further, the name of the detected partial image is read from the reference dictionary, and the read name is registered in the registration destination register.

  When one or more partial images satisfying the predetermined condition are detected in this way, the CPU 30 sets a partial area covering the detected one or two or more partial images as an evaluation area. The CPU 30 further instructs the character generator 32 to display one or more detection frame characters that respectively point to the detected one or more partial images.

  The character generator 32 creates character data according to the command, and gives the created character data to the LCD driver 26. The LCD driver 26 drives the LCD monitor 28 based on the given character data. The detection frame character has a size corresponding to the size of the designated partial image, and is displayed at a position surrounding the designated partial image.

  On the other hand, if no partial image satisfying the predetermined condition is detected, the CPU 30 sets the predetermined area at the center of the imaging surface as the evaluation area and instructs the character generator 32 to hide the detection frame character. The character generator 32 interrupts the output of the character data, whereby the detection frame character disappears.

  Therefore, when the scene shown in FIG. 5A is captured, the detection frame character DT1 is displayed so as to surround the face image of “Hiroshi”. In the first column of the person register RGST1, the position and size of the detection frame character DT1 and the person name “Hiroshi” are registered.

  When the scene shown in FIG. 5B is captured, the detection frame character DT1 is displayed so as to surround the face image of “Akiko”, and the detection frame character DT2 is displayed so as to surround the face image of “Hiroshi”. The In the first column of the person register RGST1, the position and size of the detection frame character DT1 and the person name “Akiko” are registered. Further, in the second column of the person register RGST1, the position and size of the detection frame character DT2 and the person name “Hiroshi” are registered.

  When the scene shown in FIG. 6A is captured, the detection frame character DT1 is displayed so as to surround the face image of “Hiroshi”, and the detection frame character DT2 is displayed so as to surround the face image of “Miyuki”. The In the first column of the person register RGST1, the position and size of the detection frame character DT1 and the person name “Hiroshi” are registered. Further, the position and size of the detection frame character DT2 and the person name “Miyuki” are registered in the second column of the person register RGST1.

  When the scene shown in FIG. 6B is captured, the detection frame character DT1 is displayed so as to surround the face image of “Akiko”, and the detection frame character DT2 is displayed so as to surround the face image of “Hiroshi”. Then, the detection frame character DT3 is displayed so as to surround the face image of “Miyuki”.

  In the first column of the person register RGST1, the position and size of the detection frame character DT1 and the person name “Akiko” are registered. Further, in the second column of the person register RGST1, the position and size of the detection frame character DT2 and the person name “Hiroshi” are registered. Furthermore, the position and size of the detection frame character DT3 and the person name “Miyuki” are registered in the third column of the person register RGST1.

  When the scene shown in FIG. 7A is captured, the detection frame character DT1 is displayed so as to surround the image representing the cake. In the first column of the object register RGST2, the position and size of the detection frame character DT1 and the object name “cake” are registered.

  When the scene shown in FIG. 7B is captured, the detection frame character DT1 is displayed so as to surround the face image of “Akiko”, the detection frame character DT2 is displayed so as to surround the image representing the cake, and A detection frame character DT3 is displayed so as to surround the image representing the tea cup.

  In the first column of the person register RGST1, the position and size of the detection frame character DT1 and the person name “Akiko” are registered. In the first column of the object register RGST2, the position and size of the detection frame character DT2 and the object name “cake” are registered. Further, the position and size of the detection frame character DT3 and the object name “tea cup” are registered in the second column of the object register RGST2.

  Returning to FIG. 2, the Y data forming the captured image data created by the signal processing circuit 20 is also given to the CPU 30. The CPU 30 calculates an appropriate EV value by performing AE processing on a part of the Y data belonging to the evaluation area set in the above-described manner among the given Y data, and an aperture amount that defines the calculated appropriate EV value And the exposure time are set in the drivers 18b and 18c, respectively. Thus, the quality of the through image is adjusted so that the brightness of the image belonging to the evaluation area shows an appropriate value.

  When the shutter button 40sh provided in the key input device 40 is half-pressed, the CPU 30 performs a strict AE process on the Y data belonging to the evaluation area and calculates an optimum EV value. The aperture amount and the exposure time that define the calculated optimal EV value are set in the drivers 18b and 18c, respectively, as described above. As a result, the quality of the through image is adjusted so that the brightness of the image belonging to the evaluation area shows the optimum value.

  The CPU 30 also performs AF processing on the high frequency components of the Y data belonging to the evaluation area. As a result, the focus lens 12 is arranged at the focal point, and the quality of the through image is adjusted so that the sharpness of the image belonging to the evaluation area is improved.

  When the shutter button 40sh is fully pressed, the CPU 30 executes a still image capturing process. The captured image data representing the scene at the time when the shutter button 40sh is fully pressed is saved from the YUV image area 24a to the still image area 24b by the still image capturing process.

  When the saving is completed, the CPU 30 describes the current date and time indicated by the clock circuit 44, the current position measured by the GPS device 42, the person name registered in the person register DIC1, and the object name registered in the object register DIC2. Create the specified file header. The created file header is written into the work area 24 c of the SDRAM 24 through the memory control circuit 22.

  Thereafter, the CPU 30 gives a corresponding command to the memory I / F 36 to record the captured image data saved in the still image area 24b and the file header stored in the work area 24c. The memory I / F 36 reads out the file header stored in the work area 24c and the captured image data stored in the still image area 24b through the memory control circuit 22 and stores the read file header and captured image data. Is recorded on the recording medium 38.

  The album memo setting is turned on / off by a menu operation. If the album memo setting is on, the album memo creation process is executed as follows.

  First, a file header stored in an image file for which an album memo is to be created is acquired from the recording medium 38 through the memory I / F 36. Next, the position described in the above-described manner is detected from the file header, and the name of the detected position, that is, the photographing spot name is searched with reference to the map data MP1 stored in the flash memory 46. The shooting spot name detected in this way is described on the album memo as a shooting spot memo.

  Subsequently, the person name and the object name are searched from the same file header. When only the object name is detected among the object name and the person name, the particle following the shooting spot memo is determined to be “no”. If the person name is detected in addition to the object name, but the detected person name is only the name of the camera owner, the particle following the shooting spot memo is determined to be “no”. On the other hand, when a person name other than the name of the camera owner is detected in addition to the object name, the particle following the shooting spot memo is determined as “de”. If neither an object name nor a person name is detected, the particle following the shooting spot memo is determined as “de”.

  The camera owner information is stored in advance in the flash memory 46. Whether or not the name of the person of interest is the name of the camera owner is determined based on the camera owner information stored in the flash memory 46.

  When one or more person names excluding the camera owner name are detected, the detected person names are described on the album memo as a person memo. If the number of described person names is one, the particle following the person memo is determined as “to”. On the other hand, if the number of described person names is “2” or more, the particle following the person memo is determined as “tadato”.

  Although no person names other than the camera owner name are detected, when one or more object names are detected, one of the detected object names is described on the album memo as an object memo. At this time, the particles following the described object memo are omitted.

  When the shooting spot memo and the person memo / object memo are thus created and the particles to be attached to these memos are determined, the CPU 30 further describes the date and time described in the file header to complete the album memo. The completed album memo is added to the same file header.

  Therefore, when album memo creation processing is executed for an image file containing captured image data representing the scene shown in FIG. 5A or FIG. 5B, the album memo is “March 5, 2011,” for example. "At Hiroshi XXX," When album memo creation processing is executed for an image file containing captured image data representing the scene shown in FIG. 6A or 6B, the album memo is “April 13, 2011”, for example. At the amusement park YYY, with Hiroshi and Miyuki. " Further, when the album memo creation process is executed on the image file containing the captured image data representing the scene shown in FIG. 7A or 7B, the album memo is “May 25, 2011”, for example. "The cake of a pastry shop ZZZ."

  When the reproduction mode is selected, the CPU 30 designates the latest image file recorded on the recording medium 38 and instructs the memory I / F 36 and the LCD driver 26 to execute the reproduction process focusing on the designated image file. . The memory I / F 36 reads the captured image data of the designated image file from the recording medium 38 and writes the read captured image data to the still image area 24 b of the SDRAM 24 through the memory control circuit 22.

  The LCD driver 26 reads the captured image data stored in the still image area 24b through the memory control circuit 22, and drives the LCD monitor 28 based on the read captured image data. As a result, the captured image is displayed on the LCD monitor 28.

  If the album memo is described in the header of the designated image file, the CPU 30 reads the album memo described in the file header through the memory I / F 36 and instructs the character generator 32 to display the read album memo.

  The character generator 32 creates character data according to the command, and gives the created character data to the LCD driver 26. The LCD driver 26 drives the LCD monitor 28 based on the given character data. As a result, the album memo is displayed on the LCD monitor 28 in an OSD manner.

  When the feed / return button 40fr of the key input device 40 is operated, the CPU 30 designates a subsequent image file or a preceding image file. The designated image file is subjected to a reproduction process similar to that described above, whereby the display on the LCD monitor 28 is updated. The photographed image data and album memo created in the manner described above are shown in FIGS. 8 (A), 8 (B), 9 (A), 9 (B), 10 (A), and 10 (B). It is played back as shown in.

  When the album memo button 40albm of the key input device 40 is pressed while an image file in which no album memo is described is being reproduced, the above-described album memo creation process is executed. On the other hand, when the album memo button 40albm is pressed while the image file describing the album memo is being played, the album memo editing process is executed as follows.

  First, the CPU 30 gives a corresponding command to the character generator 32 to display a character representing the keyboard. The character generator 32 creates character data according to the command, and gives the created character data to the LCD driver 26. The LCD driver 26 drives the LCD monitor 28 based on the given character data. As a result, a character representing the keyboard is displayed on the LCD monitor 28 in an OSD manner.

  The edit operation and / or end operation on the displayed keyboard is detected by the touch sensor 34. When the editing operation is performed, the CPU 30 edits the album memo displayed on the LCD monitor 28. When the end operation is performed after editing the album memo, the CPU 30 updates the album memo described in the header of the designated image file with the edited album memo.

  If the object to be edited is the imaging spot name on the album memo, the corresponding spot name on the map data stored in the flash memory 46 is updated to the same name as the changed shooting spot name. If the editing target is a person name on the album memo, the name of the corresponding person stored in the person dictionary DIC1 is changed to the same name as the changed person name. If the object to be edited is the object name on the album memo, the name of the corresponding object stored in the object dictionary DIC2 is changed to the same name as the changed object name.

  Thereafter, the CPU 30 instructs the character generator 32 to hide the character representing the keyboard. The character generator 32 interrupts the output of the character data, whereby the character representing the keyboard disappears.

  The CPU 30 executes the imaging task shown in FIGS. 11 to 12 when the camera mode is selected, and executes the reproduction task shown in FIG. 19 when the reproduction mode is selected. The CPU 30 also executes search processing shown in FIGS. 13 to 14 and album memo creation processing shown in FIGS. 15 to 18 under the imaging task, and album memo creation processing shown in FIGS. 15 to 18 under the reproduction task. The album memo editing process shown in FIGS. 20 to 21 is executed. Note that control programs corresponding to these tasks are stored in the flash memory 46.

  Referring to FIG. 11, a moving image capturing process is executed in step S1, and a search process is executed in step S3. As a result of the moving image capturing process, a through image is displayed on the LCD monitor 30. Further, as a result of the search process, a partial image that matches any one of the plurality of person images stored in the person dictionary DIC1 is searched, and matches any one of the plurality of object images stored in the object dictionary DIC2. The partial image to be searched is searched.

  For the partial image detected with reference to the person dictionary DIC1, the position and size of the partial image and the name of the sign person image are registered in the person register RGST1. For the partial image detected with reference to the object dictionary DIC2, the position and size of the partial image and the name of the code object image are registered in the object register RGST2. When such a registration process is executed, FLGht is updated from “0” to “1” to announce the detection.

  In step S5, it is determined whether or not the flag FLGht indicates “1”. If the determination result is YES, the process proceeds to step S15 through steps S7 to S9. If the determination result is NO, steps S11 to S13 are performed. Then, the process proceeds to step S15.

  In step S7, a partial area covering one or more detected partial images is set as an evaluation area. In step S9, the character generator 32 is instructed to display one or more detection frame characters that respectively point to the one or more partial images detected in step S7.

  The character generator 32 creates character data according to the command, and gives the created character data to the LCD driver 26. The LCD driver 26 drives the LCD monitor 28 based on the given character data. The detection frame character has a size corresponding to the size of the designated partial image, and is displayed at a position surrounding the designated partial image.

  In step S11, a predetermined area at the center of the imaging surface is set as an evaluation area, and in step S13, the character generator 32 is commanded to hide the detection frame character. The character generator 32 interrupts the output of the character data, whereby the detection frame character disappears.

  In step S15, it is determined whether or not the shutter button 40sh is half-pressed. If the determination result is NO, a simple AE process is executed in step S19. The simple AE process is executed with reference to the Y data belonging to the evaluation area, whereby the quality of the through image is adjusted so that the brightness of the image belonging to the evaluation area shows an appropriate value. When the process of step S19 is completed, the process returns to step S3.

  When the shutter button 40sh is half-pressed, strict AE processing is executed in step S17, and AF processing is executed in step S19. Strict AE processing and AF processing are also performed based on the Y data belonging to the evaluation area and its high-frequency components, thereby reducing the quality of the through image so that the brightness and sharpness of the image belonging to the evaluation area show optimum values. Adjusted.

  In step S23, it is determined whether or not the shutter button 40sh has been fully pressed. In step S25, it is determined whether or not the operation of the shutter button 40sh has been released. If the determination result of step S25 is YES, it will return to step S3, and if the determination result of step S23 is YES, a still image taking process will be performed in step S27. As a result of the process in step S27, the captured image data representing the scene at the time when the shutter button 40sh is fully pressed is saved from the YUV image area 24a to the still image area 24b.

  In step S29, a file header in which the current date and time indicated by the clock circuit 44, the current position measured by the GPS device 42, the person name registered in the person register DIC1, and the object name registered in the object register DIC2 are described. Create The created file header is written into the work area 24 c of the SDRAM 24 through the memory control circuit 22.

  In step S31, an instruction corresponding to the memory I / F 36 is given to record the captured image data saved in step S27 and the file header created in step S29. The memory I / F 36 reads out the file header stored in the work area 24c and the captured image data stored in the still image area 24b through the memory control circuit 22 and stores the read file header and captured image data. Is recorded on the recording medium 38.

  In step S33, it is determined whether or not the album memo setting is ON. If the determination result is NO, the process directly returns to step S3. If the determination result is YES, the album memo creation process is executed in step S35. To step S3. The album memo creation process is executed based on the date / time, position, person name, and object name described in the file header, and the album memo created thereby is added to the file header.

  The search process in step S3 shown in FIG. 11 is executed according to a subroutine shown in FIGS. First, the flag FLGht is set to “0” in step S41, the person dictionary DIC1 is designated as a reference dictionary in step S43, and the person register RGST1 is designated as a registration destination register in step S45. When the designation is completed, the variable K is set to “1” in step S47.

  In step S49, a partial image that matches the Kth dictionary image stored in the reference dictionary is searched from the captured image data stored in the YUV image area 24a. If the reference image is the person dictionary DIC1, a partial image that matches the Kth person image is searched. If the reference image is the object dictionary DIC2, a partial image that matches the Kth object image is searched.

  In step S51, it is determined whether or not a desired partial image has been detected. If the determination result is NO, the process proceeds directly to step S59. If the determination result is YES, the process proceeds to step S59 through steps S53 to S57. . In step S53, the flag FLGht is updated to “1”, and in step S55, the position and size of the detected partial image are registered in the registration destination register. In step S57, the name of the detected partial image is read from the reference dictionary, and the read name is registered in the registration destination register.

  In step S59, it is determined whether or not the variable K has reached the maximum value Kmax (= total number of dictionary images registered in the reference dictionary). If the determination result is NO, the variable K is incremented in step S61, and then the process returns to step S49. On the other hand, if a determination result is YES, it will be discriminate | determined by step S63 whether a reference dictionary is the object dictionary DIC2.

  If the determination result is NO, the reference dictionary is changed to the object dictionary DIC2 in step S65, the registration destination register is changed to the object register RGST2 in step S67, the variable K is returned to “1” in step S69, and then step Return to S49. On the other hand, if the determination result is YES, the process returns to the upper hierarchy routine.

  Album memo creation processing in step S35 shown in FIG. 12 and step S167 (described later) shown in FIG. 19 is executed according to the subroutine shown in FIGS.

  In step S71, a file header is acquired from the image file for which an album memo is to be created. In step S73, it is determined whether or not a position is described in the acquired file header. If the determination result is NO, the flag FLGspt is set to “0” in a step S81. If the determination result is YES, the process proceeds to step S75, and the name of the position described in the file header, that is, the shooting spot name is searched with reference to the map data MP1 stored in the flash memory 46. In step S77, it is determined whether or not a shooting spot name has been detected. If the determination result is YES, the flag FLGspt is set to “1” in step S79, while if the determination result is NO, the flag FLGspt is set in step S81. Set to “0”.

  When the process in step S79 or S81 is completed, it is determined in step S83 whether or not a person name is described in the file header acquired in step S71. If the determination result is NO, the flag FLGprsn is set to “0” in step S87, and the process proceeds to step S107. If the determination result is YES, the flag FLGprsn is set to “1” in a step S85, and the process proceeds to a step S89.

  In step S89, it is determined by referring to the camera owner information registered in the flash memory 46 whether the person name described in the file header includes the name of the camera owner. If the determination result is YES, the flag FLGowner is set to “1” in step S91, while if the determination result is NO, the flag FLGowner is set to “0” in step S93.

  When the process of step S91 or S93 is completed, it is determined whether the person name described in the file header includes the name of a person other than the camera owner. Again, the camera owner information registered in the flash memory 46 is referred to. If the determination result is YES, a flag FLGother is set to “1” in a step S97, and then the process proceeds to a step S101. On the other hand, if the determination result is NO, the flag FLGother is set to “0” in step S99, and then the process proceeds to step S107.

  In step S101, it is determined whether or not the number of person names other than the camera owner among the person names described in the file header is “2” or more. If the determination result is YES, the flag FLGplr is set to “1” in step S103, while if the determination result is NO, the flag FLGplr is set to “0” in step S105. When the process of step S103 or S105 is completed, the process proceeds to step S107.

  In step S107, it is determined whether or not the object name is described in the file header acquired in step S71. If the determination result is NO, the flag FLGobj is set to “0” in step S113. On the other hand, if the determination result is YES, the flag FLGobj is set to “1” in step S109, and one of one or more object names described in the file header is designated in step S111. .

  When the process of step S111 or S113 is completed, it is determined in step S115 whether or not the flag FLGspt indicates “1”. If a determination result is NO, it will progress to step S131 as it is, and if a determination result is YES, it will progress to step S131 through the process of steps S117-S129.

  In step S117, the shooting spot name detected by the process of step S75 is described as a shooting spot memo. In step S119, it is determined whether the flag FLGobj is “1”, in step S121, it is determined whether the flag FLGprsn is “0”, and in step S125, the flags FLGowner and FLGother are set to “1” and “0”, respectively. It is determined whether or not a logical product condition indicating “0” is satisfied.

  If the determination result in step S119 is NO, the process proceeds to step S121, and the particle following the shooting spot name is determined to be “de”. If the determination result in step S119 is YES and the determination result in step S123 or the determination result in step S125 is YES, the process proceeds to step S127, and the particle following the shooting spot name is determined to be “no”. If the determination result in step S119 is YES and both the determination result in step S123 and the determination result in step S125 are NO, the process proceeds to step S129, and the particle following the shooting spot name is “in” as in step S121. To decide.

  In step S131, it is determined whether or not the logical product condition that the flags FLGprsn, FLGplr, and FLGother indicate “1”, “0”, and “1”, respectively, is satisfied. In step S133, it is determined whether or not a logical product condition that flags FLGprsn, FLGplr, and FLGother all indicate “1” is satisfied. In step S135, it is determined whether or not the flag FLGobj indicates “1”.

  If the determination result in step S131 is YES, the process proceeds to step S137, and the person name (= name of a single person other than the camera owner) registered in the person register RGST1 is described on the album memo as a person memo. In step S139, the particle following the person memo is determined as “to”, and then the process proceeds to step S147.

  If the determination result of step S131 is NO, while the determination result of step S133 is YES, it will progress to step S141. In step S141, a plurality of person names (= names of a plurality of persons other than the camera owner) registered in the person register RGST1 are described on the album memo as person memos. In step S143, the particle following the person memo is determined as “tadato”, and then the process proceeds to step S147.

  If the determination result in step S131 and the determination result in step S133 are NO and the determination result in step S135 is YES, the process proceeds to step S145. In step S145, the single object name specified in step S111 described above is described on the album memo as an object memo. When the description is completed, the process proceeds to step S147. If any of the determination result in step S131, the determination result in step S133, and the determination result in step S135 is NO, the process proceeds to step S147 as it is.

  In step S147, the album memo is completed with reference to the date and time described in the file header acquired in step S71. In step S149, the completed album memo is added to the header of the creation destination image file. When the appending is completed, the routine returns to the upper level routine.

  Referring to FIG. 19, in step S151, the latest image file recorded on the recording medium 38 is designated, and in step S153, the memory I / F 36 and the LCD driver 26 are instructed to perform reproduction processing focusing on the designated image file.

  The memory I / F 36 reads the captured image data stored in the designated image file from the recording medium 38 and writes the read captured image data to the still image area 24 b of the SDRAM 24 through the memory control circuit 22. The LCD driver 26 reads the captured image data stored in the still image area 24b through the memory control circuit 22, and drives the LCD monitor 28 based on the read captured image data. As a result, the captured image is displayed on the LCD monitor 28.

  In step S155, it is determined whether or not the album memo is described in the header of the designated image file. If the determination result is NO, the process proceeds directly to step S159. If the determination result is YES, the process proceeds to step S157. The process proceeds to S159. In step S157, the album memo described in the file header is read through the memory I / F 36, and the character generator 32 is instructed to display the read album memo.

  The character generator 32 creates character data according to the command, and gives the created character data to the LCD driver 26. The LCD driver 26 drives the LCD monitor 28 based on the given character data. As a result, the album memo is displayed on the LCD monitor 28 in an OSD manner.

  In step S159, it is determined whether or not the feed / return button 40fr has been operated. If the determination result is YES, the process proceeds to step S161, and the next image file or the previous image file recorded on the recording medium 38 is designated. When the designation process is completed, the process returns to step S153. As a result, another captured image (and album memo) is displayed on the LCD monitor 28.

  If the determination result in step S159 is NO, it is determined in step S163 whether or not the album memo button 40albm has been pressed. If the determination result is NO, the process returns to step S159, while if the determination result is YES, the process proceeds to step S165. In step S165, it is determined whether or not an album memo already exists in the designated image file. If the determination result is YES, album memo creation processing is executed in step S167, and then the process returns to step S159. On the other hand, if the determination result is NO, an album memo editing process is executed in step S169, and then the process returns to step S159.

  The album memo editing process in step S169 is executed according to a subroutine shown in FIGS.

  In step S171, a corresponding command is given to the character generator 32 to display a character representing the keyboard. The character generator 32 creates character data according to the command, and gives the created character data to the LCD driver 26. The LCD driver 26 drives the LCD monitor 28 based on the given character data. As a result, a character representing the keyboard is displayed on the LCD monitor 28 in an OSD manner.

  In step S173, it is determined based on the output of the touch sensor 34 whether or not an editing operation has been performed on the displayed keyboard. In step S177, it is determined based on the output of the same touch sensor 34 whether or not an end operation has been performed on the displayed keyboard. If the determination result of step S173 is YES, the album memo displayed on the LCD monitor 28 is edited. If the determination result of step S177 is YES, it will be discriminate | determined by step S179 whether the edit process of step S175 was performed. If the determination result is NO, the process returns to the upper hierarchy routine, and if the determination result is YES, the process proceeds to step S181.

  In step S181, the album memo described in the header of the designated image file is updated with the album memo edited in step S175. In step S183, it is determined whether the imaging spot name on the album memo has been changed, in step S187, it is determined whether the person name on the album memo has been changed, and in step S191, the object name on the album memo is determined. Determine whether it has been changed.

  If the decision result in the step S183 is YES, the process advances to a step S185 so as to update the corresponding spot name on the map data stored in the flash memory 46 to the same name as the changed shooting spot name. If the determination result of step S187 is YES, it will progress to step S189 and will change the name of the corresponding person stored in person dictionary DIC1 to the same name as the person name after the change.

  If the determination result of step S191 is YES, it will progress to step S193 and will change the name of the corresponding object stored in the object dictionary DIC2 to the same name as the changed object name. If NO is determined in step S191 or if the process of step S193 is completed, the process proceeds to step S195, and the character generator 32 is instructed to hide the character representing the keyboard. The character generator 32 interrupts the output of the character data, whereby the character representing the keyboard disappears. When the process of step S195 is completed, the process returns to the upper layer routine.

  As can be seen from the above description, the CPU 30 detects the name of the person appearing in the captured image data with reference to the person dictionary DIC1 (S43 to S61), and determines the name of the object different from the person appearing in the same captured image data. Detection is performed with reference to the object dictionary DIC2 (S65 to S69, S49 to S61). The CPU 30 also detects the name of the spot where the image was taken based on the output of the GPS device 42 and the map data (S75). Thereafter, the CPU 30 describes either a person memo representing the name of the detected person or an object memo representing the name of the detected object, and an album memo describing the spot memo representing the name of the detected spot ( (Shooting Memo) is created (S115 to S117, S131 to S137, S141, S145 to S47). However, the CPU 30 designates the particles to be added to the spot memo in the album memo in different manners depending on the description mode of the person memo and the object memo (S119 to S129), and the particle to be added to the person memo in the album memo is used as the person memo. It is specified in different ways depending on the number of names that appear (S131 to S133, S139, S143).

  Thus, in the album memo, a spot memo is described, and a person memo or an object memo is described. Here, the particle attached to the spot memo differs depending on the description mode of the person memo and the object memo. In addition, when a person memo is described in an album memo, the particle attached to the person memo varies depending on the number of names appearing in the person memo. This improves the performance of arranging the album memo.

  In this embodiment, the name registered in the person register DIC1 is described in the album memo as it is. However, a title addition setting function is added, and the title is added to the person name according to ON / OFF of this function. / Exclusion may be controlled. In this embodiment, the album memo creating process or the album memo editing process is executed in response to the operation of the album memo button 40albm. However, these processes are executed in response to the menu operation. Also good.

  In this embodiment, the multitask OS and control programs corresponding to a plurality of tasks executed thereby are stored in the flash memory 46 in advance. However, as shown in FIG. 22, a communication I / F 48 is provided in the digital camera 10 and a part of the control program is prepared in the flash memory 46 from the beginning as an internal control program, while another part of the control program is prepared as an external control program. May be acquired from an external server. In this case, the above-described operation is realized by cooperation of the internal control program and the external control program.

  Furthermore, in this embodiment, the processing executed by the CPU 30 is divided into a plurality of tasks as described above. However, each task may be further divided into a plurality of small tasks, and a part of the divided plurality of small tasks may be integrated with other tasks. Further, when each task is divided into a plurality of small tasks, all or part of the tasks may be acquired from an external server.

DESCRIPTION OF SYMBOLS 10 ... Digital camera 16 ... Imager 20 ... Signal processing circuit 24 ... SDRAM
30 ... CPU
32 ... Character generator

Claims (12)

First detection means for detecting the name of a person appearing in the captured image;
Second detection means for detecting a name of an object different from the person appearing in the captured image;
Third detection means for detecting the name of the spot where the image was taken;
One of a person memo representing a name detected by the first detection means and an object memo representing a name detected by the second detection means, and a spot memo representing a name detected by the third detection means A creation means for creating the described shooting memo,
First designation means for designating a particle to be added to the spot memo in the photographing memo created by the creation means in a different manner depending on the description mode of the person memo and the object memo, and the photographing created by the creation means An imaging memo creation device comprising second designation means for designating a particle to be added to the person memo in a memo in a different manner depending on the number of names appearing in the person memo. A first holding unit that holds the feature amount of one or more persons each assigned a name; and a second holding unit that holds the feature amount of one or more objects each assigned a name. Prepared,
The first detecting means detects the name of the person with reference to the feature amount held by the first holding means,
The photographing memo creation device according to claim 1, wherein the second detection unit detects the name of the object with reference to the feature amount held by the second holding unit. It further comprises measuring means for measuring the current position and holding means for holding map data,
3. The photographing memo creation device according to claim 1, wherein the second detection unit detects the name of the spot with reference to the position measured by the measurement unit and the map data held by the holding unit. A first updating unit that updates the spot memo on the shooting memo created by the creating unit in response to an editing operation; and the name on the map data held by the holding unit is updated by the first updating unit. The photographing memo creation device according to claim 3, further comprising second update means for updating with reference to the spot memo.   5. The photographing memo creation device according to claim 1, wherein the creating unit includes a description adjusting unit that describes the person memo in the photographing memo in preference to the object memo. The detection target of the first detection means includes the name of a specific person,
The photographing memo creation device according to claim 1, wherein the creation unit includes a personal memo creation unit that creates the person memo by excluding the name of the specific person.   The photographing memo creation device according to claim 6, wherein the specific person corresponds to an owner of the photographing memo creation device. The photographing memo creation device according to claim 1, further comprising: an imaging unit that captures a scene; and a creation unit that creates the captured image based on an output of the imaging unit. To the processor of the shooting memo creation device,
A first detection step of detecting a name of a person appearing in a captured image;
A second detection step of detecting a name of an object different from the person appearing in the captured image;
A third detection step of detecting the name of the spot where the image was taken;
Either a person memo representing the name detected by the first detection step or an object memo representing the name detected by the second detection step and a spot memo representing the name detected by the third detection step A creation step to create a written memo,
A first designation step for designating a particle to be added to the spot memo in the photographing memo created by the creating step in a different manner depending on a description mode of the person memo and the object memo, and a photographing created by the creating step A shooting memo creation program for executing a second designation step of designating a particle to be attached to the person memo in a memo in a different manner depending on the number of names appearing in the person memo. A shooting memo creation method executed by a shooting memo creation device,
A first detection step of detecting a name of a person appearing in a captured image;
A second detection step of detecting a name of an object different from the person appearing in the captured image;
A third detection step of detecting the name of the spot where the image was taken;
Either a person memo representing the name detected by the first detection step or an object memo representing the name detected by the second detection step and a spot memo representing the name detected by the third detection step A creation step to create a written memo,
A first designation step for designating a particle to be added to the spot memo in the photographing memo created by the creating step in a different manner depending on a description mode of the person memo and the object memo, and a photographing created by the creating step A shooting memo creation method comprising a second designation step of designating a particle to be attached to the person memo in a memo in a different manner depending on the number of names appearing in the person memo. An external control program supplied to a photographing memo creating device including a processor that executes processing according to an internal control program stored in a memory,
A first detection step of detecting a name of a person appearing in a captured image;
A second detection step of detecting a name of an object different from the person appearing in the captured image;
A third detection step of detecting the name of the spot where the image was taken;
Either a person memo representing the name detected by the first detection step or an object memo representing the name detected by the second detection step and a spot memo representing the name detected by the third detection step A creation step to create a written memo,
A first designation step for designating a particle to be added to the spot memo in the photographing memo created by the creating step in a different manner depending on a description mode of the person memo and the object memo, and a photographing created by the creating step External control for causing the processor to execute a second designation step for designating a particle to be attached to the person memo in a memo in a different manner depending on the number of names appearing in the person memo in cooperation with the internal control program program. An imaging memo creation device comprising a capturing unit that captures an external control program, and a processor that executes processing according to the external control program captured by the capturing unit and the internal control program stored in a memory,
The external control program is
A first detection step of detecting a name of a person appearing in a captured image;
A second detection step of detecting a name of an object different from the person appearing in the captured image;
A third detection step of detecting the name of the spot where the image was taken;
Either a person memo representing the name detected by the first detection step or an object memo representing the name detected by the second detection step and a spot memo representing the name detected by the third detection step A creation step to create a written memo,
A first designation step for designating a particle to be added to the spot memo in the photographing memo created by the creating step in a different manner depending on a description mode of the person memo and the object memo, and a photographing created by the creating step Shooting memo creation corresponding to a program for executing a second designation step for designating a particle to be attached to the person memo in a memo in a different manner depending on the number of names appearing in the person memo apparatus.

Images