JP6107897B2 - Image information processing apparatus and program - Google Patents

Description

  The present invention relates to an image information processing apparatus and program for adding additional information to image data.

  2. Description of the Related Art In recent years, with the cost reduction of recording media, users have a large amount of content data such as image data, audio data, and document data. For this reason, appropriate management of a large amount of content data is required. For example, the description in Patent Document 1 discloses a method of recording photographed images having the same attribute together in one recording folder, thereby facilitating management of the photographed images.

  Also, in a digital photo frame that accumulates and displays image data, for each photo, information on the user's “dailyness” when the photo was taken, such as “weekdays / holidays”, location of stay, etc. Japanese Patent Application Laid-Open No. 2004-228688 discloses a technique for generating information from the above information and recording it in association with a photograph. This “dailyness” information is used, for example, in a process of preferentially reproducing an extraordinary photograph such as when sightseeing.

JP 2004-31244 A JP 2010-072818 A

  However, if the user gives additional information such as attributes, the operation is troublesome and the convenience is low. In addition, if the display is based on information such as the degree of daily life, for example, if you try to organize photos after traveling to different places multiple times, both will be detected as the same `` unusual '' photo , You can't search for photos of a particular event, and you can't improve your convenience.

  The present invention has been made in view of the problems of the above-described conventional example, and an object thereof is to provide an image information processing apparatus and program capable of improving convenience.

The present invention for solving the problems of the above-described conventional example is an image information processing apparatus, comprising: means for accepting image data including at least one metadata; time counting means for measuring date and time; and the image data Means for fetching the received metadata, additional information based on the fetched metadata, and means for adding additional information representing information on the capture date and time counted by the timing means to the received image data, and the acceptance Means for generating thumbnail image data obtained by reducing or expanding the image data to a predetermined size, means for storing the received image data and the thumbnail image data in association with each other, and at least one extraction condition, Information on the acquisition date and time included in the additional information and the current date and time acquired from the timing means Means for presenting a list of thumbnail image data stored in association with image data having a value less than a predetermined threshold, and an image associated with the thumbnail image data selected from the presented list The predetermined processing related to the data is performed.

Here, the predetermined process may be a process of displaying the image data associated with the thumbnail image data selected from the presented list instead of the image of the thumbnail list, and the metadata may be Or Exif (Exchangable image file format) format data. Further, the additional information may include information added by the camera, and image data may be classified into albums, and processing using the additional information or a part thereof as the album name may be executed. The predetermined processing adds additional information indicating “favorite” if the image data related to the selected thumbnail image data does not include additional information indicating “favorite”. It may be a process.

Furthermore, a program according to another aspect of the present invention provides a computer for receiving image data including at least one metadata, a clocking unit for measuring date and time, and a unit for extracting metadata included in the image data; Means for adding additional information based on the extracted metadata and additional information representing information of the capture date and time counted by the time measuring means to the received image data; and a predetermined size of the received image data Means for generating thumbnail image data reduced or enlarged, means for storing the received image data and thumbnail image data in association with each other, and at least one extraction condition, which is included in the related additional information, The difference between the capture date and time information and the current date and time acquired from the timing means is predetermined. And a means for presenting a list of thumbnail image data stored in association with image data that is less than the threshold value, and causing the computer to associate with the thumbnail image data selected from the presented list The predetermined processing related to the data is performed.

According to the present embodiment, convenience can be improved.

It is a block diagram showing the example of a structure of the image information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the example of the content of the image data which the image information processing apparatus which concerns on embodiment of this invention accepts. It is explanatory drawing showing the example of the content of the additional information setting table which the image information processing apparatus which concerns on embodiment of this invention uses. It is a functional block diagram showing an example of the image information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the example of the accumulation | storage aspect of the image data in the image information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the example of a screen display of the image information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing another example of a screen display of the image information processing apparatus which concerns on embodiment of this invention. It is a functional block diagram showing another example of the image information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the example of the content of the special day database which the image information processing apparatus which concerns on embodiment of this invention uses. It is a flowchart figure showing the example of the contents of the processing which the image information processing apparatus concerning an embodiment of the invention performs.

  As illustrated in FIG. 1, the image information processing apparatus 1 according to the embodiment of the present invention includes a control unit 11, a storage unit 12, an operation receiving unit 13, a display output unit 14, an image input unit 15, a time measuring unit 16, and The communication unit 17 is included. In an example of this embodiment, the image information processing apparatus 1 is connected to a home television and a network (Internet).

  Here, the control unit 11 is a program control device such as a CPU, and operates according to a program stored in the storage unit 12. In the present embodiment, the control unit 11 functions as means for receiving, storing and storing image data including at least one additional information. Further, out of the additional information addition conditions held in the storage unit 12 as holding means, means for extracting additional information associated with the additional information addition conditions satisfied by the additional information included in the received image data, and this extraction It also functions as means for additionally including the additional information in the received image data.

  Further, the control unit 11 includes at least one extraction condition, each extraction condition providing a list of extraction conditions associated with at least one additional information, and a list providing means for extracting the extraction condition from the provided list. It also functions as a means for accepting selection and extracting and presenting image data related to the additional information satisfying the selected extraction condition from the stored image data. The specific operation of the control unit 11 will be described in detail later.

  The storage unit 12 includes a memory device. The storage unit 12 may also include a disk device such as a hard disk drive. The storage unit 12 holds a program executed by the control unit 11. This program is provided by being stored in a computer-readable recording medium such as a DVD-ROM, and is copied and stored in the storage unit 12. Alternatively, this program may be obtained by downloading from a server device on the network. The storage unit 12 also operates as a work memory for the control unit 11. Note that the storage unit 12 may include a nonvolatile memory. This non-volatile memory retains data to be retained even if the power is cut off (for example, parameter data required at startup).

  Further, in the present embodiment, the storage unit 12 accumulates and stores image data in accordance with instructions input from the control unit 11. In the present embodiment, the image data is obtained by associating the main body (B) of the image data with the additional information (H) as illustrated in FIG. As an example, the image data may be data in an Exif (Exchangeable image file format) format including a JPEG (Joint Picture Experts Group) format image data main body and a metadata portion, which is captured by a digital camera or the like. . Further, the additional information may be included in this metadata part. The image data is not limited to still images, and may be moving image data. Even in the case of moving image data, the format may include a data body and additional information. Here, the additional information includes information added by a device such as a camera, such as shooting date information, latitude / longitude altitude information indicating a shooting location (so-called geotag), and information indicating a direction the camera is facing. The additional information according to the present embodiment includes information such as a character string set by the user.

  Furthermore, the storage unit 12 holds a table (additional information setting table) in which additional information addition conditions regarding existing additional information are associated with additional information to be added when the conditions are satisfied. As an example, as shown in FIG. 3, this table corresponds to the condition (A) based on the existing additional information such as the relationship between the shooting date and time information and the legal holidays among the additional information included in the image data. This is associated with additional information (B) to be newly added.

  The operation receiving unit 13 receives an instruction operation from the user and outputs it to the control unit 11. The operation receiving unit 13 includes, for example, buttons and switches. The operation receiving unit 13 may include a remote control unit that accepts a user's operation and a receiver that receives the user's operation from the remote control unit wirelessly or by wire. As an example, the operation receiving unit 13 includes a unit that receives remote control using infrared rays.

  The display output unit 14 outputs screen information representing an image of a screen to be presented to the user to the outside in accordance with an instruction input from the control unit 11. For example, the display output unit 14 converts screen information instructed from the control unit 11 into a television signal and outputs the television signal to an external television.

  The image input unit 15 is, for example, an infrared receiver, a memory card reader, or the like, and accepts input of image data via these interfaces in accordance with instructions input from the control unit 11 and controls the received image data. To the unit 11. The time measuring unit 16 is configured to include a calendar IC and the like, and measures the date and time. The date and time measured by the timer unit 16 is set by an instruction from the control unit 11. The communication unit 17 is, for example, a network interface or the like, and outputs data to the outside in accordance with an instruction input from the control unit 11. The communication unit 17 outputs data received from the outside to the control unit 11.

  Next, processing by the control unit 11 will be described. The control unit 11 according to the present embodiment executes processing such as setting processing, image data capture processing, menu presentation processing, calendar display processing, album organization processing, and album display processing.

[Setting process]
In accordance with a user instruction, the control unit 11 displays the current date and time, the screen design, the display time for displaying image data continuously (slideshow interval), the screen ratio of the connected television, and the person who can be the subject. The setting of birthday information and the like is accepted, and these are set or held in the timer unit 16 and the storage unit 12.

  For example, when the user sets the current date and time, the control unit 11 overwrites the time and date of the time measuring unit 16 with the contents of the setting. Further, when a name of a person who can be a subject and birthday information are input, they may be associated with each other and stored in the storage unit 12 as a birthday database.

[Image data import processing]
In an example of the present embodiment, the operation receiving unit 13 includes a “capture” switch provided in the housing of the image information processing apparatus 1 of the present embodiment. When the user inserts a memory card into, for example, a memory card reader of the image input unit 15 and presses this “capture” switch, the control unit 11 accepts the operation and performs the following image data capture process.

  Functionally, the image data capturing process includes an image data acquiring unit 21, an additional information reading unit 22, an information developing unit 23, a new additional information setting unit 24, an accumulation process, as illustrated in FIG. Part 25.

  The image data acquisition unit 21 acquires image data via the image input unit 15 in response to pressing of the “capture” switch. As an example, when the image data is stored in a memory card inserted into a memory card reader as the image input unit 15, the image data acquisition unit 21 selects one piece of image data that has not yet been read from the memory card. Read and get.

  The additional information reading unit 22 extracts additional information from the image data acquired by the image data acquisition unit 21. As described above, when the image data is in the Exif format, the additional information reading unit 22 reads information included in the metadata unit.

  Based on the information read by the additional information reading unit 22, the information development unit 23 acquires a predetermined type of information through generation or communication via the communication unit 17. As an example, this information expansion part 23 transmits a geotag to the server set beforehand via the communication part 17, and receives and acquires the place name / facility name information corresponding to a geotag. Such servers include a location reference information server provided by the Ministry of Land, Infrastructure, Transport and Tourism in Japan and a Google map service provided by Google Inc. in the United States.

  Another example of the processing of the information development unit 23 is as follows. That is, when the birthday database is held in the storage unit 12, the information expansion unit 23 acquires information on the date and time counted by the time measuring unit 16. In addition, the information development unit 23 refers to the birthday database, calculates the difference between the birthday and the date / time information obtained from the clock unit 16 for each person whose birthday is set in the birthday database, and Calculate information (you only need to get the elapsed year from your birthday to the current date). Information on the calculated age is stored (information on the age of each person when the birthdays of a plurality of persons are recorded in the birthday database).

  The new additional information setting unit 24 satisfies the information read by the additional information reading unit 22 or the information obtained by the information developing unit 23 among the conditions included in the additional information setting table stored in the storage unit 12. Find the condition by searching. Then, the new additional information setting unit 24 takes out the additional information recorded in association with the condition found by the search and adds it to the image data. The conditions included in this additional information setting table are as follows, for example. In the following description, the target for setting additional information is image data.

Condition 1. “The shooting date is between April 1 and April 10, and the facility name information acquired in connection with Geotag is“ elementary school ”,“ junior high school ”,“ high school ”,“ high school ”, or“ university ”. Is included "
For example, a character string “entrance ceremony” is associated with the condition 1. When image data satisfying the condition 1 is acquired, the new additional information setting unit 24 sets additional information of a character string of “entrance ceremony” in the acquired image data.

  Note that the date information related to the condition does not necessarily include the date information. For example, the following conditions may be set.

Condition 2. “The information of the facility that was acquired between 11:30 and 1:30 and related to geotagging is“ Restaurant ””
For example, a character string “lunch” is associated with the condition 2. In the additional information setting table, the additional information associated with a certain condition is not limited to a fixed character string. For example, if the character string of the facility name acquired in relation to the geotag is “Iroha Tei”, it may be “Iroha Tei Lunch” concatenated with “Lunch”. In this case, when image data satisfying the condition 2 is acquired, the new additional information setting unit 24 obtains the character string of the facility name acquired in relation to the geotag and the fixed character string “lunch”. Is generated, and additional information of the generated character string is set in the acquired image data.

  Further, the conditions relating to the shooting date / time have been set up so far by specifying the start date / time and the end date / time. For example, the conditions may be set as follows.

Condition 3. “The date of the photo was taken on January 1 and the information about the facility acquired in connection with the geotag is“ Temple ”.
For example, the character string “Hatsumode” is associated with the condition 3 as a fixed character string. Alternatively, in this condition 3, a character string representing the year may be extracted from the shooting date and time, and a character string that is a combination of the character string representing the extracted year and the character string “Hatsumode” may be associated as additional information. In this case, when image data satisfying the condition 3 is acquired, the new additional information setting unit 24 combines a character string representing the year extracted from the shooting date and a fixed character string “Hatsumode”. A character string (for example, a character string such as “first year 11”) is generated, and additional information of the generated character string is set in the acquired image data.

  As described above, in the additional information setting table, a character string to be generated from the shooting date / time information of the image data to which additional information is to be added may be designated. As this example, there may be processing corresponding to the following condition 4, for example.

Condition 4. “Some birthdays d1, d2,... Included in the birthday database have a difference dc−di that is less than a predetermined threshold value dth with respect to the date and time dc measured by the time measuring unit 16.
Under this condition, the threshold value dth is, for example, 100 days. This condition is satisfied, for example, when the elapsed date and time from the birthday is 100 days or less. For this condition, for example, the elapsed days corresponding to the difference dc−di may be calculated, and a character string represented using the character string x of the calculated elapsed days may be used as additional information. In this case, a character string such as “day x after birth” is added to the image data satisfying the condition 4.

In addition, when the information development unit 23 is calculating information on the age of a person who can be a subject, instead of this condition 4,
Condition 4 '. “There is“ 0 ”(0 years old) in the calculated age information”
It is good also as the conditions.

Similarly,
Condition 5. “The shooting month is July or August, and the information of the facility acquired in connection with Geotag is“ Coast ””
The character string “sea bathing” may be associated as additional information to be set.

Furthermore, only information related to the geotag may be used as a condition. For example,
Condition 6. “Elevation information contained in the geotag exceeds a predetermined threshold”
The character string “in flight” may be associated as additional information to be set.

  Furthermore, in another example of the present embodiment, the condition in the additional information setting table may include a condition based on the relationship between the shooting date / time information and the date included in the special date database set in advance. This special day database is, for example, an entry in which the date (month name (any one of January to December) and date) and the special day name are associated and stored in the storage unit 12, for example. It includes an entry that associates a legal holiday (for example, a date determined by the holiday law in Japan) and its name.

Specifically, Condition 7 "The shooting date and time match one of the dates in the special day database"
In relation to this condition, a character string of a name included in an entry having a date matched in the special day database may be used as additional information to be set.

  Also, for example, it may be a condition that the difference in the number of days between the shooting date and the legal holiday date is within a predetermined threshold range, not the legal holiday date included in the special day database. . Furthermore, this threshold value may be set differently for each legal holiday. For example, among Japanese national holidays, Respect for the Aged Day is defined as the third Monday of September, but in consideration of the fact that the Respect for the Aged Day event includes the surrounding weekends, Regarding the date, additional information of the character string “Respect for the Aged” may be set in the image data for the three days from the Saturday two days before the Respect for the Aged to the Respect for the Aged.

  The new additional information setting unit 24 may add the information obtained by the information developing unit 23 as it is to the image data as it is, regardless of the contents of the additional information setting table. For example, the facility name information acquired in connection with the geotag may be added to the image data as additional information as it is.

  The storage processing unit 25 generates thumbnail image data obtained by reducing or enlarging the image data to a predetermined size for the image data to which the additional information is added by the new additional information setting unit 24. Further, the image data includes date and time information acquired from the time measuring unit 16 as additional information as information indicating the date and time of capture. Then, the image data and the thumbnail image data are associated with each other and stored in the storage unit 12. By this processing, as illustrated in FIG. 5, the image data to which a plurality of additional information (H) is added is stored in the storage unit 12 together with the thumbnail image data.

[Menu presentation process]
The control unit 11 also executes processing for displaying the image data accumulated in the storage unit 12. As an aspect of this display, in this embodiment,
"Recently captured",
"List by shooting date",
“List of additional information” (album display),
One of the above is selectively performed.

  For example, after the power is turned on, the control unit 11 presents the screen illustrated in FIG. This screen includes a menu (A, hereinafter referred to as a top menu), the capacity of an area in the storage unit 12 where image data can be stored, and the amount used (if the image data is stored in the hard disk drive, its total capacity And an image (B) representing a capacity or a free capacity in use.

  Here, options such as “Recently Imported”, “Album”, “Calendar”, and “Other Functions” are arranged in the top menu. Here, when the user performs an operation of selecting, for example, “recently captured”, the control unit 11 stores “recently captured” as list extraction condition information, and information indicating the current date and time from the timing unit 16. To get. Then, the control unit 11 determines that the difference between the acquisition date and time included in the additional information of the image data stored in the storage unit 12 and the acquired current date and time is less than a predetermined threshold (for example, 6 days). Image data) is extracted, and a list of thumbnail image data associated with the extracted image data is displayed (FIG. 7).

  When the user performs an operation of selecting “album” from the top menu, the control unit 11 generates a list of additional information included in the image data stored in the storage unit 12 (excluding duplication). At least a part of this list is presented as a list of albums. When the user selects any additional information from the presented list as an extraction condition, the control unit 11 stores the selected additional information as list extraction condition information, and is stored in the storage unit 12. Image data including the selected additional information is extracted from the existing image data. Then, the control unit 11 reads out thumbnail image data associated with the extracted image data from the storage unit 12 and displays a list thereof. That is, in the present embodiment, a list of additional information is provided as a list of extraction conditions. This list of extraction conditions is selected according to additional information that is not actually added to the image data (the extraction conditions are selected). (Extraction conditions in which image data is not accumulated) are controlled so as not to be included. In other words, even if there is information that can be added as additional information in advance, such as legal holidays, albums related to additional information for which there is no actual added image data are treated as having no such album. Thus, a natural interface is provided.

  As described above, in the present embodiment, additional information actually added or a part thereof is used as the name of “album”. Thus, for example, when it is desired to classify image data into a plurality of albums, the image data is not duplicated and recorded in the storage area (directory etc.) corresponding to each album, but added to a plurality of albums. Classification can be achieved by including information in the image data.

[Processing during display]
For example, the control unit 11 displays a cursor pointing to one of the thumbnail image data included in the list during the list display (FIG. 7C). The control unit 11 accepts a cursor movement operation or selection operation from the user, moves the cursor to another thumbnail image data according to the operation, or a thumbnail image pointed to by the cursor when the selection operation is accepted. Image data associated with the data is read from the storage unit 12, and the image data is displayed instead of the list of images.

  Also, when an operation to display the menu is performed during the list display, the control unit 11 performs, for example, “squeeze in”, “put into album”, “favorite edit”, “move to trash”, and the like. Displays a menu that contains the selected item. If a list is displayed from the selection of “album”, the control unit 11 may include a selection item unique to the album such as “edit album” in this menu.

  Here, when the control unit 11 receives a selection of “squeeze-in”, the control unit 11 requests the user to input a new search condition. Specifically, the control unit 11 generates a list (additional duplication) of additional information included in the image data stored in the storage unit 12, and at least a part of the list (for example, thumbnails currently displayed as a list). Select one that is included in the image data associated with the image data). When the user selects any additional information from the presented list, the control unit 11 includes the selected additional information in the related image data among the thumbnail image data currently displayed in the list. And a list of the extracted thumbnail image data is displayed again.

  Further, when “add to album” is selected from the menu displayed in the list, the control unit 11 generates a list of additional information included in the image data stored in the storage unit 12 (excluding duplication), and At least a part of this list (for example, excluding those corresponding to list extraction condition information) is presented. When the user selects any additional information from the presented list (referred to as an addition target), the control unit 11 selects at least one thumbnail image data from among the thumbnail image data currently displayed in the list. Ask the user to choose. For example, the user performs a cursor movement operation and a selection operation to select at least one thumbnail image data, and performs an operation indicating that the selection is completed. The control unit 11 adds additional information as an addition target to image data related to each of at least one thumbnail image data selected by the user's operation.

  Further, when “favorite edit” is selected from the menu being displayed in the list, the control unit 11 adds additional information (“favorite” to the related image data among the thumbnail image data currently displayed in the list) ( For example, an image indicating that “favorite” is set in thumbnail image data that includes information such as a control code that cannot be input by a normal operation by a user (for example, a star image) ) Are superimposed and displayed.

  When the user performs, for example, a cursor movement operation and a selection operation to select thumbnail image data included in the list, the control unit 11 selects “favorite” related to the selected thumbnail image data. Switch settings. That is, if the image data related to the selected thumbnail image data includes additional information indicating “favorite”, the control unit 11 deletes the additional information indicating “favorite”. In addition, if the image data related to the selected thumbnail image data does not include additional information indicating “favorite”, the control unit 11 adds additional information indicating “favorite”.

  Further, when the user selects “Edit Album” from the menu displayed in the list, the related image data among the thumbnail image data currently displayed in the list includes the same additional information as the list extraction condition information. An image (for example, a star image) indicating that it is included in the album is displayed superimposed on the thumbnail image data.

  When the user performs, for example, a cursor movement operation and a selection operation to select thumbnail image data included in the list, the control unit 11 displays the image data related to the selected thumbnail image data as an album. Switch whether or not to include. That is, if the image data related to the selected thumbnail image data includes the same additional information as the list extraction condition information, the control unit 11 deletes the same additional information as the list extraction condition information. In addition, if the image data relating to the selected thumbnail image data does not include the same additional information as the list extraction condition information, the control unit 11 adds the additional information stored as the list extraction condition information.

[Anniversary settings]
In addition, the control unit 11 may receive an instruction from the user to set an arbitrary date (date specified by month and day) as an “anniversary day”, and may execute an anniversary setting process. In this process, the control unit 11 accepts an input of a month name (any one from January to December) and a date from the user, and accepts an anniversary date. Here, the name of this anniversary is treated as additional information as it is.

  The control unit 11 associates the input date information with the additional information and includes the information in the special day database and stores it in the storage unit 12. By making the special day database updatable in this way, when the user who owns the image information processing apparatus 1 of the present embodiment sets an anniversary date unique to the user, for example, a wedding anniversary date, the control unit 11, when image data whose photographing date matches the date set as the wedding anniversary is captured, additional information “Marriage anniversary” is added to the captured image data.

  In addition, an album named “Marriage Anniversary” can be selected, and in the list display of the album, image data taken on the date set as “Marriage Anniversary” is displayed. .

  As already mentioned, events related to anniversaries and public holidays are not necessarily performed on the day of the anniversary or national holidays. Therefore, in the present embodiment, a predetermined range may be set before and after the set anniversary. This applicable range may be, for example, a predetermined number of days (for example, a period from 3 days before the set day to 2 days after the set day) or by using “day of the week information” to “next Sunday to next Sunday It is good also as "between." Further, specifically, the corresponding range may be set as the period from the start date to the end date. In these cases, the special day database associates information representing the corresponding range with additional information.

  Here, the information indicating the corresponding range may be different for each entry. As an example, the information indicating the applicable range represents, for example, the first day of January 1st, the applicable range is only the current day, “January 1” indicating the current day, and the number of days before the current day. It includes information (referred to as “0” day) and information (referred to as “0” day) indicating how many days after that date are included in the applicable range. In addition, in view of the fact that the ceremony is often held on Saturdays before and after the adult day, the “second Monday of January” representing the day and the “between the previous Saturday and the next Sunday” Information including the information to be expressed is set as information indicating the corresponding range.

[Additional information]
Furthermore, the control unit 11 of the image information processing apparatus 1 according to the present embodiment may set a new entry in the additional information setting table in accordance with a user instruction. In this case, the user inputs conditions for setting additional information and additional information to be set. As an example, the user inputs the condition that the shooting month is November and the facility information acquired in connection with the geotag includes “Shrine”, and the character string “Shichigosan” as additional information. To do. The control unit 11 associates them and stores them in the additional information setting table.

  In this way, when the shooting date is in November and the image data including “shrine” is acquired in the facility information acquired in relation to the geotag which is the shooting location, the control unit 11 acquires the image data. Additional information such as “Shichigosan” is added to the image data.

  In addition, this makes it possible to select an album named “Shichigosan”, and in the list display of the album, the shooting date is November as image data included in the album of “Shichigosan”, and the geotag that is the shooting location is displayed. A list of thumbnail image data related to the image data including “shrine” in the facility information acquired in connection with is displayed.

[Reassignment processing when additional information is added]
Further, when a new additional information setting table entry or anniversary is newly added, the control unit 11 again adds additional information to the image data already stored in the storage unit 12. May be executed. This process is substantially the same as the image data capturing process illustrated in FIG. 4, and the control unit 11 that executes this process functionally includes an image reading unit 21 ′ and additional information as illustrated in FIG. The reading unit 22, the information development unit 23, the new additional information setting unit 24, and the additional information adjustment unit 26 are configured. In addition, what performs the same operation | movement as the structure illustrated in FIG. 4 attaches | subjects the same code | symbol, and abbreviate | omits description.

  The image reading unit 21 ′ sequentially reads and acquires the image data stored in the storage unit 12 one by one. Further, the additional information adjustment unit 26 checks whether or not the image data to which the new additional information setting unit 24 has added the new additional information includes a plurality of the same additional information, and the same additional information is redundantly included. Is deleted, leaving only one additional information. This prevents additional information from being added redundantly.

[Operation]
The image information processing apparatus 1 according to the present embodiment has such a configuration, and operates as in the following example. Here, a case where image data taken by a user with a camera with a GPS function (a camera that adds a geotag to image data) is managed by the image information processing apparatus 1 will be described as an example. In the following description, as illustrated in FIG. 9, in the storage unit 12 of the image information processing apparatus 1, as a special day database, for the day of adult, “January 2nd Monday” representing the current day and its “immediately before” It is assumed that an entry in which information indicating a corresponding range including information indicating “from Saturday to next Sunday” is associated with a character string “adult day” as additional information is recorded.

  And in the example here, in the year when January 15 is the day of adulthood according to Japanese laws and regulations, the adult ceremony that is customary in Japan was held on January 14th, the day before that. Then, it is assumed that a user who has taken a photograph in the adult ceremony causes the image information processing apparatus 1 to read image data of the photograph.

  When the user takes out the memory card that records the image data from the camera that captured the image data, inserts it into the image input unit 15 of the image information processing apparatus 1 and presses the “capture” switch, the image information processing apparatus 1 Of the image data stored in the memory card, image data that has not yet been read out is sequentially selected and read out.

  Whether or not the image data has not yet been read out is determined as follows, for example. The image information processing apparatus 1 according to the present embodiment calculates a unique hash value for each piece of image data stored in the storage unit 12 by a predetermined method. This hash value may be a widely known value such as MD5. The image information processing apparatus 1 holds a list of the calculated hash values in the storage unit 12.

  Therefore, the image information processing apparatus 1 extracts image data in which the hash value calculated by the predetermined method is not included in the list of the storage unit 12 from the image data stored in the memory card. As a result, image data that has not yet been read out is extracted. As illustrated in FIG. 10, the image information processing apparatus 1 selects one of the extracted image data (S1).

  The image information processing apparatus 1 reads out the selected image data, reads out the additional information from the image data as the processing target, using the read out image data as a processing target (S2). Then, the image information processing apparatus 1 generates a predetermined type of information based on the read additional information (S3). Further, in this process S3, a predetermined type of information may be acquired based on the read additional information by communication via the communication unit 17.

  Specifically, the geotag of the additional information read from the image data to be processed is transmitted to a preset server via the communication unit 17, and the place name / facility name information corresponding to the geotag is received. Get it. In this example, since it is image data of a photograph at the entrance ceremony of a child, the character string “elementary school” is included in the place name / facility name information obtained based on the geotag.

  The image information processing apparatus 1 starts a loop until there is no unselected condition among the conditions included in the additional information setting table stored in the storage unit 12 (S4), and selects one unselected condition. In step S5, it is determined whether the additional information read in step S2 or the information obtained in step S3 satisfies the condition selected in step S5 (S6).

  Here, in the additional information setting table, as the condition (hereinafter referred to as condition a), “the shooting date is between April 1 and April 10, and the facility name information acquired in connection with the geotag is“ elementary school ”. ”,“ Junior high school ”,“ high school ”,“ high school ”, or“ university ”” is included, the image data in this example is January Since it is 14 days, it is determined that this condition a is not satisfied.

  In addition, it is assumed that the additional information setting table includes a condition “the shooting date is included in the corresponding range of entries included in the special date database” as a condition (hereinafter referred to as condition b). In this example, since January 14th, which is the shooting date, is the Sunday immediately before January 15th, which is the current day, it falls within the corresponding range for the adult day specified by the information contained in the special day database. Since there is a shooting date, the condition b is satisfied.

  When the image information processing apparatus 1 determines that the condition is satisfied in this process S6 (Yes), the image information processing apparatus 1 extracts the additional information held in the additional information setting table in association with the condition, and performs processing. It is added to the image data (S7).

  Here, the condition that “the shooting date is included in the corresponding range of the entry included in the special date database” is associated with the fact that “additional information associated with the corresponding range” is the additional information. Then, a character string of “adult day”, which is additional information included in the entry relating to the adult day, is extracted and added to the image data in the example here.

  If there is an unselected condition, the image information processing apparatus 1 repeats the loop from the process S4 (S8). Further, when the image information processing apparatus 1 exits the loop from the processing S4 to S8, it generates thumbnail image data based on the processing target image data, and associates the generated thumbnail image data with the processing target image data. The data is stored in the storage unit 12 (S9). Then, it is determined whether or not image data that has not been read is still in the memory card (S10). If it is still (Yes), the process returns to the process S1 to continue the process. If there is no unread image data (if No) in process S10, the process is terminated.

  If the image information processing apparatus 1 determines that the condition is not satisfied in the process S6 (No), the process proceeds to the process S8 as it is and continues the process.

  Upon completion of this process, the image information processing apparatus 1 executes a top menu display process, and displays a menu for selecting a display mode, such as “Recently captured” and album display. Here, when the user performs an operation of selecting display in “album”, the image information processing apparatus 1 displays a list of additional information included in the image data stored in the storage unit 12 (excluding duplication). Then, at least a part of the list, for example, additional information excluding information of a predetermined type such as shooting date and geotag itself among the additional information is presented as a list of albums.

  In this example, some of the stored image data has the additional information “Adult Day” added thereto as described above. Therefore, this list includes the character string “Adult Day”.

  When the user selects “Adult Day” from the presented list, the image information processing apparatus 1 stores the selected additional information as list extraction condition information and stores the image stored in the storage unit 12. Image data including additional information of the selected “Adult Day” is extracted from the data, thumbnail image data associated with the extracted image data is read from the storage unit 12, and a list thereof is displayed.

  Then, the image information processing apparatus 1 displays a cursor pointing to one of the thumbnail image data included in the list during the list display, accepts a cursor movement operation or a selection operation from the user, and performs a selection operation. When the image data is received, the image data associated with the thumbnail image data pointed to by the cursor is read from the storage unit 12, and the image data is displayed instead of the list of images.

[Modification]
The conditions that can be set in the additional information setting table are not limited to those described so far. This condition may include, for example, a condition relating to a character string obtained by OCR from image data. For example, as a result of performing the OCR process on the image data, a condition that “a character string“ Festival ”is included” may be set. For example, additional information “festival” is associated with this condition.

  In addition, information on the age of a person who can be a subject obtained from a birthday database set by the user may be used. For example, a person in the range from “5” to “7” on the shooting date is set in the birthday database, and there is a shooting date between April 1 and April 15, and geotagging The condition that “elementary school” is included in the information of the facility name acquired based on the above may be set.

  Furthermore, the name of the event may be obtained from the geotag and the shooting date information. As an example, based on the geotag, “Near Tama River” is obtained as location and facility name information, and the shooting date and the obtained facility name information are transmitted to a search engine on the Internet via the communication unit 17, When an event name template (for example, a character string such as “Festival”, “Fireworks”, “Meeting”, “Flea Market”, etc.) is found, a character string that matches the event name template Alternatively, it may be acquired as additional information.

  Alternatively, a server for storing the event name in association with the geotag and the shooting date information is prepared, and the image information processing apparatus 1 accesses the server to acquire the event name, and acquires the event name. The event information may be used as additional information.

  DESCRIPTION OF SYMBOLS 1 Image information processing apparatus, 11 Control part, 12 Memory | storage part, 13 Operation receiving part, 14 Display output part, 15 Image input part, 16 Time measuring part, 17 Communication part, 21 Image data acquisition part, 21 'Image reading part, 22 Additional information reading unit, 23 information development unit, 24 new additional information setting unit, 25 storage processing unit, 26 additional information adjustment unit.

Claims (5)

Means for receiving image data including additional information added by the camera in the metadata portion;
A time measuring means for measuring the date and time;
Means for extracting the additional information from a metadata portion included in the image data;
Means for adding a plurality of additional information including the extracted additional information and additional information representing information of the capture date and time counted by the timing means to the received image data;
Means for generating thumbnail image data obtained by reducing or enlarging the received image data to which a plurality of additional information is added to a predetermined size;
Means for storing the received image data to which a plurality of additional information is added and thumbnail image data in association with each other;
Image data that is at least one extraction condition and that includes a difference between the information of the capture date and time included in the related additional information and the current date and time acquired from the time measuring means is less than a predetermined threshold value Means for presenting a list of thumbnail image data stored in association with each other,
Predetermined processing related to image data associated with thumbnail image data selected from the presented list, and additional information excluding information of a predetermined type among a plurality of additional information added to the image data Processing to extract and display additional information that is the name of the selected album or image data to which a part of the selected album is added when a part is used as the name of the album and display on the album is selected the execution,
When classifying the image data into a plurality of albums, additional information regarding each of the plurality of albums is stored in the storage area corresponding to each album without duplicating and recording the image data. Information processing apparatus to be added . The image information processing apparatus according to claim 1,
The image information processing apparatus, wherein the additional information added to the image data used as the name of the album or a part thereof is additional information excluding the shooting date. The image information processing apparatus according to claim 1 or 2,
The image information processing apparatus, wherein the predetermined process is a process of displaying image data associated with thumbnail image data selected from the presented list instead of an image in a thumbnail list. An image information processing apparatus according to any one of claims 1 to 3,
The predetermined process is a process of adding additional information indicating “favorite” if the image data related to the selected thumbnail image data does not include additional information indicating “favorite”. An image information processing apparatus. Computer
Means for receiving image data including additional information added by the camera in the metadata portion;
A time measuring means for measuring the date and time;
Means for retrieving from a metadata portion included in the image data;
Means for adding a plurality of additional information including the extracted additional information and additional information representing information of the capture date and time counted by the timing means to the received image data;
Means for generating thumbnail image data obtained by reducing or enlarging the received image data to which a plurality of additional information is added to a predetermined size;
Means for storing the received image data to which a plurality of additional information is added and thumbnail image data in association with each other;
Image data that is at least one extraction condition and that includes a difference between the information of the capture date and time included in the related additional information and the current date and time acquired from the time measuring means is less than a predetermined threshold value Function as a means for presenting a list of thumbnail image data associated and accumulated,
Additional information excluding information of a predetermined type from the additional information added to the image data by causing the computer to perform predetermined processing related to the image data associated with the thumbnail image data selected from the presented list Alternatively, when a part of the album is used as an album name and display on the album is selected, additional information that is the name of the selected album or image data with a part of the extracted information is extracted and displayed. Let the process run,
When classifying the image data into a plurality of albums, additional information regarding each of the plurality of albums is stored in the storage area corresponding to each album without duplicating and recording the image data. Program to add to .

Images