JP2012014235A - Scheduling support program and scheduling support apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a scheduling support program and scheduling support apparatus in which convenience in adding schedule information is improved.SOLUTION: A scheduling support program 14a is executed in a PC 10, thereby adding first-class schedule information prepared based on schedule information of a reference person as schedule information of a target person. Furthermore, even in the case where the first-class schedule information can not be prepared based on an image, second-class schedule information is prepared based on the image and added as the schedule information of the target person. Therefore, convenience in adding the schedule information of the target person can be improved. Moreover, even if the target person neglects writing of the schedule information, a schedule list 13b can be acquired on which the schedule information is complemented automatically based on the image.

Description

  The present invention relates to a schedule creation support program and a schedule creation support apparatus.

  The information processing apparatus described in Patent Document 1 stores image information captured by a camera module in a memory, detects the presence or absence of schedule information corresponding to the shooting date / time of the image information from the scheduler, and corresponds to the shooting date / time. If there is schedule information to be performed, the message stored in the message storage area of the schedule information is extracted as a keyword and stored in the memory. When a keyword input or addition process for image information is designated, a keyword corresponding to the image information is read from the memory and automatically added to the image information.

  When a keyword is input or added to the image information, the input keyword is registered in the scheduler as schedule information corresponding to the shooting date and time of the image information.

JP 2001-43240 A

  However, in the conventional technique, for example, when the user wants to newly add schedule information corresponding to the shooting date and time of the image information, the user must input a keyword for the image information. When it is necessary to add a lot of schedule information, the keyword input operation is troublesome for the user.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a schedule creation support program and a schedule creation support apparatus that improve convenience when adding schedule information.

  In order to achieve this object, a schedule creation support program of the present invention is a program that supports creation of schedule information in which the contents of a schedule and the execution time of the schedule are associated with each other, and stores schedule information of a target person A computer communicable with the storage unit is a generation date acquisition means for acquiring an image generation date, a person recognition means for recognizing a person included in the image as a subject, and a person recognized by the person recognition means. The generation date and time of the image acquired by the generation date and time acquisition means among the reference means for referring to the schedule information of the reference person other than the target person and the schedule information of the reference person referred to by the reference means. Selecting means for selecting schedule information of the implementation time to be included, and selected by the selecting means First type creation means for creating first type schedule information based on the schedule information of the reference person, and the first type schedule information created by the first type creation means, the schedule information of the target person. Function as an additional means to be added.

  The present invention includes a schedule creation support device, a control device that controls the schedule creation support device, a schedule creation support method, a recording medium that records a schedule creation support program, a schedule creation support device, and a storage device that stores schedule information. It can be configured in various modes such as a schedule creation support system that includes it.

  According to the schedule creation support program according to claim 1, the first type schedule created by the first type creation unit based on the schedule information of a person who is included as an object in the image and is a reference person other than the target person. Information is added by the adding means as schedule information of the target person. Therefore, there is an effect that convenience when adding schedule information of the target person can be improved.

  According to the schedule creation support program according to claim 2, in addition to the effect produced by the schedule creation support program according to claim 1, based on the implementation time of the schedule information of the selected reference person, Since the execution time is set, the first type schedule information of the appropriate execution time can be created and added as the schedule information of the target person, and there is an effect that the convenience is high.

  According to the schedule creation support program according to claim 3, in addition to the effect produced by the schedule creation support program according to claim 1 or 2, the first creation is based on at least one image among a plurality of images associated with each other. Since the type 1 schedule information is created, appropriate type 1 schedule information can be created, and the convenience is high.

  According to the schedule creation support program according to claim 4, in addition to the effect produced by the schedule information creation support program according to claim 3, a plurality of schedule information selected based on a plurality of images associated with each other are merged. Since the first type schedule information is created, appropriate first type schedule information created based on a plurality of images can be added as the schedule information of the target person, and the convenience is high.

  According to the schedule creation support program according to claim 5, in addition to the effect produced by the schedule information creation support program according to any one of claims 1 to 4, a plurality of images in which the generation date and time of the image continues within a predetermined time. A plurality of images are classified so as to be classified into the same group, second type schedule information is created for each group, and is added as schedule information of the target person. Therefore, there is an effect that convenience when adding schedule information of the target person can be improved.

  According to the schedule creation support program described in claim 6, in addition to the effect produced by the schedule creation support program according to claim 5, the implementation time including the generation date and time of each image included in the group is set for each group. Since the set execution time and the attached information of the image are associated with each group, the second type schedule information with an appropriate execution time can be created and added as the schedule information of the target person, which is highly convenient. Play.

  According to the schedule creation support program according to claim 7, in addition to the effect produced by the schedule creation support program according to claim 5 or 6, the image determined not to be included in the implementation time of the schedule information of the reference person. Since the second type schedule information is created based on this, even if the first type schedule information cannot be created, the second type schedule information can be created based on the image.

  According to the schedule creation support program according to claim 8, in addition to the effect produced by the schedule creation support program according to any one of claims 1 to 7, personal information indicating a person recognized as a subject of the image includes Since it is added to the schedule information of the implementation time including the image generation date and time, more complete schedule information can be created, and the convenience is high.

  According to the schedule creation support apparatus of the ninth aspect, the same effect as that of the computer that executes the schedule creation support program according to the first aspect is obtained.

It is a block diagram which shows the electric constitution of PC which mounts the schedule creation assistance program which is embodiment of this invention, and the communication system containing the said PC. (A) is a figure which shows typically the information memorize | stored in image DB, (b) is a figure which shows typically the information memorize | stored in a schedule list. It is a flowchart which shows the blank schedule automatic registration process which PC of 1st Embodiment performs. It is a flowchart which shows the 1st type schedule information creation process which PC of 1st Embodiment performs. It is a flowchart which shows the 2nd type schedule information creation process which PC of 1st Embodiment performs. It is a flowchart which shows the blank schedule automatic registration process which PC of 2nd Embodiment performs. It is a flowchart which shows the 1st type schedule information creation process which PC of 2nd Embodiment performs. It is a figure which shows typically the information memorize | stored in a detection schedule map. It is a flowchart which shows the additional information creation process which PC of 2nd Embodiment performs.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a block diagram showing an electrical schematic configuration of a communication system 1 including a personal computer 10 (hereinafter referred to as a PC 10) equipped with a schedule creation support program 14a according to the first embodiment of the present invention and a server 40. It is. The PC 10 according to the present embodiment has a function of supporting the creation of schedule information by enhancing convenience when adding schedule information.

  The PC 10 mainly includes a CPU 11, a ROM 12, a RAM 13, a hard disk drive 14 (hereinafter referred to as HDD 14), an input device 15, a display device 17, and an Internet interface 19, which are connected to each other via a bus line 20. Yes. The CPU 11 controls each unit connected by the bus line 20 according to fixed values and programs stored in the ROM 12 and the HDD 14. The ROM 12 is a memory in which a program for controlling the operation of the PC 10 is stored, and the RAM 13 is a readable / writable memory for temporarily storing data necessary for the processing of the CPU 11.

  The RAM 13 is provided with an image database 13a (hereinafter referred to as an image DB 13a) and a schedule list 13b. The image DB 13a is a database that stores information related to images selected by the user. The image DB 13a will be described later with reference to FIG. The schedule list 13b is a list for storing schedule information of the target person. The schedule list 13b will be described later with reference to FIG.

  The HDD 14 is a hard disk drive, and stores a schedule creation support program 14a. The CPU 11 executes a blank schedule automatic registration process, which will be described later with reference to FIG. 3, by executing the schedule creation support program 14a. The input device 15 is used to input instructions and information to the PC 10 and is configured with a mouse and a keyboard. The display device 17 displays various information such as a web page. The internet interface 19 connects the PC 10 to the internet line 2. The PC 10 acquires schedule information from the server 40 via the Internet line 2.

  The server 40 includes a schedule database 42 (hereinafter referred to as a schedule DB 42) that stores schedule information, and provides a service to the PC 10 that is a client through the Internet line 2. The schedule information will be described later with reference to FIG. The schedule DB 42 stores schedule information for a plurality of people. The user of the PC 10 can request schedule information from the PC 10 to the server 40, browse his own schedule information or other person's schedule information, or add a new one.

  FIG. 2A is a diagram schematically showing information stored in the image DB 13a. The image DB 13a is a database that stores image information used for automatically creating schedule information of a target person in a blank schedule automatic registration process (FIG. 3) described later. The PC 10 creates the image DB 13a based on the image file of the image selected by the user. In the present embodiment, the attached information of the image means information that can be acquired based on the image, and is included in the image as a subject in addition to meta information stored in the image file in advance. If the person can be recognized, information such as a name specifying the person can also be an example of information attached to the image.

  As shown in FIG. 2A, the image DB 13a is provided with an image ID item 50, a time stamp item 52 (hereinafter referred to as a TS item 52), a file path item 54, an attached information item 56, and a schedule link 58. Yes.

  The image ID item 50 is an item for storing an image ID assigned to each image in order to manage the image. The TS item 52 is an item for storing a time stamp (hereinafter referred to as TS) indicating an image generation date and time. The time stamp is stored in advance in, for example, a header of the image file. The file path item 54 is an item for storing a path indicating the location of the image file. The accessory information item 56 stores image accessory information. In the first embodiment, GPS information specifying the longitude and latitude of the image generation location and the file name of the image file are stored in the auxiliary information item 56 as the auxiliary information. The schedule link 58 is an item for storing a schedule ID of schedule information associated with an image. The schedule ID will be described with reference to FIG. Note that the image DB 13a may hold image information for more items.

  FIG. 2B is a diagram schematically showing information stored in the schedule list 13b. The PC 10 communicates with the server 40 to acquire the schedule information of the target person from the server 40 and stores it in the schedule list 13b. As shown in FIG. 2B, the schedule list 13b is provided with a schedule ID item 60, a title item 62, a start date / time item 64, an end date / time item 66, a participant item 68, and a holding place item 70.

  The schedule ID item 60 is an item for storing a schedule ID that is individually assigned to each schedule information in order to manage the schedule information. The title item 62 stores title information indicating the title of the schedule, such as a message or event name. The start date / time item 64 is an item for storing the start date / time of a message or event. The end date / time item 66 is an item for storing the end date / time of a message or event. The participant item 68 is an item for storing participant information indicating a participant such as a business or event. The holding place item 70 is an item for storing place information indicating a place where a business or event is executed.

  In the present embodiment, “execution time” means the time from the start date / time stored in the start date / time item 64 of a certain schedule information to the end date / time stored in the end date / time item 66. The “schedule content” is information indicating or suggesting the content of a person's action or activity. For example, each piece of information stored in the title item 62, the participant item 68, and the holding place item 70 includes Each corresponds to the contents of the schedule. The “schedule information” is a piece of information managed by one schedule ID, and includes information including title information, start date / time, end date / time, participant information, and location information. However, even if any of these pieces of information is missing, it corresponds to “schedule information” if information is stored in at least one item for the schedule ID.

  In the schedule DB 42 of the server 40, schedule information registered by the target person himself / herself is stored in advance. However, there may be a case where schedule information is not registered due to negligence or forgetfulness of the target person in spite of actually participating activities.

  The PC 10 of this embodiment automatically creates unregistered schedule information of the target person based on the image by executing the blank schedule automatic registration process (FIG. 3) based on the schedule creation support program 14a. ,to add.

  FIG. 3 is a flowchart showing blank schedule automatic registration processing according to the first embodiment executed by the CPU 11 of the PC 10. This process is a process for automatically creating and adding schedule information of the target person based on the image selected by the user. It is assumed that, before the start of this process, the user has selected a target person to which schedule information is to be added and has selected an image taken in an activity in which the target person has participated. For example, when the user himself is the target person, an image taken by the user himself or an image possessed by the user himself is selected. Furthermore, before starting this process, the CPU 11 acquires the schedule information of the target person selected by the user from the schedule DB 42 of the server 40 and stores it in the schedule list 13b in advance.

  First, in step S302 (hereinafter, step is omitted), the CPU 11 sets the image selected by the user as a search target image (S302). Next, the CPU 11 reads the attached information from the image file of the image selected by the user, and creates the image DB 13a (S304). Specifically, TS, GPS information, etc. are acquired from the image file of each image set as the search target image, and the image ID and file path of the image file are assigned and stored in the image DB 13a. When a plurality of images are set as search target images, information is stored in the image DB 13a for each of the plurality of images. Next, the CPU 11 executes a first type schedule information creation process (S308).

  FIG. 4 is a flowchart showing the first type schedule information creation processing (S308) of the first embodiment executed by the CPU 11 of the PC 10. In the first type schedule information creation process (S308), the first type schedule information is created by using the schedule information of the person included as the subject in the image, and the first type schedule information is used as the schedule of the target person. It is a process to add as information.

  First, the CPU 11 sets an image having no value in the schedule link as a processing target image (S402). Next, the CPU 11 acquires the TS of the processing target image from the image DB 13a (S403), and schedule information of the implementation time including the TS of the processing target image is already stored in the schedule list 13b as the schedule information of the target person. It is determined whether or not there is (S404).

  When the schedule information of the target person includes schedule information of the implementation time including the TS of the processing target image (S404: Yes), the CPU 11 processes the schedule ID of the schedule information of the execution time including the TS of the processing target image. In association with the target image, the schedule link 58 of the image DB 13a is set (S412). Thereby, schedule information is associated with the image. Next, the CPU 11 determines whether or not the processing has been completed for all the search target images (S416). If the determination in S416 is negative (S416: No), the CPU 11 returns to S402 and performs the next processing. Set the target image and repeat the process.

  On the other hand, if the schedule information of the target person does not include schedule information of the implementation time including the TS of the processing target image (S404: No), the CPU 11 uses the known face recognition tool as the subject in the processing target image. A person included (hereinafter referred to as a character in the image) is recognized (S406). As described above, before the start of the blank schedule automatic registration process (FIG. 3), an image taken in the activity in which the target person participates is selected as the search target image. In the search target image, a person who participated in the same activity as the target person may be photographed as a subject. In the first type schedule information creation process, first type schedule information is created by using schedule information of a person who has participated in the same activity as the target person.

  Specifically, the CPU 11 acquires and refers to schedule information of a person other than the target person (hereinafter referred to as a reference person) among the characters in the image (S407). The configuration of the reference person's schedule information is information including a schedule ID, title information, start date / time, end date / time, participant information, and location information, similar to the schedule information described with reference to FIG. However, illustration and detailed description are omitted. The schedule information of the reference person may be acquired from the schedule DB 42 of the server 40 and referred to, or when the schedule information of the reference person is stored in another database that can communicate via the network. It may be obtained from another database and referenced.

  Next, the CPU 11 determines whether there is schedule information of the implementation time including the TS of the processing target image among the schedule information of the reference person (S408). If there is schedule information of the implementation time including the TS of the processing target image among the schedule information of the reference person (S408: Yes), the CPU 11 indicates the execution time of the reference person including the TS of the image. The schedule information is selected, a copy of the selected schedule information is created as the first type schedule information, and the created first type schedule information is added to the schedule list 13b as the schedule information of the target person (S410). Since the schedule information (first type schedule information) of the target person created in this way is a copy of the schedule information of the reference person, the implementation time of the schedule information of the reference person remains unchanged as the schedule information of the target person. Set as time.

  Then, the CPU 11 associates the schedule ID of the schedule information newly added as the schedule information of the target person with the processing target image, and sets the schedule link 58 of the image DB 13a (S412). Next, the CPU 11 determines whether or not the processing has been completed for all the search target images (S416). If the determination in S416 is negative (S416: No), the CPU 11 returns to S402 and performs the next processing. Set the target image and repeat the process.

  The first type schedule information is created based on the TS of a certain image, and the created first type schedule information is stored in the schedule list 13b as the schedule information of the target person. Is included in the schedule information 58 of the newly created target person, the schedule link 58 of the image is set with the schedule ID of the schedule information of the newly created target person. Is done.

  Therefore, when TS of a plurality of images is included in the execution time of the schedule information of the reference person of one image, the plurality of images can be associated with each other by the same schedule ID. Then, one type 1 schedule information is created from a plurality of images associated with the same schedule ID and added to the schedule list 13b. Therefore, it can suppress that the schedule information of the same implementation time is produced redundantly.

  On the other hand, when the determination in S408 is negative (S408: No), for example, when there is no schedule information of the implementation time including the TS of the processing target image in the schedule information of the reference person, or the schedule information of the reference person Is protected in the schedule DB 42 and cannot be referred to, or when a person other than the target person is not included in the processing target image, the CPU 11 associates the processing target image with “N / A” in the schedule link 58 of the image DB 13a. "Is set (S414). Next, the CPU 11 determines whether or not the processing has been completed for all the search target images (S416). If the determination in S416 is negative (S416: No), the CPU 11 returns to S402 and performs the next processing. Set the target image and repeat the process.

  Then, when the processing is completed for all the search target images and values are set for the schedule links 58 of all the images while the processing is repeated, the determination in S416 is affirmed (S416: Yes). Next, the CPU 11 collates whether or not the schedule information of the implementation time including the TS is stored in the schedule list 13b for each image whose schedule link 58 is “N / A” (S418).

  That is, for a certain image, when the schedule information of the target person including the TS is not detected (S404: No) and the schedule information of the reference person including the TS is not detected (S408: No), the image “N / A” is set in the schedule link 58 (S414). However, after that, when the schedule information of the target person is newly added to the schedule list 13b based on another image, even if the image has already been set with “N / A” in the schedule link 58, There is a possibility that schedule information of the implementation time including the TS of the image is newly added.

  Therefore, for each image whose schedule link 58 is “N / A”, whether or not the schedule information of the implementation time including the TS is stored in the schedule list 13b (S418) is stored. In step S420, the schedule ID of the corresponding schedule information is set in the image schedule link 58 (S420), and the process ends.

  In this way, even when TS of a plurality of images is included in the execution time of the schedule information of the reference person selected based on one image, the plurality of images are identified by the same schedule ID. They can be associated with each other, and it is possible to suppress the creation of duplicate schedule information at the same implementation time.

  According to the first type schedule information creation process (S308), appropriate first type schedule information can be created based on the schedule information of the characters in the image (that is, the reference person) included as the subject in the image.

  Returning to FIG. Next, the CPU 11 determines whether or not there is an image whose schedule link 58 is “N / A” (S314). As described above, “N / A” is set in the schedule link 58 of the image for which the schedule information of the implementation time including the TS of the image could not be detected. If the determination in S314 is affirmative (S314: Yes), that is, if there is an image that is not associated with any schedule information, the CPU 11 executes a second type schedule information creation process (S316).

  FIG. 5 is a flowchart showing the second type schedule information creation process (S316) of the first embodiment executed by the CPU 11 of the PC 10. In this process, in the first type schedule information creation process (S308), the image that is not associated with any schedule information, that is, the TS of the image is not included in the execution time of the schedule information of the target person, and the reference person The second type schedule information is created based on an image that is determined not to be included in the schedule information implementation time, and is added to the schedule list 13b as the schedule information of the target person.

  First, the CPU 11 extracts an image whose schedule link 58 is “N / A” from the search target images (S502). Next, the CPU 11 sorts the extracted images in the order of TS of each image (S504). Next, the CPU 11 acquires information necessary for creating schedule information from the attached information of the extracted image (S506). Here, in the first embodiment, a file name and GPS information are acquired as attached information necessary for creating schedule information.

  Next, the CPU 11 classifies the extracted images sorted in the order of TS into a continuous image group. Specifically, the CPU 11 classifies the extracted images so that the extracted images in which the TS of the image continues within a predetermined time (for example, 30 minutes) are classified into the same continuous image group (S508). That is, when TS of a plurality of images is continuous within a predetermined time, there is a high possibility that the plurality of images are taken in the same action or activity. Therefore, in this embodiment, the extracted images are classified into continuous image groups, and one schedule information is created for each continuous image group.

  Next, the CPU 11 sets an execution time for each continuous image group so that the generation date and time of all the images included in the group can be included (S510). Specifically, the CPU 11 sets the TS indicating the earliest date among the TSs of the images included in the continuous image group as the start date and time of the continuous image group, and sets the TS indicating the latest date and time as the continuous image group. Set as the end date of.

  Next, the CPU 11 creates second type schedule information in which the execution time set in the process of S510 and the image accessory information are associated with each continuous image group (S512). For example, the largest file name is selected as the title information of the second type schedule information among the file names of a plurality of images classified into a certain continuous image group. In addition, a facility name or address that can be specified by GPS information of a plurality of images classified into a certain continuous image group is selected as location information of the second type schedule information. Further, the start date and time and end date and time of the continuous image group set in the processing of S510 are set as the start date and time and end date and time of the second type schedule information.

  Next, the CPU 11 adds the newly created second type schedule information as schedule information of the target person to the schedule list 13b (S514). Next, the CPU 11 sets the schedule ID of the newly added schedule information in the schedule link 58 of the extracted image (S516), and ends the process.

  According to the second type schedule information creation process (S316), schedule information of the implementation period that was not created in the first type schedule information creation process can be created and added to the schedule list 13b as the schedule information of the target person.

  Returning to FIG. The CPU 11 displays and outputs the latest schedule list 13b on the display device 17 after executing the second type schedule information creation process (S316) or when the determination in S314 is negative (S314: No) (S318). The process is terminated.

  According to the blank schedule automatic registration process of the first embodiment, the first type schedule information created based on the schedule information of the reference person can be added as the schedule information of the target person. Therefore, even if the target person neglects to write the schedule information, the schedule list 13b in which the schedule information is automatically supplemented can be acquired, which is highly convenient. Further, according to the blank schedule automatic registration process of the first embodiment, even if it is schedule information of the implementation period that was not created in the first type schedule information creation process (S308), the second type schedule information creation process (S316). ) And can be added to the schedule list 13b. Therefore, the schedule information of the target person can be added for a longer period, which is highly convenient.

  The second embodiment will be described with reference to FIGS. Note that the electrical configuration of the PC 10 of the second embodiment is the same as the electrical configuration of the PC 10 described with reference to FIG. Of the configurations or steps described in the second embodiment, the same configurations or steps as those in the first embodiment are denoted by the same reference numerals and description thereof is omitted. In addition, the CPU 11 of the PC 10 of the second embodiment executes the process illustrated in the flowcharts of FIGS. 6, 7, and 9 by executing the schedule creation support program 14a.

  FIG. 6 is a flowchart showing blank schedule automatic registration processing executed by the CPU 11 of the PC 10 according to the second embodiment. As shown in FIG. 6, the blank schedule automatic registration process of the second embodiment is a first type schedule information creation process of the second embodiment instead of the first type schedule information creation process (S308) of the first embodiment. (S602) is provided. The first type schedule information creation processing of the second embodiment will be described later with reference to FIG.

  Further, in the blank schedule automatic registration process of the second embodiment, after the second type schedule information creation process (S316) and before the schedule list 13b is displayed and output (S318), the additional information creation process (S604). ) Is provided. The additional information creation process will be described later with reference to FIG.

  In the blank schedule automatic registration process of the first embodiment described above, when there are a plurality of images included in the implementation time of the schedule information of a reference person, the first is based on one of the plurality of images. Species schedule information was created. In contrast, in the blank schedule automatic registration process of the second embodiment, when there are a plurality of images included in the execution time of a certain reference person's schedule information, based on each of the plurality of images, It differs from the blank schedule automatic registration process of the first embodiment in that the schedule information is selected and the schedule information of the selected reference persons is merged to create the first type schedule information. Details will be described below.

  FIG. 7 is a flowchart illustrating a first type schedule information creation process (S602) executed by the CPU 11 of the PC 10 according to the second embodiment. First, the CPU 11 sets one of the search target images as a processing target image (S702). Next, the CPU 11 acquires the TS of the processing target image from the image DB 13a (S703), and determines whether the schedule information of the implementation time including the TS of the processing target image is in the detection schedule map 13c (S704). ).

  The detection schedule map 13c will be described with reference to FIG. The detection schedule map 13c is created in the RAM 13 of the PC 10. FIG. 8 is a diagram schematically showing information stored in the detection schedule map 13c. In the detection schedule map 13c, a schedule ID item 80, a start date / time item 82, an end date / time item 84, and a reference schedule ID list 86 are provided, and schedule information selected based on the image is registered. In the first type schedule information creation process (S602) of the second embodiment, when a plurality of schedule information exists for the same implementation time, the schedule information is associated with each other by a schedule ID. Specifically, when the schedule information of the reference person exists for the same implementation time as the schedule information registered in the detection schedule map 13c, the schedule ID of the schedule information of the reference person is set to the detection schedule map 13c. Are stored in the reference schedule ID list 86 of the registered schedule information, and the plurality of schedule information are associated with each other. Details will be described later with reference to FIG.

  Returning to FIG. When the schedule information of the implementation time including the TS of the processing target image is not in the detection schedule map 13c (S704: No), the CPU 11 stores the schedule information including the TS of the processing target image in the schedule list 13b. It is determined whether or not (S706). If the determination in S706 is affirmative (S706: Yes), the CPU 11 sets the schedule ID, start date / time, and end of the schedule information corresponding to the schedule ID item 80, the start date / time item 82, and the end date / time item 84 of the detection schedule map 13c. A new date is added (S708). Then, the CPU 11 sets the schedule ID of the corresponding schedule information in the schedule link 58 of the image to be processed (S710). On the other hand, if the determination in S706 is negative (S706: No), the CPU 11 skips the processing from S708 to S710.

  On the other hand, when the schedule information of the implementation time including the TS of the processing target image is in the detection schedule map 13c (S704: Yes), the CPU 11 includes the processing target image of the schedule information registered in the detection schedule map 13c. The schedule ID of the schedule information of the implementation time including TS is set in the schedule link 58 of the processing target image (S710).

  Next, the CPU 11 recognizes the character in the image that is the subject of the processing target image (S712), creates personal information indicating the recognized character in the image, and uses this as the attribute information of the image to attach to the image DB 13a. Information item 56 is set (S714). In the second embodiment, in the attached information item 56 of the image DB 13a, in addition to the person information, the meta information of the image file such as the file name and GPS information, for example, the image information such as the file name and the GPS information is also stored It is assumed that it is set as attached information.

  Next, the CPU 11 acquires schedule information of a reference person who is a person other than the target person among the persons recognized as characters in the image from the schedule DB 42 of the server 40 and refers to it (S715). Next, the CPU 11 determines whether the schedule information of the reference person includes the schedule information of the implementation time including the TS of the processing target image (S716).

  When there is schedule information of the implementation time including the TS of the processing target image among the schedule information of the reference person (S716: Yes), the CPU 11 determines whether or not a schedule ID is set in the schedule link 58 of the processing target image. Is determined (S722). When it is determined that the schedule ID is set in the schedule link 58 of the processing target image (S722: Yes), the CPU 11 refers to the detection schedule map 13c corresponding to the schedule ID set in the schedule link 58. The schedule ID of the schedule information of the reference person selected as the schedule information of the implementation time including the TS of the processing target image is added to the schedule ID list 86 (S730). Thereby, the schedule information already associated with the schedule link 58 of the processing target image can be associated with the schedule information of the reference person selected based on the processing target image.

  On the other hand, when the schedule ID is not set in the schedule link 58 of the processing target image (S722: No), the CPU 11 selects the schedule information of the implementation time including the TS of the processing target image from the schedule information of the reference person. . Then, schedule information including the start date and time and the end date and time of the selected schedule information is created as the first type schedule information, given a new schedule ID, and the schedule list 13b (FIG. 2 ( Add to b)). Then, the CPU 11 acquires the schedule ID, start date / time, and end date / time of the schedule information (S724).

  Next, the CPU 11 newly adds the acquired schedule ID, start date / time, and end date / time to the schedule ID item 80, the start date / time item 82, and the end date / time item 84 of the detection schedule map 13c (S726). Then, the CPU 11 sets the acquired schedule ID in the schedule link 58 of the processing target image (S728).

  Next, the CPU 11 selects the schedule ID of the schedule information of the reference person selected as the schedule information of the implementation time including the TS of the processing target image, and the reference schedule ID corresponding to the schedule ID set in the schedule link 58 It adds to the list 86 (S730).

  On the other hand, if the determination in S716 is negative (S716: No), if there is no schedule information of the implementation time including the TS of the processing target image in the schedule information of the reference person, the schedule information of the reference person is stored in the schedule DB 42. If the image is protected and cannot be referred to, or if a person other than the target person is not included in the processing target image, the CPU 11 determines whether or not a schedule ID is set in the schedule link 58 of the processing target image ( S718). If the schedule ID is not set in the schedule link 58 of the processing target image (S718: No), the CPU 11 sets “N / A” in the scheduling link 58 of the processing target image (S720). On the other hand, when the schedule ID is set in the schedule link 58 of the processing target image (S718: Yes), the CPU 11 skips S720.

  Next, the CPU 11 determines whether all search target images have been processed (S732). If the determination in S732 is negative (S732: No), the CPU 11 returns to S702, sets the next processing target image, and repeats the processing. On the other hand, after all the search target images have been processed (S732: Yes), for each image whose schedule link 58 is “N / A”, the schedule information of the implementation time including the TS is included in the detection schedule map. It is checked whether or not it is stored in 13c (S734).

  Then, for each image whose schedule link 58 is “N / A”, when schedule information of the implementation time including the TS is stored in the detection schedule map 13c, the schedule ID of the corresponding schedule information is The schedule link 58 of the image is set (S736), and the process ends.

  According to the first type schedule information creation process of the second embodiment, images included in the same execution time can be associated with each other by the schedule ID of the detection schedule map 13c.

  FIG. 9 is a flowchart illustrating additional information creation processing (S604) executed by the CPU 11 of the PC 10 according to the second embodiment. This additional information creation process uses the detection schedule map 13c created in the first type schedule information creation process to create the first type schedule information by merging the schedule information of the reference person, and the schedule list This is a process for adding further information to the schedule information of the target person stored in 13b.

  First, the CPU 11 selects schedule information to be processed from the schedule list 13b (S902). Next, the CPU 11 acquires each schedule information set in the reference schedule ID list 86 of the schedule information to be processed (S904). Here, in the reference schedule ID list 86, the schedule ID of the schedule information of the reference person acquired from the image including the TS of the image is set at the execution time of the schedule information to be processed.

  Next, the CPU 11 adds information obtained from each acquired schedule information to the blank item of the schedule information to be processed (S906). For example, if the title item 62 of the schedule information to be processed is blank, the title information obtained from each acquired schedule information is added to the title item 62 of the schedule information to be processed.

  If it does in this way, the 1st type schedule information which merged the schedule information of a plurality of reference persons can be created, and it can add to schedule list 13b as schedule information of a target person. In the present embodiment, “merge” means that schedule information of a plurality of reference persons are matched to create one type 1 schedule information. That is, each piece of information (schedule ID, title information, start date / time, end date / time, participant information, location information) constituting the first type schedule information is acquired from any one of a plurality of reference person's schedule information, This means that one type 1 schedule information is created in combination.

  Next, the CPU 11 determines whether there is insufficient information in the schedule information to be processed (S908). If the determination in S908 is negative (S908: No), the CPU 11 proceeds to the process in S14. On the other hand, if the determination in S908 is affirmative (S908: Yes), the CPU 11 acquires the attached information of the image associated with the schedule information to be processed, and obtains insufficient information from the attached information. Here, the image associated with the schedule information to be processed is an image in which the schedule ID of the schedule information to be processed is set to the schedule link 58.

  The CPU 11 extracts an image in which the schedule ID of the schedule information to be processed is set to the schedule link 58 (S910). Then, necessary information is acquired from the extracted image and added to the schedule information to be processed (S912). For example, the largest file name among the file names of the extracted images is added to the title item 62 as the title information of the schedule information to be processed. Further, the facility name and address that can be specified by the GPS information of the extracted image are added to the holding place item 70 as place information of the schedule information to be processed. For the person recognized in at least one of the extracted images, the person information for identifying the person is added to the participant item 68 as the participant information of the schedule information to be processed.

  Next, the CPU 11 determines whether all schedule information has been processed (S914). When the determination in S914 is negative (S914: No), the CPU 11 returns to S902, selects the next processing target schedule information, and repeats the processing. When the process of all schedule information is completed while the process is repeated (S914: Yes), the CPU 11 ends the additional information creation process.

  According to the blank schedule automatic registration process of the second embodiment, the schedule information of the target person can be complemented for more items based on a plurality of images, so that more enhanced schedule information can be created.

  In the above embodiment, the PC 10 corresponds to an example of a computer and a schedule creation support apparatus, the schedule creation support program 14a corresponds to an example of a schedule creation support program, and the schedule DB 42 corresponds to an example of a storage unit. The Internet interface 19 corresponds to an example of a communication unit. TS corresponds to an example of image generation date and time. A continuous image group corresponds to an example of a group. The time from the start date to the end date of the schedule information corresponds to an example of the implementation time.

  The CPU 11 that executes S403 and S703 corresponds to an example of a generation date acquisition unit. The CPU 11 that executes the processes of S406 and S712 corresponds to an example of a person recognition unit. The CPU 11 that executes the processes of S407 and S715 corresponds to an example of a reference unit. The CPU 11 that executes the processes of S408 and S716 corresponds to an example of a generation date determination unit. The CPU 11 that executes the processes of S410, S724, and S906 corresponds to an example of a selection unit, a first type creation unit, and an addition unit. The CPU 11 that executes the processes of S412 and S728 corresponds to an example of an association unit. The CPU 11 that executes the process of S508 corresponds to an example of a classification unit. The CPU 11 that executes the process of S510 corresponds to an example of an implementation time setting unit. The CPU 11 that executes the process of S512 corresponds to an example of a second type creation unit. The CPU 11 that executes the process of S714 corresponds to an example of a person information creation unit. The CPU 11 that executes the process of S912 corresponds to an example of a person information adding unit.

  Although the present invention has been described based on the embodiments, the present invention is not limited to the above-described embodiments, and various improvements and modifications can be easily made without departing from the spirit of the present invention. Can be inferred.

  For example, in the above embodiment, the PC 10 is an example of a computer and a schedule creation support device. However, various information processing apparatuses such as multifunction peripherals, mobile phones, electronic game machines, and digital cameras can be examples of computers and schedule creation support apparatuses.

  Further, according to the above embodiment, when the first type schedule information at a certain implementation time is created, the second type schedule information at the same implementation time is not created. However, you may comprise so that both 1st type schedule information and 2nd type schedule information may be produced about a certain implementation time.

  In the above embodiment, schedule information is collected based on the characters in the still image. Instead, schedule information may be collected based on characters in the video.

  In the above embodiment, the schedule information is acquired from the server 40. However, the present invention can also be applied when the PC 10 originally stores the schedule information in, for example, its own HDD. . In this case, the HDD 14 of the PC 10 corresponds to an example of a storage unit, and the bus line 20 corresponds to an example of a communication unit.

  In the first embodiment, the first type schedule information is created based on any one of the plurality of images. However, among the plurality of reference person schedule information acquired based on each of the plurality of images, the schedule information with the most items is acquired as the first type schedule information and added as the target person schedule information. It may be configured.

  In the above embodiment, the time from the start date / time stored in the start date / time item 64 of the schedule information to the end date / time stored in the end date / time item 66 is referred to as the “execution time” of the schedule information. However, for example, when only the start date / time of the schedule information is acquired, the execution time may be determined within a predetermined time from the start date / time.

  In the embodiment described above, the latest schedule list 13b is displayed and output. However, the display output of the schedule list 13b is not essential. For example, the schedule information of the target person stored in the storage unit such as the schedule DB 42 of the server 40 may be updated with the created schedule list 13b. In the above embodiment, the first type schedule information and the second schedule information are added to the schedule list 13b. Instead, the first type schedule information and the second schedule information may be directly added to the storage unit such as the schedule DB 42 of the server 40. good.

10 PC (an example of a computer and a schedule creation support device)
14a Schedule creation support program 19 Internet interface (an example of communication means)
42 Schedule DB (an example of a storage unit)

Claims (9)

A schedule creation support program that supports creation of schedule information that associates the contents of a schedule with the implementation time of the schedule,
A computer that can communicate with the storage unit that stores the schedule information of the target person,
Generation date acquisition means for acquiring the image generation date;
Person recognition means for recognizing a person included as a subject in the image;
Reference means for referring to schedule information of a reference person other than the target person who is recognized by the person recognition means;
A selection unit that selects schedule information of an implementation time including the generation date and time of the image acquired by the generation date and time acquisition unit from among the schedule information of the reference person referred to by the reference unit;
First type creation means for creating first type schedule information based on schedule information of the reference person selected by the selection means;
A schedule creation support program for causing the first type schedule information created by the first type creation means to function as an adding means for adding as schedule information of the target person. The first type creating means includes
The schedule creation support program according to claim 1, wherein the execution time of the first type schedule information is set based on the execution time of the schedule information of the reference person selected by the selection means. The generation date and time acquisition means acquires the generation date and time of the image for each of a plurality of images,
When the generation date and time of a plurality of images are included in the execution time of the schedule information of the reference person selected by the selection means, the computer is caused to function as an association means for associating the plurality of images with each other.
The first type creating means includes
3. The schedule creation support program according to claim 1, wherein the first type schedule information is created based on at least one of the plurality of images associated with each other by the association unit. The selection means is for selecting schedule information of the reference person based on each of a plurality of images.
The first type creating means includes
The schedule information of the reference person selected by the selection unit is merged with a plurality of schedule information selected based on a plurality of images associated with each other by the association unit to create the first type schedule information The schedule creation support program according to claim 3. The generation date and time of the image acquired by the generation date and time acquisition unit are classified so that a plurality of images in which the generation date and time of the image acquired by the generation date and time acquisition unit continues within a predetermined time are classified into the same group. A classification means for classifying a plurality of images based on;
For each group classified by the classification unit, the computer functions as a second type creation unit that creates second type schedule information based on the attached information of the images included in the group,
The schedule creation support program according to any one of claims 1 to 4, wherein the adding unit adds the second type schedule information created by the second type creation unit as schedule information of the target person. . For each group classified by the classification means, the computer is caused to function as an implementation time setting means for setting an implementation time that includes the generation date and time of each image included in the group,
The second type creating means is
6. The second type schedule information in which the execution time set by the execution time setting means and the attached information of the image are associated with each group classified by the classification means. Schedule creation support program. Causing the computer to function as a generation date and time determination unit for determining whether the generation date and time of the image acquired by the generation date and time acquisition unit is included in the execution time of the schedule information of the reference person referred to by the reference unit And
The second type creation means obtains the second type schedule information based on the image determined by the generation date determination means that the generation date of the image is not included in the implementation time of the schedule information of the reference person. The schedule creation support program according to claim 5 or 6, which is created. Person information creating means for creating person information indicating a person recognized as a subject of the image by the person recognizing means;
8. The computer according to claim 1, wherein the computer functions as person information adding means for adding the person information created by the person information creating means to schedule information of an implementation time including a generation date and time of the image. Schedule creation support program. A schedule creation support device that supports creation of schedule information in which schedule contents and schedule execution times are associated with each other,
A communication unit that communicates with a storage unit that stores schedule information of the target person;
Generation date acquisition means for acquiring the image generation date;
Person recognition means for recognizing a person included as a subject in the image;
Reference means for referring to schedule information of a reference person other than the target person who is recognized by the person recognition means;
A selection unit that selects schedule information of an implementation time including the generation date and time of the image acquired by the generation date and time acquisition unit from among the schedule information of the reference person referred to by the reference unit;
First type creation means for creating first type schedule information based on schedule information of the reference person selected by the selection means;
A schedule creation support apparatus comprising: adding means for adding the first type schedule information created by the first type creation means as schedule information of the target person.

Images