JP6413625B2 - Image selection support system, image selection support device, image selection support method, and image selection support program - Google Patents

Description

  The present invention relates to an image selection support system, an image selection support device, an image selection support method, and an image selection support program.

  Various methods of providing information via mobile terminals have been proposed as services for spectators who appreciate entertainment such as sports competitions and music concerts (see, for example, Patent Document 1). In the technique disclosed in Patent Document 1, an image taken at an event venue is distributed via a small antenna that can be distributed to a limited area, thereby enabling video distribution to the audience.

  On the other hand, in the above-mentioned venues for sports competitions and concerts, many images are taken by contracted photographers. In addition to being used for event reporting, images taken in this way may be sold as sports team goods or music artist goods.

  If a photo book composed of images taken at the venue of sports competitions and concerts can be created and sold on the day after the discussion or concert ends, it can be a meaningful service for the audience enjoying the event. However, a large number of images are often taken by a large number of photographers, and it is difficult to sell on the day after extracting images to be recorded from such a large amount of images due to time constraints. .

  The present invention has been made to solve such a problem, and supports the selection of captured images in order to quickly create a photo book composed of images captured at a box office. Objective.

  In order to solve the above-described problem, one aspect of the present invention is an image selection support system that supports selection of an image recorded in an image collection composed of images taken at a performance for a spectator. Shooting information in which the date and time of the shooting and the shot image are associated with each other, an information acquisition unit for acquiring event information in which events occurring in the performance are recorded in association with the date and time, and the date and time included in the shooting information; Based on the date and time included in the event information, an association unit that associates the image with the event, and an image selection that selects a predetermined number of images from the plurality of images based on the event associated with each of a plurality of images And a selection result output unit for outputting the selection result of the image.

  ADVANTAGE OF THE INVENTION According to this invention, in order to create quickly the photograph collection comprised by the image image | photographed in the box office, selection of the image | photographed image can be supported.

It is a figure which shows the operation | use form of the system which concerns on embodiment of this invention. It is a block diagram which shows the hardware constitutions of the information processing apparatus which concerns on embodiment of this invention. It is a figure which shows the example of the information produced | generated by the recorder terminal which concerns on embodiment of this invention. It is a figure which shows the example of the event information which concerns on embodiment of this invention. It is a figure which shows the example of the scene information which concerns on embodiment of this invention. It is a figure which shows the example of the imaging | photography information which concerns on embodiment of this invention. It is a block diagram which shows the function structure of the editor terminal which concerns on embodiment of this invention. It is a figure which shows the aspect of the image analysis process which concerns on embodiment of this invention. It is a figure which shows the imaging | photography information to which the recognition information which concerns on embodiment of this invention was added. It is a figure which shows the example of the event list information which concerns on embodiment of this invention. It is a figure which shows the example of the purchase application screen which concerns on embodiment of this invention. It is a figure which shows the example of the purchase application information which concerns on this invention embodiment. It is a sequence diagram which shows the whole operation | movement of the system which concerns on this invention embodiment. It is a flowchart which shows operation | movement of the editor terminal which concerns on this invention embodiment. It is a flowchart which shows the correlation operation | movement which concerns on embodiment of this invention. It is a figure which shows the association information which concerns on embodiment of this invention. It is a flowchart which shows the weighting operation | movement which concerns on embodiment of this invention. It is a figure which shows the example of the weighting coefficient which concerns on embodiment of this invention. It is a figure which shows the example of the time-sequential change of the sound volume level which concerns on embodiment of this invention. It is a figure which shows the weighting information which concerns on embodiment of this invention. It is a figure which shows the extraction result of the image for every scene which concerns on embodiment of this invention. It is a figure which shows the example of the layout confirmation screen which concerns on embodiment of this invention. It is a figure which shows the example of the event information which concerns on embodiment of this invention. It is a figure which shows the example of the event list information which concerns on embodiment of this invention. It is a figure which shows the example of the information of the correspondence of the photographer who concerns on embodiment of this invention, and the team of imaging | photography object. It is a figure which shows the example of the information of the correspondence of the photographer who concerns on embodiment of this invention, and the team of imaging | photography object.

  Embodiments of the present invention will be described below with reference to the drawings. In the present embodiment, a baseball game will be described as an example of an entertainment performed for the audience. A system for providing, on the day of the game, a photo book, which is a collection of images of the images of the game, to the audience watching the baseball game at the game venue. In such a system, a function for selecting an image to be recorded in a photo album from a large number of images is one of the gist according to the present embodiment. That is, the system according to the present embodiment is an image selection support system that supports the selection of images recorded in an image collection from a large number of captured images.

  FIG. 1 is a diagram illustrating an operation mode of the image selection support system according to the present embodiment. As shown in FIG. 1, the system according to the present embodiment includes a recorder terminal 1, a digital camera 2, a microphone 3, an editor terminal 4, a user terminal 5, and an image forming apparatus 6 via a public line such as the Internet. Connected and configured.

  The recorder terminal 1 is an information processing device for a recorder at the game venue to input information corresponding to the progress of the game at the game venue. The digital camera 2 is a photographing device for photographing by a photographer who performs photographing at a game hall. In this embodiment, the digital camera 2 is directly connected to the network. However, the digital camera 2 may be connected to the network via an information processing apparatus such as a notebook computer.

  The microphone 3 is a recording device for collecting voice and recording voice information at the game venue. Voices recorded through the microphone 3 include voices such as cheers from the audience seats, as well as live game commentary and commentary voices. As shown in FIG. 1 separated by a broken line, the recorder terminal 1, the digital camera 2, and the microphone 3 are installed in the game hall.

  The editor terminal 4 is an information processing apparatus that receives image information generated by being photographed by the digital camera 2 and selects an image to be recorded in a photo book provided to the audience to generate a photo book layout. is there. That is, the editor terminal 4 functions as an image selection support device, and a program for realizing such a function is used as the image selection support program. The function of the editor terminal 4 is one of the gist according to the present embodiment. The user terminal 5 is an information processing apparatus that is used when a user who watches a game at a game site applies for the purchase of a photo album in advance.

  The image forming apparatus 6 is an apparatus that executes image formation output based on the layout information generated by the editor terminal 4 and performs bookbinding processing to generate a photo book. The image forming apparatus 6 does not need to be installed in the game hall, but is installed in the vicinity of the game hall in order for the audience who watched the game at the hall to receive the photo album on that day.

  Next, a hardware configuration of an information processing apparatus such as the recorder terminal 1, the editor terminal 4, the user terminal 5, and the image forming apparatus 6 according to the present embodiment will be described with reference to FIG. The image forming apparatus 6 includes an engine for realizing a scanner, a printer, and the like in addition to the hardware configuration shown in FIG.

  As shown in FIG. 2, the information processing apparatus according to the present embodiment includes the same configuration as a general server, a PC (Personal Computer), or the like. That is, the information processing apparatus according to the present embodiment includes a CPU (Central Processing Unit) 10, a RAM (Random Access Memory) 20, a ROM (Read Only Memory) 30, a HDD (Hard Disk Drive) 40, and an I / F 50. Connected through. Further, an LCD (Liquid Crystal Display) 60 and an operation unit 70 are connected to the I / F 50.

  The CPU 10 is a calculation means and controls the operation of the entire information processing apparatus. The RAM 20 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 10 processes information. The ROM 30 is a read-only nonvolatile storage medium and stores a program such as firmware. The HDD 40 is a non-volatile storage medium that can read and write information, and stores an OS (Operating System), various control programs, application programs, and the like.

  The I / F 50 connects and controls the bus 80 and various hardware and networks. The LCD 60 is a visual user interface for the user to check the state of the information processing apparatus. The operation unit 70 is a user interface such as a keyboard and a mouse for a user to input information to the information processing apparatus.

  In such a hardware configuration, the software control unit is configured by the CPU 10 performing calculations according to a program stored in the ROM 30 or a program loaded into the RAM 20 from a storage medium such as the HDD 40 or an optical disk (not shown). Functional blocks for realizing the functions of the recorder terminal 1, the editor terminal 4, the user terminal 5, and the image forming apparatus 6 according to the present embodiment by combining the software control unit configured as described above and hardware. Composed.

  Next, information recorded by the recorder terminal 1 (hereinafter referred to as “recording information”) will be described. FIG. 3 is a diagram illustrating an example of recorded information according to the present embodiment. As shown in FIG. 3, the record information according to the present embodiment includes event information and scene information. FIG. 4 is a diagram showing the contents of the event information. The event information is information indicating the details of the event that occurred during the game, that is, “event ID”, “event name”, “time stamp”, “subject team”, and “subject player” as shown in FIG. Information.

  “Event ID” is an identifier for uniquely identifying an event. “Event name” is information indicating the content of an event such as “home run” as shown in FIG. “Time stamp” is information indicating the time when the event occurred. “Subject team” is information indicating the team that is the subject of the event, and “Home Run” indicates the team of the player who hit the home run. The “main player” is information indicating the player who is the subject of the event, and “home run” indicates the player who hit the home run.

  As described above, the event information according to the present embodiment is information in which an event that occurred in the performance is stored in association with the date and time. Further, the event information includes information indicating a person who has become the subject of the event, such as a “subject team”, “subject player”, that is, a participant in the performance.

  FIG. 5 is a diagram showing the contents of the scene information. The scene information is information indicating the progress of the game in association with the time. As shown in FIG. 5, the progress of the game such as “first table”, “first bat”, “second bat” is “˜ It is recorded in association with a time stamp such as “hour to minute”. In addition, information on players and teams in each scene is recorded, such as “Pitcher: XXXXXX”, “Batter: XXXXXX”, and “Attack team: XXXXXX”. In addition, although the example as scene information is shown in FIG. 5, score information recorded by a scorer, for example, can be used as the scene information.

  The information shown in FIGS. 4 and 5 is information that is referred to in order to select an image in this embodiment. The recorder who operates the recorder terminal 1 inputs the information shown in FIGS. 4 and 5 to the terminal as needed while confirming the progress of the game. Thereby, event information and scene information are generated in the recorder terminal 1 and transmitted to the editor terminal 4.

  Next, information transmitted from the digital camera 2 to the editor terminal 4 will be described with reference to FIG. FIG. 6 is a diagram showing the contents of information (hereinafter referred to as “photographing information”) transmitted from the digital camera 2 to the editor terminal 4. As shown in FIG. 6, the shooting information includes “image data” that is information of an image generated by shooting, “time stamp” that indicates the date and time of shooting, and “photographer information that identifies the photographer who has shot the image. "Is included. That is, the shooting information is information in which the shot image is associated with the shooting date and time, and further includes information indicating the photographer who has shot the image.

  “Image data” is associated with “event information” based on the “time stamp” shown in FIG. 6 and the “time stamp” shown in FIG. Furthermore, the image arrangement according to the scene of the game progress is executed based on the scene information shown in FIG. Thus, one of the gist according to the present embodiment is to enable image selection according to the progress of the game. Such processing is executed in the editor terminal 4.

  Next, the functional configuration of the editor terminal 4 according to the present embodiment will be described with reference to FIG. As shown in FIG. 7, the editor terminal 4 according to the present embodiment includes a controller 100 and a network I / F 110 in addition to the LCD 60 and the operation unit 70 described in FIG.

  The network I / F 110 is an interface for the editor terminal 4 to communicate with other devices via the network, and uses an Ethernet (registered trademark) or a USB (Universal Serial Bus) interface. The controller 100 is configured by a combination of software and hardware, and functions as a control unit that controls the editor terminal 4 as a whole.

  As illustrated in FIG. 7, the controller 100 includes an information acquisition unit 101, an association unit 102, an image analysis unit 103, a candidate extraction unit 104, event list information 105, a candidate presentation unit 106, and an editing processing unit 107. The information acquisition unit 101 acquires the information described in FIGS. 3 to 6 and the audio information recorded by the microphone 3 via the network I / F 110.

  The association unit 102 associates the event information and the image data with respect to the information acquired by the information acquisition unit 101 based on the “time stamp” information as described above. The result of the association is input to the candidate extraction unit 104. The image analysis unit 103 analyzes image data included in the shooting information acquired by the information acquisition unit 101, extracts information obtained from the image, and adds the information to the shooting information. FIG. 8 is a diagram illustrating an aspect of image analysis performed by the image analysis unit 103.

  As shown in FIG. 8, the image analysis unit 103 recognizes the player's back number and name in the image by OCR (Optical Character Recognition), and adds the recognized character information to the shooting information. That is, the image analysis unit 103 functions as a character information extraction unit. FIG. 10 is a diagram illustrating an example of shooting information to which information (hereinafter referred to as “recognition information”) such as a back number and a player name recognized by image analysis by the image analysis unit 103 is added. Information as illustrated in FIG. 9 is input to the candidate extraction unit 104.

  The candidate extraction unit 104 assigns importance to each image data based on the association information generated by the association unit 102 and the shooting information to which the recognition information is added by the image analysis unit 103, and records based on the importance. A power image is extracted as a recording candidate. That is, the candidate extraction unit 104 functions as an image selection unit. Therefore, the candidate extraction unit 104 refers to the event list information 105.

  FIG. 10 is a diagram illustrating the contents of event list information, which is information indicating importance according to the type of event. As shown in FIG. 10, the event list information indicates an “event ID” that uniquely identifies an event type, an event type name, and an “event name” corresponding to the “event name” in FIG. This is information associated with “importance”, which is a value indicating the importance of the event type. In other words, the “importance” is a value indicating the priority as an image to be recorded in the photo album.

  The candidate extraction unit 104 assigns importance to each image data based on information as shown in FIG. 10, and extracts image data as candidates to be recorded in the photo album in descending order of importance values. The candidate extraction unit 104 inputs the candidate image data extracted as described above and the assigned importance value to the candidate presentation unit 106.

  The candidate presenting unit 106 presents a screen on which the extracted candidate image data is laid out on a GUI (Graphical User Interface). That is, the candidate presentation unit 106 functions as a selection result output unit. As a result, the editor who operates the editor terminal 4 can check the layout of the photo album, change the recorded image, and adjust the layout. As described above, in the system according to the present embodiment, image data to be preferentially recorded is extracted according to an event that has occurred in a game, and a photo album layout plan is presented. Therefore, the burden on the editor can be greatly reduced.

  The edit processing unit 107 corrects the layout plan presented on the GUI based on the editor's operation input via the operation unit 70. After that, when an operation for confirming the layout is performed by the editor, the confirmed layout information and the image data selected to be recorded are transmitted to the image forming apparatus 6 via the network I / F 110. As a result, image formation output and bookbinding processing are executed in the image forming apparatus 6 to generate a photo book.

  Next, the GUI of the purchase application screen displayed on the user terminal 5 will be described. FIG. 11 is a diagram illustrating an example of a purchase application screen according to the present embodiment. The GUI as shown in FIG. 11 is displayed, for example, when the user accesses the website of a service provider who sells a photo album via the user terminal 5. As shown in FIG. 11, on the purchase application screen according to the present embodiment, options such as “important event selection”, “important team selection”, “important player selection”, and “design pattern selection” are displayed.

  The choices of “important event selection”, “important team selection”, and “important player selection” are options for designating the content of a photograph that is preferentially selected when selecting an image to be recorded in the photo album. As described in FIG. 10, importance is set for each event type. However, this is a preset value based on a general viewpoint.

  For example, in general, when comparing “home run” and “hit”, “home run” is predicted to have a higher level of attention by the audience, so the value of importance is higher for “home run” than “hit” Is set. On the other hand, some users may wish to record more “hit” photos than “home run” photos. With the choices as shown in FIG. 11, it is possible to extract image data in accordance with the desires of such individual users.

  “Design pattern selection” is an option for designating a bound design such as the cover of a photo book or the background of each page. In addition, on the purchase request application screen, in addition to the options shown in FIG. 11, items for inputting information of the applicant who wants to purchase such as name and address are displayed.

  FIG. 12 is a diagram illustrating an example of information (hereinafter referred to as “purchase application information”) generated from information input by the GUI illustrated in FIG. 11. As shown in FIG. 12, the purchase application information includes “buyer information” in addition to the information selected in each option such as “important event”, “important team”, “important player”, and “design pattern”. It is.

  The information shown in FIG. 12 is transmitted to the editor terminal 4 and used in the importance degree assignment process by the candidate extraction unit 104. In particular, the information on “important team” and “important player” is used as information on the participants of the performance that should be preferentially selected when selecting an image to be recorded in the photo album.

  Next, the operation of the entire system according to the present embodiment will be described with reference to FIG. As shown in FIG. 13, first, the user terminal 5 makes a purchase application in response to a user operation. Thereby, the information shown in FIG. 12 is transmitted to the editor terminal 4 (S1301). Although FIG. 13 shows that a purchase application is made from the user terminal 5 to the editor terminal 4, as described above, it may be made via the service provider's web server. .

  When the purchase application is completed, the user terminal 5 issues a ticket indicating the purchase application according to the user's operation (S1302). The ticket issuing process in S1302 may be performed by information processing such as e-mail, or may be performed by outputting paper by printout or the like. This is the process executed before the game starts.

  When the game is started, the digital camera 2 transmits shooting information generated by shooting to the editor terminal 4 (S1303). Here, the transmission of the shooting information from the digital camera 2 to the editor terminal 4 may be performed directly or via another information processing apparatus such as a notebook computer. Further, it may be performed every time shooting is performed, or may be performed in response to switching of scenes, such as every few minutes, once table, once, or the like.

  Further, the recorder terminal 1 transmits the event information and scene information input by the recorder to the editor terminal 4 (S1304). Information transmission by the recorder terminal may be performed every time recording information is input as in the case of shooting information, or may be performed collectively at predetermined time intervals or scene breaks.

  In the editor terminal 4, the associating unit 102, the image analyzing unit 103, and the candidate extracting unit 104 operate based on the shooting information acquired from the digital camera 2 and the recorder information acquired from the recorder terminal 1. Is selected (S1305). When the selection of the image is completed, a layout plan is presented by the candidate presenting unit 106 (S1306).

  When the layout plan is presented, the editing processing unit 107 performs layout editing in accordance with an operation by the editor (S1307). When the layout editing completion operation is performed, the editing processing unit 107 transmits layout information and image data to the image forming apparatus 6 (S1308). As a result, print output and bookbinding are executed in the image forming apparatus 6 (S1309).

  When the photo book is generated in the image forming apparatus 6 in this way, the user receives the photo book using the ticket issued in S1302. Thereby, the user can receive a photo album on the day of the game.

  Next, the operation of the editor terminal 4 according to the present embodiment will be described in further detail. FIG. 14 is a flowchart showing the operation of the editor terminal 4 according to this embodiment. As shown in FIG. 14, the information acquisition unit 101 of the editor terminal 4 acquires image information according to the progress of the game (S1401), and acquires event information and scene information (S1402). The processes of S1401 and S1402 are executed as needed according to the progress of the game as described in FIG.

  When the information is acquired, the image analysis unit 103 performs image analysis of the image data included in the acquired shooting information (S1403). The process of S1403 is the process described in FIG. As a result, the recognition information is added to the photographing information and added to the candidate extraction unit 104 as described in FIG.

  In addition to the image analysis by the image analysis unit 103, an association process between the image data and the event information by the association unit 102 is executed (S1404). Here, the details of the association processing will be described with reference to FIG. As shown in FIG. 15, the associating unit 102 first selects one of the received event information (S1501). Next, the associating unit 102 selects one piece of image data of the received shooting information (S1502), compares each time stamp, and calculates a time difference (S1503).

  After calculating the time difference, the associating unit 102 determines whether the time difference is within a predetermined threshold (S1504). The threshold value in S1504 is a threshold value for determining whether or not an image and an event are related, and the value is, for example, ± 30 seconds. If the time difference is within the threshold as a result of the determination in S1504, the associating unit 102 associates the selected event with the selected image (S1505).

  On the other hand, when the time difference exceeds the threshold value or when the processing of S1505 is completed, the associating unit 102 repeats the processing until the processing from S1502 is completed for all received photographing information (S1506 / NO). ). Then, when the processing from S1502 is completed for all received imaging information (S1506 / YES), the associating unit 102 next performs the processing from S1501 until the processing is completed for all received event information. Is repeated (S1507 / NO).

  When the process from S1501 is completed for all received events (s1507 / YES), the associating unit 102 ends the associating process. In other words, the associating unit 102 determines the association of all received events and all shooting information based on time stamps. By such processing, as shown in FIG. 16, association information in which “image file name” indicating shooting information is associated with “event ID” is generated.

  When the association processing in S1404 in FIG. 14 is completed, the candidate extraction unit 104 starts extraction processing of image data to be recorded in the photo album from the image data. In the extraction process, the candidate extraction unit 104 first performs a weighting process on the image data (S1405). Details of the weighting process of the image data will be described with reference to FIG.

  As shown in FIG. 17, the candidate extraction unit 104 selects one of the received image data (S1701), and reflects the importance of the event (S1702). In S <b> 1702, the candidate extraction unit 104 refers to the association information generated as illustrated in FIG. 16, and acquires the “importance” of the event associated with each image file from the event list information 105. And associate it with the image file.

  Next, the candidate extraction unit 104 reflects the weighting coefficient on the importance associated with the image file (S1703). The weighting coefficient is the importance added in accordance with the “important event”, “important team”, and “important player” selected as shown in FIG. A coefficient is set according to the selected item as shown in FIG. 18, and the candidate extraction unit 104 multiplies the coefficient to calculate the importance of the image data corresponding to the item selected by the user. As a result, it is possible to calculate the importance of an image that matches the user's preference high.

  In addition, since the event, team, and player corresponding to each image data can be determined from the association information shown in FIG. 16, the coefficients of “important event”, “important team”, and “important player” are multiplied. Whether or not can be determined based on the association information. On the other hand, by referring to the recognition information shown in FIG. 9, it is possible to determine which player each image data corresponds to, and the coefficient of “important player” can be determined. In addition, referring to the scene information shown in FIG. 5, it is possible to determine the pitcher, batter, and attack team at each time, so that the above-described determination can be assisted.

  Next, the candidate extraction unit 104 reflects the importance level based on the voice level (S1704). FIG. 19 is a diagram showing the sound volume levels in the sound information recorded by the microphone 3 in time series. As the game progresses, it is possible that a louder sound is recorded when the game is excited. That is, it can be considered that a photograph at a time when the volume level is high is so important.

  Therefore, the candidate extraction unit 104 adds the importance of the image data before and after the time when the volume level exceeds a certain threshold. As a result, the importance of the photos of the exciting scene in the game can be increased, and the photos can be easily recorded. Note that when determining the image data within a predetermined period from the time when the volume level exceeds a certain threshold, it is possible to determine whether or not the time difference is within the threshold, as in S1503 and S1504 in FIG. is there. Further, the addition of the importance to the image data whose volume level exceeds the threshold value may be performed by a coefficient as shown in FIG. 18, or may be performed by adding a predetermined value.

  The candidate extraction unit 104 repeats the processing from S1701 until the processing is completed for all the image data for which association data is generated as shown in FIG. 16 (S1705 / NO). (S1705 / YES), the process ends. As a result, as shown in FIG. 20, weighting information in which “weight value” is associated with “image file name” indicating each image data is generated.

  When the weighting information is generated as shown in FIG. 20, the candidate extraction unit 104 extracts the number of image data defined for each scene such as “one-time table” and “one-time back” in descending order of importance value. (S1406). In S1406, the scene information shown in FIG. 5 is referred to, and image data corresponding to the time corresponding to each scene such as “1 time front” and “1 time back” is extracted. As a result, as shown in FIG. 21, a prescribed number of image data is extracted for each scene such as “1 time table”.

  The candidate extraction unit 104 repeats the processing from S1401 until the image extraction for the last scene of the game is completed (S1407 / NO). When the process up to S1406 is completed for the last scene of the game (S1407 / YES), the candidate presentation unit 106 displays the layout plan on the GUI based on the image data extracted for each scene and presents it (S1408). ).

  FIG. 22 is a diagram showing an example of the GUI of the layout confirmation screen according to the present embodiment. S1408 neoite, the candidate presenting unit 106 generates a layout according to the design pattern selected as “design pattern A” in the purchase application information shown in FIG. As shown in FIG. 22, in the layout confirmation screen according to the present embodiment, in addition to the “layout” space in which the extracted image data is laid out, the image data that has not been extracted is displayed along with the calculated importance. The displayed “other candidate image” space is displayed.

  In the “layout” space, information obtained from event information associated with each image is displayed as character information, such as “No. Furthermore, the size of the image is adjusted according to the importance of the event, and as shown in FIG. 22, the image related to the “home run” event is displayed in a large size.

  In addition, an “audio” button is displayed for a highly important event, and audio before and after the time stamp of the event is reproduced. This is realized by electronic paper in the actually output photo book.

  In the GUI shown in FIG. 22, display information is generated by the candidate presentation unit 106 and displayed on the LCD 60. The editor can check the automatically extracted image and layout by checking the screen shown in FIG. Further, by simultaneously displaying the images that have not been extracted, it is possible to easily determine whether the image data is to be replaced.

  When the editor performs an operation for output instruction on the screen as shown in FIG. 22 (S1409 / YES), the editing processing unit 107 displays the information of the displayed layout and the information of the included image data on the network I / F 110. Then, it is transmitted to the image forming apparatus 6 (S1410). As a result, image forming output and bookbinding processing according to the layout are executed in the image forming apparatus 6, and a photo book is generated.

  On the other hand, when the operation is not an output instruction operation (S1408 / NO) but an editing instruction operation such as an image change or layout adjustment (S1411 / YES), the editing processing unit 107 is currently displaying according to the received operation. The layout is edited (S1412), and an output instruction is awaited. By such processing, the operation of the editor terminal 4 according to the present embodiment is completed. By executing such processing for each purchase application information as shown in FIG. 12, a photo book according to the user's preference as a purchase applicant is generated.

  As described above, in the system according to the present embodiment, a large number of captured images are first associated with event information according to a time stamp. As a result, images that are irrelevant to the event that should be noted during the game are excluded from inclusion in the photo book, and only images related to some event that occurred during the game can be used as candidates.

  Also, as shown in FIG. 10, an image related to an event that attracts the attention of the audience can be preferentially selected as a candidate based on the determination based on the importance set for each event. Furthermore, as shown in FIG. 11, by accepting selection of important events, teams, and players at the time of purchase application, it is possible to select a photo that more matches the user's taste as a candidate.

  With such a function, in the system according to the present embodiment, it is possible to support the selection of captured images in order to quickly create a photo book composed of images captured at the box office.

  In the above-described embodiment, an example has been described in which final adjustment is performed by an editor after a layout plan is presented using a GUI as illustrated in FIG. However, this is merely an example, and the layout extracted by the candidate extraction unit 104 and generated by the candidate presentation unit 106 may be transmitted to the image forming apparatus 6 as it is.

  As a merit when the final operation is performed by the editor's operation, there may be a case where an image related to an event having a special meaning is individually picked up, although the type of event is normal. For example, when considering an event “hit”, the importance is generally lower than “home run”, but in the case of the 1000th hit or the like of a certain player, the importance is higher than “home run”. Become.

  In such a case, it is possible to record without missing a special scene by leaving an opportunity for adjustment by the editor on the screen shown in FIG. On the other hand, a similar function can be realized by setting a special scene as a special event.

  For example, the event information is generated as an event of “1000 hits” as shown in FIG. Then, as shown in FIG. 24, by adding an item in which the degree of importance corresponding to such a special event is set to the event list information 105, it is given priority as an event different from a normal “hit”. Can be processed automatically.

  Moreover, in the said embodiment, although the baseball game was demonstrated as an example, it cannot be overemphasized that it is applicable also to sports games other than baseball. In addition, the present invention can be applied in the same way as long as it is a performance to be appreciated in the field, such as a music concert or a parade, without being limited to sports matches, and the above-described effects can be obtained.

  In addition, there are cases where photographers who take images at the performance venue are distributed in advance by the team to be photographed. FIG. 25 is a table showing the sort of the shooting target team for each cameraman. In such a case, the candidate extraction unit 104 determines a team of players in the image data based on “photographer information” included in the shooting information as shown in FIG. 6 in the operation of FIG. It is possible.

  If it is possible to determine the teams of the players shown in the respective image data in this way, it is possible to assist in the determination when the “important team” coefficient shown in FIG. 18 is reflected. Also, as shown in FIG. 26, when each photographer is assigned as an “attack team” or “defensive team”, the team of players in each image data is determined based on the scene information shown in FIG. It is also possible.

  Moreover, in the said embodiment, as demonstrated in FIG. 11, FIG. 12, the case where an important team and an important player were selected by the user was demonstrated as an example. However, this is an example, and an important team or an important player may be set in advance by a system administrator. As a result, it is possible to preferentially select photos of generally popular teams and popular players.

DESCRIPTION OF SYMBOLS 1 Recorder terminal 2 Digital camera 3 Microphone 4 Editor terminal 5 User terminal 6 Image forming apparatus 10 CPU
20 RAM
30 ROM
40 HDD
50 I / F
60 LCD
70 Operation Unit 80 Bus 100 Controller 101 Information Acquisition Unit 102 Association Unit 103 Image Analysis Unit 104 Candidate Extraction Unit 105 Event List Information 106 Candidate Presentation Unit 107 Edit Processing Unit

JP 2005-6193 A

Claims (12)

An image selection support system for supporting selection of images recorded in an image collection composed of images taken at a performance for a spectator,
Information acquisition unit for acquiring shooting information in which shooting date and time and a shot image are associated and event information recorded in association with the date and time of an event occurring in the box office,
An association unit for associating the image with the event based on the date and time included in the shooting information and the date and time included in the event information;
An image selection unit that selects a predetermined number of images from the plurality of images based on the event associated with each of a plurality of images;
And a selection result output unit that outputs the selection result of the image.   The image selection unit refers to event list information in which the importance level according to the event type is set, and based on the importance level of the event associated with each of a plurality of images, a predetermined number of images from the plurality of images. The image selection support system according to claim 1, wherein an image is selected. The event information includes information indicating a participant of the performance that is the subject of the event,
The image selection unit adjusts the importance of the event of the event information including the participant to be prioritized based on information on the participant to be prioritized in the selection of the image among the participants of the performance. The image selection support system according to claim 2. Including a character information extraction unit that extracts character information displayed in the image;
The image selection unit adjusts the importance of an image from which character information related to the participant to be prioritized is extracted based on information on the participant to be prioritized in the image selection among the participants of the entertainment The image selection support system according to claim 2. The shooting information includes information indicating a photographer who has shot the image,
The image selection unit
Recognizing the participant of the entertainment shown in each of a plurality of images based on information associated with the participant of the entertainment to be photographed for each photographer,
3. The importance of an image in which the participant to be prioritized is selected based on information on the participant to be prioritized in the selection of the image among the participants of the performance, according to claim 2, Image selection support system.   The image selection support system according to any one of claims 3 to 5, wherein the information on the participant to be prioritized is information specified in advance by a spectator.   The information acquisition unit adjusts the importance of an image associated with a date and time within a predetermined period from a date and time when a volume of audio recorded at the entertainment venue exceeds a predetermined threshold. The image selection support system according to any one of 2 to 6. The information acquisition unit acquires information indicating a scene according to the progress of the performance,
The image selection support system according to claim 1, wherein the image selection unit selects a predetermined number of images for each scene. An image selection support system for collecting images photographed by a photographer within a predetermined time and supporting selection of images recorded in the image collection from one or more collected images,
Shooting information in which a date and time of shooting and a shot image are associated, and an information acquisition unit that acquires event information in which events that occurred within the predetermined time are recorded in association with the date and time;
An association unit for associating the image with the event based on the date and time included in the shooting information and the date and time included in the event information;
An image selection unit that selects a predetermined number of images from the collected one or more images based on the event associated with the image;
And a selection result output unit for outputting a selection result of the image selected by the image selection unit. An image selection support device for supporting selection of images recorded in an image collection composed of images taken at a performance for a spectator,
Information acquisition unit for acquiring shooting information in which shooting date and time and a shot image are associated and event information recorded in association with the date and time of an event occurring in the box office,
An association unit for associating the image with the event based on the date and time included in the shooting information and the date and time included in the event information;
An image selection unit that selects a predetermined number of images from the plurality of images based on the event associated with each of a plurality of images;
And a selection result output unit that outputs the selection result of the image. An image selection support method for supporting selection of an image recorded in an image collection composed of images taken at a performance for a spectator,
Obtaining shooting information associated with the date and time when the image was taken and the image and the event information recorded in association with the date and time when the event occurred during the performance,
Based on the date and time included in the shooting information and the date and time included in the event information, the image and the event are associated,
Based on the event associated with each of a plurality of images, a predetermined number of images are selected from the plurality of images,
An image selection support method, comprising outputting the image selection result. An image selection support program for supporting selection of an image recorded in an image collection composed of images taken at a performance for a spectator,
Capturing the shooting information associated with the date and time of shooting and the captured image and the event information recorded in association with the date and time of the event that occurred in the performance; and
Associating the image with the event based on the date and time included in the shooting information and the date and time included in the event information;
Selecting a predetermined number of images from the plurality of images based on the event associated with each of a plurality of images;
An image selection support program causing an information processing apparatus to execute the step of outputting the image selection result.