JP2016201712A - Video processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video processing apparatus capable of generating a video in line with a theme desired by a user even when the user missed to photograph an event.SOLUTION: The video processing apparatus includes: theme holding means for holding theme information in which time-order-relation between events of information of a plurality of events to be photographed is specified; event time estimation means for estimating photographing time of an event that is not associated with a video; and video extraction means for extracting a video that matches the estimated time by the event time estimation means.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a video processing apparatus that generates video data according to a theme from video data shot in multiple times along a theme.

  Today, with the widespread use of digital video cameras and digital cameras, the opportunity for general consumers to create and edit videos is increasing. Under such circumstances, there is a demand for creating a video of a specific theme (video with a story) such as athletic meet, travel, wedding, etc. in video creation such as shooting and video editing.

  In response to such a request, Patent Document 1 discloses a system that enables photographing along a story described in a script by inputting information such as a script from the outside and displaying the information on a viewfinder. It is disclosed. Patent Document 2 discloses an apparatus that can create content such as a DVD or a Video CD by assigning video data according to a video theme (template) selected by a user.

  By the way, the shooting opportunities such as the athletic meet, travel, and wedding mentioned above are greatly different from the shooting opportunities for movies and dramas. In other words, at an athletic meet, travel, wedding, etc., if an event to be photographed is missed, re-shooting may be impossible or very difficult. For example, at a wedding, a cake sword is a one-time event, and it is impossible to re-photograph just because the cake sword is missed. For this reason, when an event to be photographed is missed, there arises a problem that data for constituting a video that the user wants to create according to the theme is insufficient.

  With respect to such a problem, the above-mentioned Patent Document 2 discloses a technique for generating and allocating complementary data when there is no video data to be allocated corresponding to the template. The complementary data is, for example, video data for displaying a message indicating that there is no corresponding video. According to this technique, content in accordance with the theme of the video selected by the user can be created by generating complementary data in place of the video of the event that was missed.

JP 2006-93795 A JP 2001-320666 A

  However, the conventional techniques as described above have the following problems. That is, the complementary data used as a substitute for the video of an event that has been missed is information indicating the absence of the corresponding video, and therefore does not necessarily conform to the video theme selected by the user. For this reason, there is a possibility that a video created using such complementary data is different from a video in line with the theme (story) expected by the user.

  The present invention has been made in view of the above problems, and provides a video processing apparatus that can generate a video according to a user's desired theme even when an event is missed. Objective.

  In order to achieve the above object, the video processing apparatus of the present invention does not associate video with theme holding means for holding theme information in which information on a plurality of events to be photographed specifies the context between events. An event time estimating means for estimating the shooting time of the event, and a video extracting means for extracting a video that matches the estimated time by the event time estimating means are provided.

  According to the video processing device of the present invention, in a video processing device that generates video in accordance with a theme from video data shot in multiple times along a theme selected by a user, information on a plurality of events to be captured is an event. By holding theme information with specified context, estimating the shooting time of events that are not associated with video, and extracting video that matches the estimated shooting time, there are events that have been missed. Even in such a case, it is possible to generate a moving image according to the theme.

It is a block diagram which shows the internal structure of the video processing apparatus in the 1st Example of this invention. It is a block diagram which shows the external appearance of the video processing apparatus in 1st Example of this invention. It is a figure which shows GUI at the time of start operation in the theme imaging | photography mode of the video processing apparatus in 1st Example of this invention. It is an example of the theme data utilized with the video processing apparatus in 1st Example of this invention. It is a figure which shows GUI at the time of imaging | photography operation in the theme imaging | photography mode of the video processing apparatus in 1st Example of this invention. It is an example of the imaging | photography data utilized with the video processing apparatus in 1st Example of this invention. It is a flowchart for demonstrating operation | movement of the video processing apparatus in 1st Example of this invention. It is a flowchart for demonstrating the event estimation process of the video processing apparatus in the 1st and 4th Example of this invention. It is a figure which shows GUI at the time of the reproduction | regeneration processing of the video processing apparatus in 1st Example of this invention. It is a figure which shows GUI at the time of the selection process of the image | video extracted by the video processing apparatus in 1st Example of this invention. It is an example of the reproduction | regeneration list | wrist produced | generated by the video processing apparatus in 1st Example of this invention. It is an example of the output screen at the time of reproduction | regeneration of the video processing apparatus in 1st Example of this invention. It is a block diagram which shows the internal structure of the video processing apparatus in the 2nd Example of this invention. It is a figure for demonstrating the proximity network in the 2nd Example of this invention. It is an example of the reproduction | regeneration list | wrist produced | generated by the video processing apparatus in 2nd Example of this invention. It is a block diagram which shows the internal structure of the video processing apparatus in the 3rd Example of this invention. It is an example of the reproduction | regeneration list | wrist produced | generated by the video processing apparatus in the 3rd Example of this invention. It is a block diagram which shows the internal structure of the video processing apparatus in the 4th Example of this invention. It is an example of the theme data utilized with the video processing apparatus in the 4th example of the present invention. It is an example of the video data stored in the video processing apparatus in 4th Example of this invention. It is a flowchart for demonstrating operation | movement of the video processing apparatus in the 4th Example of this invention. It is a figure which shows GUI at the time of the selection process of the image | video of the video processing apparatus in 4th Example of this invention. It is an example of the video list produced | generated by the video processing apparatus in the 4th Example of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[Example 1]
In the first embodiment, a case where the video processing apparatus according to the present invention is a digital video camera capable of generating video in accordance with the theme by shooting according to the theme information selected by the user will be described as an example. To do.

<Device description>
FIG. 1 shows an example of the configuration of a video processing apparatus 100 to which the present invention can be applied. In FIG. 1, a CPU 101, a memory 102, a nonvolatile memory 103, an imaging unit 104, an image processing unit 105, a display unit 106, an operation unit 107, a recording medium I / F 108, an external I / F 110, and a communication I are connected to an internal bus 150. / F111 and RTC113 are connected.

  Each unit connected to the internal bus 150 can exchange data with each other via the internal bus 150.

  The memory 102 is composed of, for example, a RAM (a volatile memory using a semiconductor element).

  The CPU 101 controls each unit of the video processing apparatus 100 using the memory 102 as a work memory, for example, according to a program stored in the nonvolatile memory 103.

  The nonvolatile memory 103 stores video data, audio data, other data, various programs for operating the CPU 101, and the like. The nonvolatile memory 103 is composed of, for example, a hard disk (HD) or ROM.

  The imaging unit 104 converts video (light) into an electrical video signal based on the control of the CPU 101, and outputs the video signal to the internal bus 150. The imaging unit 104 includes, for example, an optical lens unit, an optical system that controls aperture, zoom, focus, and the like, and an imaging element that converts light (video) introduced through the optical lens unit into an electrical video signal. Composed. In general, a CMOS image sensor (CMOS image sensor) using a CMOS or a CCD image sensor (CCD image sensor) using a CCD is used as the image sensor.

  Based on the control of the CPU 101, the image processing unit 105 includes video data stored in the nonvolatile memory 103 and the recording medium 108, a video signal output from the imaging unit 104, a video signal acquired via the external I / F 109, Various image processing is performed on video data acquired via the communication I / F 111. The image processing performed by the image processing unit 104 includes A / D conversion processing, D / A conversion processing, video data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), noise reduction processing, and color conversion. Processing, face detection processing, and the like. The image processing unit 104 may be configured with a dedicated circuit block for performing specific image processing.

  Further, depending on the type of image processing, the CPU 101 can perform image processing according to a program without using the image processing unit 104.

  Based on the control of the CPU 101, the display unit 106 displays an image, a GUI screen configuring a GUI (Graphical User Interface), and the like. The display unit 106 includes, for example, a liquid crystal display device (LCD) and an LCD driver unit that controls the liquid crystal display device (LCD). The CPU 101 generates a display control signal according to a program, and controls each unit of the video processing apparatus 100 so as to generate a video signal to be displayed on the display unit 106 and output it to the display unit 106.

  The display unit 106 displays a video based on the output video signal. The video processing apparatus 100 itself may include an interface for outputting a video signal to be displayed on the display unit 105, and the display unit 105 may be configured with an external monitor (such as a television).

  The operation unit 107 is an input device for accepting user operations including buttons, dials, joysticks, touch panels, and the like. Note that the touch panel is an input device that is configured to overlap with the display unit 106 and to output coordinate information corresponding to the touched position.

  The storage medium I / F 108 can be loaded with a recording medium 109 such as a memory card or a hard disk drive. Under the control of the CPU 101, data can be read from the loaded recording medium 109 and data can be written to the recording medium 109. I do.

  The external I / F 110 is an interface that is connected to an external device by a wired cable or wirelessly to input / output a video signal or an audio signal.

  The communication I / F 111 is an interface for communicating with an external device, the Internet 112, and the like to transmit and receive various data such as files and commands. The RTC 113 is a real-time clock that is a clock function, and the CPU 101 uses the RTC 113 to recognize the time.

  FIG. 2 is a view showing the appearance of a digital video camera which is a video processing apparatus according to an embodiment of the present invention. 2A corresponds to a front view, FIG. 2B corresponds to a rear view, and FIG. 2C corresponds to a side view.

  Reference numeral 201 denotes an optical lens, which is a unit that constitutes the imaging unit 104. Reference numeral 202 denotes an LCD (Liquid Crystal Display) having a touch panel function, and the subject image is displayed while the video is being shot, so that the shot video can be confirmed. It is also used for shooting range before starting shooting, for displaying an operation menu described later, and for playing back and displaying shot video data. The touch panel function allows a user to input arbitrary coordinates on the LCD 202 to the digital video camera by touching the screen of the LCD 202. This is used to operate a GUI displayed on the LCD 202.

  The display function of the LCD 202 is the display unit 106, and the touch panel function constitutes a part of the operation unit 107. Reference numerals 203 to 213 denote buttons, dials, and joysticks for the user to operate, and constitute the operation unit 107. Reference numeral 203 denotes a joystick having a push button in the center, and the user can input in any direction including up, down, left, and right, and can select by pressing the button. This can be used to operate a GUI displayed on the LCD 202.

  Reference numeral 204 denotes a function button, and the user can display an operation menu on the LCD 202 by pressing this button. The operation menu is used, for example, when setting shooting parameters such as resolution and compression rate of video data to be recorded, or selecting video data that has already been shot and displaying it on the LCD 202.

  Reference numeral 205 denotes a playback / pause button. The user can start or pause playback by pressing this button when playing back captured video data. The reproduced video data is displayed on the LCD 202 or output to an external device via a connector 303 described later. Note that this button can also be used for instructing start / stop of shooting, similar to a shooting start / stop button 212 described later.

  Reference numeral 206 denotes a fast reverse button, which is used for rewinding the moving image being played by the play / pause button 205. If this button is pressed during pause, slow reverse playback is performed. During shooting, by pressing this button, zoom-out (wide angle) can be performed in the same manner as the left alignment of the zoom lever 210 described later.

  A fast-forward button 207 is used to fast-forward the moving image being played by the play / pause button 205. If this button is pressed during pause, slow playback is performed. During shooting, by pressing this button, zooming in (telephoto) can be performed in the same way as when the zoom lever 210 is right-justified.

  Reference numeral 208 denotes a stop button, which is used to stop the moving image being played by the play / pause button 205. During shooting, pressing this button can be used to instruct backlight correction for automatically adjusting the brightness (exposure). Reference numeral 209 denotes a power button, which turns on / off the power of the digital video camera. Reference numeral 210 denotes a zoom lever, which is a lever-like button that can be shifted left and right. Zoom in (wide angle) by moving this zoom lever to the left side during shooting and zoom in (telephoto) by moving it to the right side.

  Reference numeral 211 denotes a mode dial which can change the operation mode of the digital video camera by rotating. The operation mode includes four modes of a moving image shooting mode, a still image shooting mode, a moving image playback mode, and a still image playback mode. Reference numeral 212 denotes a start / stop button, which is used to instruct start and stop of moving image shooting. Reference numeral 213 denotes a photo button, which is used to instruct shooting of a still image when the mode dial 211 is in the still image shooting mode. The photo button 213 is a two-stage push-in switch that can be detected by the user by distinguishing between a half-pressed state and a fully-pressed state, and starts autofocus control when in the half-pressed state, and is stationary when in the fully-pressed state. A shooting operation for shooting image data is started.

  Reference numeral 214 denotes a memory card slot for mounting a memory card which is a detachable recording medium. Video data obtained by the digital video camera is recorded on a memory card mounted in the memory card slot. . Reference numeral 214 denotes a unit constituting the storage medium I / F 108.

  Reference numeral 215 denotes an HDMI (registered trademark) mini-output connector which is used to output video of the digital video camera to an external device. For example, when a high-resolution television provided with an HDMI (registered trademark) input connector is connected with an HDMI (registered trademark) cable, a high-definition video can be enjoyed on a large screen. Reference numeral 215 denotes a unit constituting the external I / F 110.

  A USB connector 216 is used to connect various devices such as a printer, a personal computer, and a disc writer using a USB cable. For example, when connected to a printer, if the printer is compatible with PictBridge (registered trademark), a still image captured by the digital video camera can be printed by the printer. When connected to a personal computer, moving image data and still image data in the digital video camera can be copied (backed up) to the personal computer. Conversely, moving picture data and still picture data on a personal computer can be returned in the digital video camera as follows. Reference numeral 216 denotes a unit constituting the communication I / F 111.

<Description of operation>
The operation of the video processing apparatus according to the present invention in this embodiment will be described with reference to FIGS. Here, the operation in the theme shooting mode in which shooting is performed in accordance with the theme will be described first, and then the reproduction process which is a characteristic operation of the present invention will be described.

  First, the operation in the theme shooting mode will be described. FIG. 3 is a diagram for explaining the operation in the theme shooting mode. The CPU 101 displays the GUI screen of FIG. 3A on the display unit 106 and prompts the user to select a shooting mode. When the user operates the operation unit 107 to select the theme shooting mode as the shooting mode, the CPU 101 displays the screen in FIG. The screen in FIG. 3B is a theme selection screen for selecting theme data used in the theme shooting mode. The user selects theme data to be used by operating the operation unit 107. The theme data is data that designates events to be photographed together with the context (shooting order), and is held in the nonvolatile memory 103.

  FIG. 4 is an example for explaining the theme data. The theme data is a collection of shooting event data including a combination of “shooting order 401”, “shooting event name 402”, “face detection 403”, and “playback order 404”. A legend 405 indicates the meaning of the contents described in the shooting order 401. A legend 406 indicates the meaning of the contents described in the face detection 403. In this example, the wedding theme includes 10 shooting event data, and the order of the shooting events is designated as the shooting order 401. For example, a shooting event “a congratulatory message from a guest” is an event that can occur at any time (capable of shooting) because the shooting order is “F”.

  In addition, since the shooting order “Cheers” has the shooting order “1-2”, the “bride and groom admission” event with the shooting order “1” and the “cake sword” event with the shooting order “2”. It is an event that can occur between. Similarly, in the shooting event “Bride and Groom Greeting”, the shooting order is “3”, so the “cake entry” event in the shooting order “2” and the “leave the bride and groom” event in the shooting order “4”. Events that can occur between

  FIG. 5 is a diagram for explaining the shooting operation in the theme shooting mode. The CPU 101 displays the GUI screen of FIG. 5A on the display unit 106, and when the user who prompts the user to select a shooting event selects the shooting event by operating the operation unit 107, the CPU 101 displays FIG. ) Is displayed on the display unit 106. The screen in FIG. 5B is an example of a preview screen displayed on the display unit 106 when shooting the selected shooting event. On the screen of FIG. 5B, the image by the imaging unit 104 is displayed as a preview image as 501, and a message for prompting shooting of the shooting event selected on the screen of FIG.

  In addition, an icon representing that shooting is being performed and shooting is stopped is overlaid as indicated by reference numeral 503. The user determines the subject and composition according to the message displayed as in 502, and operates the operation unit 107 to perform shooting. Data generated by shooting is stored in the nonvolatile memory 103.

  FIG. 6 is an example for explaining data photographed in the theme photographing mode (wedding theme). The shooting data in the theme shooting mode is a collection of event moving image data including a combination of “shooting start time 601”, “moving image length 602”, “event name 603”, and “event moving image file”. In this example, as the theme shooting mode, a shooting event is selected and shooting is performed 12 times. For example, the data in the first row is taken as an “atmosphere of the venue” event for 11 seconds from 12:00:10 on November 22, 2010, and the video is 00001.10. It indicates that the file name is mts.

  Next, reproduction processing by the video processing apparatus of the present invention will be described in detail with reference to the flowcharts of FIGS. In the description of these flowcharts, the wedding theme data shown in FIG. 4 and the shooting data of FIG. 6 are used as specific data examples.

  In step S <b> 700, the CPU 101 determines whether the user has made a selection to reproduce a video shot along the theme. 9A and 9B show examples of GUIs that the CPU 101 displays on the display unit 106 at this time. The user operates the operation unit 107 to select what kind of reproduction is to be performed on the GUI in FIG. 9A. When the user selects the theme playback mode, the CPU 101 groups the videos shot in the theme shooting mode according to the respective themes and displays them as shown in FIG. 9B. In FIG. 9B, when the user selects any theme video, the process proceeds to step S701.

  In step S701, the CPU 101 clears a reproduction list that manages information of moving image data to be reproduced. The reproduction list will be described in detail in step S711 described later.

  In step S702, the CPU 101 reads the theme data (FIG. 4) of the theme selected in FIG. 9B, and sequentially selects shooting events to be processed in steps S703 to S711 described later. The selection order at this time follows the reproduction order defined by the theme data (column 404 in FIG. 4). According to the wedding theme data in FIG. 4, “atmosphere of the venue” event in the first process, “reception” event in the second process, “congratulations from guest” event in the third process ,···become that way.

  In step S703, the CPU 101 acquires information of the shooting data (FIG. 6) corresponding to the theme selected in step S701 from the nonvolatile memory 103, and whether or not event moving image data corresponding to the event selected in step S702 exists. Determine. If the corresponding event video data exists, the process proceeds to step S711, and if not, the process proceeds to step S704. For example, when the “atmosphere at the venue” event is selected as the event in step S702, the event moving image data corresponding to FIG. 6 exists, and the process proceeds to step S711. On the other hand, if the “cheers” event, “cooking introduction” event, and bride and groom greetings event are selected as events in step S702, the event video data does not exist, and the process proceeds to step S704.

  In step S704, the CPU 101 estimates the time when the event selected in step S702 has occurred. This estimation process will be described in detail with reference to the flowchart of FIG.

  In FIG. 8, in step S801, the CPU 101 determines what shooting order is defined in the theme data (FIG. 4) for the event selected in step S702. If the shooting order of the event is “numerical value”, go to step S802, if “numeric value N−numerical value M”, go to step S806, and if “F”, go to step S813. move on. First, processing for an event whose shooting order is “numerical value” will be described in steps S802 to S805.

  In step S <b> 802, the CPU 101 acquires from the nonvolatile memory 103 the event in which the shooting order is before the event selected in step S <b> 702 and the shooting is actually performed and the event moving image data. For example, in the case where the “Bride and groom greeting” event whose shooting order is “3” is selected in step S702, the “cake sword (shooting order: 2)” event “toast (shooting order) whose shooting order is the previous one is selected. : 1-2) Event video data of the event “Bride and groom admission (shooting order 1)” event is acquired, and event video data that started shooting at the latest time is selected. In this example, event video data (605) of the “cake sword” event of FIG. 6 is acquired as the previous event information.

  In step S803, the CPU 101 calculates the event shooting end time from the event moving image data acquired in step S802, and sets the time as the estimated start time of the event selected in step S702. For example, if event video data of the “cake entered” event is acquired in step S802, the estimated start time of the event selected in step S702 is 2010/11/22 13:33:30.

  In step S <b> 804, the CPU 101 acquires from the nonvolatile memory 103 the event in which the shooting order is later with respect to the event selected in step S <b> 702, and the event that was actually shot and its event moving image data. For example, in the case where the “bridal bride and groom greeting” event whose shooting order is “3” is selected in step S702, event video data of the “leave the bride and groom (shooting order: 4)” event whose shooting order is later is acquired. Event video data that started shooting at the latest time is selected. In this example, the event moving image data (606) of the “bride and groom leaving” event of FIG. 6 is acquired as event information immediately after.

  In step S805, the CPU 101 acquires the event shooting start time from the event moving image data acquired in step S804, and sets the time as the estimated end time of the event selected in step S702. For example, assuming that event moving image data of the “leave the bride and groom” event is acquired in step S804, the estimated end time of the event selected in step S702 is 2010/11/22 14:15:00.

  As described above, the CPU 101 can estimate the shooting time of the event selected in step S702. For example, when the “Bride and Groom Greeting” event is selected in step S702, the estimated time of this event is 2010/11/22 13:33:30 to 14:15:00.

  Next, processing for an event whose shooting order is “numerical value N−numerical value M” will be described using steps S806 to S812. In step S <b> 806, the CPU 101 acquires from the nonvolatile memory 103 the event in which the shooting order is before the event selected in step S <b> 702 and the shooting is actually performed and the event moving image data. For example, if a “Cheers” event with a shooting order of “1-2” is selected in step S702, event video data of the “bride and groom admission (shooting order: 1)” event with the shooting order preceding is acquired. To do. When a plurality of events are applicable, event moving image data that has started shooting at the latest time is selected. In this example, the event moving image data (607) of the “bride and groom admission” event of FIG. 6 is acquired as the immediately preceding event information.

  In step S807, the CPU 101 calculates the event shooting end time from the event moving image data acquired in step S806, and sets the time as the estimated start time of the event selected in step S702. For example, assuming that event moving image data of the “bride and groom entrance” event is acquired in step S806, the estimated start time of the event selected in step S702 is 2010/11/22 13:02:20.

  In step S <b> 808, the CPU 101 acquires from the nonvolatile memory 103 the event in which the shooting order is later with respect to the event selected in step S <b> 702, and the event that was actually shot and its event moving image data. For example, if a “Cheers” event whose shooting order is “1-2” is selected in step S702, a “cake entry (shooting order: 2)” event, “Bride and groom greeting ( Shooting order: 3) Event video data of the event “Bride and groom exit (shooting order: 4)” event is acquired, and event video data that started shooting at the latest time is selected. In this example, the event moving image data (605) of the “cake sword” event of FIG. 6 is acquired as event information immediately after.

  In step S809, the CPU 101 acquires the event shooting start time from the event moving image data acquired in step S808, and sets the time as the estimated end time of the event selected in step S702. For example, if event video data of the “cake entered” event is acquired in step S808, the estimated end time of the event selected in step S702 is 2010/11/22 13:30.

  In step S810, the CPU 101 acquires all event moving image data of shooting data (FIG. 6) in the theme shooting mode from the nonvolatile memory.

  In step S811, the CPU 101 determines whether another event has been shot in the theme shooting mode between the estimated start time and the estimated end time determined in steps S807 and S809. If another event has been shot, the process proceeds to step S812. If no other event has been photographed, the period consisting of the times determined in steps S807 and S809 is set as the estimated time of the event selected in step S702.

  In step S812, the estimated time of the event selected in step S702 is obtained by excluding the period in which the event moving image data related to other events is taken from the period determined by steps S807 and S809.

  As described above, the CPU 101 can estimate the shooting time of the event selected in step S702. For example, when the “Cheers” event is selected in step S702, the estimated time of this event is 2010/11/22 13:02:20 to 13:30.

  Next, processing of an event whose shooting order is “F” will be described using steps S813 to S816.

  In step S813, the CPU 101 acquires, from the nonvolatile memory 103, event moving image data of an event shot at the oldest time among shooting data (FIG. 6) in the theme shooting mode. For example, when the “cooking introduction” event whose shooting order is “F” is selected in step S702, event video data (608) of the “venue atmosphere” event is acquired as the top event according to the data of FIG.

  In step S <b> 814, the CPU 101 acquires, from the nonvolatile memory 103, event moving image data of an event shot at the latest time among shooting data (FIG. 6) in the theme shooting mode. For example, when the “dishes introduction” event whose shooting order is “F” is selected in step S702, event video data (606) of the “leave the bride and groom” event is acquired as the final event according to the data of FIG.

  In step S815, the CPU 101 determines a period during which shooting was performed in the theme shooting mode from the first event and the last event acquired in steps S813 and S814. For example, when the event video data of the “atmosphere of the venue” event is acquired in step S813 and the event video data of the “leave the bride and groom” event is acquired in step S814, the shooting period is 2010/11/22 12:00:10. 14:17:50.

  In step S816, the CPU 101 acquires all event moving image data of the shooting data (FIG. 6) in the theme shooting mode from the nonvolatile memory, and excludes the period in which the event moving image data was shot from the shooting period determined in step S815. Is the estimated time of the event selected in step S702. In the example of FIG. 6, the estimated time is 2010/11/22 12:00:21 to 12:10:06, 2010/11/22 12:10:11 to 12:15:33, ..., 2010/11. / 22 It is a plurality of periods such as 14:00:20 to 14:15:00.

  The above is the description of the process for estimating the shooting time of the event selected in step S702. Returning to FIG. 7, in step S705, the CPU 101 determines whether the shooting time of the event selected in step S702 has been obtained by the processing in step S704 (FIG. 8). If one or more periods can be calculated as the estimated event time, the process proceeds to step S706 as a successful estimation, and if the estimated event time cannot be obtained, the process proceeds to step S712 because the estimation has failed.

  In step S706, the CPU 101 accesses the storage medium 109 via the storage medium I / F 108, and extracts video (still image or moving image) data stored in the storage medium 109 by a two-stage process.

  The first stage of processing is extraction of video data based on the shooting time. Video data shot within the estimated time obtained in step S704 is extracted. The second stage processing is extraction based on the presence or absence of face detection. In the second stage process, the CPU 101 uses the image processing unit 105 to acquire the presence / absence of face detection in the video data extracted by the first stage process. Next, in the theme data (FIG. 4), the value of the face detection term of the event selected in step S702 is acquired. Then, from the video data extracted in the first stage processing, when the face detection term value is “Yes”, the face detected video data is used. When the face detection term value is “None” Extracts video data for which no face has been detected, and extracts all video data if the value of the face detection term is “−”.

  In step S707, the CPU 101 displays the video data information extracted in step S706 on the display unit 106 as a GUI. The GUI is composed of thumbnail images of the extracted video data, shooting date / time, moving image still image type, and the like. FIG. 10 shows an example of the GUI. The user operates the operation unit 107, browses the information of the video data extracted in step S706, and selects video data suitable for the event selected in step S702 (in the example of FIG. 10, “bridal groom greeting” event). can do.

  In step S708, the CPU 101 determines whether or not the user has selected one or more video data presented in step S707. If the user has selected video data, the process proceeds to step S709; otherwise, the process proceeds to step S712.

  In step S709, the CPU 101 determines whether still image data is included in the video data selected by the user. If still image data is included, the process proceeds to step S710; otherwise, the process proceeds to step S711.

  In step S710, the CPU 101 generates moving image data based on still image data included in the video data selected by the user. Specifically, it is converted into moving image data that sequentially displays a plurality of still image data at intervals (slide show), or scrolls (digital pan / tilt) while displaying a part of the still image data. Or convert it to video. The CPU 101 stores the generated moving image data in the nonvolatile memory 103.

  In step S711, the CPU 101 obtains “the captured video data acquired in step S703”, “moving image data selected by the user in step S706”, and “moving image data extracted in step S706 and generated from the still image selected by the user. To the playlist. The order of adding to the play list may be the order of shooting times.

  FIG. 11 shows an example of a play list generated by the series of processes shown in FIG. This reproduction list corresponds to the example of the theme data in FIG. 4 and the example of the shooting data in FIG. In the reproduction list of FIG. 11, moving image data is added to the reproduction list according to the reproduction order 403 of the theme data. In the example of the shooting data in FIG. 6, the “Cheers” event, “Cooking introduction” event, and “Bride and groom greeting event” are not included (not shot). Video data acquired from a recording medium is used (1101 to 1104). In this example, reference numerals 1101 and 1104 denote moving image data in an external storage medium, and reference numerals 1102 and 1103 denote moving image data generated in step S710 from still image data in the external storage medium.

  In step S712, the CPU 101 selects whether or not all shooting events in the theme data (FIG. 4) have been selected in step S702. In the example of FIG. 4, if the “leave the bride and groom” event is selected in step S702, it means that all the shooting events have been selected. If all shooting events have been selected in step S702, the reproduction list updated in step S711 is completed, and the process proceeds to step S713. On the other hand, if there is an unselected shooting event, the process returns to step S702 to process the next shooting event.

  In step S713, the CPU 101 acquires the moving image data from the nonvolatile memory 103 or the storage medium 109 according to the reproduction list generated in step S711. The CPU 101 decodes the acquired image data in cooperation with the image processing unit 105 and displays the decoded data on the display unit 106. Further, it may be output from the external I / F 110 as a video signal.

  FIG. 12 is an example of a video that is decoded and displayed. In the video processing apparatus according to the present embodiment, the video is displayed as described above, and the character string 1201 linked to the shooting event name is overlaid and displayed, so that the video to be reproduced can have a story.

  In the present embodiment, an example is shown in which a playlist is created and video data is sequentially played according to the playlist. However, no new playlist is provided, and new video data in which video data is linked is generated in step S711. The moving image data may be reproduced in step S713.

  By performing such processing, for example, when shooting according to wedding theme data, even if you forget to take a certain shooting event, for example, by using the recording medium of a friend who was present You can easily get video data of events that you forgot to take and get videos that match the theme.

  As described above, according to the present embodiment, the information on a plurality of events to be photographed holds the theme information in which the context between events is specified, and the estimated shooting time of the event not associated with the video is estimated. By extracting a video that matches the shooting time from the attached storage medium, it is possible to provide a video processing device that generates a moving image according to a theme even when there is an event that has been missed.

[Example 2]
In the second embodiment, as in the first embodiment, a digital video camera capable of generating a video according to a theme by shooting according to the theme information selected by the user will be described.

  The difference from the first embodiment is that the video data is acquired by the proximity communication means. In the description of the present embodiment, the configuration and operation different from those of the first embodiment will be mainly described.

<Device description>
FIG. 13 shows an example of the configuration of a video processing apparatus 1300 to which the present invention can be applied. In FIG. 13, reference numerals 1301 to 1310 and 1313 to 1350 are the same as 101 to 110 and 113 to 150 in FIG. The communication I / F 1311 is an interface for communicating with other nearby devices via the proximity network 1312 and transmitting / receiving various data such as files and commands. Specifically, it is a communication unit that realizes communication such as wireless LAN (IEEE802.11a / b / g / n) or Bluetooth (registered trademark).

  FIG. 14 shows an example (schematic diagram) of a proximity network. Reference numeral 1401 denotes a video processing apparatus according to the present invention. The video processing apparatus 1401 communicates with surrounding digital cameras 1402 and 1403 and a notebook PC 1404 via a proximity network 1450.

<Description of operation>
The operation of the video processing apparatus in the present embodiment will be described based on the difference from the first embodiment. In the second embodiment, the reproduction process operates based on the flowcharts of FIGS. 7 and 8 as in the first embodiment.

  The difference from the first embodiment is the operations in step S706, step S711, and step S713 in FIG. In other steps, it can be applied to the second embodiment by replacing 101 to 110 with 1301 to 1310, respectively.

  Hereinafter, steps S706, S711, and S713 will be described. In step S706 in the second embodiment, the CPU 1301 accesses another device on the proximity network 1312 via the communication I / F 1311 and uses the video (still image or moving image) data stored in each device as in the first embodiment. Similarly, extraction is performed by a two-stage process.

  In step S711 in the second embodiment, the CPU 1301 updates the reproduction list in the same manner as in step S711 in the first embodiment. FIG. 15 shows an example of a playlist generated by a series of processes. Unlike the first embodiment, an address that identifies a device on a neighboring network may be used as a storage location (1501 and 1502).

  In step S713 in the second embodiment, the CPU 1301 acquires moving image data from another device on the proximity network 1312 via the nonvolatile memory 1303 or the communication I / F according to the reproduction list generated in step S711. The CPU 1301 decodes the acquired image data in cooperation with the image processing unit 1305 and displays it on the display unit 1306. Further, it may be output from the external I / F 1310 as a video signal.

  By performing such processing, for example, when shooting according to wedding theme data, even if you forget to take a shooting event, the video data of the event you forgot to take from a surrounding camera or personal computer You can get a video according to the theme.

  As described above, according to the present embodiment, the information on a plurality of events to be photographed holds the theme information in which the context between events is specified, and the estimated shooting time of the event not associated with the video is estimated. By extracting a video that matches the shooting time from other peripheral devices, it is possible to provide a video processing device that generates a moving image according to a theme even when there is an event that is missed.

[Example 3]
In the third embodiment, as in the first embodiment, a digital video camera capable of generating a video according to a theme by shooting according to the theme information selected by the user will be described.

  The difference from the first embodiment is that video data is acquired from a server on the Internet by communication means. In the description of the present embodiment, the configuration and operation different from those of the first embodiment will be mainly described.

<Device description>
FIG. 15 shows an example of the configuration of a video processing apparatus 1500 to which the present invention can be applied. In FIG. 15, reference numerals 1501 to 1513 and 1550 are the same as 101 to 113 and 150 of FIG. The GPS 1514 is a unit that receives a signal from a GPS (Global Positioning System) satellite and calculates geographical information such as latitude, longitude, and altitude. The CPU 1501 can access the GPS 1514 via the internal bus 1550 and acquire the current location of the video processing device 1500.

<Description of operation>
The operation of the video processing apparatus in the present embodiment will be described based on the difference from the first embodiment. In the third embodiment, the reproduction process operates based on the flowcharts of FIGS. 7 and 8 as in the first embodiment.

  The difference from the first embodiment is the operations in step S706, step S711, and step S713 in FIG. In other steps, 101 to 110 can be read as 1501 to 1510, respectively, and can be applied to the third embodiment.

  Hereinafter, steps S706, S711, and S713 will be described. In step S706 in the third embodiment, the CPU 1501 accesses a server on the Internet via the communication I / F 1511, and extracts video (still image or moving image) data from the server through three stages of processing.

  The extraction process in the first stage and the second stage is performed according to the estimated time and presence / absence of face detection as in the first embodiment. In the third embodiment, the third stage extraction process is further performed using the position information acquired from the GPS 1514. Specifically, based on the position information (current value information) acquired from the GPS 1514, the position information of the video data (information indicating the shooting location called geotag) is compared, and the two position information are within a predetermined distance ( For example, video data that is within 100 m is extracted. For this distance, a GUI for selecting the distance may be displayed on the display unit 1506 and specified by the user.

  Note that the server that acquires the video may be determined based on the position information acquired from the GPS 1514. In this case, for example, if the position information acquired by the GPS 1514 is in the wedding hall, the video is obtained by accessing a server provided by the wedding hall.

  In step S711 in the third embodiment, the CPU 1501 updates the reproduction list in the same manner as in step S711 in the first embodiment. FIG. 17 shows an example of a playlist generated by a series of processes. Unlike the first embodiment, information (a host name or the like) for specifying a server may be used as a storage location (1701 and 1702).

  In step S713 in the third embodiment, the CPU 1501 acquires moving image data from the server via the nonvolatile memory 1503 or the communication I / F according to the reproduction list generated in step S711. The CPU 1501 decodes the acquired image data in cooperation with the image processing unit 1505 and displays the decoded data on the display unit 1506. Further, it may be output from the external I / F 1510 as a video signal.

  By performing such processing, for example, when shooting according to wedding theme data, even if you forget to take a shooting event, video data shot at a nearby location from a server on the Internet. You can get and get a video according to the theme.

  As described above, according to the present embodiment, the information on a plurality of events to be photographed holds the theme information in which the context between events is specified, and the estimated shooting time of the event not associated with the video is estimated. By extracting a video that matches the shooting time from the server, it is possible to provide a video processing device that generates a moving image according to a theme even when there is an event that has been missed.

[Example 4]
In the fourth embodiment, the video processing apparatus according to the present invention is an authoring apparatus in which a user can create content such as a DVD or a Blu-ray disc by selecting video data according to a theme (template). I will explain.

<Device description>
FIG. 18 shows an example of the configuration of a video processing apparatus 1800 to which the present invention can be applied. In FIG. 18, the CPU 1801, the memory 1802, the non-volatile memory 1803, the image processing unit 1804, the display I / F 1805, the operation unit 1807, the recording unit 1808, the storage medium I / F 1810, the external I / F 1812, communication with respect to the internal bus 1850 An I / F 1813 and an RTC 1815 are connected.

  Each unit connected to the internal bus 1850 can exchange data with each other via the internal bus 1850.

  The memory 1802 is composed of, for example, a RAM (a volatile memory using a semiconductor element). The CPU 1801 controls each unit of the video processing apparatus 1800 using the memory 1802 as a work memory, for example, according to a program stored in the nonvolatile memory 1803. The nonvolatile memory 1803 stores video data, audio data, other data, various programs for the CPU 1801 to operate, and the like. The non-volatile memory 1803 is composed of, for example, a hard disk (HD) or ROM.

  Based on the control of the CPU 1801, the image processing unit 1804 acquires video data stored in the nonvolatile memory 1803 and the recording medium 1811, a video signal acquired via the external I / F 1812, and a communication I / F 1813. Various image processing is performed on video data. Image processing performed by the image processing unit 1804 includes A / D conversion processing, D / A conversion processing, video data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), noise reduction processing, and color conversion. Processing, face detection processing, and the like. The image processing unit 1804 may be configured by a dedicated circuit block for performing specific image processing. Also, depending on the type of image processing, the CPU 1801 can perform image processing according to a program without using the image processing unit 1804.

  The display I / F unit 1805 displays an image, a GUI (Graphical User Interface) screen, and the like on the external display device 1806 based on the control of the CPU 1801. The display I / F 1805 includes, for example, a video driver unit that outputs a video signal to the outside and a frame buffer.

  The display device 1806 is a device that displays a received video signal as a visual image. For example, a liquid crystal display or a CRT is used. The CPU 1801 controls each unit of the video processing apparatus 1800 including the display I / F 1805 so as to generate a display request and display data according to the program and display the display request and display data on the display apparatus 1806. The display I / F 1805 outputs a video signal to the display device 1806 based on the control and data, and the display device 1806 displays a video according to the received video signal. Note that the video processing apparatus 1800 itself may include a display device 1806 built in the video processing apparatus 1800.

  The operation unit 1807 is an input device for accepting user operations including buttons, a keyboard, a mouse, a touch panel, and the like. Note that the touch panel is an input device that is configured to overlap with the display device 1806 and is configured to output coordinate information according to the touched position.

  The recording unit 1808 is a device for recording video data on a recording medium 1809 used for recording video such as a DVD or a Blu-ray disc. For example, a recordable DVD drive or a recordable Blu-ray disc drive is equivalent.

  The storage medium I / F 1810 can be loaded with a recording medium 1811 such as a memory card or a hard disk drive, and reads data from the loaded recording medium 1811 and writes data to the recording medium 1810 under the control of the CPU 1801. I do. The external I / F 1812 is an interface that is connected to an external device by a wired cable or wirelessly and inputs / outputs a video signal and an audio signal.

  It is an interface for communicating with a communication I / F 1813, an external device, the Internet 1814, etc., and transmitting / receiving various data such as files and commands. The RTC 1815 is a real-time clock that is a clock function, and the CPU 1801 uses the RTC 1815 to recognize the time.

<Description of operation>
The operation of the video processing apparatus of the present invention in this embodiment will be described based on the diagrams and flowcharts of FIGS. Here, first, an example of theme data (template) and video data stored in advance in the nonvolatile memory 1803 will be described, and authoring processing which is a characteristic operation of the present invention will be described.

  FIG. 19 is an example for explaining the theme data (template). The theme data is a collection of event data composed of combinations of “configuration order 1901”, “event name 1902”, “face detection 1903”, and “assumed shooting order 1904”. A legend 1905 indicates the meaning of the contents described in the face detection 1903. A legend 1906 indicates the meaning of the contents described in the assumed shooting order 1904. In this example, a wedding theme (template) is composed of 10 event data. For each event, an assumed shooting order is specified as an assumed shooting order 1904.

  For example, an event “celebration from a guest” is an event that can occur at any time (can be photographed) because the assumed shooting order is “F”. In addition, since the assumed shooting order of the event “Cheers” is “1-2”, the “bride and groom admission” event of the assumed shooting order “1” and the “cake entry” of the assumed shooting order “2”. It is an event that can be filmed between events. Similarly, for the event “Bride and Groom Greeting”, the assumed shooting order is “3”, so the “cake entry” event in the assumed shooting order “2” and the “bride and groom exit” in the assumed shooting order “4”. An event that can be filmed between events.

  FIG. 20 is an example for explaining video data stored in the nonvolatile memory 1803. The video data stored in the non-volatile memory 1803 is a collection of event moving image data including a combination of “shooting start time 2001”, “moving image length 2002”, “event name 2003”, and “file name 2004”. In this example, twelve pieces of video data are stored in the nonvolatile memory. For example, the data in the first row is an image taken as an “atmosphere of the venue” event for 11 seconds from 12:00:10 on November 22, 2010. This indicates that the file is stored with the file name mts.

  Note that the event name may be assigned to the event moving image data by a mechanism that is given by the imaging device at the time of shooting, or a mechanism that is given by the user using the operation unit 1807 in the video processing apparatus of the present embodiment. It is good.

  Next, the authoring process by the video processing apparatus of the present invention will be described in detail with reference to FIG. 21 and FIG. In the explanation of these flowcharts, wedding theme data shown in FIG. 19 and video data in the nonvolatile memory 1803 shown in FIG. 20 are used as specific data examples.

  In step S2101, the CPI 1801 determines whether or not the user has selected theme data (template) when starting authoring. The theme data is selected by the CPU 1801 displaying a selection GUI on the display device 1806 via the display I / F 1805 and the user operating the operation unit 1807.

  In step S2102, the CPU 101 clears the moving image list for managing content generated by authoring. The video list will be described in detail in step S2114 described later. In step S2103, the CPU 1801 reads the theme data (FIG. 19) selected in step S2101 and sequentially selects events to be processed in steps S2104 to S2114 described later. The selection order at this time follows the configuration order defined in the theme data (column 1901 in FIG. 19).

  When the wedding theme data in FIG. 19 is selected, the “atmosphere at the venue” event is performed in the first process, the “reception” event is performed in the second process, and the “congratulations from guest” event is performed in the third process. ,···become that way. In step S2104, the CPU 1801 determines whether event moving image data corresponding to the event selected in step S2103 exists in the nonvolatile memory 1803. If the corresponding event moving image data exists, the process proceeds to step S2105. Otherwise, the process proceeds to step S2107.

  In step S2105, the CPU 1801 displays information on the event moving image data corresponding to the event selected in step S2103 as a GUI on the display device 1806 via the display I / F 1805. The GUI is composed of thumbnail images, shooting date and time of event moving image data corresponding to the event. FIG. 22A shows an example of the GUI. The user operates the operation unit 1807, browses the information of the video data corresponding to the event, and selects event video data appropriate for the event (in the example of FIG. 22A, “congratulations from the guest” event). can do.

  In step S2106, the CPU 1801 determines whether or not the event moving image data selected in step S2103 in step S2105 has been selected. If event video data is selected, the process proceeds to step S2114. If not selected, the process proceeds to step S2115. Steps S2107 to S2113 are processing when event moving image data corresponding to the event selected in step S2103 is not stored in the nonvolatile memory 1803 by the processing of step S2104.

  In step S2107, the CPU 1801 estimates the time when the event selected in step S2103 has occurred. The flowchart of FIG. 8 can be applied to this estimation process.

  The processing in FIG. 8 is equivalent to the processing described in the first embodiment. The processing of FIG. 8 according to the first embodiment is described by replacing step S702 with step S2103, CPU 101 with CPU 1801, nonvolatile memory 103 with nonvolatile memory 1803, FIG. 6 with FIG. 20, and 601 to 608 with 2001 to 2008. The present embodiment can be applied.

  Returning to FIG. 21, in step S2108, the CPU 1801 determines whether or not the shooting time of the event selected in step S2103 has been obtained by the process of step S2107 (FIG. 8). If one or more periods can be calculated as the estimated event time, the process proceeds to step S2109 as a successful estimation, and if the estimated event time cannot be obtained, the process proceeds to step S2115 because the estimation has failed.

  In step S2109, the CPU 1801 accesses the storage medium 1811 via the storage medium I / F 1810, and extracts video (still image or moving image) data stored in the storage medium 1811 by a two-stage process. The first stage of processing is extraction of video data based on the shooting time, and video data shot within the estimated time obtained in step S2107 is extracted. The second stage processing is extraction based on the presence or absence of face detection. In the second stage process, the CPU 1801 uses the image processing unit 1804 to acquire the presence / absence of face detection in the video data extracted by the first stage process.

  Next, in the theme data (FIG. 19), the value of the face detection term of the event selected in step S2103 is acquired. Then, from the video data extracted in the first stage processing, when the face detection term value is “Yes”, the face detected video data is used. When the face detection term value is “None” Extracts video data for which no face has been detected, and extracts all video data if the value of the face detection term is “−”.

  In step S2110, the CPU 1801 displays the information of the video data extracted in step S2109 as a GUI on the display device 1806 via the display I / F 1805. The GUI is composed of thumbnail images of the extracted video data, shooting date / time, moving image still image type, and the like. FIG. 22B shows an example of the GUI. The user operates the operation unit 1807, browses the information of the video data extracted in step S2109, and the video suitable for the event selected in step S2103 (the “bride and groom greeting” event in the example of FIG. 22B). Data can be selected.

  In step S2111, the CPU 1801 determines whether the user has selected one or more video data presented in step S2110. If the user selects the data in the video, the process proceeds to step S2112. If not, the process proceeds to step S2115. In step S2112, the CPU 1801 determines whether still image data is included in the video data selected by the user. If still image data is included, the process proceeds to step S2113. If not, the process proceeds to step S2114.

  In step S2113, the CPU 1801 generates moving image data based on still image data included in the video data selected by the user. Specifically, it is converted into moving image data that sequentially displays a plurality of still image data at intervals (slide show), or scrolls (digital pan / tilt) while displaying a part of the still image data. Or convert it to video. The CPU 1801 stores the generated moving image data in the nonvolatile memory 1803.

  In step S2114, the CPU 1801 “captured video data acquired in step S2105” “moving image data extracted in step S2109 and selected by the user” “moving image data extracted in step S2109 and generated from the still image selected by the user. Are sequentially added to the video list. FIG. 23 is an example of a video list generated by the series of processes in FIG. This video list corresponds to the example of theme data in FIG. 19 and the example of video data stored in the nonvolatile memory 1803 in FIG. In the video list of FIG. 23, video data is added to the video list in accordance with the composition order 1901 of the theme data.

  In the example of the video data in FIG. 20, the “Cheers” event, “Cooking introduction” event, and “Bride and groom greeting event” are not included (not stored). Video data acquired from a recording medium is used (2301 to 2304). In this example, 2301 and 2304 represent moving image data in an external storage medium, and 2302 and 2303 represent moving image data generated in step S2113 from still image data in the external storage medium.

  In step S2115, the CPU 1801 selects whether or not all events in the theme data (FIG. 19) have been selected in step S2103. In the example of FIG. 19, if the “leave the bride and groom” event is selected in step S2103, it means that all shooting events have been selected. If all shooting events have been selected in step S2103, it is determined that the video list updated in step S2114 has been completed, and the process advances to step S2115. On the other hand, if there is an unselected event, the process returns to step S2103 to process the next event.

  In step S2116, the CPU 1801 acquires moving image data from the nonvolatile memory 1803 or the storage medium 1811 according to the video list generated in step S2144, and generates data corresponding to the content to be created. For example, data in a DVD-Video format or Blu-ray (registered trademark) Disc format is generated. In step S2117, the CPU 1801 writes the data created in step S2116 into the recording medium 1809 using the recording unit 1808.

  By performing such processing, for example, when content is authored according to wedding theme data, even when there is a shortage of video data of an event, for example, a recording medium of a friend who was present at the event By using it, it is possible to obtain video data of a lacking event and obtain video in line with the theme.

  As described above, according to the present embodiment, the information on a plurality of events to be photographed holds the theme information in which the context between events is specified, and the estimated shooting time of the event not associated with the video is estimated. By extracting a video that matches the shooting time from the attached storage medium, it is possible to provide a video processing device that generates a moving image according to a theme even when there is an event that has been missed.

[Other Examples]
In the third embodiment, the GPS is used to acquire the position information. However, the present invention is not limited to this, and the position information is acquired by the input by the user or the position information is determined from the IP address. Also good.

  In the third embodiment, the current position information of the video processing apparatus is used as the position information used for the extraction process in the third stage of step S706, but the present invention is not limited to this. For example, position information (geotag) of video data added to the reproduction list immediately before may be used.

  In the third embodiment, the CPU 1501 performs the three-stage extraction process in step S706. However, the present invention is not limited to this, and the CPU 1501 transmits information necessary for the extraction process to the server, and the extraction result is sent to the server. You may make it the structure which acquires from.

  In the fourth embodiment, the video is extracted from the storage medium. However, the present invention is not limited to this, and the video data is obtained from peripheral devices and the Internet as in the second and third embodiments. May be extracted.

  The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program code. It is a process to be executed. In this case, the program and the storage medium storing the program constitute the present invention.

100 video processing apparatus, 101 CPU (event time estimation means, video extraction means), 102 memory, 103 non-volatile memory (theme holding means), 104 imaging unit,
105 image processing unit, 106 display unit, 107 operation unit, 108 storage medium I / F, 109 storage medium, 110 external I / F, 111 communication I / F,
112 External network, 113 RTC, 150 Internal bus

Claims (12)

Theme holding means for holding theme information in which information of multiple events to be photographed specifies the context between events;
Event time estimation means for estimating the shooting time of an event with no associated video;
An image processing apparatus comprising: an image extracting means for extracting an image that matches the estimated time by the event time estimating means. Video acquisition means for acquiring the video extracted by the video extraction means;
The video processing apparatus according to claim 1, further comprising: a video generation unit configured to generate a video by associating the video acquired by the video acquisition unit with an event not associated with the video. Video selection means capable of selecting one or more videos among the videos extracted by the video extraction means;
The video processing apparatus according to claim 2, wherein the video acquisition unit acquires the video selected by the video selection unit. A moving image converting means for converting one or more still image data into moving image data;
4. The video processing apparatus according to claim 2, wherein when the video acquired by the video acquisition means is still image data, the still image data is converted into moving image data. A recording medium connecting means for mounting the recording medium in a readable state;
5. The video processing apparatus according to claim 1, wherein the video extraction unit is capable of extracting a video from a recording medium attached to the recording medium connecting unit. Proximity communication means for communicating with neighboring devices,
The video processing apparatus according to claim 1, wherein the video extraction unit can extract a video from a device that can communicate with the proximity communication unit. Network communication means for connecting to an Internet network system;
The video processing apparatus according to claim 1, wherein the video extraction unit can extract a video from a server that can communicate with the network communication unit. Position information acquisition means for acquiring position information of the video processing device,
The video processing apparatus according to claim 7, wherein the video extraction unit extracts a video from a server corresponding to the position information acquired by the position information acquisition unit. Position information acquisition means for acquiring position information of the video processing device,
8. The video processing apparatus according to claim 7, wherein the video extraction unit extracts a video from a video group corresponding to the position information acquired by the position information acquisition unit. Comprising object detection means for determining whether or not a specific object is included in the video;
The theme information held by the theme holding means includes information on whether or not shooting of a specific object is performed in each event,
If the event whose shooting time was estimated by the event time estimation means was an event that shot a specific object,
The video extracting means extracts a video that matches the estimated time by the event time estimating means and that is determined by the object detecting means to contain the specific object. The video processing device according to any one of claims 9 to 9. Comprising object detection means for determining whether or not a specific object is included in the video;
The theme information held by the theme holding means includes information on whether or not shooting of a specific object is performed in each event,
If the event whose shooting time is estimated by the event time estimation means is an event that does not shoot a specific object,
The video extraction means extracts a video that matches the estimated time by the event time estimation means and that is determined by the object detection means to not contain the specific object. The video processing apparatus according to claim 10. 12. The video processing apparatus according to claim 10, wherein the specific object means a person, and the object detection unit detects whether the person is included in the video.