JP4451620B2 - Imaging device with guidance function and editing device - Google Patents

Description

  The present invention relates to an imaging data editing apparatus, and more particularly to an editing apparatus having a function of digest editing imaging data.

  A moving image picked up by a photographing device such as a digital video camera is difficult to understand if it is raw data, and it is highly likely that the degree of completion as one work is low. Therefore, the moving image data captured by the digital video camera is transferred to a personal computer (PC) in which application software for video editing (hereinafter referred to as “video editing software”) is installed in advance, and the user edits the video editing software. In general, the video data transferred in accordance with the instruction from the video editing software is edited.

  Also, a video game device for creating a video clip composed of music and video using music material and video material given during the game, displaying a time memory indicating the performance time of the music, It has a control means for displaying a marking designation screen for performing marking processing for designating a cut split. In this marking designation screen, when the start of marking is instructed by the player, music for the video clip starts playing, As the music progresses, the specified markings on the time memory are given, and the player selects the desired video material in the cut unit specified by the player, thereby creating a video clip corresponding to the music in the cut unit. Video game devices that can be played are also proposed (patent text) Reference 1).

Japanese Patent Laid-Open No. 11-306373

  The technique described in Patent Document 1 is for creating a video clip composed of music and video using music material and video material given during the game.

  In addition, the method of once editing the video data after transferring the video data to the PC is cumbersome operation, and whether the video data necessary for editing is included in the shot video data. It is easy to happen that the necessary scenes have not been shot since the time of editing.

  By the way, when editing shooting data of a certain event, it is preferable that an outline of a certain event (so-called digest version) can be edited in addition to a general data editing method. In particular, since moving image data tends to have a large amount of data as a whole, it is very convenient if an overview of an event can be made a single work in data communication using e-mail or a mobile phone.

  An object of the present invention is to provide a technique for easily editing a digest version of moving image data. Furthermore, the present invention is characterized in that it provides a shooting technique capable of shooting in a format that facilitates digest editing during shooting.

  According to one aspect of the present invention, a storage device that can be associated with an editing device for editing shooting data, and is shot according to a shooting guidance presented and divided into a plurality of shooting data for each scene. A shooting data storage area for storing data and a guidance file attached to each of the divided shooting data, and storing a guidance file associated with the divided shooting data There is provided a storage device characterized in that information relating to priority in editing the shooting data is added to the divided shooting data.

  The priority added with respect to the divided photographing data can be used as an index when performing digest editing.

  At this time, it is preferable to determine the number of shooting scenes or shooting time or the number of scenes included in editing or the time of works included in editing based on the priority.

  According to another aspect of the present invention, a guidance file that is photographed along the presented photographing guidance and that is attached to each of the photographing data divided for each scene and associated with the divided photographing data. A second step of analyzing the acquired guidance file and acquiring a priority for each scene defined in the guidance file, and a priority acquired in the second step And a third step of editing the divided shooting data based on the shooting data editing method.

  The third step is characterized in that the divided photographing data is edited so that the reproduction time of the photographing data is within a time determined by a work.

  By using the above method, a video clip that has been digest-edited for a desired time can be created.

  Video data shot based on a certain guidance rule can be easily edited by using this guidance rule. In this case, the digest version can be easily edited by weighting the shooting scene.

  The digest editing technology according to the present invention is based on the premise that there is a possibility that digest editing will be performed in advance at the time of shooting. This is a technology that automatically performs digest editing. A video camera system capable of shooting and recording moving images and still images has a guidance function for starting recording after selecting a guidance in accordance with the shooting environment at the time of shooting. The guidance may be text information, audio information, or any information (marker) that can be understood by the photographer as to the contents to be executed. The photographer refers to the guidance, and successively performs an operation of recording information according to the instruction, and the photographing according to the guidance is completed.

  The guidance data may be stored in a device that is different from a storage device that stores moving image data captured by the video camera, or may be stored in a storage device that stores the captured data. In consideration of cooperation with an editing apparatus that can interpret the guidance data and edit the shooting information stored based on the guidance data, the latter is preferable. This is because shooting information and guidance data used at that time are already stored in the storage device. Therefore, since the entire data can be moved at the same time as editing, editing can be performed quickly.

  In addition, the shooting data and the guidance data used at the time of shooting are preferably stored in association with 1: 1. By maintaining the conditions regarding the 1: 1 correspondence, it is possible to perform advanced automatic editing using guidance data. In order to quickly perform automatic editing, a so-called removable slot from which the storage device can be removed can be added to the photographing apparatus side. In addition, it is preferable that the slot is also provided on the editing apparatus side.

  By satisfying the above conditions, a set of shooting data and guidance data can be instantaneously moved between apparatuses. Since the editing device can perform editing processing using the above storage device, the time required for data transfer itself is almost equal to the time for replacing the storage device, compared to the technology for transferring data between different devices. Efficient data transfer is possible.

  Hereinafter, an automatic editing technique including a digest editing technique according to the present embodiment will be described with reference to the drawings. First, the guidance-equipped photographing apparatus will be briefly described. The user selects a scene to be photographed or a photographing scene candidate close to it from among a plurality of typical photographing scene candidates prepared in advance, and provides guidance by the selected photographing scene candidate. The user only needs to shoot according to the guidance provided by the selected shooting scene candidate. FIG. 1 is a functional block diagram illustrating a configuration example of a video camera with a guidance function.

  As shown in FIG. 1, the photographing apparatus A with a guidance function includes a camera unit 1, a camera signal processing unit 3, a recording / playback signal processing unit 5, an I / O processing unit 7, and a graphics (Graphics) process. Unit 11, a control unit (MPU) 15, a memory 17 including a memory 17 and a ROM 17 a for storing application programs, and a communication control unit 21. The communication control unit 21 is provided to perform data transfer with another device based on a standard such as USB or IEEE1394.

  Furthermore, the imaging device A with a guidance function according to the present embodiment includes a storage device 31 that is associated with the I / O processing unit 7 via, for example, the general-purpose bus 50. The storage device 31 is provided, for example, so as to be detachable from other parts of the photographing device A with a guidance function, and includes a guidance file storage area (region) 33, a user-defined guidance file storage area (region) 35, and photographing data. And a storage area (area) 37. The storage device may be built in the photographing apparatus A.

  The photographed video signal (optical signal) is converted into an electrical signal through a lens provided in the camera unit 1, a CCD solid-state imaging device (not shown), and the like, and signal processing including digitization is performed in the camera processing unit 3. Is called. The video signal generated by the signal processing is subjected to data compression by a necessary codec in the recording / reproduction signal processing unit 5 and written into the photographing data storage area 37 of the storage device 31 via the I / O processing unit 7. Also for the audio signal, the analog signal is digitized, compressed by a necessary codec, and synchronized with the video signal system by the I / O processing unit 7 and written in the shooting data storage area 37 of the storage device 31.

  When a user selects a desired guidance related to an event to be shot before shooting, guidance such as a GUI (Graphic User Interface) or voice is appropriately presented at the start of shooting, and shooting is performed according to the presented guidance. To start. A detailed GUI will be described later in the embodiment.

  A plurality of guidance files are stored in the guidance file storage area 33 in the guidance file used for the guidance function that is a feature of the photographing apparatus with the guidance function according to the present embodiment. Based on the importance of the scene in the event for each event, information on the priority or importance is added to the guidance file for each scene. For example, in the case of a reception, it is stored in the guidance file storage area in a state where the priority order of a scene such as a candle service is set high. Although the priority order has a default value for each event, the user may be able to change the order.

  FIG. 2 is a diagram illustrating an example of a guidance sequence. With reference to FIG. 1 as well, for example, a case where the event is an athletic meet will be described as a more specific example of the shooting sequence. As the guidance sequence, shooting guidance is advanced along the sequence so that typical scenes in athletic meet 1 to 11 shown below are shot. The above priorities 1 to 5 are exemplified by () after the number of each scene.

1 (2). Opening scene: Guidance example “Please select the opening screen from the following”. On the other hand, the user selects a favorite opening screen.
2 (3). Shooting scene 1: Guidance example “Please shoot the gate of the athletic meet for about 5 seconds”. On the other hand, the user photographs the vicinity of the athletic meet gate. The period of 5 seconds may be used as a guide, or the apparatus may set a period of time for photographing to 5 seconds (shooting 1).
3 (4). Photographing scene 2: Guidance example “Please photograph the opening scene appropriately”. On the other hand, actual shooting is performed (shooting 2).
4 (2-1). Shooting scene 3-1: Guidance example “Please shoot related programs in order”. On the other hand, actual shooting is performed (shooting 3-1).
5 (2-2). Shooting scene 3- *: Guidance example “Shoot related programs in order”. In contrast, actual shooting is performed (shooting 3 *).
6 (2-3). Shooting scene 3-n: Guidance example “Please shoot related programs in order”. On the other hand, actual shooting is performed (shooting 3n).
7 (5). Shooting scene 4: Guidance example “Please shoot a lunch break scene”. On the other hand, actual shooting is performed (shooting 4).
8 (2-4). Shooting scene 5-1: Guidance example “Please shoot related programs in order”. On the other hand, actual shooting is performed (shooting 3-1).
9 (2-5). Shooting scene 5- *: Guidance example “Shoot related programs in order”. On the other hand, actual shooting is performed (shooting 5- *).
10 (2-6). Shooting scene 5-n: Guidance example “Shoot related programs in order”. On the other hand, actual shooting is performed (shooting 5-n).
11 (1). Shooting scene 6: Guidance example “Please shoot the award ceremony” In response to this, shooting is actually performed (shooting 6).

  The respective guidance timings from 1 to 11 are automatically assembled based on, for example, the time when shooting is started and time information from a clock built in the video camera. In the sequence shown in FIG. 2, for example, a user operation such as opening selection is added, and a user-defined guidance file is newly created instead of a standard guidance file.

  The presented guidance and the photographing data photographed along the guidance are stored in the storage device 31 in association with 1: 1. The user data definition file area is an area for filing user data arbitrarily defined by the user in addition to the standard guidance file. Since priority information is added to each scene, when performing digest editing in later automatic editing, whether or not to include the scene in the work, if so, it will be a guide when deciding the time .

  Next, the automatic editing technique will be described with reference to the drawings. FIG. 3 is a diagram showing a schematic configuration of the automatic editing system according to the present embodiment, and the photographing apparatus with a guidance function shown in FIG. 1 is used. It is a figure which shows the structural example of the automatic editing system using the guidance file and imaging | photography data produced along the sequence shown in FIG. As described above, the moving image data photographed using the guidance function is stored in the storage device 31 that can be removed from the photographing device A. However, as shown in FIG. A slot (not shown) from which 31 (preferably the same as the storage device 31 in FIG. 1) can be removed is provided. FIG. 3 shows a state in which the storage device 31 is removed from the photographing device and the storage device 31 is inserted into the slot of the editing device B. In FIG. 3, the storage device (2) 55 connected to the general-purpose bus 12 is provided, but may be omitted depending on the situation such as cost. Here, the description will be made on the assumption that the storage device (2) 55 is provided.

  In the editing apparatus B shown in FIG. 3, the process executed by the editing process program stored in the memory 43 for the guidance file group stored in the guidance file storage area 33 in the storage device 31 inserted in the slot. Then, through the graphics processing unit 53, the thumbnail information of the icon group or character string group of the guidance data file used for editing and the photographing data file group synchronized therewith is displayed on a display unit (not shown). From the displayed thumbnail information, for example, the guidance of “athletic meeting” taken at this time is selected, and an editing start button (not shown) is pressed, so that the optimum editing based on the guidance of “athletic meeting” is performed. However, the total editing time or other factors desired by the user are preferably set in advance before pressing the editing start button.

  The guidance file is linked with a group of resource data files necessary for editing. These resource data file groups are stored in advance in any storage device. If the above-mentioned factors are set, information in the guidance file is read in consideration of these factors, and editing processing is performed by a series of sequences.

  FIG. 4 is a flowchart showing the flow of automatic editing processing. As shown in FIG. 4, first, in step S21, an editing recorder (editing device) recognizes a storage device (in this case, a hard disk drive HDD) 31 that stores data photographed by a photographing device (video camera). Next, in step S22, a guidance file stored in the guidance file storage area 33 in the storage device 31 is selected based on, for example, a plurality of displayed icons, and the selected guidance file is read. In step S23, the guidance file is verified. If the guidance files match, as shown in step S30, the editing program corresponding to the selected guidance file and the shooting data to be edited are set in the editing program.

  At this time, the selected guidance file is analyzed in step S24, and it is determined in step S25 whether there is user-defined data in the guidance file. If there is no user definition file, it is determined whether there is a link to resource data in the guidance file. If it is determined in step S26 that there is no resource link in the guidance file, the process proceeds to step S27 to perform automatic editing (guide editing) based on the guidance. Further, editing may be performed in consideration of the above-described priority (importance).

  If there is user-defined data in the guidance file in step S25, the process proceeds to step S31, data is set in the editing program data area, and the process proceeds to step S27. If it is determined in step S26 that there is a resource link in the guidance file, data is set in the editing program data area, and the process proceeds to step S27.

  After automatically editing the digest version of the photographic data using the guidance and the priority in step S27, the format is converted in step S28 and saved (copied) in, for example, a DVD-R / RW in step S29. Alternatively, the edited digest version data is directly stored in the internal HDD or the like from step S27. In addition, after format conversion, it can be stored as data in MPEG-4.

  As described above, in the digest version automatic editing technology according to the present embodiment, the priority (importance) of each scene is determined for each event, so that editing can be performed while referring to the priority. .

  Hereinafter, the flow of the entire process including the imaging technique and the editing technique of the present invention will be described in detail with reference to the drawings while illustrating the user interface.

  First, at the time of shooting, as shown in FIG. 5 (a), a menu that allows selection of either new guidance shooting or continued guidance shooting is displayed. FIG. 5A is a diagram showing a state in which “new guidance shooting” is selected from the menu. Then, as shown in FIG. 5B, for example, “Athletic meet, travel note, reception, movie style, 4-frame comic” is displayed as an event that is a guidance candidate. FIG. 5B is a diagram showing a state in which “athletic meet” is selected from these menus.

  This screen lists the scenes required for the “athletic event”. As a result, it is possible to prevent forgetting to take a necessary scene. Here, the guidance of the subject suitable for each scene, and the shooting time and the number of cuts are guided. Thereby, the user can know what is more effective when photographing. On this screen, “Guidance suitable for shooting athletic meet and athletic meet. It consists of“ Intro ”,“ Opening ”,“ Interval ”and“ Ending ”scenes. "Is provided.

  FIG. 6A is a diagram illustrating a state in which “sports day” is selected in the shooting guidance and an “opening” scene is selected. In this example, “It will be the first scene of the video clip. Please take a picture of the venue and the date and time. For example, a gate with the name of the event, a schedule table, etc. If you forget to shoot, you may shoot the date of the newspaper later, it will be enough substitute material, and then you can shoot additional interviews (such as enthusiasm) to the contestants Please take a photo of about 1 to 3 cuts with a length of about 5 to 10 seconds. ”

  FIG. 6B is a diagram showing a state in which the “interval” scene is selected. In this example, “Please take a picture of a scene between lunch and competition. A cameraman may also participate in the conversation together as an interview. When shooting a conversation scene, connect an external microphone. If you do, the voice will be recorded clearly. Note that this scene will be cut by the automatic editing digest editing. " In other words, in conjunction with automatic editing, it is guided to be cut depending on the selection of automatic editing. As mentioned above, such announcements are presented based on the importance of the scene.

  Next, an example of a user interface relating to automatic editing for the athletic meet will be shown. FIG. 7 is a diagram showing a state in which the above-described shooting result is selected from editing, which prompts the user to select “digest editing” or “video editing” for the video shot with the “athletic meeting” guidance. It is a figure which shows a state. In the case of digest editing, there is a guide that the image is created using a part of the shooting scene. The display content on the screen shows an example of an outline of processing actually performed in this automatic editing. If digest editing is executed as it is, automatic editing starts.

In this case, the editing apparatus performs editing based on a script (data describing a processing procedure) in which editing rules of “athletic meet” and “digest edit” are described. At that time, scene selection is performed based on the importance of the scene. For example, the following procedure is described in the script.
1: Select the first scene of the intro, cut 4 seconds, and add it to the edit list.
2: Select the first scene of the opening, cut 4 seconds, and add it to the edit list.
3: From the competition, scenes with high audio levels are cut every 8 seconds for 8 scenes and added to the edit list in order of shooting time.
4: Add an opening animation (title) to the top of the edit list.
5: Add an ending animation to the end of the edit list.
6: Information on the shooting date recorded in the competition scene is used for the caption of the date to be superimposed on the opening animation.
7: Add BGM to the whole story.
8: The resulting video is compressed with the MPEG-4 codec (to make the amount of data that can be sent by e-mail).

  Based on the above script, automatic editing is performed, and a digest version of the video work of tens of seconds is completed. If the device has a configuration capable of recording on a memory card such as an SD card, the work can be recorded on the memory card. Further, if a communication device capable of directly transmitting an e-mail is provided, it can be sent as it is attached to the e-mail. Table 1 is a table showing the flow of more specific digest editing processing.

  Next, an example where “banquet” is selected as an event in the shooting guidance will be described. FIG. 8A is a diagram illustrating a state where “candle” is selected as the shooting scene at the reception. In this case, for example, “Let's shoot a scene of a candle service, one of the events of the reception. When editing automatically, the bright part of the dark scene is emphasized as in the left sample. “Image light is applied.” Is displayed. As described above, in conjunction with automatic editing, it is possible to add video effects, BGM, and sound effects according to the shooting scene.

  In addition, when adding a video effect, it is possible to help the photographer understand by displaying a reduced image as in this example. In addition to displaying a reduced image, it is also possible to play a sample animation, or to play a sample sound if it is a sound effect or BGM.

  FIG. 8B is a diagram showing a state where “4-frame comic” is selected in the shooting guidance. In this case, for example, a scene that corresponds to the “approval” of the “conversion” is shot. Please take a picture so that you can receive "Ki". Is displayed. A typical example of how to assemble a story is the order of “starting up and down”, but it is not always necessary to shoot in that order for cooperation with automatic editing. For example, even if “Yu” is photographed first, it can be edited as the last scene in automatic editing.

FIG. 9A is a diagram illustrating an example of automatically editing data captured based on the “travel” guidance in automatic editing. On this screen, one of video editing, DVD (menu for each date), and DVD (menu for each location) can be selected. For example, when a DVD (Menu for each date) is selected, a menu for each date is created so that it can be viewed for each date. As a result, the user can sensuously know the shooting target of the day. Automatic editing for video equipment such as a DVD with a menu for each scene and chapter (in the case of a movie, a DVD that introduces the main part, making, and casting) in addition to a video along a single time axis It can be performed. The same applies when creating a homepage on the Web instead of a DVD. If it is a travel note, it automatically creates a menu for each shooting date and a menu for each shooting location. If digest editing is executed here, automatic editing starts. Automatic editing is performed based on a script (data describing a processing procedure) in which editing rules of “travel” and “DVD (menu for each date) editing” are described. For example, the following procedure is described in the script.
1: The scenes recorded in the opening are connected in time series and set to the first in the DVD menu.
2: The scenes recorded on the trip are grouped by date according to the shooting start time.
3: Connect in time series within each date group, and set as a DVD menu for each date.
4: The scenes recorded in the ending are connected in time series and set at the end of the DVD menu. Based on the above script, DVD editing with an opening ending and a menu for each date becomes possible.

  Next, an example of processing when a part of a necessary scene is not photographed will be described with reference to FIG. Depending on the type of guidance, all scenes need to be shot. For example, in the case of a “four-frame comic” with a change in order, if all four scenes are not complete, editing cannot be performed as intended by the guidance. As described above, when there is a scene that is insufficient at the time of automatic editing, it is possible to prevent omission of shooting of the scene by displaying a warning and prompting shooting as shown in FIG. 9B. In the guidance where it is not necessary to have all the scenes, this check process is unnecessary.

  As shown in FIG. 10A or 10B, the third embodiment is an example in which shooting is continuously performed from previously shot shooting data (guidance shooting in FIG. 5A). ). In actual shooting, there are few cases where continuous shooting is performed at one time, but there are many cases where interruptions occur. At this time, when the date is changed, there are cases where it is more effective to include a scene indicating that the date has been changed depending on an object to be photographed. For example, a case such as a travel record is applicable. Therefore, when the shooting is resumed, the current time is compared with the last shooting time, and if the date has changed, a message prompting the user to take a video indicating that is displayed. As a result, it is possible to prevent forgetting to take the material and to make a video that is easy to understand even for amateurs.

  Furthermore, for devices equipped with a positioning system such as GPS, the same advice ("The shooting location seems to have changed. Indicates that the location has changed." By displaying “What if you want to shoot a thing?”), You can prevent forgetting to take the material and create a video that makes it easy for amateurs to understand the location.

  As described above, the present invention has been described according to the embodiments or examples, but the present invention is not limited to these examples, and various modifications can be made. For example, the video camera can be replaced with a digital still camera, a normal camera, a mobile terminal such as a mobile phone or a PDA.

It is a functional block diagram showing an example of composition of an imaging device with a photography guidance function for creating animation data edited in an automatic editing device according to an embodiment of the present invention. It is a sequence diagram which shows an example of imaging | photography guidance. It is a block diagram which shows the structural example of the automatic edit system using the guidance file by this Embodiment. It is a flowchart figure which shows the flow of the automatic edit process by this Embodiment. FIG. 5A and FIG. 5B are diagrams illustrating an example of presentation of guidance in the first embodiment. It is a figure following FIG. FIG. 10 is a diagram illustrating a selection screen for editing processing according to the first embodiment. FIG. 10 is a diagram illustrating an example of presentation of guidance in the second embodiment. FIG. 9A is a process selection screen in video editing, and FIG. 9B is a diagram showing a warning display example regarding a four-frame cartoon. FIG. 10A is a guidance display example when shooting is continued, and FIG. 10B is a diagram showing a guidance display example when the date changes.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Camera part, 3 ... Camera signal processing part, 5 ... Recording / reproduction | regeneration signal processing part, 7 ... I / O processing part, 12 ... General-purpose bus, 31 ... Memory | storage device, 33 ... Guidance file storage area (area | region), 35 ... User-defined guidance file storage area (area), 37 ... shooting data storage area (area), 41 ... MPU, 43 ... memory, 47 ... disk storage device, 51 ... I / O processing section, 53 ... graphics (Graphics) Processing unit, 55 ... second storage device, 61 ... communication control unit.

Claims (5)

A camera unit;
A guidance file storage area that stores a plurality of guidance files that provide shooting guidance by the camera unit, a user-defined guidance file storage area that stores a user-defined guidance file that is a guidance file added by a user operation,
A storage device having a shooting data storage area for storing shot data that has been shot and divided by the camera unit along the guidance file,
The importance level of each scene is defined for each event in the guidance file, and data taken along the guidance corresponding to each scene in the guidance file is divided in association with the scene and taken data. As a result, the importance of the scene associated with each photographed data is added as a result.   The photographing apparatus with a guidance function according to claim 1, wherein the importance is information including the number of photographing scenes or photographing time. An editing device for performing a digest edit of the photographed data stored in the photographing data storage area of the photographing device with a guidance function according to claim 1 or 2,
An editing apparatus that performs digest editing of the divided photographed data in consideration of high importance. When resuming shooting after interruption, when resuming shooting from the shooting data shot before the interruption, the current time is compared with the last shooting time, and the date has changed. 3. The photographing apparatus with a guidance function according to claim 2 , wherein a message prompting the user to shoot a video indicating that is displayed. Furthermore, when a positioning system is installed and resuming shooting after a shooting interruption, the shooting location has changed and the location has changed only when the change in the shooting resumption position from the previous shooting stop position is large. 3. The photographing apparatus with a guidance function according to claim 2 , wherein prompting the photographing of the object to be displayed is displayed.

Images