JP2009232325A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically perform relating of scenes in an imaging apparatus which creates scenario data before a take of film shooting and performs automatic editing, on the basis of the scenario data. <P>SOLUTION: An imaging apparatus comprises: a camera unit that captures a video image and outputs the video image together with a camera-setting parameter in image capturing; a scenario data holding means for holding scenario data containing a shooting condition, for each shooting scene created beforehand; a scene-specifying means for determining the shooting condition in shooting, based on the camera-setting parameter and comparing the determined shooting condition, with the shooting condition for each shooting scene in the scenario data to associate a closest shooting scene with a video image; and a recording unit for recording on a recording medium the information made to associate with the shooting scene and the video image associated by the scene-specifying means. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, a camera recorder, and an editing system that create scenario data before actual shooting and automatically edit a video shot based on the scenario data.

  In recent years, devices for recording video and audio data as files on a randomly accessible recording medium such as an optical disk or a semiconductor memory have become common. For example, such a recording is also used in broadcasting stations and video production companies. Video editing work or the like is performed using an editing device provided with a medium.

  Conventionally, filming of movies, TV dramas, and the like has been performed based on scenarios created based on storyboards. A scenario has a title (name) and is composed of a plurality of scenes. A scene is composed of a plurality of cuts. The director performs according to the scenario, and actors such as actors, actresses, and extras perform according to the description of the scenario, and shooting is performed according to the shooting conditions (for example, camera parameter settings, camera position, orientation, etc.). Done. In live performances, concerts, etc., we will shoot what was performed in the order of the scenes shown in the scenario. Lectures and weddings are taken in advance according to a predetermined schedule in accordance with the progress of lectures and weddings. On the other hand, in movies, dramas and the like, it is rare that shooting is performed in the order of the scenes indicated in the scenario.

Based on these backgrounds, there is a technique (for example, Patent Document 1) that inputs scenario data that is scenario information at the time of shooting including shooting contents, dialogue, shooting number, etc. before shooting, and performs shooting guidance according to the scenario data. It is disclosed. On the other hand, digitized scenario data related to shooting is created, and by selecting a scene in the scenario data and shooting, the created scenario data is recorded in association with the shot taken as take metadata. A technique (for example, Patent Document 2) that uses scenario data from a planning process to an editing process is disclosed.
JP 2006-174318 A JP 2004-187275 A

  However, in the conventional configuration disclosed in Patent Document 2, the user inputs scenario data before shooting, and at the start of shooting, the scene to be shot from the scenario data input before shooting must be selected. There is a problem that it is troublesome at the time of shooting.

  In view of the above problems, an imaging apparatus according to the present invention aims to facilitate the input of scenario data and automatically associate the scenario data with the captured video data in order to reduce the user's shooting load. .

  In order to solve the above-described problems, the imaging apparatus of the present invention holds a scenario data including a camera unit that captures an image and outputs it together with camera setting parameters at the time of imaging, and shooting conditions for each shooting scene that are created in advance. A scenario data holding means, a shooting condition at the time of shooting based on camera setting parameters, and a scene specifying means for associating the closest shooting scene with a video by comparing with shooting conditions for each shooting scene in the scenario data; A recording unit that records information on the association between the shooting scene associated with the scene specifying unit and the video on a recording medium;

  According to the imaging apparatus of the present invention, when associating scenario data and video data, the apparatus can automatically select a scene without selecting a scene, thereby reducing the burden on the user when shooting. . Further, for example, by adding a captured video data identifier including a shooting condition to the scenario data, the captured video data and the scenario data are associated with each other so that the captured video data can be searched from the scenario data. As a result, it is possible to improve the efficiency of the editing work such as automatically arranging the scenes in order and not taking in unnecessary scene data.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram of an imaging apparatus according to an embodiment of the present invention. In the present embodiment, a camera unit that captures an image of a subject, and a video image captured by the camera unit is recorded on a recording medium as encoded video data that is compression-encoded, and the encoded video data recorded on the recording medium is reproduced. An example of a camera recorder having a recording / reproducing device for recording will be described. Such a camera recorder is a device intended for business use intended for video production companies and the like, and is used for interviews and the like at shooting sites. For example, video data and audio data (hereinafter collectively referred to as material data) generated by shooting with the camera recorder at the shooting site are recorded on a recording medium detachable from the camera recorder. Further, in the editing room, editing work is performed using a plurality of material data recorded on the recording medium.

  As shown in FIG. 1, a camera recorder as an imaging apparatus of the present invention is connected to a system control unit 101 that manages and controls each unit and recording medium of the camera recorder, and each unit is connected in common, and various data is transmitted between the units. A PCMCIA I / F unit 160 serving as an interface for connecting a transmission I / O bus 121 and a recording memory 161 as a detachable recording medium, and a user instructs recording and reproduction of encoded video data and audio data An input unit 131 for input, a camera unit 141 that captures an image captured by a CCD or the like as an image sensor as a video signal, and a video processing unit that performs preprocessing of the video signal and converts the video signal into digital video data 142, a video encoding unit 143 that performs compression encoding on the video data and generates encoded video data, and an audio signal. A microphone unit 144 that performs input processing, pre-processing of the input audio signal, an audio processing unit 145 that converts the audio signal into digital audio data, and decoding the encoded video data to restore the original video data The video decoding unit 148, the video output unit 149 that outputs the restored video data, the audio output unit 150 that outputs the audio data, the display unit 132 that presents the operating state of the device to the user, and the camera recorder And position detecting means 133 for detecting the physical position of the head.

  The recording memory 161 is a recording medium that can be attached to and detached from the camera recorder. In the present embodiment, an example of a configuration in which the recording memory 161 can be attached to and detached from the camera recorder in the shape of a PCMCIA is given. The recording memory 161 and the PCMCIA I / F unit 160 (hereinafter referred to as an I / F unit as appropriate). ) Is connected based on the PC card standard.

  Further, in the present embodiment, an example is given in which the system control unit 101 includes, for example, a microcomputer and a memory (not shown), and is realized by the microcomputer executing a program stored in the memory. Each processing means other than the scenario data holding means 106, the recording buffer memory 110, and the reproduction buffer memory 115 included in the system control unit 101 is realized by the microcomputer executing various programs stored in the memory. The system control unit 101 executes a program stored in a memory by a microcomputer, thereby performing a shooting mode switching unit 113 that switches a shooting mode between a test shooting mode and a real shooting mode, and a camera operation that receives camera setting parameters from the camera unit 141. The detection unit 102, the shooting condition specifying unit 103 for specifying the shooting condition based on the camera setting parameter sent from the camera operation detection unit 102, and the shooting condition specifying unit 103 when the shooting mode is the test shooting mode. Based on the information, the scenario data corresponding to the shooting scene from the shooting conditions (the scenario data includes the shooting scenario information including shooting contents, dialogue, shooting number, etc., and classification information used for associating with the shot video And scenario features that create shooting features (both described later) Data creation means 104, scenario data reading means 105 for reading the scenario data recorded in the recording memory 161, and scenario data holding means 106 for holding the scenario data in, for example, a memory or recording the scenario data in the recording memory 161. The shooting conditions are compared with the scenario data held by the scenario data holding means 106, and the scene specifying means 107 for associating the shooting scene corresponding to the closest scenario data with the captured video and the scene specifying means 107 specify the shooting conditions. Mark assigning means 108 for assigning a mark from the scene information, management file processing means 109 for processing a management information file for managing video / audio data recorded in the recording memory 161, a video encoding section 143, and an audio processing section 145 provided by 145 A recording buffer memory 110 that temporarily stores data, a recording processing unit 111 that performs processing for recording the video and audio data stored in the recording buffer memory 110 in the recording memory 161 in a predetermined file format, and a recording memory 161 A reproduction processing means 114 for performing a process for reproducing the file recorded in the recording medium, and a reproduction buffer memory 115 for temporarily holding reproduced video / audio data from the recording memory 161.

  Furthermore, in the present embodiment, the camera unit 141 includes an imaging unit 171 that captures an image of a subject, zoom means 172 that performs zoom control of the imaging unit 171, and angle and angular velocity data for performing camera shake correction of the imaging unit 171. Camera operation using a zoom setting value (zoom magnification) controlled by the zoom unit 172, and an angle and angular velocity data such as a shooting angle detected by the angle detection unit 173 as camera setting parameters. Provided to the detection unit 102.

  Next, a basic recording operation in the camera recorder of the present embodiment configured as described above will be described. When the user instructs the camera recorder to start recording, the camera recorder performs an imaging process, compresses and encodes video data, and records it in the recording memory 161 as an encoded video file. When the user instructs the camera recorder to stop recording, the camera recorder ends recording of the video data. A group of files including an encoded video file generated by one continuous recording as described above, that is, a recording operation from the start of recording to the end of recording as a unit and a file related thereto are referred to as a clip. I will call it. The clip includes at least an encoded video data file obtained by compressing and encoding video, and may further include an audio file.

  Hereinafter, the recording operation will be described in more detail. For example, when the user instructs to start normal recording through the input unit 131, the camera unit 141 performs an imaging process and outputs digitized video data. Next, this signal is supplied to the video processing unit 142, and the supplied video data is subjected to, for example, band limitation and noise removal by a filter, and the processed video data is provided to the video encoding unit 143. .

  The video data supplied to the video encoding unit 143 is, for example, an MPEG-2 system, an MPEG-4 / AVC system, or a business-use digital VTR (Video Tape Recorder) standard widely used as a video compression system. Is encoded based on SMPTE (Society of Motion Picture and Television Engineers) -314M (DV-Based 25M) standard. The video encoding unit 143 supplies the encoded video data generated by the compression encoding process to the system control unit 101 via the I / O bus 121.

  The encoded video data supplied to the system control unit 101 is supplied to the recording buffer memory 110. In the system control unit 101, the following process is executed as a pre-process of the recording process.

  First, in the system control unit 101, the recording processing unit 111 performs processing related to generation of a file for storing encoded video data currently being processed in the recording memory 161 in accordance with a user instruction from the input unit 131. . That is, for example, when the start of recording of new material data is instructed by the user, the recording processing unit 111 creates index data as additional information in order to record new material data in the recording memory 161, Processes such as generation of data files and audio data files.

  The index data includes, for example, a media index table that is information for managing material data recorded in the recording memory 161, and a clip index table that is metadata that is attribute information of each material data. The index data is recorded in an index file provided in the recording memory 161 by the management file processing unit 109. Details of the index data and the index file will be described later.

  Further, the management file processing means 109 updates the index file for the generated file and the recording memory 161 to be recorded prior to recording the encoded video data.

  Further, prior to recording the encoded video data, the recording processing unit 111 searches for the presence or absence of an empty area for writing the encoded video data in the recording memory 161, and starts recording only when there is an empty area. Note that the recording processing unit 111 notifies the user that the recording is impossible, for example, by displaying on the display unit 132 when there is no free space.

  When a predetermined file area of the recording memory 161 is secured by the recording processing unit 111, the recording processing unit 111 further converts the encoded video data sequentially supplied to the recording buffer memory 110 into the I / O bus 121 and the I The data is sent to the recording memory 161 via the / F unit 160 and written as a file in the secured recording area.

  When the user instructs the input unit 131 to stop recording, the supply of the video signal from the camera unit 141 is terminated, and the writing of the encoded video data to the recording memory 161 is also terminated.

  By executing such a series of recording operations, the video imaged by the camera unit 141 is recorded in the recording memory 161 as an encoded video data file filed as one file, and one code is stored in the recording memory 161. A new video data file is created.

  On the other hand, in this camera recorder, when the user instructs the input unit 131 to start recording, capturing of audio from the microphone unit 144 is started together with capturing of video from the camera unit 141. The audio captured from the microphone unit 144 is supplied to the audio processing unit 145 as an audio signal. The audio processing unit 145 converts the supplied audio signal into audio data in a digital format, and supplies the audio data to the recording buffer memory 110. The audio data supplied to the recording buffer memory 110 is written into the recording memory 161 as an audio file by the recording processing unit 111 in the same manner as the recording processing for the video.

  As described above, the audio captured by the microphone unit 144 is recorded in the recording memory 161 as an audio file in parallel with the video capture.

  In this embodiment, audio compression is not performed, but audio compression may be performed.

  Next, in this camera recorder, for example, when the user designates a clip to the input unit 131 and instructs the start of reproduction, the management file processing unit 109 reproduces from the index file recorded in the recording memory 161. The information of the encoded video file and the audio file included in the clip to be read is read, and the file names are supplied to the reproduction processing unit 114. The reproduction processing unit 114 reads the encoded video data of the encoded video file designated for reproduction and the audio data of the audio file, and transmits the encoded video data to the video decoding unit 148 via the reproduction buffer memory 115. Data is supplied to the audio output unit 150. The video decoding unit 148 performs video decoding processing conforming to the SMPTE-314M system, and supplies the decoded video data to the video output unit 149. The video output unit 149 converts the supplied video data into a video signal, and presents the reproduced image to the user from a monitor provided in the camera recorder, for example. In addition, the audio output unit 150 converts the supplied audio data into an audio signal, and presents the reproduced audio to the user from, for example, a speaker provided in the camera recorder.

  By executing such a series of playback operations, encoded video data and audio data recorded in the recording memory 161 are read out, and playback video is output from the video output unit 149 and playback audio is output from the audio output unit 150. The

  Note that recording and reproduction of video and audio are normally performed in parallel. That is, at the time of recording and reproduction, the recording start time, recording end time, reproduction start time, and reproduction end time of the video and audio are processed in synchronization.

  The basic operation of recording and playback processing in the camera recorder has been described above. As described briefly above, the system control unit 101 can record and playback material data as a clip in the file format. Processing is executed.

  Next, processing related to index data as additional information by the system control unit 101 will be described.

  As described above, the camera recorder that is the imaging apparatus of the present invention records index data, which is additional information of these material data, in the recording memory 161 together with the encoded video data and audio data. Such index data is metadata indicating attribute information of each piece of material data recorded during coverage. The camera recorder records such metadata as a clip index table in the index file of the recording memory 161 in association with each material data and each recording memory 161.

  The index file is generated as only one file for one recording memory 161. For example, after the formatting process of the recording memory 161, the management file processing unit 109 generates an index file having the configuration described below on the recording memory 161.

  FIG. 2 is a diagram showing an overview of the index file provided in the recording memory 161. As shown in FIG. 2, an index table having a two-layer structure is set in the index file. As shown in the recording memory-A of FIG. 2, a media index table for recording information corresponding to each recording memory 161 is provided as an upper layer, and metadata specific to each recording memory 161 is provided in this media index table. Is recorded. In addition, as shown by Clip-A and Clip-B in FIG. 2, a clip index table for recording information corresponding to each recorded clip is provided as a lower layer. Metadata is recorded.

  In FIG. 2, one encoded video file and two audio files are linked corresponding to one clip. That is, each time material data is recorded, one encoded video file and two audio files in which the material data is stored are generated, and a new clip index table is set in the index file. Metadata corresponding to the material data is recorded in the clip index table.

  Further, as shown in FIG. 2, one or a plurality of scenario data are recorded as scenario files for the index file. That is, the scenario file is recorded as a separate file from the index file. This is because, for example, when changing the recording medium to be recorded, data movement of only scenario data is facilitated. The scenario data defines scenario information at the time of shooting including shooting contents, dialogue, shooting number, etc., for each scene constituting a video to be shot, and includes shooting time length, camera work, and the like.

  FIG. 3 is a diagram showing a configuration of the scenario data and a specific example, and illustrates two examples of (1) scenario data at the time of wedding shooting and (2) scenario data at the time of movie shooting. The scenario data at the time of wedding shooting in (1) will be described as an example when it is not allowed to shoot again, and the scenario data at the time of shooting a movie of (2) will be described as an example when shooting of the same scene can be repeated. . Here, a scene represents a certain continuous shooting section defined in a scenario in which shooting is planned, and the shot data becomes a clip (or cut) according to the scene. Therefore, when there is some mistake during shooting and the same scene is shot again, there are a plurality of clips corresponding to one scene. Moreover, taking the same scene repeatedly is called a take, and the number of repetitions is represented by a take number (take 1, take 2,...).

  The “scene number” is, for example, a scene identification number indicating the shooting order or the edited scene order, and can be freely added by the user.

  The “title” is a title of each scene that can be arbitrarily added by the user, and a name (character string) that can be easily recognized by the user can be freely added.

  “Adopted Duration” is a time length and a frame length scheduled to be adopted as an editing result in each scene.

  “Shooting feature” represents a typical feature of the shooting method and shooting conditions of each scene. For example, “pan”, “tilt” indicating angle change or angle movement of the camera recorder, and “zoom” indicating zoom-up. Or “position movement” indicating the physical movement amount of the photographing apparatus.

  “Zoom setting at the start of shooting” represents the zoom setting state of the camera unit 141 at the start of shooting, and is classified into “zoom up” indicating a zoomed state and “normal” indicating a non-zoomed state.

  “Zoom change” represents a change in zoom setting value of the camera unit 141 (controlled by the zoom unit 172) from the start of shooting to the end of shooting, and is classified into “changed” and “no change”.

  The “shooting start angle” represents the angle of the imaging apparatus at the start of shooting, “horizontal” indicating a state horizontal to the ground, “upward” indicating an upward angle with respect to the ground, Is classified as “downward” indicating that the angle is downward.

  “Angle change” indicates the angle change of the image pickup apparatus from the start of shooting to the end of shooting, “vertical movement” indicating that the angle has changed in the direction perpendicular to the ground, and a direction horizontal to the ground Are classified into “horizontal movement” indicating that the angle has changed, and “no change” indicating that no angle change has occurred.

  “Shooting start position” represents the physical position of the imaging apparatus at the start of shooting, and indicates, for example, the latitude, longitude, and relative distance from the reference point. FIG. 3 describes an example of latitude and longitude.

  “Position movement amount” represents the movement of the physical position of the imaging apparatus from the start of shooting to the end of shooting, and indicates the amount of change in latitude and longitude, as well as the direction and moving distance. FIG. 3 describes an example of a direction and a moving distance.

  If the scenario data classification described above is subdivided, the accuracy of associating captured clips with scenario data can be improved. Further, in the example, sampling is performed temporally at the start of shooting and at the end of shooting. However, if the time resolution is increased, it is possible to increase the accuracy of association with scenario data. Note that the classification of each item of the scenario data described above is collectively referred to as classification information, and is an option for each item when creating scenario data.

  Next, the media index table and clip index table constituting the index data will be described in detail.

  FIG. 4 is a diagram illustrating a configuration example of the media index table. FIG. 5 is a diagram showing a configuration example of the clip index table.

  In the media index table shown in FIG. 4, “Media ID” is an identifier (IDentifier, hereinafter referred to as “ID” as appropriate) added to each medium, that is, unique to each recording memory 161. For example, when formatting a medium, a unique ID can be added by a combination of the formatting time and the device ID. This “Media ID” can be used as an identifier when searching for a desired clip in combination with “Clip ID” described below, for example.

  “Media Title” is a media-specific title that can be arbitrarily added by the user, and a name that can be easily recognized by the user can be freely added. Since the media in the device is specified by “Media ID”, “Media Title” can be freely changed even when an encoded video file or audio file is recorded.

  In the clip index table shown in FIG. 5, “Clip ID” is an ID added so as to be unique for each clip. For example, when recording a clip, a unique ID can be added by a combination of the recording start time and the device ID. The encoded video file, the audio file, and the clip are associated with each other by describing the “Clip ID” in the file name. For example, an encoded video file with a “Clip ID” of C001 is “C001.DIF”, and files for two audio channels are “C001_1.WAV” and “C001_2.WAV”, respectively. Can be associated with a file. The DIF format file with the extension “.DIF” is a file of encoded video data that has been compression-encoded based on the SMPTE-314M standard.

  “Clip Title” is a clip-specific title that can be arbitrarily added by the user, and a name that can be easily recognized by the user can be freely added. Since the clip in the device is specified by “Clip ID”, “Clip Title” can be freely changed even in a state where an encoded video file or an audio file is recorded.

  “Frame Rate” represents the frame frequency of the video signal. “Duration” represents the number of frames included in the clip. Further, the recording time of the entire clip can be calculated by “Frame Rate” and “Duration”.

  “Mark” represents a type (classification) identifier of the clip. For example, when it is desired to distinguish between a shooting success clip and a shooting failure clip, it is defined as OK_MARK: OK clip, NG_MARK: NG clip, and a clip is discriminated by recording a character string of OK_MARK or NG_MARK by a user operation. .

  “Condition” represents typical characteristics of the shooting method and shooting conditions of each clip, and corresponds to “shooting characteristics” in the scenario data.

  “Zoom” represents the zoom setting state of the camera unit 141 at the start of shooting, and corresponds to “zoom setting at shooting start” in the scenario data.

  “Zoom Change” indicates a change in the zoom setting value of the camera unit 141 from the start of shooting to the end of shooting, and performs the same classification as “zoom change” in the scenario data.

  “Angle” indicates an angle in a direction perpendicular to the ground of the imaging apparatus at the start of photographing, and corresponds to “an angle at the start of photographing” in the scenario data.

  “Angle Change” indicates a change in angle of the imaging apparatus from the start of shooting to the end of shooting, and corresponds to “angle change” in the scenario data.

  “Position” represents the physical position of the imaging apparatus at the start of imaging, and represents, for example, the latitude, longitude, and relative distance from the reference point. This corresponds to the “shooting start position” in the scenario data.

  “Position Change” represents the movement of the physical position of the imaging apparatus from the start of shooting to the end of shooting, and indicates the amount of change in latitude and longitude, the direction, and the moving distance. This corresponds to the “position movement amount” in the scenario data.

  The scenario data of FIG. 3 and the clip index table of FIG. 5 have corresponding items, although there is a difference between the classified type and the numerical value. For example, “adopted Duration” of scenario data corresponds to “Duration” of the clip index table, and similarly, “shooting feature” and “Condition”, “zoom setting at start of shooting”, and “Zoom” correspond to each other. This is to facilitate the process of referring to the scenario data from the contents of the clip index table and associating it with the corresponding scene of the shot clip. If the clip index table has more information than the scenario data, Information other than that illustrated in FIG. 5 may be included.

  FIG. 6 is a diagram showing a description example of the clip index table in the index file. FIG. 6A shows the contents of the clip index table immediately after the start of recording. In this embodiment, the index file is in a text format and is recorded in a Comma Separated Values (CSV) format in which character strings are delimited by “,”. The clip index table is described for each clip in the order shown in FIG. “C001” represents ClipID, and for example, a serial number prefixed with “C” is allocated. “Title001” indicates a Clip Title. “30” indicates Frame Rate, and represents that a shooting clip is shot at 30 frames per second. “0” indicates Duration, and is set to 0 because the value cannot be determined at the start of recording. Since other data cannot be determined at the start of recording, no information or “NONE” indicating no change is recorded.

  FIG. 6B shows the contents of the clip index table after the end of recording. After recording, a value less than Duration is determined and information is recorded. A method for determining each item will be described later. In the example of FIG. 6B, Duration is 5400 frames and represents that a clip of 180 seconds has been recorded. Mark is “OK_MARK”, indicating that an OK clip mark has been added. “Condition” is “ZOOM” and represents that the shooting feature is determined to be “zoom”. Zoom is “ZOOM_UP”, indicating that recording has started in the zoom state. ZoomChange is “CHANGED”, which indicates that the zoom setting value has been changed during recording. Angle is “UPPER”, indicating that recording has started in an “upward” state. AngleChange is “NONE”, indicating that there was no change in the shooting angle during recording. Position is “N_90 — 232323_E — 100 — 121212”, which represents 90.232323 degrees north latitude and 100.121212 degrees east longitude. In the present embodiment, the latitude and longitude will be described using an example in which a Global Positioning System (GPS) device is used as the position detection means 133. Regarding Position, in addition to latitude and longitude, the distance from the reference point may be recorded using a distance sensor or the like. “PositionChange” is “NONE”, indicating that the position of the photographing apparatus was not moved during recording.

  The basic recording / reproducing method and recorded data have been described above.

  Next, a description will be given of an outline of the processing of scenario data and the association between scenario data and clips according to shooting conditions, which is a feature of the present invention.

  First, scenario data reading processing will be described as preparation before starting shooting for actual shooting. There are the following two methods for capturing the scenario data into the photographing apparatus of the present invention. First, assuming that a scenario file as shown in FIG. 3 is recorded in the recording memory 161 in advance, the scenario data is read from the recording memory 161 by the scenario data reading means 105, and the scenario data holding means 106 reads the scenario data. It is a method of holding. The second is a method in which scenario data is created by the scenario data creating means 104 and the scenario data is held by the scenario data holding means 106. As for the second one, the shooting mode switching unit 113 switches the shooting mode to the test shooting mode to perform shooting, and after shooting, the scenario data creation unit 104 creates scenario data from the clip index table created by this test shooting. Can do. Whichever method is adopted, the scenario data is held in the scenario data holding means 106, and the scenario data is supplied to a necessary block such as the scene specifying means 107. Details of scenario data creation will be described later.

  Next, on the premise that scenario data is held in the scenario data holding means 106, an outline of processing from detection of shooting conditions to recording and association with scenario data will be described.

  In the basic recording method as described above, the camera unit 141 captures captured images as video signals in units of frames, and at the same time, sets camera setting parameters (eg, zoom setting values, camera shake correction gyro values, etc.) in units of frames. To the camera operation detection unit 102. The camera operation detection unit 102 thins out and holds data by sampling camera setting parameters at regular intervals between the start of recording and the end of recording (in this embodiment, two times at the start of recording and at the end of recording). This shows an example of sampling the camera setting parameters for a total of 2 frames.If the time resolution is increased with the stored scenario data (if the sampling cycle is shortened), the accuracy of associating with the scenario data can be increased. .) The camera operation detection unit 102 supplies the camera setting parameters sampled and thinned out to the imaging condition specifying unit 103 and supplies all the camera setting parameters, that is, the camera setting parameters before thinning out the data, to the recording processing unit 111.

  The shooting condition specifying unit 103 detects, from the sampled camera setting parameters provided, for example, classification information classified as shown in FIG. 3 and shooting characteristics that are characteristics of a clip from a plurality of pieces of classification information (hereinafter, referred to as “clip information”). The classification information and the shooting characteristics are collectively referred to as shooting conditions). The detected shooting condition is used as a key for scenario data search or the like. An algorithm for detecting shooting conditions from camera setting parameters will be described later. On the other hand, during recording, the recording processing unit 111 associates the camera setting parameters and the video data provided from the camera motion detection unit 102 for each frame, multiplexes them with the encoded video data, and records them as an encoded video file. Record in the memory 161.

  Next, the shooting condition specifying unit 103 supplies the detected shooting condition to the scene specifying unit 107 and the management file processing unit 109 at the end of shooting. The scene specifying unit 107 acquires scenario data from the scenario data holding unit 106 and compares the acquired scenario data with the shooting conditions provided from the shooting condition specifying unit 103 to evaluate similarity. If it is determined that the clip is similar, the clip taken by adding the clip ID of the clip to the scene number on the scenario data is associated with the scenario data. A specific description of this association process will be described later. On the other hand, the management file processing unit 109 records the shooting condition provided from the shooting condition specifying unit 103 in the clip index table of the index file.

  Through the above processing, the camera setting parameters for each frame are recorded in the encoded video file, the shooting conditions are recorded in the clip index table of the index file, and the association with the clip is recorded in the scenario file.

  Next, the outline of processing for scenario data creation in the imaging condition detection and test imaging modes will be described. With respect to creation of scenario data, in this embodiment, the scenario data is reconstructed from the clip index table after recording. This is easy to implement and is recorded as a file in the recording memory 161, so that there is an advantage that reconfiguration is easy. Specifically, each shooting condition has the same definition (same classification) in the clip index table and the scenario data, and the conversion from the clip index table to the scenario data can be realized by simple format conversion of each shooting condition. To do.

  By one test shooting, a clip index table including shooting conditions corresponding to one clip is added to the index file. Then, scenario data corresponding to one scene is created from the shooting conditions created by the test shooting and recorded in the scenario file. In a situation where a scenario file already exists, a new line of scenario data obtained by test shooting is added to the scenario file. Hereinafter, scenario data creation will be described in more detail.

  First, a clip index table including shooting conditions is recorded in the recording memory 161 by the recording method described above. The recording processing unit 111 records the clip index table and at the same time provides the shooting conditions in the clip index to the scenario data creation unit 104. The scenario data creation unit 104 converts the supplied shooting conditions into a scenario file format as shown in FIG.

  FIG. 7 is a diagram illustrating an example of a scenario file. In this embodiment, the text format CSV format is used in the same manner as the index file, and the scenario data items in FIG. 3 are recorded in order, and FIG. 7 shows the example scenario file shown in FIG. ing.

  A method for creating each item other than the shooting conditions in each item of the scenario data shown in FIGS. 7 and 3 will be described. The scene number is a scene number obtained by adding 1 to the last scene number already recorded in the scenario file. When a scenario file does not exist and a new scenario file is created, the scene number is 1. For the title, text information is input from the input unit 131 and the scenario data creation means 104 adds the text information to the scenario data. Since the title is only used for display, a method of automatically generating from the scene number or the like, not recording, or recording after the event may be used. Adopted Duration records the same value as the clip length (Duration of clip index table).

  Although the scenario data is reconstructed from the clip index table after recording, the photographing conditions are directly supplied from the photographing condition specifying unit 103 to the scenario data creating unit 104 without being reconstructed from the clip index table. In addition, the scenario data creation means 104 can similarly be configured to create the scenario file described above, and the purpose of scenario data creation can be achieved.

  Through the above processing, scenario data is created from the shooting conditions obtained by the test shooting, and is recorded in the recording memory 161 as a scenario file. In the present embodiment, the scenario data creation unit 104 creates scenario data at the end of shooting. However, scenario data is recorded from the recorded clip index table at any timing after shooting. It is possible to create. For example, it is possible to easily display the menu on the display unit 132 without providing the test photographing mode and allow the user to select the timing for creating the scenario data via the input unit 131.

  Heretofore, the processing outline of associating the clip with the scenario data and creating the scenario data of the present invention has been described.

  Next, the processing of each block in the camera recorder of the present embodiment will be specifically described.

  First, the detection of camera setting parameters in the camera operation detection unit 102 will be specifically described. In the present embodiment, an example will be described in which a zoom setting value, a shooting angle, a shooting position, and each change amount are detected as camera setting parameters.

  The zoom setting value represents a zoom magnification value. When performing zoom photography with a camera recorder, there are generally an optical zoom using a lens and a digital zoom that enlarges a part of the image by processing digital video data. At this time, the user inputs the zoom magnification by operating the zoom lever provided in the camera, the zoom ring of the lens unit, or the like. This input is supplied to the zoom unit 172 of the camera unit 141 via the input unit 131, and the zoom unit 172 of the camera unit 141 performs zoom operation processing. The camera operation detection unit 102 acquires a zoom setting value at which the camera unit 141 (zoom unit 172) is currently operating from the camera unit 141.

  The shooting angle represents the horizontal angle and the vertical angle (angle) of the camera recorder at the time of shooting. When shooting with a camera recorder, in general, the shooting device is often fixed so that it is level with the ground, but due to video effects and location restrictions, the shooting target is looked down from above. In some cases, the camera may be shot from below. In some cases, the camera angle (orientation) is changed up and down (tilt) or changed left and right (pan) when following the subject during shooting. The camera motion detection unit 102 acquires the horizontal and vertical angles at this time from the angle detection unit 173 of the camera unit 141. The angle detection unit 173 includes, for example, an angle and angular velocity detection unit such as a gyro sensor. In this embodiment, the angle detection unit 173 uses a gyro sensor as the angle detection unit 173 and is configured to be used in common with camera shake correction processing. . In addition, as the angle detection means 173, you may make it obtain the angle directly from the pan head etc. which attach a camera recorder.

  The shooting position represents position information measured using a GPS, an infrared sensor, or the like at the time of shooting, for example. In the present embodiment, the position detection unit 133 measures position information including latitude and longitude using GPS, and provides the position information to the camera operation detection unit 102 as a shooting position.

  The camera operation detection unit 102 supplies the detected and acquired camera setting parameters (for example, zoom setting value, shooting angle, shooting position) to the recording processing unit 111 for each frame, and at the start of shooting, at the end of shooting, and the like. The camera setting parameters are sampled at the sampling timing and supplied to the photographing condition specifying means 103.

  Next, a specific description will be given of a method by which the shooting condition specifying unit 103 specifies shooting characteristics.

  The shooting condition specifying unit 103 classifies the camera setting parameters detected and acquired by the camera motion detection unit 102, and determines shooting conditions, that is, shooting characteristics representing the classification information and the clip.

  FIG. 8 shows an example of the classification of the photographing characteristics, and FIG. 9 shows an example of the classification information. The shooting conditions determined by the shooting condition specifying unit 103 based on the camera setting parameters are recorded or processed as a clip index table by the management file processing unit 109. Further, the scenario data creation means 104 creates scenario data based on the shooting conditions described in the clip index table.

  In both FIG. 8 and FIG. 9, basically, the upper part of each item in the option column shows the contents, and the lower part shows the identifiers recorded as the clip index table and scenario data. However, the Position in FIG. 9 indicates that the latitude and longitude of the position information are specifically described. Similarly, for PositionChange, when the movement amount is not zero, the direction and distance are specifically described. A specific description method will be described later.

  First, a method in which the photographing condition specifying unit 103 determines classification information from camera setting parameters will be described.

  “Zoom” is classified by the following expression according to the zoom setting value (Zoom_s) at the start of photographing and the threshold value (Zoom_Th1). In the present embodiment, Zoom_Th1 is set to 5 (times), but the same effect is exhibited if the numerical value (magnification) is 1 or more.

Zoom_s> Zoom_Th1: Zoom UP state Zoom_s ≦ Zoom_Th1: Normal state “ZoomChange” is a zoom setting value (Zoom_s) at the start of shooting, a zoom setting value (Zoom_e) at the end of shooting, and a threshold value (Zoom_Th2). Break down. In the present embodiment, Zoom_Th2 is set to 3 (times), but may be a numerical value (magnification) of 0 or more.

| Zoom_e-Zoom_s |> Zoom_Th2: zooming change | Zoom_e-Zoom_s | ≦ Zoom_Th2: no zooming change “Angle” is a vertical angle at the start of shooting (Angle_v_s) and a threshold (Angle_v_Th) To do. In this embodiment, Angle_v_Th is set to 2.0 (degrees), but the same effect can be achieved if the numerical value (angle) is 0 or more.

Angle_v_s> Angle_v_Th: upward | Angle_v_s | ≦ Angle_v_Th: horizontal
Angle_v_s <-Angle_v_Th: downward “AngleChange” is an angle at the start of shooting (Angle_v_s), an angle at the end of shooting (Angle_v_e), and an angle at the start of shooting (Angle_h_s), The horizontal direction angle (Angle_h_e) at the end of photographing and the threshold values (Angle_v_Th, Angle_h_Th) are used to classify them according to the following equations. Angle_v_Th and Angle_h_Th are set to 2.0 (degrees), respectively. However, if the numerical value (angle) is 0 or more, the same effect is exhibited.

h_abs = | Angle_h_e-Angle_h_s |
v_abs = | Angle_v_e-Angle_v_s |
When h_abs> v_abs,
h_abs> Angle_h_Th: Horizontal movement h_abs ≦ Angle_h_Th: No change When h_abs ≦ v_abs
v_abs> Angle_v_Th: Vertical movement v_abs ≦ Angle_v_Th: No change “Position” represents position information composed of latitude and longitude in this embodiment, and for example, 12.345678 degrees north is expressed as N_12.345678. Similarly, 34.567890 degrees south latitude is represented as S_34.567890, 56.89012 degrees east longitude is E_56.789012, and 78.901234 degrees west longitude is represented as W_78.901234.

  “PositionChange” represents the direction of the position at the end of shooting relative to the position at the start of shooting and the distance between the two points at the start and end of shooting (for example, the unit is meters). Using a general method such as the square root theorem and spherical trigonometry, the direction and distance can be obtained from the latitude and longitude of two points.

  In the foregoing, the method of classifying into the classification information in the imaging condition specifying unit 103 has been described.

  Next, a method in which the shooting condition specifying unit 103 determines the shooting feature from the classification information will be specifically described.

  The shooting feature represents a feature representing each clip as shown in FIG. 8, and is determined from each classified classification information. That is, the classification information divided in FIG. 9 is prioritized, and the shooting characteristics are determined from the classification shown in FIG.

  FIG. 10 is a flowchart for determining the shooting feature. First, in S101, it is confirmed whether or not “PositionChange” = NONE. When “PositionChange” = NONE, that is, “No movement”, the process proceeds to S103, and when “PositionChange” = NONE, the process proceeds to S102.

  In S102, for example, it is confirmed whether or not the moving distance is 3 meters or more. If the moving distance is 3 meters or more, it is determined that there is a position movement. In S114, the shooting feature is MOVE_POS, and the moving distance is determined. If is less than 3 meters, the process proceeds to S103.

  If “AngleChange” = MOVE_V in S103, that is, if the shooting angle is moved vertically, the shooting feature is set to TILT (tilt) in S113, and if “AngleChange” = MOVE_V, the processing of S104 Move on.

  If “AngleChange” = MOVE_H in S104, that is, if the shooting angle is moved horizontally, the shooting feature is set to PAN (Pan) in S112, and if “AngleChange” = MOVE_H, the process of S105 Move on.

  If “Zoom” = ZOOM_UP in S105, that is, if shooting is started in the zoom state, the shooting feature is set to ZOOM_UP (zoom state) in S111. If “Zoom” = ZOOM_UP is not set, in S110 The shooting feature is NONE (no feature).

  Note that the flowchart of FIG. 10 is an example, and any classification method may be used as long as it is a method for determining the shooting characteristics based on the classification information or the camera setting parameter that is the basis of the classification information.

  Next, the mark setting process in the mark assigning means 108 will be specifically described. FIG. 11 shows an example of mark types. OK_MARK is a mark representing a clip that should be adopted during editing, and NG_MARK represents a clip that is not employed during editing. OK_MARK and NG_MARK are marks that the user inputs by selecting a menu or pressing a button via the input unit 131. With this mark type, each clip can be classified and handled, and the convenience for the user is enhanced.

  The mark assigning means 108 can automatically set any one of the above OK_MARK and NG_MARK to the clip simultaneously with the process of associating the scenario data with the clip. Details of this mark processing method will be described later.

  Next, a method for embedding metadata in an encoded video file in the recording processing unit 111 will be specifically described.

  In the SMPTE-314M standard, each video frame can be recorded with attached information such as VAUX added as DIF data. In the present embodiment, the attached information includes camera setting parameters, that is, a camera setting parameter, that is, a zoom setting value (Zoom), a shooting angle (Angle), and a shooting position for each video frame, at a certain interval, or at the start and end of recording Record (Position). By recording the camera setting parameters as the attached information in the encoded video file, even when the clip index table is deleted, the effects of the present invention such as association with the scenario information can be exhibited.

  The attached information is the same as the information recorded in the clip index table of the index file, although there is a difference in recording interval.

  It should be noted that the standard for video / audio encoding other than the SMPTE-314M standard (for example, MPEG-2 system) is configured such that the attached data can be recorded for each frame, and the same applies to other standards. Can be effective.

  Next, a method for associating the scene of the scenario data with the shot scene of the clip index table in the scene specifying unit 107 will be described in detail. FIG. 12 shows a conceptual diagram of association. Here, associating the scene of the scenario data with the clip of the shot clip index table means, for example, associating a shot clip (clip index table) with each scene of the scenario data as shown in FIG. means. The basic concept of this association method will be described with reference to FIG. FIG. 12A shows the order of associating the first scene of the scenario data and the items to be processed. First, as shown in (1), a match between the shooting conditions of the scenario data and the shooting conditions (including a plurality of items) in the clip index table is detected, and then the scenario data and the clip index are shown in (2). An identifier associated with the table (in the example, Clip0001 C0001) is recorded in the scenario data (or clip index table). Further, as shown in (3), the scene number obtained by the associating process as the scene determination and the take number (serial number given to the same scene number) are recorded. FIG. 12B shows an example of association between scenario data and clip index data at the time when association processing for all scenes and all clips is completed. After completion of the association processing for all scenes and all clips, as shown in (4), as an automatic determination, the associated clips are OK clips, and the unassociated clips are NG clips. The above is the basic association method, but since the efficient association method differs depending on the preconditions at the time of shooting, two association methods will be described (described later). A plurality of methods are conceivable as a method for recording the association result. Specifically, as a recording method of the association, the association (for example, FIG. 13) by recording the scene number of the scenario data in the clip index table and the association recording by recording the Clip ID of the clip recorded in the scenario data. The method (for example, FIG. 14) etc. are mentioned. The difference between FIG. 13 and FIG. 14 is that the item “association” is in the clip index table in FIG. 13 and the item “association” is in the scenario data in FIG. FIG. 13 and FIG. 14 are both examples of the same association, and “x” indicates that there is no association destination (unphotographed).

  In this embodiment, as shown in FIG. 14, the association is performed by recording the scene number of the scenario data in the clip index table. In this way, if the scenario data is interpreted at the time of editing, clips (encoded video files and audio files) necessary for editing can be specified, and the control of the editing machine becomes easy.

  FIG. 14A shows the contents of the scenario data after the end of shooting, and FIG. 14B shows the contents of the clip index table after the end of shooting. In the scenario data, scene 1 is associated with clip C0001, scene 2 is associated with clip C0003, scene 3 is associated with clip C0004, scene 4 is associated with C0006, and scene 5 is associated with clip C0007. “X” in the “association” item of the scene 6 indicates that the scene number existing in the scenario file is not associated with the clip index table, and indicates that the scenario scene is not photographed. Since clips C0002 and C0005 are not associated with each scene of the scenario data, the clip that does not exist in the scenario data or the same scene was shot multiple times, and the clip was not adopted (others Indicates that the clip has been adopted). When the same scene is shot, for example, there is a method of associating clips recorded later in time with scenario data. This can be easily determined by checking the time stamp (date / time information) of the recorded encoded video file and audio file, or by recording the date / time information in the clip index table.

  As a process flow of association, the first association method assuming the case where the same scene is allowed to be repeatedly photographed as in movie production, and the same scene is repeatedly photographed as in wedding or lecture photography. Two associating methods will be described as a second associating method assuming that the shooting order of each scene cannot be performed and the shooting order of each scene is determined in advance.

  First, FIG. 15 shows a flowchart of the first association method in the case where it is allowed to repeatedly photograph the same scene. An example will be described in which the scene number of the scenario data and the shooting characteristics of the shot clip are compared in order, and if they match, the scene number at that time is associated with the clip at that time. In the association processing in the case where the same scene is allowed to be repeatedly photographed, when there are a plurality of photographed clips corresponding to each scene of the scenario data, they are associated with all the corresponding clips. At this time, if take numbers are assigned in order of recording time, it becomes easy to determine whether a clip is necessary (OK clip or NG clip).

  In S301, the processing target is the first scene of the scenario data, and in S302, the processing target of the clip index table is the first clip. In S303, it is determined whether the shooting characteristics of the scene that is the processing target of the scenario data and the clip that is the processing target of the clip index table match. If they match, the process goes to S304. It is determined that there is none, and the process proceeds to S307. In S304, it is confirmed whether or not the relevant scene of the scenario data has already been associated. If no association has been established, the current process target scenario data is displayed in the scene association field of the current process target scenario data. Processing for recording the Clip ID of the clip is performed (S305). If the association has already been performed, the ClipID of the current processing target clip is overwritten and recorded (S306). In S307, it is confirmed whether or not the processing target clip is the last clip. If it is the last clip, the process proceeds to S309. If it is not the last clip, the processing target is moved to the next clip, and the process returns to S303. . In S309, it is confirmed whether or not the processing target scene is the final scene. If it is the final scene, the processing ends. If it is not the final scene, the processing target is moved to the next scene (S310). The clip is moved to the first clip (S302), and the matching of the photographing characteristics is confirmed again.

  Further, in the mark assigning unit 108, for example, as shown in the automatic determination column of FIG. 12, when the clip is associated with the same scene, the subsequent clip is set as an OK clip (OK_MARK is assigned), and the clip previously associated NG clip (NG_MARK is given). That is, when there are a plurality of captured clips corresponding to each scene of the scenario data, OK_MARK is assigned to the latest corresponding clip (the last captured clip). This is because when there are a plurality of clips corresponding to the same scene, it is highly possible that the last photographed scene is the adopted scene.

  In this embodiment, the association is determined based only on the shooting characteristics. However, the determination may be made based on the shooting conditions including the classification information. In this embodiment, the scenario data and the clip index table are the same. Since the contents are recorded, for example, the processing conditions of S303 may be changed so that the classification information is compared to confirm the match.

  Next, FIG. 16 shows a flowchart of the second association method when the same scene cannot be repeatedly shot. When the same scene cannot be repeatedly shot, generally, an editing mode is often used in which unnecessary videos are deleted in the shooting order. Therefore, when comparing the scene number of the scenario data and the shooting condition of the shot clip, the detection accuracy and the correlation processing efficiency can be improved by associating the scenario data with the clip index table in the shooting order. Assuming that the shooting order has been decided and there is only one shot clip corresponding to each scene, the scenario data and clip index table are compared in this order, and the process of associating those with matching shooting characteristics first is performed. By repeating, it is possible to easily associate all clips.

  The flowchart of FIG. 16 will be described in detail. In S401, a process of arranging the clip index table of each clip in the recording order is performed. However, for example, if a recording form in which recording is performed in the order of recording is adopted, it is not necessary to rearrange them in particular, and association can be performed even before all scenes are recorded. In S402, it is confirmed whether or not the scenario data and the shooting characteristics of the clip index table of each clip match. If they match, the clip ID of the corresponding clip is recorded in the “association” field of the corresponding scenario data in S403, and the processing target of the scenario data is moved to the next scene number in S404. On the other hand, if they do not match, it is confirmed in S405 whether or not it is the final clip or the final scene. If it is the final clip or the final scene, the process is terminated. The processing target is moved to the next clip in the recording order, and the process returns to S402.

  As described above, by performing processing on each scene of scenario data and the clip index table of each clip, the scene of the scenario data and the captured clip can be associated and recorded in the scenario file.

  FIG. 17 shows an example of the scenario data file after the association process is completed. FIG. 17 (1) is an example in which the association shown in FIG. 14 is performed from the scenario data file before photographing shown in FIG. 7 (1), and FIG. 17 (2) is shown in FIG. 7 (2). This is an example in which the association shown in FIG. 12 is performed from the scenario data file before photographing.

  In FIG. 17, when there is an associated clip, ClipID (for example, “C0001”) is added to the last item of each scene, and when there is no associated clip, “NO_CLIP” is recorded. This means that there is no clip already taken. In the case of “NO_CLIP”, for example, the display unit 132 displays that there is uncaptured scenario data (for example, the corresponding scene number is displayed as an “unphotographed list”), and the scene number or By displaying the title character string, it is possible to prevent forgetting to shoot. Further, the same operation as “NO_CLIP” may be performed even when there is no data in the item representing the association, as in the scenario data before photographing in FIG.

  The mark assigning unit 108 sets the OK clip (provided OK_MARK) when the association is performed (not “NO_CLIP”), and the NG clip when the association is not performed (becomes “NO_CLIP”). (NG_MARK is given).

  Although the two association methods have been described above, the scene specifying unit 107 of the present embodiment is configured to be able to switch between the first association method and the second association method. This can be applied to various shooting applications by switching the association method, and the association accuracy can be improved by the user selecting the association method depending on the application. In order to achieve this, for example, a selection menu is displayed on the display unit 132, and the user selects via the input unit 131.

  Next, a scenario data creation method in the scenario data creation means 104 will be specifically described. There are the following three methods for creating scenario data. The first scenario data creation method is a method in which a test shooting mode is provided and scenario data is created from a clip index table corresponding to a clip shot in the test shooting mode. The second scenario data creation method is an arbitrary scenario data creation method. This is a method for creating scenario data from a clip index table corresponding to a shot clip. The third scenario data creation method generates a clip index table from attached information recorded in an encoded video file, and uses this clip index table. This is a method for creating scenario data.

  First, the first scenario data creation method will be described. The first scenario data creation method includes a test shooting mode and a production shooting mode. The test shooting mode is a mode in which scenario data is recorded and no video / audio file is recorded. The production shooting mode has been described above. In this mode, an encoded video file and an audio file are recorded. This mode transition is performed in the shooting mode switching unit 113 based on, for example, menu operation or operation information provided from the input unit 131 such as a dial button. Since the actual shooting mode has been described above as the basic operation of the present embodiment, the operation in the test shooting mode will be described.

  In the present embodiment, the operation in the test shooting mode is realized by performing a normal recording operation and creating scenario data without creating an encoded video file and an audio file. This is because mounting can be facilitated by making the normal recording operation and processing the same. Note that this can be realized even if the processing related to the recording file such as the video encoding unit 143 is omitted.

  Scenario data is created from a clip index table recorded in a normal recording operation. This scenario data creation method is the same as the second scenario data creation method, and will be described in detail later.

  When the user actually changes the camera recorder angle in the test shooting mode and presses the record button, the camera recorder automatically changes the camera parameters and camera recorder operating status. Will be recorded as a scenario data file. The scene on the scenario data is defined as a period from pressing of the recording start button to pressing of the recording end button, as in the normal recording operation, and the scene number is automatically incremented each time the recording start button is pressed. Preferably, it is only necessary to refer to the scenario data file recorded in the display unit 132 to change the scene number, delete an unnecessary scene, or input the title of each scene. This function may be realized.

  Next, a second scenario data creation method will be described. The second scenario data creation method is a method of creating scenario data from a clip index table, and there is a clip index table of a normally recorded index file or a clip index table recorded in a test shooting mode. Assuming That is, the items of the clip index table shown in FIG. 5 are converted into the items of scenario data as shown in FIG. Hereinafter, with reference to FIG. 5 and FIG. 3, a method for converting correspondences between items in the clip index table and items in the scenario data will be described.

  First, ClipID, FrameRate, and Mark are not converted into scenario data items (similar information does not exist in the scenario file).

  ClipTiTle corresponds to the title, and the character string may be recorded as it is. Duration corresponds to the adopted duration, and the value may be recorded as it is. The Condition corresponds to the shooting feature, and the shooting feature shown in FIG. 8 may be recorded as it is. Zoom corresponds to the zoom setting at the start of shooting, and the zoom classification information (option) shown in FIG. 9 may be recorded as it is. ZoomChange corresponds to the zoom change, and the ZoomChange classification information (option) of FIG. 9 may be recorded as it is. Angle corresponds to the angle at the start of shooting, and Angle classification information (option) in FIG. 9 may be recorded as it is. AngleChange corresponds to the angle change, and the AngleChange classification information (option) in FIG. 9 may be recorded as it is. Position corresponds to the shooting start position, and the latitude and longitude may be recorded as they are. PositionChange corresponds to the position movement amount, and the direction and distance may be recorded as they are.

  Finally, a third scenario data creation method will be described. The third scenario data creation method is a method in which a clip index table is generated from attached information recorded in an encoded video file, and scenario data is photographed by the second scenario data creation method. Since the second scenario data creation method has been described above, a method for generating a clip index table from metadata recorded in an encoded video file will be specifically described.

  The method for embedding the attached information in the encoded video file in the recording processing unit 111 has been described above, but the embedded attached information is read out for all the encoded video files to generate the clip index table. The attached information is the same item as the clip index table, and the sampling period is the same or shorter for each item of the clip index table. For example, the clip index table performs processing based on only when recording starts and when recording ends, whereas in an encoded video file, camera setting parameters are embedded as attached information for each frame. That is, if the camera setting parameter at the start of recording and the camera setting parameter at the end of recording can be acquired from the encoded video file, the clip index table from the encoded video file after recording can be obtained in the same manner as the creation of the clip index table at the time of recording. Can be generated.

  As described above, the scenario data file can be generated, and as described above, by associating the scene of the scenario data with the shooting clip, a series of shooting and editing from the planning stage (shooting test stage). It is possible to improve the workflow efficiency. That is, according to the present invention, scenario data including camera setting parameters is generated before shooting, and the scenario data and recorded clips are associated and classified using the camera setting parameters. Search, automatic editing, and editing assistance. This feature is particularly effective for improving the editing efficiency when performing repetitive shooting with a typical shooting pattern or when performing detailed rehearsal in advance.

  As described above, according to the camera recorder of the present embodiment, editing efficiency can be dramatically improved, and a camera recorder that is highly convenient for the user can be realized.

  In the present embodiment, the clip index table has been described as a method of recording the index file as a separate file from the video file. However, the same effect can be achieved by embedding the clip index table in the header portion of the video recording file. . In addition, the method of recording in the text format when recording the index file and the scenario file has been described. For example, a markup language such as an XML (extensible Markup Language) format, a format in which the text format is converted into binary data, and the like. The same effect is demonstrated even if described in.

  Moreover, although the example of compressing and encoding by the SMPTE-314M system has been described, any compression encoding system such as the MPEG-2 system or the MPEG-4 / AVC system that compresses using correlation information between frames is adopted. However, the same effect is exhibited. Also, the same effect can be achieved without compressing the video. Further, the example in which the video data and the audio data are recorded as separate files has been described. For example, the video data and the audio data are multiplexed using a method of multiplexing the video data and the audio data, such as the MPEG2-TS (Transport Stream) method. Even if the audio data is encoded as one file, the same effect is exhibited.

  Furthermore, in the present embodiment, the example in which the recording memory 161 has a PCMCIA shape has been described. .

  The image pickup apparatus according to the present invention improves the convenience in editing by the user, and can be widely applied to a video recording / playback apparatus, a video editing apparatus, or the like to which a semiconductor memory, an optical disk, or the like is applied.

The figure which shows the structure of the camera recorder of this invention Conceptual diagram of index file The figure which shows one structural example of a scenario data table The figure which shows one structural example of a media index table The figure which shows one structural example of a clip index table The figure which shows one specific example of a clip index table Figure showing an example of a scenario data file before shooting The figure which shows 1 division example of imaging | photography characteristics The figure which shows one division example of classification information Flow chart for determining shooting characteristics The figure which shows one example of mark classification Conceptual diagram showing the association between scenario data and recorded clips The figure which shows one example of the correlation of scenario data and a recording clip in the case of recording on scenario data The figure which shows an example of the correlation of the scenario data and recording clip in the case of recording on a clip index table Flowchart of association when not repeatedly shooting Flow chart for association when shooting repeatedly The figure which shows an example of the scenario data file after the end of association

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 System control part 102 Camera operation | movement detection part 103 Shooting condition specific | specification means 104 Scenario data creation means 105 Scenario data reading means 106 Scenario data holding means 107 Scene specification means 108 Mark giving means 109 Management file processing means 110 Recording buffer memory 111 Recording processing means 113 Shooting Mode Switching Unit 114 Playback Processing Unit 115 Playback Buffer Memory 121 IO Bus 131 Input Unit 132 Display Unit 133 Position Detection Unit 141 Camera Unit 142 Video Processing Unit 143 Video Encoding Unit 144 Microphone Unit 145 Audio Processing Unit 148 Video Decoding Unit 149 Video output unit 150 Audio output unit 171 Imaging unit 172 Zoom unit 173 Angle detection unit

Claims (9)

A camera unit that captures an image and outputs it together with camera setting parameters at the time of imaging;
Scenario data holding means for holding scenario data including shooting conditions for each shooting scene created in advance;
By obtaining shooting conditions at the time of shooting based on the camera setting parameters and comparing with shooting conditions for each shooting scene in the scenario data, a scene specifying means for associating the closest shooting scene with the video,
An imaging apparatus comprising: a recording unit that records information on association between the shooting scene associated with the scene specifying unit and the video on a recording medium. The camera unit detects the angle and angular velocity of the camera unit at the time of shooting and includes the camera setting parameter for output,
The shooting condition for each shooting scene includes at least one of a shooting angle and information indicating a change in the shooting angle,
The scene specifying unit obtains at least one of the information indicating the change in the shooting angle and the shooting angle included in the shooting condition for each shooting scene as the shooting condition at the time of shooting based on the angle and the angular velocity. The imaging device according to claim 1. The camera unit detects the shooting position of the camera unit at the time of shooting and outputs it included in the camera setting parameter,
The imaging apparatus according to claim 1, wherein the shooting condition for each shooting scene and the shooting condition at the time of shooting include the shooting position. The scene specifying means, when determining the association between the shooting scene and the video, if there are a plurality of shooting conditions at the time of shooting corresponding to the shooting conditions for each of the shooting scenes, The first associating method for associating and the second associating method for comparing the photographing scene and the video in the photographing order and repeating the process of associating the first matching condition with each other are executed by switching. Imaging device. Mark providing means for applying a mark indicating adoption to the video,
In the case of the first association method, the mark attaching unit assigns the mark to the latest image among the images associated with each shooting scene, and in the case of the second association method, The video recording apparatus according to claim 4, wherein the mark is added to the video associated with a shooting scene. The first scenario data creating means for creating scenario data including shooting conditions at the time of shooting obtained based on the camera setting parameters output from the camera unit as shooting conditions for each shooting scene. Imaging device. The recording unit includes the camera setting parameter in the video and records it on the recording medium,
The video including the camera setting parameters is read from the recording medium, and scenario data including shooting conditions at the time of shooting determined based on the camera setting parameters included in the video as shooting conditions for each shooting scene is created. The imaging apparatus according to claim 1, further comprising second scenario data creation means. Shooting mode switching means for switching the shooting mode between the test shooting mode and the actual shooting mode;
When the shooting mode is the test shooting mode, scenario data including shooting conditions at the time of shooting determined based on the camera setting parameters captured and output by the camera unit as shooting conditions for each shooting scene is generated. 3 scenario data creation means,
The scenario data holding means holds the scenario data created by the third scenario data creating means,
The scene specifying unit obtains a shooting condition at the time of shooting based on the camera setting parameter captured and output by the camera unit when the shooting mode is the actual shooting mode, and the scenario holding unit holds the shooting condition. The video recording apparatus according to claim 1, wherein the closest shooting scene is associated with the video by comparing with shooting conditions for each shooting scene in the scenario data. The imaging apparatus according to claim 1, further comprising: a display unit configured to display an unphotographed scene for the photographed scene that is not associated by the scene specifying unit.

Images