JP2010056681A - Sound reproducer, editing device, and video editing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video editing system for automatically associating schedule information with video data actually photographed and performing automatic extraction (automatic cutout) of significant scenes. <P>SOLUTION: The video editing system is provided with: an image pickup recording part 3 for recording video data to a recording medium; a signal selection part 14 for inputting a plurality of signals, switching input signals according to selection of an operator, and outputting them; a selection information recording part 5 for recording selection time of day when the signal selection part 14 switches the signals and switch state information; a schedule management part 21 for managing schedule information having schedule selection information which shows switch schedule of the signal selection part 14 and a schedule selection time of day when the signal selection part performs switching; a schedule time of day differential detection part 22 for comparing the selection time of day with the schedule selection time of day to detect a time of day differential; and a video editing part 23 for associating the video data with the schedule information on the basis of the schedule selection information of the schedule information and the time of day differential, and editing video data on the basis of the associated schedule information. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an audio reproduction device, an editing device, and a video editing system that create schedule information before actual shooting and automatically extract important scenes from video shot based on the schedule information.

  In recent years, devices for recording video data and audio data as files on a randomly accessible recording medium such as an optical disk or a semiconductor memory have become common. For example, in broadcasting stations and video production companies, Video editing work or the like is performed using an editing apparatus equipped with a recording medium. Even in the case of using photographic equipment for recording on a magnetic tape medium, after video data and audio data on the magnetic tape medium are filed, editing work is often performed using an editing device as described above.

  By the way, events such as lectures, weddings, and theaters that are subject to photography proceed according to a predetermined schedule. Traditionally, when shooting and editing the state of events such as lectures and weddings, photographers have taken important parts and their surroundings along the course of the event, and are especially important from the material data taken at the time of editing. We are working on cutting out important sections (important scenes).

  A technique (for example, Patent Document 1) is disclosed in which scenario data including a shooting method and a title is input before shooting using such characteristics of the shooting target, and shooting guidance is performed according to the scenario data.

In addition, when a presentation is performed with a personal computer, a technique for automatically dividing a presentation material by transmitting switching operation information when switching the presentation material display is disclosed (for example, Patent Document 2).
JP 2006-174318 A JP 2004-236238 A

  However, in the conventional configuration disclosed in Patent Document 1, the user inputs scenario data before shooting, and the scene to be shot at the start of shooting must be selected from the scenario data input before shooting. It will be troublesome.

  Further, in the conventional configuration disclosed in Patent Document 2, it is possible to divide at a display switching time point (display switching event), but only an important scene when a section away from the display switching event is an important scene. Is difficult to associate for automatic editing. For example, when switching the display from the first page to the second page of the presentation material is a display switching event, an important scene occurs 10 seconds before the display switching event occurs, or a camera is displayed when a display switching event occurs. When shooting by a recorder (recording on a medium) is not performed, it is difficult to associate a display switching event with an important scene.

  In view of the above problems, the present invention provides a video editing system capable of automatically associating schedule information with actually captured video data and automatically extracting important scenes (automatic segmentation). With the goal.

  In order to solve the above problems, the video editing system of the present invention is capable of inputting a plurality of signals and an imaging recording unit that records video data on a recording medium, and the input signals are switched by an operator's selection. Output signal selection unit, selection information recording unit for recording selection time and switching state information when the signal selection unit switches the signal, schedule selection information indicating a switching schedule of the signal selection unit, and the signal selection A schedule management unit that manages schedule schedule information having a schedule selection time to be switched, a schedule time difference detection unit that detects a time difference by comparing the selection time and the schedule selection time, and a schedule of the schedule schedule information Based on the selection information and the time difference, the video data is associated with the scheduled schedule information, and the associated Characterized by comprising a video editing unit for editing the image data based on a constant schedule information.

  In order to solve the above problems, an audio reproduction device of the present invention reads an information on a recording medium and reproduces an audio signal, an audio input unit that converts audio into an audio signal, and the audio The audio signal from the signal reproduction unit and the audio signal from the audio input unit are switched by an operator's selection to output the audio signal, and the audio signal output from the signal selection unit An audio output unit for converting to audio, and a selection information recording unit for recording a selection time and switching state information when the signal selection unit switches the audio signal to a recording medium are provided. Here, the audio signal is a signal output as voice, sound, or music in the audio output unit.

  In order to solve the above problems, the voice switcher device of the present invention switches a voice signal from a plurality of voice signal output sections according to an operator's selection and outputs one voice signal; The signal selection unit includes a selection information recording unit that records a selection time and switching state information when the signal is switched.

  In addition, in order to solve the above-described problem, the video editing apparatus of the present invention switches the plurality of signals and schedule selection information indicating the switching schedule of the signal selection unit that outputs one signal, and the signal selection unit plans to switch. A schedule management unit to manage having a selection time, and a selection time and switching state information when the signal of the signal selection unit is switched by an operator's selection is read, and the scheduled schedule information is associated with the selection time and switching state information; A schedule difference detection unit for detecting a time difference between the selected time and the schedule selection time; and, based on the schedule schedule information and the time difference, the video data is associated with the schedule schedule information, and the associated schedule schedule And a video editing unit for editing the video data based on the information. To.

  According to the present invention, there is provided a video editing system capable of automatically associating schedule information with captured video data and automatically extracting important scenes (automatic segmentation) by comparing progress information with a scheduled schedule. Can be provided.

  The video editing system and video editing apparatus of the present invention can take various forms based on the above-described configuration. That is, in the video editing system, the signal may be an audio signal.

  The audio signal output unit includes a plurality of audio signal output units that input the audio signal to the signal selection unit, and an audio output unit that converts the audio signal output from the signal selection unit into audio. One is an audio signal reproducing unit that reads information from an audio recording medium and reproduces an audio signal, and the scheduled schedule information includes audio information to be reproduced in each schedule, and the reproduced audio and the audio When the information matches, the video data and the scheduled schedule information can be associated with each other.

  The scheduled schedule information may include a scene start time and section length information of important scene information, and may include an important scene extraction unit that extracts the important scene from the video data.

  In the video editing apparatus, the scheduled schedule information includes a scene start time and section length information of the important scene information, and includes an important scene extraction unit that extracts a scene corresponding to the important scene from the video data. can do.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  The video editing system according to the embodiment of the present invention is a system for business use intended for video production companies and the like, taking pictures of events at lectures, wedding venues, music concerts and performance venues, and videos. It is used for editing. For example, video data acquired by a video recording device at a lecture or wedding venue is recorded on a recording medium that can be attached to and detached from the video recording device, and in addition to other video data in the editing room, this recording medium. Editing work is performed using the video data recorded in.

  Before an important section (important scene) starts in a lecture or wedding, a sound selection (switching) event occurs, such as the starter announces with a microphone or a new song flows through the venue. It is common to do. The important scene is, for example, a scene (video section) that is necessary at the time of editing, and means a scene that is highly likely to be adopted as a completed video after editing.

  The video editing system according to the present embodiment discriminates an important scene based on the audio selection (switching) event occurrence time (including before and after) in order to photograph and edit the important scene.

(Configuration of video editing system)
FIG. 1 is a block diagram showing a configuration of a video editing system according to the present embodiment. The video editing system according to the present embodiment includes an audio reproduction selection device 1, an editing device 2, a video recording device 3, a video recording medium 4, and a progress information recording medium 5.

  The audio reproduction selection device 1 includes an audio signal reproduction unit 13 that reproduces music signals that can be reproduced as audio by the audio output unit 15, music, music, and the like recorded on the audio recording medium 11, a microphone unit 12, and an audio switcher. 14 and an audio output unit 15. The reproduction of the music signal by the audio signal reproduction unit 13 is hereinafter referred to as CD reproduction. The audio recording medium 11 is a recording medium such as a music compact disc (hereinafter referred to as a CD). In addition, the microphone unit 12 is used, for example, for recording or amplifying the voice of the presenter, and generates a microphone audio signal that can be output as a voice in the voice output unit 15. The voice switcher 14 includes a voice selection unit 16 and a progress information recording unit 17. The audio selection unit 16 outputs an audio output signal obtained by selecting or multiplexing the music signal output from the audio signal reproduction unit 13 and the microphone audio signal output from the microphone unit 12.

  In the progress information recording unit 17, progress information including event information and event time information is recorded by the voice selection unit 16 when an event occurs. An event refers to switching the audio output signal output from the audio selection unit 16 from a music signal to a microphone audio signal (turning on the sound source of the microphone), and changing the audio output signal from the microphone audio signal to the microphone audio signal and the music signal. This is an operation of switching the voice selection unit 16 such as making a multiplexed signal. The event also includes changing the audio signal (music) recorded on the audio recording medium 11 reproduced by the audio signal reproducing unit 13. The event information is information indicating the contents of the event such as switching the sound output signal output from the sound selection unit 16 from the music signal to the microphone sound signal. The event time information is information indicating the time when the event occurs.

  The event time can be detected by mounting an integrated circuit having a Real Time Clock (RTC) function on the progress information recording unit 17 or the voice switcher 14. In this embodiment, a case where an integrated circuit having an RTC function is mounted on the voice switcher 14 will be described as an example.

  The voice switcher 14 records the progress information on the progress information recording medium 5. The audio output unit 15 includes a speaker or the like, and outputs an audio output signal output from the audio switcher 14 as audio.

  The progress information recording medium 5 is detachably attached to the audio reproduction selection device 1 and the editing device 2. In the progress information recording medium 5, the progress information is recorded by the voice switcher 14, and the progress information is taken out by the schedule time difference detection unit 22.

  The video recording apparatus 3 is a camera recorder, and includes a camera unit that captures an image of a subject and a recording unit that records video captured by the camera unit as video data on a video recording medium. In the case of a camera recorder released for business use, a camera unit, a recording unit, and other necessary functions (a specific description of the function will be described later) are often installed. The video recording medium 4 is a recording medium that records video data captured by the video recording device 3 and is detachable from the video recording device 3.

  The video recording medium 4 and the progress information recording medium 5 may be the same recording medium as the recording medium in which information other than the video data and the progress information is stored. In the present embodiment, the progress information recording medium 5 and the video recording medium 4 will be described by taking an example of a configuration in the form of an SD card. The video recording medium 4 and the progress information recording medium 5 are based on the SD I / F standard. Connected. The recording medium may not be in the form of an SD card.

  The editing device 2 includes a schedule management unit 21, a schedule time difference detection unit 22, a video editing unit 23, and an important scene cutout unit 24. In the present embodiment, the editing apparatus 2 operates a program in which a schedule management unit 21, a schedule time difference detection unit 22, and an important scene cutout unit 24 are added to a general nonlinear editing program on a computer. realizable.

  The schedule management unit 21 manages schedule information including scheduled event information and scheduled event time information determined in advance before the start of events such as lectures and weddings. The schedule information is composed of scheduled event information and scheduled event time information in a list format. Scheduled event information is information indicating the contents of a predetermined event (voice selection event). Further, the scheduled event time information is information indicating the time at which an event is scheduled to occur.

  The schedule time difference detection unit 22 extracts the progress information from the progress information recording medium 5 and extracts the scheduled event information from the schedule management unit 21. The schedule time difference detection 22 associates the progress information and the scheduled event information for each event, detects the difference time between the event time information of the associated progress information and the scheduled event time information of the schedule information, and the difference time Information is supplied to the important scene cutout unit 24.

  The important scene cutout unit 24 cuts out an important scene from the video / audio data based on the difference time detected by the schedule time difference detection unit 22.

  The video editing unit 23 combines the extracted important scenes to generate important video data. Video data is edited (for example, cut editing or image effect is added). The video editing unit 23 takes out video data from the video recording medium 4 and performs cut editing and video processing.

(Overview of video editing system operation)
Next, an outline of operations from preparation before shooting to shooting and editing in the video editing system will be described. Here, events (events) that are subject to photography such as lectures, weddings, music concerts, presentations, plays, and performances are called photography events. The state of the event to be photographed is photographed, and editing work is performed on the photographed video data after or during the event.

  In the shooting target event, if the progress is delayed, the occurrence of the event is also delayed by that time. This video editing system automatically detects important scenes even if the shooting target event is delayed, and automatically extracts important scenes by extracting the video data at the time shifted by that delay. Can be done.

  First, scheduled schedule information including scheduled event information, scheduled event time information, and information related to an important scene defined following the scheduled event before the shooting target event is started, that is, before shooting starts. Is recorded in the schedule management unit 21. Details of the schedule information will be described later.

  Next, the video recording device 3 starts shooting the event to be shot by the operation of the photographer. The video data of the video recording device 3 is stored in the video recording medium 4. In photographing by the video recording device 3, the computerized schedule schedule information may be recorded on the video recording medium 4, and the schedule schedule information may be displayed on the viewfinder of the video recording device 3. Further, it may be recorded (or printed) on paper when the scheduled schedule information is completed, and photographing may be performed while referring to the paper. Furthermore, it is possible to always record the video of the shooting target while the shooting target event is being performed (the recording is not stopped in the middle of the shooting target event), and it is always possible to prevent the important scene from being missed. be able to.

  In the present embodiment, the video recording apparatus 3 will be described by taking as an example a case where the shooting position is fixed and shooting is started and stopped by intermittently repeating the shooting of the shooting target. Here, the subject of photography refers to the main person, etc. in the subject of photography, for example, if the subject is a lecture, a speaker, if the subject is a wedding, the bride and groom, if the subject is a theater or play, the stage The whole and the leading actor.

  Next, the shooting target event is started. The shooting may be started after the start of the shooting target event. The shooting target event proceeds according to a predetermined schedule by a host of the shooting target event (hereinafter, the facilitator of the shooting target event is referred to as a moderator).

  In the audio reproduction selection device 1, according to the scheduled schedule, the presenter causes the audio selection unit 16 to generate an audio selection event such as outputting audio to the venue where the shooting target event is being performed. For example, when the moderator announces the start of the shooting target event, the voice selection unit 16 connects the microphone unit 12 and the voice output unit 15 (voice selection event), so that the voice input from the microphone unit 12 is received. It is thrown to the venue for the event. When playing back music, the audio selection unit 16 disconnects the microphone unit 12 and the audio output unit 15 and connects the audio reproduction selection unit 13 and the audio output unit 15. Then, the audio signal reproducing unit 13 reproduces the music data of the audio recording medium 11 so that music (music) is played to the venue of the shooting target event.

  When the moderator causes a voice selection event, the voice selection unit 16 generates event information and event time information and records the event information and event time information in the progress information recording unit 17. The progress information recording unit 17 stores event information and event time information in the progress information recording medium 5.

  Next, when the shooting target event ends and shooting ends, the progress information recording medium 5 is attached to the editing device 2 by the editor. When entering the editing operation, the schedule time difference detection unit 22 extracts the progress information from the progress information recording medium 5 and extracts the schedule information from the schedule management unit 21. The schedule time difference detection unit 22 compares the progress information with the schedule information, and performs association for each voice selection event. The schedule time difference detection unit 22 detects difference time information between the event time information of the associated progress information and the scheduled event time information of the schedule information, and extracts the progress information, the schedule information, and the difference time information from the important scene. To the unit 24.

  The important scene cutout unit 24 is further supplied with video data from the video recording medium 4 via the video editing unit 23. The important scene cutout unit 24 determines that the video data at the time shifted by the difference time information with respect to the important scene position of the schedule information is the important scene, and cuts out the video data. The important scene cutout unit 24 supplies video data of the cutout important scene to the video editing unit 23.

  The video editing unit 23 performs video editing by connecting the supplied video data of important scenes. Examples of the editing mode include a method of connecting video data corresponding to the cut-out result of the important scene by cut editing, and a method of applying a video effect (effect) to the joint. Note that a method for connecting by cut editing and a method for applying a video effect (effect) to the joint can be realized by a method used by a general non-linear editing machine, and detailed description thereof will be omitted.

  As described above, the processing flow related to the editing of video data has been described. However, the schedule schedule information management method in the schedule management unit 21, the detection method in the schedule time difference detection unit 22, and the extraction of important scenes in the important scene extraction unit 24 Details of the method will be described later. In this embodiment, the editing apparatus 2 is described as an example realized by a single program. However, since the editing apparatus 2 operates on a computer, the schedule management unit 21, the schedule time difference detection unit 22, and the important scene cutout unit 24 are operated. May be realized as a separate program.

  As described above, the video editing system according to the present embodiment detects the delay in the progress of the shooting target event as a delay in the occurrence of the audio selection event, and extracts the video data at the position shifted by the delay. You can edit the scene.

  Next, in the video editing system of the present embodiment, a shooting method and an editing method will be specifically described.

(Video recording device)
First, functions necessary for the video recording apparatus 3 in the present embodiment will be specifically described. The video recording device 3 can exert the effect of the present invention as long as it has a function of recording video data in which recording (shooting) time and video are associated with each other on a recording medium. As a method for realizing this function, a method of recording shooting date and time, shooting time information and time code information in one frame of video data, recording video data, and management information for managing the video data are recorded. In addition, there is a method in which the first shooting time information or time code information is recorded in the management information, and an arbitrary video data shooting time is specified by a video frame position (frame offset). In this embodiment, a method of embedding time information and time code information in one frame of a video will be described.

  Since these video recording apparatuses 3 are techniques that are generally widely implemented in camera recorders for business use and consumer use, detailed description thereof is omitted. In the present embodiment, any content management method can be used because it does not depend on the video compression method or the content (captured video data) management method. Further, even if the video recording device 3 alone cannot identify the shooting time information, at least the configuration that can be calculated by the editing device 2 is sufficient.

(Video recording medium)
Next, the video recording medium 4 will be described. The video recording medium 4 is a magnetic tape medium, a semiconductor memory, or an optical disk. For example, in the case of a magnetic tape medium, DIF as in the SMPTE (Society of Motion Picture and Television Engineers) -314M (DV-Based 25M) standard, which is one of the standards for business-use digital VTR (Video Tape Recorder). As a recording method, the recording date and time, the shooting time information, and the time code information can be recorded in association with the video data.

  Furthermore, even in the case of a randomly accessible recording medium such as a semiconductor memory or an optical disk, a method of recording video data generated according to the SMPTE-314M standard, data including shooting date and time, and shooting time information as a file is used. The video recording medium 4 can be used. The shooting time may be recorded in a separate file as management information for managing video data, or a time stamp on a file system for recording video data may be referred to.

(Data structure and recording format of scheduled schedule information)
Next, the data structure and recording format of the scheduled schedule information will be specifically described. A configuration example of the scheduled schedule information is shown in FIG. FIG. 2A shows a configuration example for managing scheduled schedule information. There is a “schedule identifier” as a component, and the “schedule identifier” is an identifier for managing scheduled schedule information. For example, a character string or a number such as “S0001” is assigned to the scheduled schedule information, and a match between the character string or the number is searched to identify the same scheduled schedule information.

  FIG. 2B shows one configuration example of one item (one event) of the scheduled schedule information. The scheduled schedule information is expressed by a list structure of items shown in FIG. 2B, and a plurality of items (multiple events) are configured in FIG. The schedule information includes schedule information and important scenes. The schedule information is information related to a voice selection event, and includes “schedule time”, “schedule voice selection”, and “schedule content”. The important scenes include “start time”, “important scene length”, and “title”.

  In general, important scenes (events that you want to see after shooting) are often limited or patterned. For this reason, if the schedule information is determined, it is possible to set an important scene before the event starts. The important scenes include, for example, a section explaining particularly important matters in the lecture, a section where the bride and groom appear at the wedding, and all sections from the start to the end in the play.

  The “scheduled time” corresponds to the scheduled event time information and indicates the scheduled time when the voice selection event occurs. “Scheduled audio selection” is a type of audio output that is finally output from the audio output unit 15 as a result of selection (switching) by the scheduled audio selection unit 16, for example, a microphone audio is output. Voice selection information such as CD playback sound being output. “Schedule content” represents attribute information of the sound that is finally output from the sound output unit 15 as a result of being selected (switched) by the sound selection unit 16, and includes, for example, a microphone number and a name of music (music) ( Any character string).

  The “start time” indicates the start time of the important scene when proceeding according to the schedule information. The “important scene length” indicates the section length of the important scene when proceeding according to the schedule information. Moreover, you may make it the structure which shows the end time of the important scene when it progresses according to schedule information instead of section length. “Title” is a title of an important scene and may be any character string. This is used, for example, by displaying scene selection on the screen during editing.

  FIG. 3A is a diagram showing items of a recording file (hereinafter referred to as a scheduled schedule information file) for recording the scheduled schedule information shown in FIG. FIG. 3B shows a specific example of the scheduled schedule information file. The scheduled schedule information file is recorded in a text format and in a Comma Separated Values (CSV) format in which character strings are separated by “,”.

  The schedule schedule information file shown in FIG. 3B has a format in which the schedule identifier described in FIG. 2 is described at the head of the file, and the configurations described in FIG. 2 are arranged in order and separated by “,”. The “scheduled time” and “start time” are described as “AM: 10:00: 00” with “AM” in the morning and “PM” in the afternoon. In “scheduled voice selection”, “CD playback” is used when the audio signal reproduced from the audio signal reproduction unit 13 is output to the audio output unit 15, and the audio signal of the microphone unit 12 is output to the audio output unit 15. Is described as “microphone sound”.

  Any character string may be described in “schedule content”, but in this embodiment, when “schedule audio selection” is “CD playback”, a song name (in the example of FIG. A ”,“ Song B ”,“ Song C ”) are described as a microphone number (“ Mic B ”in the example of FIG. 3) in the case of“ Mic voice ”. In “important scene length”, “00:02:00” is described in time display. Since the “title” is an arbitrary character string, the user can freely describe it. When no information is indicated, “NO_INFO” is described. In the present embodiment, the time information is represented as a character string. However, any description format may be used as long as the time information is meant.

(Data structure and recording format of progress information)
Next, the data structure and recording format of the progress information will be specifically described. The progress information is information regarding the progress state actually performed at the shooting target event, and is associated with the schedule information in the schedule time difference detection unit 22 (details will be described later). In other words, the progress information requires an element for the association, and thus has the same list format as the scheduled schedule information.

  FIG. 4 shows one configuration example of the progress information. The “progress information identifier” is an identifier for managing / identifying the progress information, and is an arbitrary character string. For the same shooting target event, it is preferable to match the schedule identifier of the scheduled schedule information. This is because the schedule schedule information can easily be associated with the progress information. When recording as a file instead of an identifier, a method of assigning the same character string to a file name and performing association may be used.

  “Actual start time” corresponds to the event time information, and represents a voice selection event occurrence time (time when the voice selection event actually occurs) in the progress of the shooting target event. The “voice selection result” represents the selection state of the voice selection unit 16 at the actual start time, and corresponds to the “scheduled voice selection” shown in FIG. The “content result” represents attribute information of the audio signal that is finally output from the audio output unit 15 as a result of being selected (switched) by the audio selection unit 16, and corresponds to the “scheduled content” illustrated in FIG.

  The progress information recording unit 17 records the progress information as a progress information file on the progress information recording medium 5. The format of the progress information file is assumed to be a text format (CSV format) similarly to the scheduled schedule information file.

(Shooting target)
Next, the relationship between the shooting method and the progress of the shooting target event in the video editing system of the present embodiment will be specifically described. First, an assumed shooting target event will be described. For example, in lectures, weddings, theater performances, etc., announcements of the start of the host's events are output on speakers, etc., and speakers and performers appear as music (music) starts to play There is a case. As in these examples, a voice selection event occurs during the shooting event. These audio selection events often occur immediately before or after the start of an important scene. The scheduled time information to be created in advance (before the start of the shooting event), aiming to improve the editing efficiency by using the occurrence time of the audio selection event and the audio selection result during editing during the shooting target event. This makes it possible to cut out and edit important scenes using.

  In the present embodiment, a case will be described in which the video recording apparatus 3 is used to perform shooting by a shooting method in which recording of a shooting target is started and stopped before and after the start of the shooting target event. If the time that can be recorded in the video recording medium 4 is sufficiently long for the event to be photographed, the photographing position of the camera recorder is set when the range of movement of the photographing object is limited, such as a lecture, wedding, or theater. By fixing and always recording, it is possible for the photographer to take a picture without monitoring the photographing situation.

(Important scene extraction method)
Next, the basic concept of extracting important scenes during editing will be described. First, scene division of video data that is the basis of editing will be described with reference to FIG. FIG. 5 is a conceptual diagram showing scene division of video data. The audio output (a) schematically represents the state of the audio signal output from the audio output unit 15, and at time 00: 00: 00: 00, the audio output unit 15 outputs “Song A” (audio signal reproduction). The unit 13 plays a CD). Similarly, at 00: 00: 02: 15, the audio signal output from the audio output unit 15 is switched from the CD playback audio to the microphone audio (audio signal input from the microphone unit 12), and time 00:00: At 13:20, the CD playback sound is switched again and “Song C” is output.

  The recording format (b) is a diagram showing video data recorded on the video recording medium 4. The reproduction format (c) is a diagram showing a state in which the video data is edited (divided).

  The change of the audio selection performed in the audio selection unit 16 and the change of the reproduction music can be divided into scenes as division points (division point 1, division point 2, division point 3 in FIG. 5). The above is the basic concept of automatic scene division of a scene at the time of editing.

  Here, the audio selection unit 16 is configured to reproduce the designated song with respect to the audio signal reproduction unit 13 (details will be described later). In addition, the time in FIG. 5 represents a time code value, and is a notation in which an hour, minute, second, and frame digit are separated by “:”. For example, 00: 00: 02: 15 represents 15 frames for 2 seconds. If the shooting time information of the division point is associated with the video data and recorded in the video recording medium 4, the editing apparatus 2 can easily perform scene division.

  However, when the above basic concept of scene division is realized only by the video recording apparatus 3, there are cases where the user cannot perform the desired scene division. For example, in a recording method in which recording is stopped or started intermittently, there is a possibility that shooting was not performed when an audio selection event occurred. In this case, since a division point cannot be associated with video data, Cannot split.

  In the present embodiment, in the video editing device 2, the video editing unit 23 performs video editing from the progress recording medium 5, the video recording medium 4, and the scheduled schedule information. FIG. 6 is a conceptual diagram of a method for extracting an important scene of video data in the present embodiment. The “scheduled schedule information” (a) includes important scene information including the occurrence time (scheduled sound selection event occurrence time) of the sound selection change or the reproduction music change and the schedule schedule information.

  The content described in “actual progress (sound output)” (b) includes, for example, the sound output from the speaker to the venue and the switching timing information thereof (sound generation event occurrence time, sound selection result and content result). Have. “Recording data” (c) includes “progress information” and “video data”. “Progress information” is recorded in the progress information recording medium 5 as progress information, such as voice selection events 0, 1, 2, and 3, as actual audio selection changes and playback song changes.

  In “after important scene cutout” (d), video data corresponding to important scene information included in the scheduled schedule information is extracted and arranged in the order of shooting. Note that, in order to arrange in an arbitrary order instead of arranging in the order of photographing, it can be easily realized by adding order information (number) to the important scene information.

  In the present embodiment, the important scene is defined based on the time point of the event. Therefore, as shown in FIG. 6, when the start position of the music piece A deviates from the scheduled schedule, the division points (such as voice selection changes) are also shifted accordingly. Since the important scene starts at a certain time away from (or at the same time) from the division point, the important scene also deviates from the scheduled schedule. In the video data, an important scene can be extracted by cutting out a section that is separated from the dividing point by a certain time.

  Therefore, as shown in event 2, the video editing system according to the present embodiment records video at the start of an important scene even if the video recording device 3 does not record video at the start of the event. If so, important scenes can be cut out.

  Next, the operation of each part of the video editing system in the present embodiment will be described in more detail.

(Operation of voice switcher)
First, the detection of the occurrence of a voice selection event during the shooting target event in the voice selection unit 16 will be specifically described. FIG. 7 is a block diagram showing a more detailed configuration of the voice switcher 14 in the present embodiment. The voice selection unit 16 is based on an operation input unit 31 for receiving an operation from a user, a switching unit 32 that selects an output audio signal based on operation information of the operation input unit 31, and operation information of the operation input unit 31. The audio signal reproduction unit 13 is instructed to reproduce and a reproduction instruction unit 33 that acquires the music title is included.

  Moreover, it has the 1st audio | voice input part 34 and the 2nd audio | voice input part 35 for inputting an audio | voice signal (music signal, microphone audio | voice signal). Furthermore, a voice selection event information notification unit 36 for notifying the progress information recording unit 17 of the voice selection result supplied from the switching unit 32, the playback start information and the song name supplied from the playback instruction unit 33, and a voice selection event A time generation unit 37 for generating the generation time. In addition, what is necessary is just to change about the 1st audio | voice input part 34 and the 2nd audio | voice input part 35 according to the input number of a required audio | voice signal.

  The operation input unit 31 receives an operation from the user and supplies operation information to the switching unit 32 and the reproduction instruction unit 33. When the selection switching between the first audio input unit 34 and the second audio input unit 35 occurs, such as when switching from CD playback to microphone sound, the operation input unit 31 sends the operation information to the switch unit 32. Supply. Further, the operation input unit 31 supplies operation information to the reproduction instruction unit 33 when starting CD reproduction or when changing the music to be reproduced on the CD.

  The switching unit 32 selects either the music signal supplied from the first audio input unit 34 or the microphone audio signal supplied from the second audio input unit 35 based on the operation information (that is, audio selection) of the operation input unit 31. Or both are selected and supplied to the audio output unit 15. In addition, the switching unit 32 notifies the audio selection event information notification unit 36 that the audio selection has been performed (audio selection result) and the content result thereof. The switching unit 32 is the same as a general function installed in a general voice switcher.

  The reproduction instruction unit 33 instructs the audio signal reproduction unit 13 to start and stop reproduction based on the operation information (reproduction instruction information) of the operation input unit 31. Also, the name of the song (corresponding to the result of the progress information) that is being played back (and instructed to start playback) is acquired and supplied to the voice selection event information notification unit 36. Since the reproduction instruction unit 33 of the present embodiment can be realized by a technique mounted on a general music player, details thereof are omitted. The first audio input unit 34 and the second audio input unit 35 receive audio signals (music signal and microphone audio signal) supplied from the audio signal reproduction unit 13 and the microphone unit 12, respectively, and supply them to the switching unit 32. Interface. An audio signal transmission medium is not particularly limited, and can be realized by a general audio interface.

  The time generation unit 37 generates a time when a voice selection event occurs, and supplies the time to the voice selection event information notification unit 36 as the voice selection event occurrence time. The time generation unit 37 generates a time by mounting an integrated circuit having a Real Time Clock (RTC) function. Since the voice selection event information notification unit 36 is configured to acquire the voice selection event occurrence time from the time generation unit 37 when the voice selection event occurs, the time generation unit 37 is configured to be able to calculate the time of each time by the RTC. I just need it.

  The audio selection event information notification unit 36 includes the audio selection result and content result supplied from the switching unit 32, the name of the music being played (and instructed to start playback) supplied from the playback instruction unit 33, and the time The progress information for one event is generated from the voice selection event occurrence time acquired from the generation unit 37. FIG. 8 is a diagram showing a specific example of the progress information file. The progress information in FIG. 8 corresponds to the scheduled schedule information in FIG.

(Progress information generation method)
Next, the progress information generation method in the voice selection event information notification unit 36 will be described. As shown in FIG. 8, for example, with respect to the progress information described in FIG. 4, “actual start time” corresponds to the voice selection event occurrence time, and the time information may be described as it is. The “sound selection result” corresponds to the sound selection result (for example, “microphone sound” or “CD playback” in FIG. 8) supplied from the switching unit 32.

  The “content result” differs depending on the audio selection result. The content result describes the content result supplied from the switching unit 32 or the playback in progress (and the playback start instruction supplied from the playback instruction unit 33). It is obtained by selecting whether to describe the music name. For example, when the sound selection result is “microphone sound”, the content result (for example, “microphone B” in FIG. 8) supplied from the switching unit 32 is described, and when it is “CD playback”, A music name (for example, “Song A”, “Song B”, “Song C” in FIG. 8) being played (and instructed to start playing) supplied from the playback instruction unit 33 is described.

  In addition, regarding the generation of the character string of the content result supplied from the switching unit 32, “Mike B” is used for convenience of explanation. However, even if “Mic” is used, the numerical value is incremented every time the voice selection is switched. 1 ”,“ microphone 2 ”,... In the present embodiment, “Mike B” and “Mike” are assumed to be the same (that is, “B” has no meaning).

  The voice selection event information notification unit 36 supplies the generated progress information for one event to the progress information recording unit 17. The progress information recording unit 17 holds the progress information for one event supplied from the voice selection event information notification unit 36 and manages the progress information for all events in a list. The audio selection event information notification unit 36 preferably holds the progress information from the start to the end of the shooting target event. However, when recording video from immediately after the start of shooting, such as after the start of the shooting target event, the progress information is retained from the time the power is turned on or after the event start operation from the user is received until it ends. You just have to.

  In addition, the progress information (list of all events) created and held by the progress information recording unit 17 is recorded in the progress information recording medium 5 at the end of the shooting target event. The shooting target event is ended by an explicit end instruction from the user.

(Details of editing video data)
Next, editing of video data will be described in detail. First, the management method of the schedule schedule information in the schedule management part 21 is demonstrated concretely. The functions necessary for the schedule management unit 21 include firstly a function of creating schedule schedule information, secondly a function of supplying schedule schedule information corresponding to the designated schedule identifier to the schedule time difference detection unit 22, and thirdly A function for holding the schedule schedule information created in the past, and a function for correcting the past schedule schedule information held in the past and creating new schedule schedule information.

  The schedule information file for recording the schedule information is a text file in CSV format, and the schedule management unit 21 is realized as a program on a computer in the present embodiment. Therefore, the schedule schedule management unit 21 having the above four necessary functions can be realized by a general computer processing technique.

  Next, a method for detecting the time difference between the scheduled schedule information and the progress information voice selection event occurrence time in the schedule time difference detection unit 22 will be described in detail. In order to detect the time difference, it is necessary to perform a two-stage process. As the first stage, the schedule schedule information and the progress information are associated with each other, and as the second stage, the difference between the scheduled time and the voice selection event occurrence time is calculated.

  A method for associating scheduled schedule information with each piece of information (each event) of progress information, which is processing in the first stage, will be described. First, the schedule time difference detection unit 22 reads the progress information recorded on the progress information recording medium 5 and acquires the schedule information corresponding to the progress information read from the schedule management unit 21. The corresponding schedule schedule information is associated with the progress information by comparing the progress information identifier of the progress information with the schedule identifier of the schedule schedule information and confirming a match.

  Next, each event is associated with each other from the time information, voice selection information, and content results included in the scheduled schedule information and the progress information. FIG. 9 is a diagram illustrating a specific example of association between schedule schedule information and progress information. FIG. 9A shows schedule schedule information, and FIG. 9B shows progress information. FIG. 9C shows a correspondence result between the schedule information in FIG. 9A and the progress information in FIG. 9B. The schedule identifier in FIG. 9A and the progress information identifier in FIG. 9B are omitted, but both identifiers are “S0001”.

  First, the schedule time difference detection unit 22 reads the progress information of FIG. 9B from the progress information recording medium 5. Next, the schedule time difference detection unit 22 acquires scheduled schedule information from the schedule management unit 21.

  Next, the schedule time difference detecting unit 22 compares each element of each event of the scheduled schedule information and associates the event of the scheduled schedule information with the event of the progress information. Specifically, “scheduled voice selection” and “sound selection result”, “schedule content” and “content result” are compared, and if all match, they are detected as the same event. For example, when comparing “scheduled event 1” and “progress event 1” shown in FIG. 9, the scheduled voice selection and the voice selection result (“CD playback”) match the scheduled content and the content result (“music A”). Therefore, it is detected as the same event, and as the “event 1” in FIG. 9C, the schedule schedule information and the progress information are associated with each other.

  Similarly, “event 2”, “event 3”, and “event 4” are also associated. Generally, schedules are written in order of time, so the same event detection process can be performed efficiently if the events with the earliest scheduled schedule information are compared with the events with the earliest progress information. Can do.

  Next, a method for calculating the time difference between the associated scheduled time and the voice selection event occurrence time, which is the second stage process, will be described. In the process of the first stage, the association between the scheduled schedule information and each event of the progress information is completed. Therefore, in order to calculate the time difference of the event occurrence time from the scheduled time, the scheduled time may be subtracted from the actual start time for each event. In other words, the time difference t (time difference) is expressed by the following equation.

t (time difference) = t (actual start time) -t (scheduled time)
Here, t (actual start time) is the actual start time of the progress information, and t (planned time) is the scheduled time in the schedule information of the scheduled schedule information.

  FIG. 10 is a diagram illustrating a time difference calculation result in the schedule information and the progress information associated with each other in FIG. In “Time difference”, it can be seen that each event is delayed from the scheduled time of 10 to 12 minutes. Here, “00:10:00” of “time difference” represents 10 minutes, and the hour, minute, and second digits are separated by “:”.

  Next, the important scene cutout method in the important scene cutout unit 24 will be specifically described. FIG. 11 is a diagram illustrating the relationship before the important scene cutout process and after the important scene cutout process.

  First, “cutout start time” indicates a point (cut edit point) at which video data starts to be cut out as an important scene, and is a time obtained by adding a time difference from the start time. However, since the time difference can be a negative value, when the time difference is a negative value, a negative value is added, that is, a value obtained by subtracting the time difference from the actual start time. For example, for the important scene 1 in FIG. 11, since the start time of the important scene information is AM 10:00 and the time difference is 00:10:00, the extraction start time is AM 10:10:00. The cut-out scene length represents a section length (time length) cut out as an important scene, and is the same section length (time length) as the important scene length of the important scene information. The cut-out title represents the title after the important scene is cut out, and is the same character string as the title of the important scene information.

  Next, the relationship between the video and the important scene cutout result will be described with reference to FIG. Here, FIG. 11 and FIG. 6 show the same specific example. In the example of FIG. 6 and FIG. 11, the start time of the shooting target event in actual progress is delayed by 10 minutes with respect to the scheduled schedule information. Yes.

  Further, the important scene cutout unit 24 obtains video data (one frame worth of video data) associated with the same time as the audio selection event occurrence time from the shooting time information corresponding to the video data recorded on the video recording medium 4. ) Position (for example, a frame offset from the first video data) is detected. That is, as described in “recording data” shown in FIG. 6, the video data and the progress information are associated with each other by the above method.

  Next, the important scene cutout unit 24 performs an important scene cutout process based on the result of associating the progress information with the video data and the important scene information in the scheduled schedule information. The start time t (important scene start) of the important scene to be cut out can be expressed by the following equation.

t (important scene start) = t (start time) + t (time difference)
Here, t (time difference) is the time difference described above, and t (start time) is the start time as the important scene information of the scheduled schedule information.

  The time t (important scene end) at the end point of the important scene to be extracted can be expressed by the following equation.

t (important scene end) = t (important scene start) + t (important scene length)
However, t (important scene length) is an important scene length as important scene information of the scheduled schedule information.

  Next, the video data section corresponding to the end point time (t (important scene end)) from the start point time (t (important scene start)) of the important scene calculated by the above important scene cutout method is obtained. Cut out as an important scene. FIG. 12 is a diagram showing a calculation method of the start point time and end point time of the cut out important scene and a specific example of cut out of the important scene (example of cut out of the important scene B in FIG. 6).

  Note that t (time difference) may be calculated based on the voice selection event (actual start time) closest to the start time (t (start time)) of the important scene information. Also, the video data corresponding to the start time and end time of the important scene after clipping may be detected with reference to the shooting time associated with each frame of the video data, or the scheduled time ( The frame offset may be calculated from the difference between t (scheduled time)) and the start time (t (start time)) to derive video data corresponding to each shooting time.

  By the above method, the important scene is cut out according to the important scene information of the scheduled schedule information regardless of the actual progress delay. As shown in FIG. 6, for example, video data is not recorded at the time of event 2. Also in this case, the important scene can be cut out by the method described above.

  As described above, according to the video editing system of the present embodiment, editing efficiency can be dramatically improved, and an editing device that is highly convenient for the user can be realized.

  The method of recording in the text format (CSV format) when recording the scheduled schedule information file and the progress information file has been described. For example, a markup language such as XML (extensible Markup Language) format or a text format is used. The same effect is exhibited even if it is described in a binary data format.

  Furthermore, although the audio selection event has been described in the present embodiment, for example, if a new means for detecting a scene change from video or detecting a loud sound from audio is provided, the same effect can be obtained with the same configuration. It is possible to demonstrate.

  Further, regarding the recording of the shooting time in the video recording device 3, it may be recorded as management information for managing video data (for example, a separate file from the video data), or a time stamp on the file system may be referred to.

  In the present embodiment, the schedule time difference detection unit 22 has acquired the schedule information from the schedule management unit 21 and compares the schedule information with the progress information. However, the present invention is not limited to this embodiment. For example, the schedule time difference detection unit 22 supplies the progress information identifier (“S0001” in the example) to the schedule management unit 21 and corresponds to FIG. 9A. It is also possible to obtain a schedule schedule information.

  The video editing system according to the present invention dramatically improves user editing convenience, and includes events such as video editing systems, video editing apparatuses, audio equipment, and the like that apply magnetic tape media, semiconductor memory, optical disks, etc. It can be widely used for venue equipment.

The block diagram which shows the structure of the video editing system which concerns on embodiment of this invention The figure which shows one structural example of the schedule schedule information in this Embodiment The figure which shows one specific example of the schedule schedule information file in this Embodiment The figure which shows one structural example of the progress information in this Embodiment. Conceptual diagram showing scene division of video data in the present embodiment Conceptual diagram showing the extraction of important scenes of video data in the present embodiment The block diagram which shows the detailed structure of the voice switcher in this Embodiment The figure which shows one specific example of the progress information file in this Embodiment The figure which shows one specific example of the correlation result of schedule schedule information and progress information in this Embodiment The figure which shows one specific example of the result of having calculated the time difference in this Embodiment The figure which shows the figure which shows the relationship before the important scene cut-out process in this Embodiment, and after an important scene cut-out process Conceptual diagram showing an important scene cutout start time and end time calculation method in the present embodiment

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Audio reproduction selection apparatus 2 Editing apparatus 3 Video recording apparatus 4 Video recording medium 5 Progress information recording medium 11 Audio recording medium 12 Microphone part 13 Audio signal reproduction part 14 Audio switcher 15 Audio output part 16 Audio selection part 17 Progress information recording part 21 Schedule management unit 22 Schedule time difference detection unit 23 Video editing unit 24 Important scene cutout unit 31 Operation input unit 32 Switching unit 33 Playback instruction unit 34 First voice input unit 35 Second voice input unit 36 Voice selection event information notification Unit 37 Time generation unit

Claims (8)

An imaging recording unit for recording video data on a recording medium;
A plurality of signals can be input, and a signal selection unit that switches and outputs the input signals according to an operator's selection;
A selection information recording unit for recording a selection time and switching state information when the signal selection unit switches the signal;
A schedule management unit that manages schedule selection information indicating a switching schedule of the signal selection unit, and schedule schedule information having a schedule selection time to be switched by the signal selection unit;
A schedule time difference detection unit for detecting a time difference by comparing the selected time with the scheduled selection time;
A video editing unit that associates the video data with the schedule schedule information based on the schedule selection information of the schedule schedule information and the time difference, and edits the video data based on the associated schedule schedule information; Video editing system.   The video editing system according to claim 1, wherein the signal is an audio signal. A plurality of audio signal output units for inputting the audio signal to the signal selection unit;
An audio output unit that converts the audio signal output from the signal selection unit into audio;
One of the audio signal output units is an audio signal reproduction unit that reads information on an audio recording medium and reproduces an audio signal;
The scheduled schedule information includes audio information to be reproduced in each schedule,
The video editing system according to claim 2, wherein the video data and the scheduled schedule information are associated when the reproduced audio and the audio information match. The scheduled schedule information includes scene start time and section length information of important scene information,
The video editing system according to claim 1, further comprising an important scene extraction unit that extracts the important scene from the video data. An audio signal reproducing unit that reads information on a recording medium and reproduces an audio signal;
An audio input unit for converting audio into an audio signal;
A signal selection unit that outputs the audio signal by switching between the audio signal from the audio signal reproduction unit and the audio signal from the audio input unit according to an operator's selection;
An audio output unit that converts the audio signal output from the signal selection unit into audio;
An audio reproducing apparatus comprising: a selection information recording unit that records a selection time and switching state information when the signal selection unit switches the audio signal on a recording medium. An audio signal selection unit that outputs audio signals by switching audio signals from a plurality of audio signal output units according to an operator's selection;
A voice switcher device comprising: a selection information recording unit for recording a selection time and switching state information when the signal selection unit switches the signal. Schedule selection information indicating a switching schedule of a signal selection unit that switches a plurality of signals and outputs one signal, and a schedule management unit that manages the schedule selection time that the signal selection unit switches;
The selection time when the signal of the signal selection unit is switched and the switching state information are read by the operator's selection, the scheduled schedule information is associated with the selected time and the switching state information, and the time between the selected time and the scheduled selection time A schedule difference detector for detecting differences;
A video editing apparatus comprising: a video editing unit that associates the video data with the scheduled schedule information based on the scheduled schedule information and the time difference and edits the video data based on the associated scheduled schedule information . The scheduled schedule information includes important scene information scene start time and section length information,
The video editing apparatus according to claim 7, further comprising an important scene extraction unit that extracts a scene corresponding to the important scene from the video data.

Images