JP2013131871A - Editing device, remote controller, television receiver, specific audio signal, editing system, editing method, program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an editing device capable of easily editing plural pieces of audio video data.SOLUTION: An audio analysis part 15 of an editing device 10 extracts a specific audio signal embedded in the pieces of audio video data and identifies a reproduction start point on each audio video data on the basis of each extracted specific audio signal. A control part 16 performs control to reproduce each piece of audio video data from the reproduction start point.

Description

  The present invention relates to an editing apparatus for editing video / audio data. The present invention also relates to a television receiver including such an editing device and a remote control device for remotely controlling such an editing device.

  In recent years, with the digitalization of video cameras, it has become possible for ordinary users to easily shoot digital images with high image quality and high sound quality. In addition, along with the price reduction of video cameras, it is said that general users want to create an edited video by shooting a subject from a plurality of angles using a plurality of video cameras and editing the plurality of audio / video data. Needs are growing.

  Patent Document 1 discloses an operation device for a video camera video recording deck capable of controlling a plurality of video recording decks at a time.

JP-A-10-271431 (released on October 9, 1998)

  Editing digital audio / video data requires an editing environment such as a personal computer and editing software. In general, the editing work requires a high level of knowledge and is a laborious work. Therefore, many users dislike editing work.

  The present invention has been made to solve the above-described problems, and a main object of the present invention is to realize an editing apparatus capable of easily editing a plurality of audio-video data.

  In order to solve the above problems, an editing apparatus according to the present invention is an editing apparatus that edits a plurality of videos represented by each audio-video data, and extracts a specific audio signal embedded in each audio-video data. Extraction means, identification means for specifying a reproduction start point on each audio video data based on each specific audio signal extracted by the extraction means, and each audio so as to reproduce each audio video data from the reproduction start point And control means for cueing video data.

  According to the editing apparatus configured as described above, the reproduction start point is identified based on the specific audio signal embedded in each audio / video data, and each audio / video data is reproduced from the identified reproduction start point. Since the audio / video data is cued, the audio / video data can be easily synchronized. Therefore, since the user does not need to perform a complicated operation to synchronize the audio / video data, the audio / video data can be easily edited.

  The specific audio signal includes a fixed frequency signal composed of a fixed frequency and a variable frequency signal composed of a variable frequency that changes in stages, and the identifying means includes the fixed frequency signal and the fixed frequency signal. It is preferable to specify the reproduction start point with reference to the variable frequency signal.

  According to the above configuration, the specifying unit specifies the reproduction start point with reference to the fixed frequency signal and the variable frequency signal included in the specific audio signal, and therefore, with a simple configuration for analyzing the frequency. The playback start point can be specified.

  In the editing apparatus according to the present invention, each audio / video data is supplied from each external device, and the control means controls each external device to reproduce each audio / video data from the reproduction start point. Is preferred.

  According to the editing apparatus configured as described above, the playback start point is specified based on the specific audio signal embedded in each audio video data supplied from each external device, and each audio video is determined from the playback start point. Since each external device is controlled so as to reproduce the data, each audio video data supplied from each external device can be easily synchronized. Therefore, the user does not need to perform a complicated operation to synchronize each audio / video data supplied from each external device, so that the audio / video data can be easily edited.

  The editing apparatus preferably further includes editing means for generating edited audio / video data by selecting any of the audio / video data to be reproduced at each time.

  According to the above configuration, the user can easily generate edited audio / video data from each audio / video data by using the editing means.

  The remote control device according to the present invention is a remote control device for remotely controlling an editing device that edits a plurality of videos represented by audio-video data, and the editing device starts reproduction of each audio-video data. It is characterized by comprising output means for outputting a specific audio signal that is referred to for specifying a point.

  According to the remote control device configured as described above, the editing device includes an output unit that outputs a specific audio signal that is referred to in order to specify the reproduction start point of each audio video data. Using the remote control device, a specific audio signal can be embedded in a part of audio / video data recorded by each external device.

  In addition, since an editing apparatus that edits such audio-video data can specify the playback start point with reference to the specific audio signal, the user can easily perform editing work.

  The editing system according to the present invention includes the editing device, the remote control device, and a plurality of video cameras as the external devices.

  According to the above configuration, the editing device identifies the playback start point based on the specific audio signal embedded in the audio / video data supplied from each video camera, so that the user can easily perform editing operations. Can do.

  A television receiver according to the present invention includes the editing device.

  According to the television receiver configured as described above, since the editing device is provided, the user can easily perform editing work. In addition, since it is not necessary to prepare a personal computer or editing software for editing work, user convenience can be improved.

  In addition, the specific audio signal according to the present invention is a specific audio signal that is embedded in the audio signal and referred to for specifying a specific position on the audio signal, and a fixed frequency signal composed of a fixed frequency, And an analysis device that analyzes the audio signal refers to the fixed frequency signal and the variable frequency signal to determine the specific position. It is characterized by specifying.

  The analysis device that analyzes the specific audio signal configured as described above specifies the specific position with reference to the fixed frequency signal and the variable frequency signal. Therefore, the specific audio signal has a simple configuration. Can be used to identify a specific location on the audio signal.

  The editing method according to the present invention is an editing method for editing a plurality of videos represented by each audio-video data, the extraction step extracting a specific audio signal embedded in each audio-video data, and the above extraction Based on each specific audio signal extracted in the process, a specific step for specifying a reproduction start point on each audio / video data, and cueing of each audio / video data to reproduce each audio / video data from the reproduction start point And a control process for performing.

  According to the editing method configured as described above, the same effects as those of the editing apparatus can be obtained.

  Further, a program for operating a computer as each means included in the editing apparatus according to the present invention and a computer-readable recording medium on which the program is recorded are also included in the scope of the present invention.

  As described above, the editing apparatus according to the present invention is an editing apparatus that edits a plurality of videos represented by each audio-video data, and an extraction unit that extracts a specific audio signal embedded in each audio-video data; , Based on each specific audio signal extracted by the extraction means, specifying means for specifying a reproduction start point on each audio video data, and each audio video data to reproduce each audio video data from the reproduction start point Control means for performing cueing.

  According to the editing apparatus configured as described above, the user can easily edit audio-video data.

It is a block diagram which shows the structure of the editing apparatus which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the remote control which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the digital video camera which concerns on one Embodiment of this invention. It is a figure which shows the waveform of the specific audio | voice signal which concerns on one Embodiment of this invention. It is a flowchart which shows the flow of the edit start point specific process by the editing apparatus which concerns on one Embodiment of this invention. It is a figure for demonstrating the example of application of this invention, Comprising: It is a figure which shows the case where the track course used at an athletic meet etc. is image | photographed from several different angles. It is a figure for demonstrating the application example of this invention, Comprising: (a) has shown the digital video camera and recording device which are used in the said application example, (b) is shown by each apparatus shown to (a). Each waveform of a specific audio signal to be recorded is shown. It is a figure for demonstrating the example of application of this invention, Comprising: Each voice data analyzed by the audio | voice analysis part which concerns on embodiment, and the figure which shows the time interval to the edit start point calculated as a result of an analysis is there. It is a figure which shows an example of the display screen in the edit operation | work using the television receiver provided with the editing apparatus which concerns on one Embodiment of this invention.

(Television receiver 30)
A television receiver 30 according to an embodiment of the present invention will be described with reference to FIG. The television receiver 30 includes an editing apparatus 10 according to an embodiment of the present invention, a video processing unit 31, an LCD panel 32, a recording unit 33, an amplifier 34, and a speaker 35. As shown in FIG. 1, the television receiver 30 is operated by a remote controller (remote operation device) 40.

(Configuration of editing apparatus 10)
As shown in FIG. 1, the editing apparatus 10 includes a first external input / output unit 11a, a second external input / output unit 11b, a third external input / output unit 11c, a USB interface 12a, an SD card interface 12b, a memory 13, and a decoding unit. 14, a voice analysis unit 15 (extraction unit, identification unit), a control unit 16 (control unit), an infrared light receiving unit 17, and an editing unit (editing unit) 20. The editing unit 20 includes a video selection unit 21, an audio selection unit 22, and an editing data generation unit 23.

  The first external input / output unit 11a, the second external input / output unit 11b, and the third external input / output unit 11c are interfaces for connecting an external device to the editing apparatus 10. The interface accepts audio / video data from an external device connected to the editing apparatus 10 and conforms to a standard capable of controlling the external device connected to the editing apparatus 10.

  Examples of the interface standard include HDMI and HDV (IEEE 1394). In the present embodiment, the first external input / output unit 11a and the second external input / output unit 11b are adapted to HDMI, and the third external input / output unit 11c is adapted to HDV. However, this is not a limitation of the present embodiment, and any signal may be used as long as it can transmit a control signal for controlling cueing of audio / video data by a digital video camera 50 described later.

  The USB interface 12a is an interface for taking in audio / video data from an external device connected via USB, and the SD card interface 12b is an interface for taking in audio / video data recorded on the SD card.

  The audio / video data fetched from the USB interface 12 a and the SD card interface 12 b is stored in the memory 13. As the memory 13, for example, a large-capacity flash memory can be used.

  In the following description, it is assumed that first to third digital video cameras 50a to 50c are connected to the first to third external input / output units as external devices, respectively. The first external input / output unit 11a, the second external input / output unit 11b, and the third external input / output unit 11c are also collectively referred to as the external input / output unit 11.

  In the present embodiment, a description will be given using audio / video data recorded in the digital video cameras 50a to 50c as an example of a plurality of audio / video data edited by the editing apparatus 10. However, the plurality of audio / video data edited by the editing apparatus 10 is not limited to this. The editing apparatus 10 can also be used to edit a plurality of audio / video data recorded in advance in the memory 13 or the recording unit 33 provided in the television receiver 30.

(Decoding unit 14)
The decoding unit 14 includes first to third audio / video data supplied from the first to third digital video cameras 50 a to 50 c via the external input / output unit 11, and video / audio data stored in the memory 13. Each audio video signal is generated by decoding each audio video data. The generated audio / video signals are supplied to the video selection unit 21 and the audio analysis unit 15. Each audio / video data is, for example, an MPEG2 stream or an MPEG4 stream.

  Hereinafter, the audio / video signals obtained by decoding the first to third audio / video data are also referred to as first to third audio / video signals, respectively.

In addition,
(Voice analysis unit 15)
The sound analysis unit 15 detects and extracts a specific sound signal from each sound signal decoded by the decoding unit 14 and specifies a synchronization position on each sound signal based on the extracted specific sound signal. Further, the voice analysis unit 15 supplies synchronization position information representing the identified synchronization position to the control unit 16.

  Here, the specific audio signal is a specific audio signal embedded in each audio signal, and the audio analysis unit 15 may specify a synchronization position in each audio video data by analyzing the specific audio signal. it can. In the present embodiment, this synchronization position is mainly used as an editing start point, and therefore, this synchronization position is also referred to as an editing start point (reproduction start point) P below. The edit start points P in the first to third audio / video data are also referred to as edit start points P1 to P3, respectively.

  Since specific processing for specifying the editing start point P based on the specific audio signal will be described later, description thereof is omitted here.

(Control unit 16)
The control unit 16 is connected to the external input / output unit 11, the decoding unit 14, the voice analysis unit 15, the infrared light receiving unit 17, and the editing unit 20, and controls these units.

  The infrared light receiving unit 17 receives an operation signal transmitted from the remote controller 40 operated by the user, and outputs the received operation signal to the control unit 16. The control unit 16 controls each of the above units according to the operation signal.

  The operation performed by the user via the remote controller 40 is, for example, an operation for putting the first to third audio / video data on standby at the editing start point P (standby operation), and an operation for starting editing (editing start operation). ), And an operation (audio / video data selection operation) for selecting audio / video data during editing. The control unit 16 can detect what operation the user is requesting from the editing apparatus 10 by acquiring an operation signal via the infrared light receiving unit 17.

  The control unit 16 generates a selection signal indicating which one of the first to third video / audio signals should be selected based on an audio / video data selection operation performed by the user via the remote controller 40, and the video selection unit 21, The audio selection unit 22 and the video processing unit 31 are supplied. More specifically, the selection signal is a signal indicating which of the first to third video / audio signals should be selected at each time point.

  Further, the control unit 16 controls the first to third digital video cameras 50 a to 50 c via the first to third external input / output units 11 a to 11 c based on a standby operation performed by the user via the remote controller 40. On the other hand, a control signal is supplied, and each audio / video data is put on standby at the edit start point P.

(Editor 20)
The editing unit 20 includes a video selection unit 21, an audio selection unit 22, and an editing data generation unit 23. Among the first to third audio / video signals decoded by the decoding unit 14, the first to third video signals which are the respective video signals are supplied to the video selection unit 21. Of the first to third audio / video signals decoded by the decoding unit 14, the first to third audio signals that are respective audio signals are supplied to the audio selection unit 22.

  The video selection unit 21 selects any one of the first to third video signals based on the selection signal supplied from the control unit 16 and outputs the selected video signal to the editing data generation unit 23. Further, the video selection unit 21 supplies the first to third video signals to the video processing unit 31.

  The audio selection unit 22 selects any one of the first to third audio signals and outputs the selected audio signal to the editing data generation unit 23 and the amplifier 34.

  The video processing unit 31 causes the LCD panel 32 to display each video represented by the first to third video signals supplied from the video selection unit 21. More specifically, the video processing unit 31 divides one screen into a plurality of areas, and displays the video and the video selected by the user in each area. An example of a screen displayed on the LCD panel 32 by the video processing unit 31 is shown in FIG.

  The amplifier 34 amplifies the audio signal supplied from the audio selection unit 22 and outputs the audio indicated by the audio signal via the speaker 35.

  Here, the selection of the audio signal by the audio selection unit 22 is performed based on the selection signal supplied from the control unit 16. Therefore, the audio selection unit 22 selects an audio signal corresponding to the video signal selected by the video selection unit 21. For example, when the video selection unit 21 selects the first video signal, the audio selection unit 22 selects the first audio signal.

  However, as another selection method in the voice selection unit 21, any one of the first to third voice signals may always be selected. For example, the sound selection unit 21 may be configured to compare the sound quality of each sound signal, and may be configured to always select the first sound signal when the sound quality of the first sound signal is excellent. Further, the voice selection unit 21 may be configured to select voice data stored in the memory 13.

  The edit data generation unit 23 generates edited audio / video data by multiplexing the video signal selected by the video selection unit 21 and the audio signal selected by the audio selection unit 22. Further, the generated audio / video data is appropriately encoded by an encoding method suitable for the recording unit 33, and the encoded data is supplied to the recording unit 33. The encoded data is, for example, an MPEG2 stream or an MPEG4 stream.

  The recording unit 33 records the encoded data supplied from the editing data generation unit 23 on a recording medium.

  As an example of the recording medium, an HD (hard disk) built in the television receiver 30, a BD (Blu-ray Disk) inserted in the television receiver 30, and the television receiver 30 are connected. DLNA compatible HD and the like. In the present embodiment, the recording medium is not limited to these, and any recording medium can be used as long as it can record the edited audio / video data.

(Remote control 40)
The remote controller (remote control device) 40 converts an operation selected by the user into an operation signal, and transmits the converted operation signal to the infrared light receiving unit 17 included in the television receiver 30. As a function different from the function of transmitting the operation signal, it has a function of generating a specific audio signal.

  FIG. 2 is a block diagram showing the configuration of the remote controller 40. As shown in FIG. 2, the remote controller 40 includes a control unit 41, an operation unit 42, an infrared transmission unit 43, a specific sound generation unit 44, and a speaker 45.

  An example of an operation performed by the user operating the remote control 40 is a general operation as an operation on the television receiver, such as changing a viewing channel and changing a volume. Further, as will be described later, an operation of selecting any of the plurality of sub-images is an example of an operation performed by the user via the remote controller 40.

  On the other hand, operations unique to the television receiver 30 according to the present embodiment include, for example, operations such as detecting the editing start point P, starting editing, and selecting audio / video data during editing.

  An operation signal indicating the content of the operation performed by the user on the operation unit 42 is supplied to the control unit 41. The control unit 41 interprets a specific operation indicated by the supplied operation signal, and when the operation indicated by the operation signal is to be transmitted to the television receiver 30, the control signal is transmitted to the infrared receiver. The data is supplied to the transmission unit 43. The infrared transmitter 43 transmits the operation signal supplied from the controller 41 to the outside of the remote controller 40 as an infrared signal.

  On the other hand, when the user wants to generate a specific audio signal from the remote controller 40, the user presses a specific audio output button provided on the operation unit 42, for example. Then, the operation unit 42 supplies an operation signal for generating a specific audio signal to the control unit 41, and when the control unit 41 receives the operation signal, the control signal for generating a specific audio signal. Is supplied to the specific voice generation unit 44.

  When receiving the control signal, the specific sound generation unit 44 generates a specific sound signal and outputs it through the speaker 45.

  Since details of the specific audio signal will be described later, the description thereof is omitted here. Further, the specific sound signal that can be generated by the specific sound generation unit 44 is not limited to one waveform. For example, the specific sound generation unit 44 may be set in advance so as to generate a plurality of specific sound signals having different waveforms. In such a configuration, the operation unit 42 of the remote controller 40 is provided with a button for selecting a specific audio signal, and the user can select the specific audio signal by operating the button.

(Digital video camera 50)
The specific audio signal output from the remote controller 40 is recorded as a part of each video / audio data by the first to third digital video cameras 50a to 50c.

  When audio / video data is edited using the television receiver 30, the first to third digital video cameras 50a to 50c are connected to the first to third external input / output units, respectively. The first to third digital video cameras 50a to 50c are collectively referred to as a digital video camera 50.

As the digital video camera 50, a general-purpose digital video camera can be used as long as the following conditions are satisfied.
An interface that can be connected to the external input / output unit 11 included in the television receiver 30 is provided.
-Specific audio signals can be recorded as part of audio-video data.

  As described above, the interface that can be connected to the external input / output unit 11 includes, for example, an interface that conforms to HDMI and HDV. However, the interface is not limited to these, and is a digital video camera. Any control signal may be used as long as it can transmit a control signal for controlling cueing of audio-video data by 50.

  In the present embodiment, as will be described later, a frequency region of 20 KHz or less is used as the frequency of the specific audio signal. Therefore, the digital video camera 50 only needs to be able to record a frequency region of 20 KHz or less as part of the audio video data.

  The above-mentioned two conditions are conditions that are included in most general-purpose digital video cameras distributed at the time of filing. In this embodiment, it is not necessary to prepare a special digital video camera in order to edit the audio / video data using the television receiver 30. For example, the digital video camera 50 does not need to have a configuration for performing special communication with other digital video cameras to synchronize audio / video data.

  FIG. 3 is a block diagram showing a basic configuration of the digital video camera 50. As shown in FIG. 3, the digital video camera 50 includes a control unit 51, an operation unit 52, an image sensor 53, a microphone 54, an external input / output unit 55, and a recording unit 56 that is a recording medium.

  The user performs operations such as recording start and stop, angle of view adjustment, and focus adjustment via the operation unit 52. The operation unit 52 supplies a signal corresponding to the operation performed by the user to the control unit 51. The control unit 51 controls each unit described above according to the signal.

  The image sensor 53 converts light input from an optical system that adjusts focus and magnification into video data and supplies the video data to the controller 51.

  The microphone 54 converts sound in the surrounding environment of the digital video camera 50 into sound data and supplies the sound data to the control unit 51.

  The control unit 51 generates audio / video data by multiplexing the video data supplied from the imaging element 53 and the audio data supplied from the microphone 54. Further, the generated audio / video data is appropriately encoded by an encoding method suitable for the recording unit 56, and the encoded audio / video data is supplied to the recording unit 56. The encoded audio / video data is, for example, an MPEG2 stream or an MPEG4 stream.

  The recording unit 56 records the encoded audio / video data supplied from the control unit 51 on a recording medium. As an example of the recording medium, any recording medium may be used as long as it can record audio-video data such as HD, SD card, or BD.

  The external input / output unit 55 may be an interface corresponding to the external input / output unit 11 included in the editing apparatus 10. For example, any interface that conforms to the HDMI or HDV standard may be used.

  The audio / video data recorded on the recording medium by the recording unit 56 is supplied to the television receiver 30 via the external input / output unit 55. Further, a control signal from the television receiver 30 is input to the external input / output unit 55, and the control unit 51 controls each unit included in the digital video camera 50 with reference to the control signal.

  For example, when receiving a control signal from the television receiver 30 to stand by at a predetermined time position on the audio / video data, the control unit 50 rewinds to a predetermined time position on the audio / video data. Fast-forwarding is performed, and standby is performed so that playback can be performed from the predetermined time position.

(Specific audio signal)
A specific audio signal extracted from each audio signal by the audio analysis unit 15 included in the television receiver 30 will be described with reference to FIG. The specific audio signal is generated by the specific audio generation unit 44 included in the remote controller 40 and recorded as a part of each of the first to third audio / video data and the audio data (or video / audio data) stored in the memory 13. Signal.

  The specific audio signal is embedded in the audio signal corresponding to each of the first to third audio signal data and the audio data (or video / audio data) stored in the memory 13. The specific audio signal is extracted by the audio analysis unit 15 in order to specify the editing start point P in each audio video data.

  FIG. 4 is a waveform diagram showing an example of the specific audio signal in the present embodiment. As shown in FIG. 4, the specific audio signal is an audio signal in which a fixed frequency signal FF having a fixed frequency and a variable frequency signal VF having a variable frequency that changes stepwise are repeated.

  In the example shown in FIG. 4, the fixed frequency signal FF is a signal having a frequency of 17.0 KHz. The variable frequency signal VF is a signal that gradually changes from 18.0 KHz to 18.9 KHz at intervals of 0.1 KHz. As shown in FIG. 4, the specific audio signal includes a fixed frequency signal FF that continues for a predetermined period and a variable frequency signal VF that continues for a predetermined period. Here, the predetermined time is expressed as t. In this embodiment, t = 0.5 seconds. That is, the audio specific signal according to the present embodiment is 17.0 KHz, 18.0 KHz, 17.0 KHz, 18.1 KHz, 17.0 KHz, 18.2 KHz, 17.0 KHz, 18.3 KHz,. Each signal having each frequency of 0 KHz, 18.8 KHz, 17.0 KHz, and 18.9 KHz is an audio signal continuous for 0.5 seconds, and the length of the specific audio signal is 10 seconds.

  The position of the edit start point P may be determined as a position where the specific audio signal ends, or may be determined as a position after an arbitrary time after the specific audio signal ends. This arbitrary time is defined as α. In the present embodiment, the editing start point P is determined with α = 1 second (see FIG. 4).

  Note that the repetition period of the fixed frequency signal FF and the variable frequency signal VF may be determined not by the predetermined time t but by the number of periods in which the signal continues. For example, the waveform of the specific audio signal may be determined so that the fixed frequency signal FF and the variable frequency signal VF are repeated every 8850 periods. In this case, the length of the specific audio signal is 10 seconds.

(Identification of editing start point P)
The voice analysis unit 15 extracts the specific voice signal from the voice signal to be analyzed, and analyzes the extracted specific voice signal to specify the editing start point P. The sound analysis unit 15 changes the frequency of the specific sound signal from the fixed frequency signal FF to the variable frequency signal VF (referred to as case 1) or from the variable frequency signal VF to the fixed frequency signal FF (referred to as case 2). A time point (also referred to as a frequency change point) on the audio signal to be detected is detected. This frequency change point is defined as _Tch .

Since t = 0.5 seconds in the present embodiment, it is preferable that the voice analysis unit 15 analyzes a specific voice signal for a time longer than 0.5 seconds in order to detect at least one _Tch . Correspondingly, it is preferable that the audio signal to be analyzed includes a specific audio signal having a time longer than 0.5 seconds.

The specific audio signal is an audio signal embedded in an audio signal obtained by decoding audio / video data, and may be embedded in other audio. Therefore, in order to specify the edit start point P more accurately, it is more preferable that the voice analysis unit 15 detects and analyzes a plurality of _Tch . For this purpose, it is more preferable that the voice analysis unit 15 analyzes a specific voice signal having a time longer than 1.0 seconds. Correspondingly, it is preferable that the audio signal to be analyzed includes a specific audio signal having a time longer than 1.0 seconds.

Incidentally, in the audio specified signal shown in FIG. _4, the frequency of the variable frequency signal VF at _{T ch} is defined as _{f VF.} For example, when the frequency of the specific audio signal changes from 17.0 KHz to 18.3 KHz, f _VF = 18.3 KHz. When the frequency of the specific audio signal changes from 18.6 KHz to 17.0 KHz, f _VF = 18.6 KHz. In addition, the frequency of the last variable frequency signal VF in the specific audio signal is defined as f _fVF . In the present embodiment, f _fFV = 18.9 KHz. Further, an interval when the frequency of the variable frequency VF changes stepwise is defined as D. In this embodiment, D = 0.1 KHz.

Hereinafter, a process in which the voice analysis unit 15 specifies the _first editing start point P1 on the assumption that the voice signal to be analyzed is the first voice signal will be described with reference to FIG. The same applies to the processing of analyzing the second and third audio signals and specifying the second and third editing start points P ₂ and P ₃ .

FIG. 5 is a flowchart showing a flow of processing for specifying the _first editing start point P ₁ by the voice analysis unit 15.

(Step S101)
The voice analysis unit 15 first acquires a first voice signal from the decoding unit 14.

(Step S102)
Subsequently, the voice analysis unit 15 extracts a specific voice signal embedded in the first voice signal acquired in step S101.

(Step S103)
Subsequently, the voice analysis unit 15 detects T _ch1 which is a time point when the frequency changes in the specific voice signal extracted in step S102.

(Step S104)
Subsequently, the voice analysis unit 15 determines whether T _ch1 corresponds to Case 1 or Case 2 by comparing frequencies before and after T _ch1 in the specific voice signal.

(Step S105)
When T _ch1 corresponds to Case 1, the voice analysis unit 15 determines the time T _P1 from T _ch1 to the editing start point P ₁ by the following formula (1).

For example, in the case of T _ch where α = 1 second and the frequency of the specific sound signal changes from 17.0 KHz to 18.3 KHz, the sound analysis unit 15 determines that T _P1 = 7.5 seconds.

(Step S106)
On the other hand, when T _ch1 corresponds to case 2, the voice analysis unit 15 determines _TP1 by the following formula (2).

For example, in the case of T _ch1 where α = 1 second and the frequency of the specific sound signal changes from 18.6 KHz to 17.0 KHz, the sound analysis unit 15 determines that T _P1 = 4.0 seconds.

(Step S107)
Then, the voice analysis unit 15 identifies the point in time obtained by adding T _P1 at time T _ch1 on the voice signal as the editing start point P _1. Further, the voice analysis unit 15 supplies the editing start point information indicating the editing start point P to the control unit 16.

Thus, the voice analysis unit 15 detects a T _ch is the timing to change the frequency of the audio specified signal, by identifying T _P using the above equation, the audio signal specific sound signal is embedded The editing start point P can be specified. In other words, the audio analysis unit 15 can specify the editing start point P in the audio / video data corresponding to the audio signal by performing the above analysis. Further, by specifying the editing start point P using the above formula, it is possible to deal with specific audio signals having various waveforms. That is, the editing start point P can be specified also by specific audio signals having various values as the parameters t, f _fVF , and D described above.

Note that specific values of the parameters t, f _fVF , D, and α are stored in the memory 13 provided in the editing apparatus 10 as predetermined values, and the voice analysis unit 15 reads out the values and reads the above values. It is good also as a structure used for this analysis process. The editing apparatus 10 acquires information on these specific numerical values from the remote controller 40, and based on the acquired information, the voice analysis unit 15 determines those specific numerical values and uses them for the above analysis processing. Good. This configuration is suitable when a plurality of types of characteristic audio signals are used.

Further, a method using a look-up table (LUT) may be adopted as a method for the voice analysis unit 15 to specify the editing start point P. For example, t, when using the f FFV predetermined value respectively _as, and alpha, obtained in advance the values of T _P for each value of f _VF, the voice analysis unit 15, a LUT containing these values Referring _to, it may be configured to determine _{T P} from _{f VF.} Such an LUT may be stored in the memory 13 provided in the editing apparatus 10, for example. By using the LUT, it is possible to reduce the processing amount due to calculation of T _P, the processing speed is improved.

  The fixed frequency and variable frequency that characterize the specific audio signal are preferably frequencies that can be recorded by a general-purpose digital video camera, for example, 20 KHz or less. Moreover, it is preferable that the frequency of the specific audio signal belongs to a high frequency band within a frequency range that can be recorded by the digital video camera. The specific audio signal is a signal for specifying a temporal position in the audio video data. As the frequency of the specific audio signal is higher, the editing start point P can be specified with higher accuracy.

(Modified example of specific audio signal)
The continuous time of the specific audio signal is not limited to 10 seconds, and can be set to an arbitrary time. When the time for which the specific audio signal continues is set longer than the above example, for example, the following two methods may be used.

  The first method is to increase the time t of each fixed frequency signal FF and each variable frequency signal VF without changing the range of the variable frequency signal VF (18.0 KHz to 18.9 KHz) and the frequency interval D. It is a method to do. In this embodiment, t = 0.5 seconds, but by setting t = 1.0 seconds, the specific audio signal becomes 20 seconds.

  Another method is to increase the number of times that the variable frequency signal VF changes sequentially without changing t = 0.5 seconds. By changing the frequency of the variable frequency signal VF from 18.0 KHz to 19.9 KHz at D = 0.1 KHz, the frequency of the variable frequency signal VF changes 20 times. Also in this case, the specific audio signal is 20 seconds.

  Further, even when t = 0.5 seconds and the frequency range of the variable frequency signal VF is 18.0 KHz to 18.9 KHz, by setting D = 0.05 KHz, the number of times the variable frequency signal VF changes can be set. Can be 20 times. Also in this case, the specific audio signal is 20 seconds.

  Generally, if the time of the specific audio signal is long, the convenience for the user can be improved. What is necessary is just to define the specific waveform of a specific audio | voice signal so that it may be convenient for a user.

<Application example>
A feature of the editing process using the television receiver 30 including the editing apparatus 10 is that a plurality of audio / video data is synchronized by analyzing a specific audio signal embedded in each audio / video data. Therefore, as a pre-process for editing a plurality of audio / video data using the television receiver 30, a specific audio signal is embedded in each audio / video data at the stage of recording and recording each audio / video data ( Record it).

  Hereinafter, an example of a method for recording and recording a plurality of audio / video data to be edited using the television receiver 30 will be described with reference to FIGS. In the following, a case will be described as an example where a plurality of audio-video data to be edited is obtained by photographing the same scene from different angles, but this does not limit the present embodiment.

  FIG. 6 is a diagram illustrating a case where a track course used in an athletic meet or the like is photographed from a plurality of different angles.

  The first digital video camera 50a and the second digital video camera 50b shown in FIG. 6 are digital video cameras whose shooting positions are fixed. The first digital video camera 50a is for photographing with a wide angle of view, and is for photographing mainly the atmosphere of the athletic meet. On the other hand, the second digital video camera 50b is for performing shooting at a narrow angle of view. In other words, it is for shooting with the runner's face up or shooting while adjusting the zooming according to one runner. The third digital video camera 50c is a camera held by the user, and the shooting position and the angle of view for shooting are not particularly defined. The third digital video camera 50c is for the user to move while moving freely.

  Further, as shown in FIG. 7A, in addition to the first to third digital video cameras 50a to 50c, the sound of the athletic meet is separately recorded using the recorder 60.

  FIG. 7B shows a specific audio signal emitted from the remote controller 40, a specific audio signal recorded by the first digital video camera 50a, a specific audio signal recorded by the second digital video camera 50b, and a third digital signal. It is a figure which shows each waveform of the specific audio | voice signal recorded by the video camera 50c, and the specific audio | voice signal recorded by the recording device 60. FIG.

  As shown in FIG. 7B, the user sequentially brings the remote controller 40 closer to the vicinity of the first to third digital video cameras 50a to 50c and the recorder 60, so that at least a specific audio signal is transmitted to each device. Record a part.

Here, as shown in FIG. 7B, the specific audio signal recorded in each device includes at least one frequency change point (the above-mentioned T _ch ) and frequencies before and after that.

  The audio analysis unit 15 included in the editing apparatus 10 analyzes audio data recorded in the first to third digital video cameras 50 a to 50 c and the recorder 60.

  FIG. 8 shows audio data recorded in the first to third digital video cameras 50a to 50c and the recorder 60 analyzed by the audio analyzing unit 15, and up to an editing start point P calculated as a result of the analysis. It is a figure which shows a time interval.

  As shown in FIG. 8, the audio analysis unit 15 analyzes the specific audio signal included in the audio video data recorded by the first digital video camera 50a by the above-described processing, and changes the frequency from the frequency 18 KHz to the frequency 17 KHz. The time interval from the point to the editing start point P is calculated as 10 seconds (sec). Similarly, the audio analysis unit 15 analyzes the specific audio signal included in the audio video data recorded by the second digital video camera 50b by the above-described processing, and starts from the frequency change point from the frequency 18.1 KHz to the frequency 17 KHz. The time interval to the edit start point P is calculated as 9 seconds (sec). Similarly, the audio analysis unit 15 analyzes the specific audio signal included in the audio video data recorded by the third digital video camera 50c by the above-described processing, and starts from the frequency change point from the frequency 18.3 KHz to the frequency 17 KHz. The time interval to the editing start point P is calculated as 7 seconds (sec). Similarly, the voice analysis unit 15 analyzes the specific voice signal included in the voice data recorded by the recorder 60 by the above-described processing, and from the frequency change point from the frequency 18.8 KHz to the frequency 17 KHz to the editing start point P. Is calculated as 2 seconds (sec).

  When the user instructs editing standby to the editing apparatus 10 via the remote controller 40, the control unit 16 included in the editing apparatus 10 performs the audio analysis unit 15 on the first to third digital video cameras. The video / audio data (audio data for the recorder 60, the same applies hereinafter) is fast-forwarded or rewound to the position of the editing start point P specified by the above, and each audio / video data is reproduced at the position of the editing start point P. Is paused to cue each audio-video data. In addition, the control unit 16 performs cueing so that the audio data recorded by the recording device 60 and stored in the memory 13 is reproduced from the position of the editing start point P.

  Here, as is clear from the above description, the editing start point P indicates the same time point in each audio video data, for example, the time point when the opening ceremony of the athletic meet starts.

  When the user instructs the editing apparatus 10 to start editing via the remote controller 40, the control unit 16 sends the audio / video data to the first to third digital video cameras and the recorder 60. Then, playback is started from the editing start point P.

  FIG. 9 is a diagram illustrating an example of a display screen in editing work using the television receiver 30 including the editing device 10. As shown in FIG. 9, first to third digital video cameras 50 a to 50 c are connected to the first to third external input / output units 11 a to 11 c included in the television receiver 30, respectively, and an SD card interface is provided. An SD card 61 on which audio data is recorded by the recorder 60 is connected to 12b.

  In addition, as shown in FIG. 9, video data from the first to third digital video cameras 50a to 50c are displayed as sub-images on the LCD panel 32 of the television receiver 30, respectively. The user selects one of the sub-images by performing an audio / video data selection operation via the remote controller 40. The video data corresponding to the selected sub-image is displayed as a main image as shown in FIG. In the example shown in FIG. 9, the sub image c is selected as the main image. As shown in FIG. 9, it is preferable that the currently selected sub-image is highlighted with a frame.

  Further, the user can switch the selected image by performing an audio / video data selection operation at an arbitrary timing. In this case, it is preferable that a frame is attached to the sub-image to be selected and the main image is switched to the sub-image to be selected when the user presses the determination button on the remote controller 40. FIG. 9 shows a case where the sub-image a is scheduled to be selected.

  Note that the frame box attached to the sub-image being selected and the frame box attached to the sub-image to be selected use different colors, for example, or the thicknesses of the frame lines are different from each other. It is preferable to display so that they can be distinguished from each other. Further, as shown in FIG. 9, the frame box attached to the selected sub-image may be displayed with a solid line, and the frame box dotted line attached to the sub-image to be selected may be displayed.

  The video selection unit 21 selects video data corresponding to the sub-screen (that is, the main image) selected at each time by the user, and the edit data generation unit 23 selects the video data selected at each time. Output as edited audio / video data. As described above, the audio data included in the edited audio / video data may be audio data included in the audio / video data from the first to third digital video cameras 50a to 50c, or may be recorded. The audio data included in the audio data from the device 60 may be used, or other audio data may be used as the BGM.

  As described above, the editing apparatus 10 according to the present embodiment can automatically perform cueing of audio / video data from a plurality of digital video cameras, so that the user can edit based on synchronized audio / video data. Work can be done easily. Further, since each digital video camera does not need to have a special configuration for synchronization, no extra cost is incurred.

  In the above-described example, the editing apparatus 10 directly uses audio / video data supplied from the first to third digital video cameras 50a to 50c which are external devices connected to the editing apparatus 10. Although the case of performing the editing process has been described, the present embodiment is not limited to this.

  For example, the editing apparatus 10 can be used to edit a plurality of audio / video data recorded in advance in the memory 13. As another example, the editing apparatus 10 can be used to edit a plurality of audio-video data recorded in advance in the recording unit. The recording unit may be the recording unit 33 included in the television receiver 30, or may be an external recording unit connected to the editing apparatus 10 via the USB interface 12a, for example.

  In such a case, the memory 13 may have a large number of audio and video data recorded with different shooting dates and times. The editing apparatus 10 is preferably configured to store such a large number of audio / video data in association with their shooting dates and times. The editing device 10 searches the audio / video data having substantially the same shooting date / time with reference to the shooting date / time associated with each of these audio / video data, and also specifies the specific audio from the searched audio / video data. What is necessary is just to set it as the structure which specifies the edit start point P by extracting a signal. The editing apparatus 10 may be configured to perform the above-described editing by playing back each audio-video data from the specified editing start point P. By adopting such a configuration, even when a large number of audio / video data having different shooting dates and times stored in at least one of the memory 13, the recording unit 33, and the external recording unit are edited, the user can easily perform editing work. It can be performed.

(Appendix 1)
In the above description, the digital audio / video data has been described as an example. However, this does not limit the present embodiment. As is clear from the above description, the editing process by the editing apparatus 10 according to the present embodiment is as follows. The present invention can also be applied to analog audio / video data. Therefore, an analog video camera may be used instead of the first to third digital video cameras 50a to 50-c.

(Appendix 2)
Each block of the editing device 10 described above may be realized in hardware by a logic circuit formed on an integrated circuit (IC chip), or may be realized in software using a CPU (Central Processing Unit). Also good.

  In the latter case, the apparatus includes a CPU that executes instructions of a program that realizes each function, a ROM (Read Only Memory) that stores the program, a RAM (Random Access Memory) that expands the program, the program, and various data. A storage device (recording medium) such as a memory for storing the. An object of the present invention is to provide a recording medium on which a program code (execution format program, intermediate code program, source program) of a control program for each device, which is software for realizing the functions described above, is recorded in a computer-readable manner. This can also be achieved by supplying to the apparatus and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. IC cards (including memory cards) / optical cards, semiconductor memories such as mask ROM / EPROM / EEPROM / flash ROM, PLD (Programmable logic device), FPGA (Field Programmable Gate Array), etc. Logic circuits can be used.

  Further, each of the above devices may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited as long as it can transmit the program code. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication network, and the like can be used. The transmission medium constituting the communication network may be any medium that can transmit the program code, and is not limited to a specific configuration or type. For example, even with wired lines such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, and ADSL (Asymmetric Digital Subscriber Line) line, infrared rays such as IrDA and remote control, Bluetooth (registered trademark), IEEE 802.11 wireless, HDR ( It can also be used by radio such as High Data Rate (NFC), Near Field Communication (NFC), Digital Living Network Alliance (DLNA), mobile phone network, satellite line, and digital terrestrial network.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  The present invention can be suitably applied as an editing apparatus for editing audio-video data.

DESCRIPTION OF SYMBOLS 10 Editing apparatus 11a 1st external input / output part 11b 2nd external input / output part 11c 3rd external input / output part 12a USB interface 12b SD card interface 13 Memory 14 Decoding part 15 Speech analysis part (extraction means, identification means)
16 Control unit (control means)
17 Infrared light receiving unit 20 Editing unit (editing means)
DESCRIPTION OF SYMBOLS 21 Image | video selection part 22 Audio | voice selection part 23 Edit data generation part 30 Television receiver 31 Image | video processing part 32 LCD panel 33 Recording part 34 Amplifier 35 Speaker 40 Remote control (remote control device)
50a First digital video camera (external device)
50b Second digital video camera (external device)
50c Third digital video camera (external device)

Claims (11)

An editing device for editing a plurality of videos represented by each audio-video data,
Extraction means for extracting a specific audio signal embedded in each audio video data;
Identification means for identifying a reproduction start point on each audio-video data based on each specific audio signal extracted by the extraction means;
Control means for cuing each audio-video data so as to reproduce each audio-video data from the reproduction start point;
An editing apparatus comprising: The specific audio signal repeatedly includes a fixed frequency signal composed of a fixed frequency and a variable frequency signal composed of a variable frequency that changes in stages,
The specifying means specifies the reproduction start point with reference to the fixed frequency signal and the variable frequency signal.
The editing apparatus according to claim 1. Each audio video data is supplied from each external device,
The control means controls each external device to reproduce each audio-video data from the reproduction start point.
The editing apparatus according to claim 1 or 2, characterized in that Editing means for generating edited audio / video data by selecting any of the audio / video data to be reproduced at each time;
The editing apparatus according to any one of claims 1 to 3, wherein A remote control device for remotely controlling an editing device for editing a plurality of videos represented by audio-video data,
The editing apparatus includes output means for outputting a specific audio signal referred to for specifying a reproduction start point of each audio video data.
A remote control device characterized by that. The editing device according to claim 3 or 4, the remote control device according to claim 5, and a plurality of video cameras as the external device,
An editing system characterized by that. The editing apparatus according to claim 1 is provided.
A television receiver characterized by that. A specific audio signal embedded in an audio signal and referred to to specify a specific position on the audio signal,
It includes a fixed frequency signal consisting of a fixed frequency and a variable frequency signal consisting of a variable frequency that changes in stages.
The analysis device for analyzing the audio signal specifies the specific position with reference to the fixed frequency signal and the variable frequency signal.
A specific audio signal characterized by that. An editing method for editing a plurality of videos represented by each audio-video data,
An extraction step of extracting a specific audio signal embedded in each audio-video data;
Based on each specific audio signal extracted in the extraction step, a specific step for specifying a reproduction start point on each audio video data,
A control step of cueing each audio / video data to reproduce each audio / video data from the reproduction start point;
The editing method characterized by including.   The program for operating a computer as each means with which the editing apparatus of any one of Claim 1 to 4 is provided. The computer-readable recording medium which recorded the program of Claim 10.