JP2008042630A - Recording apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving picture recording apparatus capable of mixedly recording video and audio by reducing the deviation of video and audio owing to delay of the video signal. <P>SOLUTION: The recording apparatus includes a delay means (delay section 308) for setting delay time so that the output timing from an imaging means (camera 305) coincides with the output timing from a tuner means (tuner 303), a composite means (composite section 307) for composing outputs from the imaging means and output from the tuner means with which output timing coincide each other, and a recording means (recording and reproducing section 313) for recording video and audio composite with means. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a recording apparatus, and more particularly to a recording apparatus suitable for use in a mobile recording apparatus with a TV / radio tuner in a digital video camera or a mobile phone.

  In recent years, in addition to analog television / radio broadcasting, digital television / radio broadcasting has been started and positioned as an important information infrastructure, and corresponding products and system development have been further advanced. TV / radio tuners are also installed in mobile devices such as mobile phones, and broadcasting for mobile devices is about to begin.

  By the way, in this digital broadcasting technology, it is known that a delay occurs due to each processing time such as encoding and multiplexing from the video input on the transmitter side to the video output on the receiver side. ing.

  Compared with conventional analog broadcasting, a delay corresponding to the total time required for each processing of a large-capacity digital video signal occurs, and the time actually transmitted is greatly shifted. When the actual digital broadcast is actually compared with the analog broadcast broadcast at the same time, it can be seen that there is a delay of about 2 to 3 seconds in the digital broadcast.

In addition, analog broadcasting itself, which is supposed to have a higher video signal processing speed than digital broadcasting, is originally broadcast after performing various processes, so that there is a slight deviation from the phenomenon at a certain time. Note that this delay amount also varies depending on the relay route such as satellite relay, broadcast station relay, and broadcast vehicle relay. In relation to the digital broadcasting technology, there is a technology described in Patent Document 1 below.
JP-A-5-153449

  For example, when a camcorder with a TV tuner wants to record live commentary by TV (or radio) broadcasting in a scene where a soccer game being broadcast is filmed at a local soccer stadium, there have been the following problems. It was.

  For example, in a scene that captures the state of a goal broadcast, when recording is performed by mixing the captured video and the audio during the broadcast, the video and the video have a sense of incongruity due to the delay of the video signal and a considerable time shift. .

  An object of the present invention is to provide a recording apparatus capable of reducing a gap between video and audio due to a delay of a video signal and capable of mixed recording of captured video and audio.

  In order to achieve the above object, a recording apparatus according to claim 1 is a tuner that receives broadcast waves and outputs a video signal and an audio signal, an imaging unit, a microphone, and a video signal from the imaging unit. A delay means for delaying; a setting means for setting a delay time of the delay means based on an output timing of a specific audio signal from the microphone and an output timing of a specific audio signal from the tuner means; and The image processing apparatus includes: synthesis means for synthesizing the output video signal and the audio signal from the tuner means; and recording means for recording the video signal and audio signal synthesized by the synthesis means.

  The recording apparatus according to claim 10 is a recording apparatus including a tuner unit that extracts video, audio, or data from radio waves, an imaging unit, a delay unit that delays an output from the imaging unit, and an output from the tuner unit. Comparing means for comparing the voice and the output voice from the delay means to determine a shift time, and a synthesizing means for synthesizing the output from the tuner means and the output from the delay means based on the output of the comparing means And recording means for recording the video and audio synthesized by the synthesizing means.

  According to the present invention, the output from the imaging unit and the output from the tuner unit that match the output timing are combined, and the combined video and audio are recorded. Alternatively, video and audio are synthesized and recorded in consideration of the amount of audio deviation. Therefore, the shift between the video and audio due to the delay of the video signal is reduced, and the mixed video and audio recording can be performed.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram schematically showing a system configuration of a recording apparatus according to an embodiment of the present invention.

  In FIG. 1, a camera-integrated recording apparatus includes a lens group 101, an image sensor 102, a camera signal processing unit 103, an image memory 104, an operation switch 105, a display 106, an audio comparison circuit 107, and a moving image encoding / decoding circuit 108. The recording medium 109 is provided.

  The recording apparatus also includes an interface 110, a CPU 111, a program memory 112, a program flash memory 113, a read control circuit 114, a CM detection circuit 115, a moving image synthesis circuit 116, and a TV / radio tuner circuit 117. The above modules are connected by a bus 118. In addition, a microphone 119 is connected to the voice comparison circuit 107.

  At startup, the program compressed in the program flash memory 113 is decompressed / expanded in the program memory 112, and the CPU 111 operates according to the program in the program memory 112 and performs various control operations described below.

  Light from the subject is imaged on the image sensor 102 through the lens group 101. The subject image formed on the image sensor 102 is photoelectrically converted into an electrical signal. A photoelectric conversion image from the image sensor 102 is read out at a predetermined cycle, and signal processing is performed by the camera signal processing unit 103 so as to become a standard digital moving image signal. It is temporarily stored in the memory 104.

  At the same time, this digital moving image is sent to the display 106, and the moving image currently being captured is displayed (photographing standby state). Shooting is started by pressing a shooting button (not displayed) included in the operation switch 105 in the shooting standby state.

  When shooting starts, the original moving image temporarily stored in the image memory 104 is compressed and encoded as a moving image in the moving image encoding / decoding circuit 108 (compressed main moving image). After being performed, the image memory 104 is temporarily stored as a buffer.

  Thereafter, the compressed main moving image is recorded on the recording medium 109 through the interface 110. When the shooting button included in the operation switch 105 is pressed again, recording of one cut video clip ends as recording ends.

  On the other hand, when analog broadcast waves and digital broadcast waves are converted into moving image signals through the TV / radio tuner circuit 117, they are sent to the display 106 as they are during playback and can be viewed.

  At the time of recording, the moving image signal that has passed through the TV / radio tuner circuit 117 is compressed and encoded by the moving image encoding / decoding circuit 108 and then sequentially recorded on the recording medium 109 via the shock proof memory. .

  Here, the voice comparison circuit 107 compares the two voices and detects that they are the same sound. The read control circuit 114 performs various reads. The CM detection circuit 115 detects a CM from the output of the television / radio tuner circuit 117. The moving image synthesis circuit 116 synthesizes two moving images. These are activated as appropriate under the control of the CPU 111 through the bus 118.

  Although these functions are described in hardware in FIG. 1, it is needless to say that these functions can be easily realized by software and are stored in the program memory 112.

  FIG. 2 is a diagram showing the concept of moving image recording / playback in the recording apparatus of FIG.

  In FIG. 2, there are two objects from the camera body and the television, which are the camera image (CV), camera microphone sound (CS), television image (FV), and television sound (FS), respectively. The input from the TV tuner and the input from the camera are combined by the combining circuit 203.

  At that time, audio and video from the camera are synchronized by providing a delay corresponding to the delay time of the television broadcast path in the buffer 201. Further, the delay control unit 202 controls the delay of the input from the TV tuner and the input from the camera.

  The output from the synthesizing circuit 203 can be selectively switched by the switch 204, and various synthetic recordings can be performed depending on the usage method of the user. The output from the synthesis circuit 203 is encoded by the encoding unit 205, and is recorded and reproduced.

  When there are two targets, video on the camera side and video on TV broadcast, the user can record or play back three types of video, camera, TV, and TV + camera, and three types of audio as well. Each combination.

  Here, first, the recording operation when the camera and the TV side are mixedly recorded, particularly when the recording target is the output sound from the TV tuner and the video of the camera will be described with reference to FIG. For simplicity of explanation, analog broadcasting is assumed.

  FIG. 3 is a diagram schematically showing functional blocks of the recording apparatus according to the embodiment of the present invention.

  In FIG. 3, the subject A is photographed by both the television broadcast camera 301 and the camera 305 in the recording apparatus (imaging recording apparatus) 300 (dotted line frame) of the present invention. The video shot by the TV broadcast camera 301 is broadcast on the radio wave from the broadcast station 302 through the broadcast path of the broadcast station while being encoded into MPEG video, error correction code, multiplexing, modulation and the like. The

  On the other hand, when the user operates the operation unit 312 in the recording apparatus 300 to select a broadcast channel, the tuner 303 decodes (or demodulates) the signal encoded (or modulated) for broadcasting. Then, the video signal and audio signal of the selected broadcast are output.

  Both the output video signal and audio signal are sent to the CM cut unit 306 using the CM detection circuit 115. Although only the audio signal is output from the CM cut unit 306, when the CM is detected, the detected time is silenced and the TV audio signal is input to the synthesis unit 307.

  On the other hand, when the broadcast channel selection unit 311 selects a broadcast channel, a predetermined delay time amount preset in the delay setting memory 310 is extracted for each broadcast station, and the delay time amount is extracted to the delay control unit 309. Sent to the delay unit 308 for delay control.

  The video signal and audio signal from one camera 305 are sequentially sent to the delay buffer of the delay unit 308. The video signal of the camera 305 is sequentially sent to the synthesizing unit 307 and the audio signal is sequentially sent to the delay time calculating unit 304 at the timing read from the delay control unit 309. The audio / video from the synthesis unit 307 is recorded / reproduced by the recording / reproduction unit 313.

  The delay time calculation unit 304 receives a television audio signal from the output of the tuner 303, and calculates the delay time using the television audio signal and the above-described delayed camera audio signal. In the delay time calculation unit 304, the audio comparison circuit 107 in FIG. 1 is used to compare the camera audio and the TV audio, detect the location where the same audio is generated, and calculate the time of deviation.

  Taiko and other sounds often contain sounds that are characteristic of the sound's frequency and sound pressure. This is detected at regular time intervals, the calculated time is sent to the delay setting memory 310, and the time used for delay control is reset. If the two audio signals of the camera sound and the television sound are signals in which a time code is written, the delay time calculated based on the time code may be calculated.

  When the delay control with the reset delay time is entered, the delay time is calculated by following a similar loop. When this becomes less than the prescribed delay amount, this loop is exited and recording proceeds with the final delay time.

  However, this voice comparison is programmed so as not to be performed when a CM is detected. If the buffer memory for delaying the camera video is small, the camera video may be encoded (compressed) once, buffered, and decoded (decompressed) before reading. Note that the encoding at this time is the maximum bit rate encoding or the bit rate equivalent to that of digital television broadcasting.

  This embodiment has been described using an example in which audio from a television and video from a camera are combined and recorded. When synthesizing TV video and camera audio, the output from the tuner 303 is switched to the TV audio signal, and the output from the delay unit 308 to the synthesizing unit 307 is switched to the camera audio signal. It can be easily realized without.

  In addition, when synthesizing the audio of the television and the audio of the camera, it is possible to synthesize the uncompressed audio signal by the synthesizing unit 307, and other configurations may be the same.

  Further, in the case of digital television broadcasting, since it takes time to decode the output from the tuner 303, the capacity and delay time of the delay unit 308 further increase. On the other hand, when a system that requires a large amount of processing for signal processing of camera video is incorporated, the television or radio broadcast signal may be delayed.

1 is a diagram schematically showing a system configuration of a recording apparatus according to an embodiment of the present invention. It is a figure which shows the concept of the moving image recording / reproducing in the recording device of FIG. FIG. 2 is a diagram schematically showing functional blocks of a recording apparatus according to an embodiment of the present invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Lens group 102 Image pick-up element 103 Camera signal processing part 104 Image memory 105 Operation switch 106 Display 107 Voice comparison circuit (comparison means)
108 video encoding / decoding circuit 109 recording medium 110 interface 111 CPU
112 Program memory 113 Program flash memory 114 Read control circuit 115 CM detection circuit 116 Movie composition circuit 117 TV / radio tuner 118 Bus 303 Tuner (tuner means)
304 Delay time calculation unit (delay amount calculation means)
305 Camera (imaging means)
307 Combining unit (combining means)
308 Delay section (delay means component)
309 Delay control unit (delay means component)
313 Recording / playback unit (recording) means

Claims (10)

Tuner means for receiving broadcast waves and outputting video and audio signals;
Imaging means;
A microphone,
Delay means for delaying a video signal from the imaging means;
Setting means for setting the delay time of the delay means based on the output timing of the specific audio signal from the microphone and the output timing of the specific audio signal from the tuner means;
Synthesizing means for synthesizing the video signal output from the delay means and the audio signal from the tuner means;
Recording means for recording the video signal and the audio signal synthesized by the synthesis means;
A recording apparatus comprising:   The recording apparatus according to claim 1, wherein the delay unit has a plurality of the delay times and selects any one of the delay times.   2. The recording apparatus according to claim 1, wherein the delay time of the delay means is preset for each channel of the tuner means.   4. The recording apparatus according to claim 1, wherein the delay unit has a moving / audio encoding / decoding function.   5. The recording apparatus according to claim 4, wherein the bit rate of encoding / decoding of the delay unit is equal to the bit rate of the signal input to the tuner unit.   The setting means calculates the delay time by comparing an output timing of a specific audio signal output from the tuner means with an output timing of a specific audio signal output from the microphone. The recording apparatus according to claim 1.   The recording apparatus according to claim 6, wherein the delay amount calculating unit calculates a delay amount based on a frequency analysis result of two input voices.   The recording apparatus according to claim 6, wherein the delay amount calculating unit calculates a delay amount from time codes of two input audio or video signals. 9. The method according to claim 1, further comprising CM detecting means for detecting CM from the output of the tuner means, and switching the input to the synthesizing means from the tuner output during the detected CM period. The recording device described in 1. In a recording device comprising tuner means for extracting video, audio or data from radio waves, and imaging means
Delay means for delaying the output from the imaging means;
A comparison means for comparing the output sound from the tuner means and the output sound from the delay means to determine a shift time;
Combining means for combining the output from the tuner means and the output from the delay means based on the output of the comparing means;
Recording means for recording video and audio synthesized by the synthesizing means;
A recording apparatus comprising:

Images