JP2006166210A - Image pickup system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To control image pickup at a crucial moment in reproducing video. <P>SOLUTION: At a broadcasting station 1, during a desired vertical blanking period of an inputted video signal, an image pickup control signal is superimposed and sent as a television broadcasting signal. To a tuner 16, the television broadcasting signal received from the broadcasting station 1 is inputted. An output of the tuner 16 is sent to a separation part 18. The separation part 18 separates from the television broadcasting signal a video signal and a data signal. The video signal is sent to a video processing circuit 20, whereas the data signal is sent to an image pickup control signal extraction part 24. The image pickup control signal extraction part 24 extracts the image pickup control signal from the data signal. The extracted image pickup control signal is transmitted to a digital camera 200 via a communication interface 29. The digital camera 200 controls image pickup according to the received image pickup control signal. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging system, and more particularly to an imaging system that controls imaging in conjunction with video reproduction.

Conventionally, a technique for obtaining desired information from a television broadcast signal has been developed. For example, according to Patent Document 1, a broadcaster provides and stores various information as communication contents on a content server for information related to a program broadcast by its own station. The viewer operates a remote control attached to the home server to select a broadcast program stored in the home server and reproduce and view it. The viewer can also pause the reproduction of the program and access various information provided via the content server during the reproduction and viewing of the broadcast program. Then, after browsing the data obtained from the content server, it is possible to start playback of the program again from the place where the previous program was paused and watch the rest of the program.
JP 2002-142208 A

  By the way, when watching a highly entertaining program such as the Olympics, if a decisive moment is aired, the viewer may react to the expression and motion. In order to take a picture in such a decisive scene, the cameraman has to wait with the camera facing the viewer and press the shutter button in response to the arrival of the decisive moment to start imaging. The present invention has been made in view of such a problem, and an object thereof is to control imaging at a decisive moment during video reproduction.

  In order to solve the above-described problem, an imaging system according to the present invention includes an extraction unit that extracts an imaging control signal superimposed in synchronization with a drawing timing of a specific video from the video signal of the video, and a video according to the video signal. And an imaging device having an imaging unit that images the subject, and a control unit that controls imaging of the subject by the imaging unit in accordance with the extracted imaging control signal.

  According to the present invention, it is possible to control imaging at a timing when a specific video is displayed. For this reason, when watching a highly entertaining program video such as the Olympics, it is possible to automatically record the viewer's facial expression, attitude, and reaction when a decisive moment is displayed. Note that the imaging control signal includes a signal for controlling the start of still image capturing, the start of moving image capturing, or the end of moving image capturing.

  In order to synchronize the start timing of drawing of a specific video and the timing of imaging control, the imaging control signal is superimposed on a vertical blanking period between two fields constituting the drawing frame of the specific video.

  The extraction unit may extract additional information from the video signal, and the imaging apparatus may record the additional information together with the captured image.

  An imaging method according to the present invention includes a step of extracting an imaging control signal superimposed in synchronization with a drawing timing of a specific video from the video signal of the video, a step of displaying a video according to the video signal, and an extracted imaging Controlling imaging of the subject in accordance with the control signal.

  It is also possible to provide a recording medium that records the video signal of the video on which the imaging control signal is superimposed in synchronization with the drawing timing of the specific video.

  According to the present invention, it is possible to control imaging at a timing when a specific video is displayed. For this reason, the viewer's facial expression, attitude, and reaction can be automatically recorded when a decisive moment is displayed while watching a highly entertaining program video or the Olympic Games.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

<First Embodiment>
FIG. 1 is a diagram showing a schematic configuration of an imaging system according to a preferred first embodiment of the present invention. The imaging system of the first embodiment includes a television broadcast receiver 100, a digital camera 200, and a monitor 22. The television broadcast receiving apparatus 100 includes an antenna 14, a tuner 16, a separation unit 18, a video processing circuit 20, an imaging control signal extraction unit 24, a ROM 25, a display control unit 28, and a communication interface 29. The digital camera 200 is placed at a position where a person (viewer) who views the monitor 22 can be imaged as a subject.

  The television broadcast receiving apparatus 100 and the digital camera 200 are connected to each other via various communication interfaces 29 such as USB (Universal Serial Bus), LAN, and Bluetooth, and can transmit / receive desired data to / from each other.

  The antenna 14 receives a television broadcast signal including a program video signal from the broadcast station 1. The broadcast station 1 transmits a video signal (or a video / audio signal including audio) by a television broadcast signal, and transmits a digital data signal (hereinafter simply referred to as a data signal) as a data broadcast.

  The TV video transmitted by the video signal is called interlace (interlace scanning), and first scans every other line to draw a rough screen, and the next 262.5 times draws a screen that fills in between. A screen drawn by two scans is called a frame, and two rough screens constituting one frame are called fields. The broadcasting station 1 sends a moving image by sending a still image of 30 frames (60 fields) per second.

  The monitor 22 is provided with 525 scanning lines, but not all of the 525 scanning lines are used for screen display, and an interval period (vertical period) is set at the timing corresponding to the first 21 lines in each field. (Blanking period) is assigned. One vertical blanking period has a capacity of 10 KB per second as digital data. By superimposing various digital data signals such as caption information during this vertical blanking period, it is possible to send the data signal together with the video signal. The vertical blanking period includes a signal (vertical synchronization signal) for synchronizing the timing to start drawing the screen.

  In the broadcasting station 1, a video signal obtained from a television camera or the like is input from the video signal input unit 3 to the superimposing unit 4, while the data signal input unit 2 inputs a data signal from a personal computer or the like to the superimposing unit 4. The superimposing unit 4 superimposes the imaging control signal in a desired vertical blanking period of the input video signal. The imaging control signal includes an AE / AF process start signal, an imaging start signal, a recording start signal, and a recording end signal, which will be described later. However, the imaging control signal is not limited to these as long as it is a control signal related to imaging of the camera 200.

  The imaging start signal is a signal for instructing the digital camera 200 to start still image shooting. However, the imaging system of the present embodiment starts and ends the imaging of the digital camera 200 at the timing when a specific video screen is drawn. Objective. For this reason, it is necessary to synchronize the drawing start timing and the imaging start timing of a specific video screen. In order to achieve this synchronization, an imaging control signal is superimposed on a vertical blanking period between two fields constituting one specific frame. In this way, an imaging start signal is sent in synchronization with the drawing start timing of a specific video screen, so that a change in the facial expression of the person viewing the video screen can be shot in conjunction with the drawing of the video screen. The frame (or the field constituting the frame) on which the imaging control signal is to be superimposed can be arbitrarily designated from the superimposing unit 4, and the superimposing unit 4 captures the imaging control signal between the fields constituting the designated desired frame. Is superimposed. By doing so, the timing of the imaging control of the digital camera 200 can be arbitrarily specified remotely from the broadcasting station 1 side.

  The recording start signal is a signal for instructing the start of moving image shooting by the digital camera 200, and the recording end signal is a signal for instructing the end of moving image shooting of the digital camera 200, but the recording start signal, the recording end signal, and other imaging control It is possible to arbitrarily specify between which fields the signal is inserted from the superimposing unit 4. For this reason, an attendant at the broadcasting station 1 can remotely issue an imaging start instruction, a recording start instruction, and a recording end instruction at a timing that matches the drawing timing of an arbitrary frame.

  As data signals, various additional information other than imaging control signals such as program related information including information related to video such as explanation of TV program contents, character telop information, images, link information to HTML data, etc. May be superimposed on the vertical blanking period.

  The transmission unit 5 of the broadcast station 1 wirelessly transmits a television broadcast signal on which a video signal and a data signal are superimposed. A TV broadcast signal received by the antenna 14 from the broadcasting station 1 is input to the tuner 16. The tuner 16 performs processing such as frequency conversion and digital demodulation of an analog signal. The output of the tuner 16 is sent to the separation unit 18. The separation unit 18 separates the video signal and the data signal from the television broadcast signal sent from the tuner 16. The video signal is sent to the video processing circuit 20. The video signal contains any video. On the other hand, the data signal is sent to the imaging control signal extraction unit 24. The imaging control signal extraction unit 24 separates and extracts the imaging control signal and the additional information from the data signal.

  The video signal sent to the video processing circuit 20 is encoded into a video signal in accordance with a predetermined signal system, for example, a video signal of the NTSC (National Television System Committee) system and output to the monitor 22. The monitor 22 displays an image according to the video signal.

  The display control unit 28 controls the tuner 16 by the channel selection signal transmitted from the remote controller 30 to select and receive a television broadcast signal of a specific channel. The display control unit 28 controls the operation of each unit of the television broadcast receiving apparatus 100 (for example, turning on / off the character telop display or changing the sound volume).

  The imaging control signal extraction unit 24 extracts an imaging control signal from the data signal, and transmits the extracted imaging control signal to the digital camera 200 via the communication interface 29. When the imaging control signal extraction unit 24 separates the additional information, the additional information is also transmitted to the digital camera 200 via the communication interface 29.

  FIG. 2 is a functional block diagram of the digital camera 200. In the figure, a central processing unit (CPU) 112 includes various buttons such as a shutter button 102 and a mode switching lever 106, a cross key, a menu / execution button, a cancel / return button, a display button, a shift button, and a display switching button. Based on the input from the operation unit 157 including an enlarged display button, an AE fixing button for inputting an AE lock instruction, a mode dial, and the like, the respective circuits in the digital camera 200 are controlled in an integrated manner.

  The camera 200 includes a communication unit 156 that transmits / receives various data to / from the television broadcast receiving apparatus 100, and particularly receives an imaging control signal and additional information.

  Now, when the shooting mode is set by the mode switching lever 106, the CPU 112 displays a moving image (through image) on the image display device 110 so that the shooting angle of view can be confirmed. That is, the subject light that has passed through the diaphragm 116 and the photographing lens 118 forms an image on the light receiving surface of the image sensor (CCD) 120. The CCD 120 converts the subject light imaged on the light receiving surface into a signal charge in an amount corresponding to the light amount. The signal charge accumulated in this way is sequentially read out as a voltage signal (image signal) corresponding to the signal charge based on a drive pulse supplied from the timing generator 121 in accordance with a command from the CPU 112.

  The signal output from the CCD 120 is sent to an analog processing unit (CDS / AMP) 122, where the R, G, B signals for each pixel are sampled and held (correlated double sampling processing), amplified, and then A / Applied to the D converter 124. The dot sequential R, G, B signals converted into digital signals by the A / D converter 124 are stored in a memory (SDRAM) 128 via the image input controller 126. The memory 128 is used as a temporary storage area for image data, as well as a program development area and a calculation work area for the CPU 112.

  The image signal processing circuit 130 processes the R, G, and B signals stored in the memory 128 according to a command from the CPU 112. That is, the image signal processing circuit 130 includes a synchronization circuit (a processing circuit that converts a color signal into a simultaneous expression by interpolating a spatial shift of the color signal associated with the color filter array of the single CCD), a white balance correction circuit, It functions as an image processing means including a gamma correction circuit, a contour correction circuit, a luminance / color difference signal generation circuit, etc., and performs predetermined signal processing using the memory 128 in accordance with commands from the CPU 112.

  The R, G, and B signals input to the image signal processing circuit 130 are converted into luminance signals (Y signals) and color difference signals (Cr, Cb signals) and subjected to predetermined processing such as gamma correction. The YC signal processed by the image signal processing circuit 130 is stored in the VRAM 132.

  When the captured image is output to the image display device 110 as a monitor, the YC signal is read from the VRAM 132 and sent to the video encoder 134. The video encoder 134 converts the input YC signal into a predetermined display signal (for example, an NTSC color composite video signal) and outputs the converted signal to the image display device 110.

  The YC signal of each frame processed at a predetermined frame rate is alternately written in the A area and B area of the VRAM 132, and the Y area other than the area where the YC signal is written out of the A area and B area of the VRAM 132. The YC signal that has been written is read out from this area. In this way, the YC signal in the VRAM 132 is periodically rewritten, and a video signal generated from the YC signal is supplied to the image display device 110, so that the image being captured is displayed on the image display device 110 in real time. Is done. The user can check the shooting angle of view from the video (through) displayed on the image display device 110.

  Here, when the shutter button 102 is half-pressed or an AE / AF process start signal is received via the communication unit 156, the AE and AF processes are started. That is, the image signal output from the CCD 120 is input to the AF detection circuit 136 and the AE / AWB detection circuit 138 via the image input controller 126 after A / D conversion.

  The AE / AWB detection circuit 138 includes a circuit that divides one screen into a plurality of areas (for example, 16 × 16) and integrates RGB signals for each divided area, and provides the integrated value to the CPU 112. The CPU 112 detects the brightness of the subject (subject brightness) based on the integrated value obtained from the AE / AWB detection circuit 138, and calculates an exposure value (shooting EV value) suitable for shooting. The aperture value and shutter speed are determined according to the obtained exposure value and a predetermined program diagram, and the CPU 112 controls the electronic shutter of the CCD 120 via the timing generator 121 and controls the aperture 116 via the motor driver 140 according to this. To obtain an appropriate exposure amount.

  In addition, the AE / AWB detection circuit 138 calculates an average integrated value for each color of the RGB signals for each divided area during automatic white balance adjustment, and provides the calculation result to the CPU 112. The CPU 112 obtains an integrated value of R, an integrated value of B, and an integrated value of G, obtains a ratio of R / G and B / G for each divided area, and calculates R / G and R / G of the values of B / G. The light source type is determined based on the distribution in the color space of G, B / G, etc., and, for example, the value of each ratio is about 1 (that is, RGB in one screen) according to the white balance adjustment value suitable for the determined light source type. The gain value (white balance correction value) for the R, G, B signal of the white balance adjustment circuit is controlled so that the integration ratio of R: G: B≈1: 1: 1) Apply correction.

  Further, for example, contrast AF for moving the photographing lens 118 so that the high-frequency component of the G signal of the image signal is maximized is applied to the AF control. That is, the AF detection circuit 136 is a high-pass filter that passes only the high-frequency component of the G signal, an absolute value processing unit, and an AF that cuts out a signal within a focus target area that is preset in the screen (for example, the center of the screen). An area extraction unit and an integration unit that integrates absolute value data in the AF area are configured.

  The integrated value data obtained by the AF detection circuit 136 is notified to the CPU 112. The CPU 112 calculates a focus evaluation value (AF evaluation value) at a plurality of AF detection points while moving the photographing lens 118 by controlling the motor driver 142, and determines a lens position where the evaluation value is a maximum as a focus position. To do. Then, the motor driver 142 is controlled so as to move the photographing lens 118 to the obtained in-focus position. The calculation of the AF evaluation value is not limited to a mode using the G signal, and a luminance signal (Y signal) may be used.

  When the AE / AF processing is performed and the shutter button 102 is fully pressed or an imaging start signal is received via the communication unit 156, a recording imaging operation starts. Image data acquired in response to the reception of the S2 ON or imaging start signal is converted into a luminance / color difference signal (Y / C signal) by the image signal processing circuit 130 and subjected to predetermined processing such as gamma correction. Stored in the memory 128.

  The Y / C signal stored in the memory 128 is compressed according to a predetermined format by the compression / decompression processing circuit 144 and then recorded as an Exif (Exchangeable Image File Format) file on the storage medium 40 via the media controller 146. The image is recorded in the data part of the Exif file. The camera 200 is provided with a panorama switch 103, which can perform shooting by switching between the normal shooting mode and the panoramic shooting mode while fully pressing the shutter button 102 or waiting for reception of an imaging start signal. When the shutter button 102 is fully pressed or the imaging start signal is received when the panorama shooting mode is on, the upper and lower predetermined portions of the full-size shooting screen are shielded from light and the panorama size is recorded. Additional information (such as a television program name) received via the communication unit 156 may be recorded as tag information in the header portion of the image file.

  When the moving image recording mode is set by the mode dial of the operation unit 157, the recording operation starts when the shutter button 102 is pressed or the recording start signal is received. Operation stops. The recording operation may be performed while the shutter button 102 is continuously pressed, and the recording may be stopped by releasing the press. The moving image data is recorded on the storage medium 40 in, for example, the motion JPEG format.

  When the reproduction mode is selected by the mode switching lever 106, the compressed data of the last image file (last recorded file) recorded on the storage medium 40 is read. When the file related to the last recording is a still image file, the read image compressed data is decompressed into an uncompressed YC signal via the compression / decompression processing circuit 144 and stored in the VRAM 132. The YC signal stored in the VRAM 132 is added to the video encoder 134. The video encoder 134 creates an NTSC color composite video signal from the input YC signal and outputs it to the image display device 110. Accordingly, the last frame image recorded in the storage medium 40 is displayed on the image display device 110.

  Thereafter, when a forward frame advance switch (not shown) is pressed, the frame is advanced in the forward direction, and when a reverse frame advance switch (not shown) is pressed, the frame is advanced in the reverse direction. Then, the frame-positioned image file at the frame position is read from the storage medium 40, and the frame image is reproduced on the image display device 110 in the same manner as described above. If the last frame image is displayed and the frame is advanced in the forward direction, the first frame image file recorded in the storage medium 40 is read, and the first frame image is an image. It is reproduced on the display device 110. When the image file to be reproduced is a moving image file, the moving image is continuously reproduced on the image display device 110. Along with the reproduction of the image file, additional information (such as character telop information) recorded in the header portion of the image file may be reproduced.

  The camera 200 may be built in the television broadcast receiving apparatus 100. The camera 200 may be a so-called camera built-in camera phone.

  As described above, in the imaging system of the present invention, the imaging control signal is superimposed on the video signal, and the imaging of the digital camera 200 is started and ended at the timing when the specific video screen is drawn on the monitor 22. For this reason, when watching a highly entertaining program video such as the Olympics, it is possible to automatically record the viewer's facial expression, attitude, and reaction at the decisive moment.

Second Embodiment
FIG. 3 is a diagram showing a schematic configuration of an imaging system according to the preferred second embodiment of the present invention. The imaging system of the second embodiment includes an image reproduction device 300, a digital camera 200, and a monitor 22. A video signal recorded on a video recording medium 301 such as a DVD, a hard disk, or a VTR is converted into an optical / magnetic method or other recording method of the video recording medium 301 by a video signal reading unit 302 such as an optical pickup device. Is read. Similar to the first embodiment, the data signal is superimposed on the video signal recorded on the video recording medium 301. In particular, the imaging control is performed during the vertical blanking period between two fields constituting a specific frame. The signal is superimposed.

  The video signal read by the video signal reading unit 302 is sent to an AD (analog-digital) conversion circuit 303 to be amplified, synchronously detected based on a reference clock, and converted from an analog signal to a digital signal. The video signal converted into the digital signal is sent to the demodulation / error correction circuit 304 and demodulated, and the error in the data of the read video signal is corrected. The separation unit 305 separates the data signal from the video signal error-corrected by the demodulation / error correction circuit and inputs the data signal to the imaging control signal extraction unit 307. The imaging control signal extraction unit 307 extracts an imaging control signal from the data signal, and transmits the extracted imaging control signal to the digital camera 200 via the communication interface 308. In addition, the functions of the video processing circuit 306, the display control unit 309, and the communication interface 308 are the same as those of the video processing circuit 20, the display control unit 28, and the communication interface 29 of the first embodiment, and thus description thereof is omitted.

  Even when a video signal on which an imaging control signal is superimposed is recorded in advance on the video recording medium 301 and played back by the image playback device 300 as in this embodiment, the timing at which a specific video screen is drawn on the monitor 22 Thus, the imaging of the digital camera 200 can be controlled.

1 is a schematic configuration diagram of an imaging system according to a first embodiment. Digital camera block diagram Schematic configuration diagram of an imaging system according to the second embodiment

Explanation of symbols

100: TV broadcast receiving apparatus, 200: digital camera, 300: image reproducing apparatus

Claims (6)

An extraction unit that extracts the imaging control signal superimposed in synchronization with the drawing timing of the specific video from the video signal of the video;
A display unit for displaying video according to the video signal;
An imaging device having an imaging unit that images a subject, and a control unit that controls imaging of the subject by the imaging unit in accordance with the extracted imaging control signal;
An imaging system comprising:   The imaging system according to claim 1, wherein the imaging control signal is superimposed in a vertical blanking period between two fields constituting the drawing frame of the specific video. The extraction unit extracts additional information from the video signal,
The imaging system according to claim 1, wherein the imaging device records the additional information together with the captured image.   The imaging system according to any one of claims 1 to 3, wherein the imaging control signal includes a signal that controls a start of capturing a still image, a start of capturing a moving image, or an end of capturing a moving image. Extracting the imaging control signal superimposed in synchronization with the drawing timing of the specific video from the video signal of the video;
Displaying video according to the video signal;
Controlling imaging of a subject according to the extracted imaging control signal;
An imaging method including:   A recording medium that records a video signal of the video on which an imaging control signal is superimposed in synchronization with a drawing timing of a specific video.

Images