JPH11346324A - Remote image pickup system, remote image pickup method and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a control means side to select a function of converting a light in a visual light region of an image pickup means into a video image and a function of converting a light in an infrared ray region into a video image through a communication line. SOLUTION: In this system, an image pickup means 1 having a 1st video conversion function that converts a light in a visual light region into a video image and a 2nd video conversion function that converts a light in an infrared ray region into a video image and a control means 3 that controls the image pickup means 1 are connected via a communication line 2, and a video signal and a command are sent/received through the communication line 2. In this case, the control means 3 controls the image pickup means 1 to select the 1st video conversion function or the 2nd video conversion function.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a remote imaging system,
The remote imaging method and the storage medium are particularly suitable for use in an AV network in which a video camera and a controller are connected via a communication line including IEEE1394 or USB and the controller controls the video camera.

[0002]

2. Description of the Related Art At present, a digital video camera recorder is used.
Connect to a personal computer with an IEEE1394 or USB (Universal Serial Bus) cable, and watch the video camera recorder image on the personal computer while watching the operation using CTS (Command Tr
An ansaction Set) is used to start, stop, and play back recordings from a personal computer, and image editing is performed on the personal computer.

FIG. 1 is a block diagram showing an example of a system for remotely controlling the operation of a digital video camera recorder with a personal computer.

In FIG. 1, 1 is a digital video camera recorder, 2 is an IEEE1394 cable, and 3 is a personal computer. Here, the CTS will be described. IEEE1394 is based on "IE
The physical layer, link layer, and transaction layer are defined in “EE1394-1995Std”, and FCP (Function C) that controls devices in “IEC61883CDV” as the upper layer
ontro1 Protocol).

[0005] Of these, the controlling side is called a controller, and the controlled side is called a target.
Is a controller, and the digital video camera recorder 1 is a target.

[0006] As shown in FIG.
The command is written to the target by the write transaction of the 1394 asynchronous communication, and the target returns an acknowledgment (Ack). After that, the response to this command is similarly written to the controller (the controller also returns Ack). In this FCP, a command group called CTS is used in a consumer DVCR such as the digital video camera recorder 1.

In the command group called CTS, VCR subunits are currently defined, and control commands such as REC, PLAY, and STOP are prepared as commands, and these commands are transmitted from the personal computer 3. And the digital video camera recorder 1 is controlled.

A status command is provided to know the state of the digital video camera recorder 1, so that the current mechanical state and time code can be known.

There are cases where the function of converting the light in the visible light region into an image and the function of converting the light in the infrared region into an image provided in the digital video camera recorder 1 are switched. Since the function is not a function of the VCR sub-unit, the user directly operated the changeover switch provided on the digital video camera recorder body.

Here, a digital video camera recorder 1
Switching between the function of converting light in the visible light region into an image and the function of converting light in the infrared region into an image will be described. FIG. 9 is a block diagram showing a schematic configuration inside the digital video camera recorder 1. In FIG. 9, 31 is a lens, 32 is an infrared cut filter, 33 is a CCD, 34 is a matrix circuit, 35 is a recorder signal processing circuit, 36 is a recorder, 37 is a digital interface (hereinafter, DIF), 38
Is a microcomputer, 39 is an actuator, and A is a switch.

First, when converting light in the visible light region into an image, the light that has passed through the lens 31 is an infrared light cut filter.
At 32, only the visible light region is extracted and imaged on the CCD 33. The CCD 33 converts the formed optical image into an electric signal and sends it to the matrix circuit 34.

The CCD 33 is provided with a complementary color filter. Light of a different color passes through each pixel. The matrix circuit 34 performs an operation for each pixel. The luminance signal Y and the color difference signals RY, BY are output from the CCD 33. Is output from the matrix circuit 34.

The luminance signal Y and the color difference signals RY, BY output from the matrix circuit 34 are
Is input to In the recorder signal processing circuit 35, the video signal sent to the digital video format is converted, supplied to the recorder 36, and recorded on the recording medium in the recorder 36. At the same time, it is digitally output via the DIF circuit 37.

Next, when converting light in the infrared region to a video signal, the user switches the switch A to infrared processing. In response to the switch information, the microcomputer 38 first controls the actuator 39 so that the infrared light cut filter 32
Move it away from before 3 (moving the infrared cut filter as indicated by the black arrow in the figure). by this,
Light up to the infrared region enters the CCD 33, is converted into an image, and is sent to the matrix circuit.

Next, the recorder signal processing 35 is controlled, and since the color components of infrared light are invisible to humans, the color difference signal R-
Make Y, BY colorless. Subsequent processing is the same as the case where light in the visible light region is converted into an image.

In this way, if the user converts the light in the visible light region into an image and the image is dark and unclear, if the light in the infrared region is emitted, the user can convert the light in the infrared region into the image. It was converted so that only the outline was clearly visible.

[0017]

However, in the above-mentioned conventional example, the function of converting the light in the visible light region of the digital video camera recorder 1 into an image and the function of converting the light in the infrared region into an image are provided from the personal computer 3. Since there is no command to switch, the user has to operate a switch of the digital video camera recorder main body.

[0018] In addition, the outline of an image which is shot in a dark place by the function of converting light in the visible light region into an image is not clear. There was a drawback that the video being shot was not colored.

In addition, when control is performed via a network, if the user is operating differently from the operation of the main body, there is a disadvantage that the contents of the control cannot be understood just by looking at the main body.

Further, when control is received from the network, there is a disadvantage that unnecessary circuits operate in the main body and power is wasted.

Therefore, a first object of the invention according to the present application is to provide a function of converting light in the visible light region into an image and a function of converting light in the infrared region into an image, which are included in the imaging means, via a communication line. It is an object of the present invention to be able to switch from the control means side. It is a second object of the present invention to generate a clear image even when a dark place is photographed. It is a third object of the present invention to generate an image in which both the outline and the color are clear even when a dark place is photographed. It is a fourth object of the present invention to make it possible for the imaging means to recognize that control is being performed via a communication line. A fifth object is to reduce power consumption when control is performed via a communication line.

[0022]

SUMMARY OF THE INVENTION A remote imaging system according to the present invention has a first image conversion function for converting light in a visible light region into a video signal and a second image conversion function for converting light in an infrared region into a video signal.
An imaging unit having a video conversion function, a control unit for controlling the operation of the imaging unit, and a communication line connecting the imaging unit and the control unit. The imaging unit and the control unit through the communication line A function inquiry command is transmitted to the imaging means, and the first and second video signals and command signals are transmitted and received between the first and second imaging means.
A conversion function inquiry means for inquiring which of the video conversion function and the second video conversion function has been selected, and a conversion function switching command in accordance with the photographing state of the image pickup means to transmit the first video image The control means includes a switching means for switching between a conversion function and a second video conversion function. Another feature of the remote imaging system of the present invention is that a first video conversion function of converting light in a visible light region into a video signal and a second video conversion function of converting light in an infrared region into a video signal. An imaging unit having a video conversion function, a control unit for controlling the operation of the imaging unit, a communication line connecting the imaging unit and the control unit, and a display unit provided on the control unit. A remote imaging system that transmits and receives a video signal and a command signal between the control unit and the imaging unit through the communication line, and displays an image from the imaging unit on the display unit; A video signal generating means for generating a video signal while transmitting and controlling the video signal, and displaying the generated video signal on the display means, and a converter when the video displayed on the display means is dark. By sending a switching command, and a second conversion function drive means to operate the said image pickup means at a second video conversion function characterized by comprising the above control means.
Other features of the remote imaging system of the present invention include a first video conversion function for converting light in a visible light region into a video signal, and a second video conversion function for converting light in an infrared region into a video signal. An imaging unit having a video conversion function, a control unit for controlling the operation of the imaging unit, a storage unit provided in the control unit, and a communication line connecting the imaging unit and the control unit, In a remote imaging system for transmitting and receiving a video signal and a command signal between the imaging unit and the control unit through a communication line,
AG that sends a command to inquire about the AGC level status
In response to the C state inquiry means and the command for inquiring of the AGC state, when the light in the visible light region is small, a video signal obtained by converting the video signal obtained by converting the light in the visible light region into the storage means. Storage means, second conversion function driving means for transmitting a conversion function switching command for causing the imaging means to operate with a second video conversion function,
A video signal synthesizing unit for synthesizing the video signal obtained by converting the light in the infrared region and the video signal obtained by converting the light in the visible light region stored in the storage unit. Another feature of the remote imaging system of the present invention is that the switching between the first video conversion function and the second video conversion function is performed by a conversion function switching command sent via the communication line. When performing, the switching speed is faster than the normal video sampling speed, and the video signal obtained by converting the light in the infrared region and the video signal obtained by converting the light in the visible light region are combined. . Another feature of the remote imaging system of the present invention is that a disk is provided in front of the photoelectric conversion unit provided in the imaging unit, and a visible light cut filter and an infrared light cut filter are mounted on the disk. And the first
The alternate conversion is performed by rotating the disk in synchronization with the switching cycle between the video conversion function of the above and the second video conversion function. Other features of the remote imaging system of the present invention include a first video conversion function for converting light in a visible light region into a video signal, and a second video conversion function for converting light in an infrared region into a video signal. Imaging means having a video conversion function, control means for controlling the operation of the imaging means,
A remote imaging system that includes a communication line connecting the imaging unit and the control unit, and that transmits and receives a video signal and a command signal between the imaging unit and the control unit through the communication line; A display means for displaying a command signal to be displayed is provided on the imaging means. Other features of the remote imaging system according to the present invention include an imaging unit having a display unit including at least a viewfinder or a liquid crystal panel, a control unit for controlling the imaging unit, the imaging unit, and the control unit. And a communication line for connecting the image signal and the command signal between the imaging unit and the control unit through the communication line. In the remote imaging system, a command for controlling the operation of the imaging unit is provided. A signal, or a command transmission unit for transmitting a command signal for inquiring the state of the imaging unit is provided in the control unit, and when a command signal for inquiring the state of the imaging unit is transmitted from the command transmission unit, the display unit of the display unit A power supply disconnecting means for turning off the power is provided in the imaging means. Other features of the remote imaging system according to the present invention include an imaging unit having a display unit including at least a viewfinder or a liquid crystal panel, a control unit for controlling the imaging unit, the imaging unit, and the control unit. And a communication line for connecting the image signal and the command signal between the imaging unit and the control unit through the communication line. In the remote imaging system, a command for controlling the operation of the imaging unit is provided. A signal, or a command transmission unit for transmitting a command signal for inquiring the state of the imaging unit, provided in the control unit, and when the command signal is transmitted from the command transmission unit, whether the control unit has a viewer screen. Screen inquiry means for sending a command to inquire about When present in the control means has a power-off means for turning off the power of the display unit is characterized in that provided in the image pickup means. Another feature of the remote imaging system of the present invention is that the communication line is a communication line based on IEEE1394 or USB. Another feature of the remote imaging system of the present invention is that the communication line conforms to IEEE1394 or USB, and the conversion function switching command and the function inquiry command conform to the AVC protocol. Features. Another feature of the remote imaging system of the present invention is that the communication line is IEEE1394 or
Compliant with USB, the above conversion function switching command, the above AGC
The command for inquiring the status is based on the AVC protocol.

The remote imaging method according to the present invention has an imaging function having a first image conversion function of converting light in a visible light region into an image signal and a second image conversion function of converting light in an infrared region into an image signal. Means, a control means for controlling the operation of the imaging means, and a communication line connecting the imaging means and the control means, a video signal and a video signal between the imaging means and the control means through the communication line In the remote imaging method for transmitting and receiving a command signal to generate a video signal, a function inquiry command is transmitted to the imaging unit to determine whether the first video conversion function or the second video conversion function is selected. And a function switching process for transmitting a switching command from the control unit to the imaging unit in accordance with the imaging state of the imaging unit to switch the selected video conversion function. It is characterized by carrying out the door. Another feature of the remote imaging method of the present invention is that:
An imaging unit having a first video conversion function of converting light in the visible light region into a video signal, and a second video conversion function of converting light in the infrared region into a video signal, and controlling the operation of the imaging unit A control unit, a communication line connecting the imaging unit and the control unit, and a display unit provided on the control unit, wherein an image is displayed between the control unit and the imaging unit through the communication line. In a remote imaging method for transmitting and receiving a signal and a command signal and displaying an image from the imaging unit on the display unit, a command signal is transmitted from the control unit to the imaging unit via the communication line. A video signal generating process for generating a video signal while controlling and displaying the generated video signal on display means on the control means; and controlling the video signal when the video displayed on the display means is dark. By sending a switching command from the stage to the imaging means, it is characterized by performing the image conversion function switching process so as to operate the imaging means at a second video conversion function. Other features of the remote imaging method of the present invention include a first video conversion function for converting light in a visible light region into a video signal, and a second video conversion function for converting light in an infrared region into a video signal. An imager having a video conversion function, a controller for controlling the imager, a storage provided in the controller, and a communication line connecting the imager with the controller. Transmitting a video signal and a command signal between the imaging unit and the control unit through the remote imaging method to generate a video signal, transmitting a command for inquiring an AGC level of the imaging unit; When the command for inquiring the AGC state is received, if the light in the visible light region is small, the video signal storage for storing the video signal converted from the light in the visible light region in the storage means. A video conversion function switching process for transmitting a switching command to the imaging means to generate a video signal using the second video conversion function; and a video signal obtained by converting light in the infrared region. And a video signal synthesizing process for synthesizing the video signal converted from the light in the visible light region stored in the storage means. Another feature of the remote imaging method of the present invention is that the first video conversion function and the second video conversion function are alternately switched by a conversion function switching command sent via the communication line. In this case, the switching speed is faster than the normal video sampling speed, and the video signal obtained by converting the light in the infrared region and the video signal obtained by converting the light in the visible light region are synthesized. Another feature of the remote imaging method of the present invention is that an alternate switching process between the first video conversion function and the second video conversion function is performed by a photoelectric conversion unit provided in the imaging unit. Is provided with a visible light cut filter and an infrared light cut filter mounted on the disk, and the disk is rotated in synchronization with a switching cycle. Other features of the remote imaging method of the present invention include a first video conversion function for converting light in a visible light region into a video signal, and a second video conversion function for converting light in an infrared region into a video signal. Imaging means having a video conversion function, display means provided in the imaging means for displaying a command signal transmitted from the control means, control means for controlling the operation of the imaging means,
A remote imaging method comprising: a communication line connecting the imaging unit and the control unit; transmitting and receiving a video signal and a command signal between the imaging unit and the control unit through the communication line to generate a video signal. And displaying a command signal transmitted from the control means on the display means. Other features of the remote imaging method according to the present invention include an imaging unit having a display unit including at least a viewfinder or a liquid crystal panel, a control unit that controls an operation of the imaging unit, the imaging unit, and the imaging unit. A remote communication method for transmitting and receiving a video signal and a command signal between the imaging unit and the control unit through the communication line to generate a video signal, the communication unit comprising: When a command signal for controlling the operation of the image pickup device or a command signal for inquiring about the state of the image pickup device is sent from the control device, a process for turning off the power of the display device provided on the image pickup device is performed. And Other features of the remote imaging method according to the present invention include an imaging unit having a display unit including at least a viewfinder or a liquid crystal panel, a control unit that controls an operation of the imaging unit, the imaging unit, and the imaging unit. A remote communication method for transmitting and receiving a video signal and a command signal between the imaging unit and the control unit through the communication line to generate a video signal, the communication unit comprising: When a command signal for controlling the operation of the camera or a command signal for inquiring about the state of the imaging means is sent from the control means, a process for inquiring whether or not there is a viewer screen to the control means; And turning off the display unit when the viewer screen exists. Another feature of the remote imaging method of the present invention is that the communication line is IEEE1394 or
It is characterized by a USB-compliant communication line.
Another feature of the remote imaging method of the present invention is that the communication line conforms to IEEE1394 or USB, and the conversion function switching command and the viewer screen presence / absence inquiry command conform to the AVC protocol. It is characterized by having. Another feature of the remote imaging method of the present invention is that the communication line conforms to IEEE1394 or USB, and the conversion function switching command and the AG
The C status command is characterized by conforming to the AVC protocol.

The storage medium of the present invention is characterized in that a program for causing a computer to function as each of the above means is stored. Another feature of the storage medium of the present invention is that a program for causing a computer to execute the procedure of the remote imaging method is stored.

[0025]

FIG. 1 is a block diagram of a control system of a digital video camera recorder. In FIG. 1, 1 is a digital video camera recorder, 2 is
IEEE1394 cable, 3 is a personal computer.

As shown in FIG. 1, by connecting a digital interface terminal (not shown) provided on the digital video camera recorder 1 to the personal computer 3 via the IEEE1394 cable 2, the user can obtain the connection shown in FIG. The user can control the zoom operation and the focus operation while watching an image captured by the digital video camera recorder 1 on the screen of the personal computer 3 to capture a desired image on the personal computer 3.

In FIG. 2, 21 is a personal computer monitor, 22 is a preview screen of an image sent from the digital video camera 1, 23 is a wide button for moving the zoom to the wide end, 24 is a tele button for moving the zoom to the tele end, 25 is a near button that moves the focus to near, 26 is a fur button that moves the focus to fur, and 27 is a toggle that switches between the function of converting visible light light to video and the function of converting infrared light to video by toggle operation. Button.

When any one of these buttons 23 to 27 is pressed, a control command of the camera subunit shown in Table 1 below is sent from the personal computer 3 to the digital video camera recorder 1.

[0029]

[Table 1]

For example, when the zoom buttons 23 and 24 are pressed, tele and wide are designated and transmitted as operands of the last ZOOM command in Table 1. Also, the personal computer 3 sends a status command as shown in Table 2 and can know the current state of the digital video camera recorder 1 from the response.

[0031]

[Table 2]

For example, when a ZOOM status command is sent, the target puts information on the ZOOM position into an operand and sends it back to the controller as a response. Also,
As shown in Table 3, a command is provided to report a change to a specified state by a notify command.

[0033]

[Table 3]

For example, when a ZOOM notify command is specified and transmitted as a zoom position as an operand, the target returns a response to the controller when the zoom position is reached. Here, switching between the function of converting light in the visible light region into an image and the function of converting light in the infrared region into an image when the switch button 27 is pressed in the digital video camera recorder 1 will be described.

FIG. 3 shows a digital video camera recorder 1
FIG. 2 is a block diagram showing an internal configuration of the device. In FIG. 3, 31
Is a lens, 32 is an infrared cut filter, 33 is a CCD, 34 is a matrix circuit, 35 is a recorder signal processing circuit, 36 is a recorder, 37 is a DIF (Digital Interface), 38 is a microcomputer, and 39 is an actuator.

First, when converting light in the visible light region into an image, light that has passed through the lens 31 is converted to an infrared light cut filter.
At 32, only light in the visible light region is extracted and imaged on the CCD 33. The CCD 33 converts the formed optical image into an electric signal and sends it to the matrix circuit 34. The CCD 33 is provided with a complementary color filter, and when a different color passes through each pixel, an electric signal for each color component is generated.

The electric signal is converted to a matrix circuit.
34, where the calculated luminance signal is calculated for each pixel.
Y and color difference signals RY and BY are generated. These luminance signal Y and color difference signals RY and BY are provided by a recorder signal processing circuit 35.
Given to. The recorder signal processing circuit 35 converts the video signal sent to the digital video format, links the status data indicating the infrared / visible light mode and the like to the image, supplies the linked status data to the recorder 36, and records the image in the recorder 36. Record on the medium. At the same time, the DIF circuit
It is output digitally via 37.

Next, when converting light in the infrared region into an image, the DIF circuit 37 sends an INFRARED command, which is a control command for switching between infrared and visible light of CTS, with an operand for switching to infrared processing. Then, the DIF circuit 37 sends the CTS to the microcomputer 38.

Upon receiving the CTS, the microcomputer 38 first controls the actuator 39 to control the infrared light cut filter.
Move 32 so that it comes off from the front of CCD33 (move the infrared cut filter as shown by the black arrow in the figure). Thus, light up to the infrared region enters the CCD 33, is converted into an electric image, and is sent to the matrix circuit.

Next, the recorder signal processing circuit 35 is controlled,
Since the color components of light in the infrared region are invisible to humans, the color difference signals RY and BY are set to have no color. Subsequent processing is the same as the case where light in the visible light region is converted into an image.

The INFRARED control command also has a toggle operation operand, and the current state is a state of a function of converting light in the visible light region into an image or a function of converting light of the infrared region into an image. Depending on the condition
It is also the command that goes in the opposite state. And personal computer 3
Can use this status command to know which processing the digital video camera 1 is performing.

As described above, there are provided an operand for forcibly converting light in the visible light region into an image and an operand for forcibly converting light in the infrared region into an image. Regardless of the state of the digital video camera 1, the desired state can be set.

(Second Embodiment) As shown in FIG. 2, when an image of light in a visible light region being photographed is displayed on a preview screen 22 of the personal computer 3, the user can photograph a dark place. You can see that the image becomes dark and unclear when it is in. In this case, when the switch button 27 is pressed, the operation described in the first embodiment occurs, and the image of light in the infrared light region is displayed on the preview screen 22.

Therefore, if there is much light in the infrared region,
When the screen becomes bright, the state is maintained, and when the screen does not become bright, the switching button 27 may be pressed again in order to return to the state in which the image of light in the visible light region is colored.

(Third Embodiment) In the second embodiment, an example in which the switching is performed when the user determines that the image is dark has been described. Show. FIG. 4 is a block diagram showing the inside of the digital video camera recorder 1. In FIG. 4, 31 is a lens, 32 is an infrared light cut filter, 33 is a CCD, 34 is a matrix circuit, 35 is a recorder signal processing circuit, 36 is a recorder, 37 is a digital interface (hereinafter DIF), 38 is a microcomputer, 39 Is an actuator, and 41 is an AGC circuit.

First, when converting light in the visible light region into an image, the light that has passed through the lens 31 is an infrared light cut filter.
At 32, only the visible light region is extracted and imaged on the CCD 33. The CCD33 converts the light into electric signals, and the AGC circuit 310
Sent to

The AGC circuit 310 works to increase the gain when the signal is small, and sends the signal as it is to the matrix circuit 34 when the signal is large. The CCD 33 is provided with a complementary color filter, and a different color passes through each pixel. The matrix circuit 34 performs an operation for each pixel, and outputs a luminance signal Y and color difference signals RY and BY.

The recorder signal processing circuit 35 converts the video signal sent to the digital video format and records it on the recorder 36. At the same time, the DIF circuit 37
Is output digitally to the communication line.

The personal computer 3 periodically sends a status command (GAIN command in Table 2) for inquiring about the state of the AGC to the digital video camera recorder 1 while displaying the transmitted image on the preview screen 22.

In the digital video camera recorder 1, DI
The F circuit 37 sends CTS to the microcomputer 38. In microcomputer 38,
The state of the AGC circuit 41 is always known, and the state of the AGC is sent to the personal computer 3 as a response to the CTS.

Here, when the state of the AGC is larger than a certain value, the personal computer 3 determines that a dark image is being shot, and divides the current image into a luminance signal and a color signal. It is stored in the memory and sends INFRARED, which is a control command for switching between infrared and visible light, to the digital video camera recorder 1.

When INFRARED, which is a CTS infrared / visible light switching control command, is sent to the DIF circuit 37,
The DIF circuit 37 sends CTS to the microcomputer 38. In response to the CTS, the microcomputer 38 first controls the actuator 39 to move the infrared cut filter 32 so as to deviate from the front of the CCD 33 (the infrared cut filter is moved as indicated by a black arrow in the figure). As a result, the light up to the infrared region is converted into an image on the CCD 33 and transmitted to the matrix circuit 34 through the AGC circuit 310.

Next, the recorder signal processing circuit 35 is controlled,
Since the color components of light in the infrared region are invisible to humans, the color difference signals RY and BY are set to have no color. Subsequent processing is the same as the case where light in the visible light region is converted into an image.

In this state, the personal computer 3 compares the gain of the AGC with a constant value different from the previous one in the CTS for inquiring about the state of the AGC that is periodically transmitted. If the gain is large, it is determined that there is not much light in the infrared region, and INFRARED is sent again to capture an image in the visible light region, and the processing ends.

On the other hand, when the gain is small, since there is a lot of light in the infrared region, the current image in the infrared region is added to the luminance signal of the image in the visible region stored in the memory and synthesized, and the preview screen is displayed. The signal is output to the luminance signal 22 and the stored color signal. FIG. 5 is a flowchart illustrating the processing procedure of the personal computer 3 described above.

As shown in FIG. 5, when the process is started, in a first step S1, a command for switching back to the visible light process is transmitted. Next, in step S2,
It is determined whether the gain is greater than a predetermined value. If the result of this determination is that the gain is smaller than the fixed value, the process ends.

On the other hand, if the result of determination in step S2 is that the gain is greater than the fixed value, the process proceeds to step S3,
A process for storing the image in the memory is performed. After the storing process is completed, the process proceeds to step S4, and a command for switching the process of converting light into a video signal to the second video conversion function of converting light in the infrared region into a video signal is transmitted.

Next, in step S5, it is determined again whether the gain is larger than a predetermined value.
If the result of this determination is that the gain is greater than the certain value, the process proceeds to step S6, and a command for switching to the first video conversion function for converting light in the visible light region into a video signal is transmitted.

If the result of determination in step S5 is that the gain is smaller than the fixed value, the operation proceeds to step S7, where the data is stored in the memory. A process for synthesizing the video signal and the captured video signal is performed. Next, the synthesized video signal is
Performs processing to be displayed on the viewer screen. Thus, an image can be displayed using the combined luminance and the color stored in the memory.

The above-described processing is effective for a video that does not move like a landscape or a still image of the same scene.
If the switching speed is slow, there is a possibility that the shift is large even if the moving speed is fast. Therefore, it is conceivable to permit or prohibit the above processing by adding a motion detection process or the like.

On the other hand, even in the case of a moving picture, in the case of a normal NTSC signal, the moving picture is represented by sampling every 1/60 second. Sampling is performed earlier, and the visible light processing and the red The above-described combination may be always performed by alternately performing the external light processing. In this case, it is easier to replace the filter before the CCD 33 by rotating a disk type filter in which two filters are alternately arranged than in the slide type, so that synchronization can be easily achieved.

(Fourth Embodiment) A display when a controller is connected to a target digital video camera and receives a command as in the above embodiment will be described with reference to FIGS. 6 and 7. FIG. .

In FIG. 6, 31 is a lens, 32 is an infrared light cut filter, 33 is a CCD, 34 is a matrix circuit, 35 is a recorder signal processing circuit, 36 is a recorder, 37 is a DIF, 38 is a microcomputer, and 39 is an actuator. , 61 is a finder, and 62 is a carachene. Also, in FIG.
The video screens 72, 73, and 74 shown in FIG. 7 are information mixed in the video.

First, when converting light in the visible light region into an image, the light that has passed through the lens 31 is an infrared light cut filter.
At 32, only the visible light region is extracted and imaged on the CCD 33. The CCD 33 converts the light into an electric signal and sends it to the matrix circuit 34.

The CCD 33 is provided with a complementary color filter, and a different color passes for each pixel, and a matrix circuit is provided.
At 34, the calculation for each pixel is performed, and the luminance signal Y and the color difference signal are calculated.
RY, BY is output. The recorder signal processing circuit 35 converts the video signal sent to the digital video format and records it on the recorder 36. At the same time, it is digitally output from the DIF circuit 37.

Then, an image is also sent to the finder 61 so that the user can confirm the photographed contents. finder
A mixing circuit is incorporated in 61, and information 73 and 74 in FIG. 7 are generated from the character cine 62 and mixed with the image by the finder 61. For the information 73 and 74, the character scene 62 is designated by the microcomputer 38.

Next, when converting light in the infrared region into an image, when the INFRARED, which is a control command for switching between infrared and visible light of CTS, is transmitted to the DIF circuit 37, the DIF circuit
37 sends CTS to the microcomputer 38. In the microcomputer 38, this CT
Upon receiving S, first, the actuator 39 is controlled to move the infrared light cut filter 32 so as to be out of front of the CCD 33 (the infrared cut filter is moved as indicated by the black arrow in the figure). As a result, light up to the infrared region is converted into an image on the CCD 33 and sent to the matrix circuit 34.

Next, the recorder signal processing circuit 35 is controlled,
Since the color components of light in the infrared region are invisible to humans, the color difference signals RY and BY are set to have no color. Subsequent processing is the same as the case where light in the visible light region is converted into an image.

At the same time, the microcomputer 38 controls the character cache 62 to indicate that it is controlled by the CTS.
The information 72 generated in the character shell 62 is mixed with a video signal in the finder 61 and displayed together with other information 73 and 74.

(Fifth Embodiment) As in the above embodiment, when the controller and the target digital video camera 1 are connected and receive a command, the controller displays a preview screen 22 as shown in FIG. There is
The user is watching the preview screen 22 instead of the finder of the digital video camera 1.

In this case, an example in which the finder of the digital video camera 1 is turned off will be described with reference to FIG. 8, 31 is a lens, 32 is an infrared cut filter, 33 is a CCD,
34 is a matrix circuit, 35 is a recorder signal processing circuit, 36
Is a recorder, 37 is a DIF, 38 is a microcomputer, 39 is an actuator, and 61 is a finder.

First, when converting light in the visible light region into an image, the light that has passed through the lens 31 is an infrared light cut filter.
At 32, only the visible light region is extracted and imaged on the CCD 33. The CCD 33 converts the light into an electric signal and sends it to the matrix circuit 34.

The CCD 33 is provided with a complementary color filter, and a different color passes for each pixel, and a matrix circuit is provided.
At 34, the calculation for each pixel is performed, and the luminance signal Y and the color difference signal are calculated.
RY, BY is output. The recorder signal processing circuit 35 converts the video signal sent to the digital video format and records it on the recorder 36. At the same time, it is digitally output from the DIF circuit 37. Then, the image is also sent to the finder 61 so that the user can confirm the photographed content.

Next, when converting light in the infrared region into an image, when the INFRARED which is a control command for switching between infrared and visible light of CTS is sent to the DIF circuit 37, the DIF circuit
37 sends CTS to the microcomputer 38. In the microcomputer 38, this CT
Upon receiving S, first, the actuator 39 is controlled to move the infrared light cut filter 32 so as to be out of front of the CCD 33 (the infrared cut filter is moved as indicated by the black arrow in the figure). As a result, light up to the infrared region is converted into an image on the CCD 33 and sent to the matrix circuit 34.

Next, the recorder signal processing circuit 35 is controlled,
Since the color components of light in the infrared region are invisible to humans, the color difference signals RY and BY are set to have no color. Subsequent processing is the same as the case where light in the visible light region is converted into an image. At the same time, when controlled by the CTS, the microcomputer 38 controls to turn off the power of the finder 61.

The condition for turning off may be from when the CTS is sent to when the bus reset is performed.
Since there is not always a preview screen on the controller side, a CTS command for inquiring whether there is a new preview screen may be provided, and the power of the finder 61 may be turned off only when there is a preview screen on the controller side.

(Other Embodiments of the Present Invention) The present invention is applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), but is also applicable to an apparatus composed of one device. You may.

Further, in order to realize the functions of the above-described embodiments, a device connected to the above-described various devices or a computer in a system is operated so as to operate various devices so as to realize the functions of the above-described embodiments. The present invention also includes programs implemented by supplying the program code of the software described above and operating the various devices according to programs stored in a computer (CPU or MPU) of the system or apparatus.

In this case, the program code of the software implements the functions of the above-described embodiment, and the program code itself and means for supplying the program code to a computer are provided.
For example, a storage medium storing such a program code constitutes the present invention. As a storage medium for storing such a program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM,
A magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

Further, when the computer executes the supplied program code, not only the functions of the above-described embodiments are realized, but also the OS (operating system) or other operating system running on the computer. Needless to say, the program code is also included in the embodiment of the present invention when the functions of the above-described embodiment are realized in cooperation with application software or the like.

Further, after the supplied program code is stored in the memory provided on the function expansion board of the computer or the function expansion unit connected to the computer, the function expansion board or the function expansion unit is specified based on the instruction of the program code. It is needless to say that the present invention also includes a case where a CPU or the like provided in the first embodiment performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments. Further, the present invention includes an imaging device or a control device used in the imaging system.

[0082]

As described above, according to the present invention,
Imaging means having both a first image conversion function of converting light in the visible light region into an image and a second image conversion function of converting light in the infrared region into an image; and control means for controlling the imaging unit. In a system connected by a communication line and transmitting and receiving a video signal and a command over the communication line,
A function switching command for switching the video conversion function and a selection state command for inquiring about a state in which one of the first and second video conversion functions is selected are transmitted from the control means to the imaging means. Since the second video conversion function is switched as needed, the function of converting the light in the visible light region into the video of the imaging device and the control of converting the light in the infrared region into the video can be switched from the control device side. Can be
A first image conversion function for converting light in the visible light region into a video signal and a second image conversion function for converting light in the infrared region into a video signal can be made without having to operate a switch of the imaging means main body. It is possible to provide a remote imaging system capable of selectively using the second video conversion function according to a shooting state.

According to another feature of the present invention, when the image display on the control means is dark, a conversion function switching command is transmitted from the control means to use the second image conversion function. Since the video signal is generated, it is possible to provide a remote imaging system capable of clarifying a video image of a dark place.

According to another feature of the present invention, when the light in the visible light region is small, the image generated by the light in the visible light region and the image generated by the light in the infrared region are combined. Since the video signal is generated by using this method, it is possible to provide a remote imaging system capable of clarifying both the outline and the color of a video image of a dark place.

Further, according to another feature of the present invention, since a display for indicating that a command has been received is provided on the image pickup means, it is possible for the image pickup means to know that control has been received via the communication line. A remote imaging system can be provided.

According to another feature of the present invention, when a command for controlling or inquiring about a state is transmitted from the control means to the imaging means, the viewfinder provided on the imaging means is provided. Since the power of the display means such as the liquid crystal panel is turned off, it is possible to provide a remote imaging system capable of suppressing power consumption of unnecessary circuits when receiving control from a communication line.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a schematic configuration example of a remote imaging system.

FIG. 2 is a diagram illustrating an example of a control screen on a PC.

FIG. 3 is a block diagram of an imaging unit showing a configuration example of switching between visible and infrared functions according to the first embodiment;

FIG. 4 is a block diagram of an imaging unit showing a configuration example of switching between visible and infrared functions according to a third embodiment.

FIG. 5 is a flowchart of control unit processing according to the third embodiment.

FIG. 6 is a block diagram of an imaging unit showing a configuration example of switching between visible and infrared functions according to a fourth embodiment.

FIG. 7 is a diagram illustrating an example of a finder screen according to a fourth embodiment.

FIG. 8 is a block diagram of an imaging unit showing a configuration example of switching between visible and infrared functions according to a fifth embodiment.

FIG. 9 is a block diagram of an imaging unit showing a conventional switching between visible and infrared functions.

FIG. 10 is an explanatory diagram of communication exchange of CTS.

[Explanation of symbols]

 1 Digital video camera recorder 2 IEEE1394 cable 3 PC 21 PC monitor 22 Preview screen 23 Wide button 24 Tele button 25 Near button 26 Far button 27 Switching button 31 Lens 32 Infrared cut filter 33 CCD 34 Matrix circuit 35 Recorder signal processing circuit 36 Recorder 37 DIF 38 Microcomputer 39 Actuator 41 AGC circuit 61 Viewfinder 62 Characene 71 Video screen 72, 73, 74 Information A switch

Claims (24)

[Claims] An imaging unit having a first video conversion function of converting light in a visible light region into a video signal, and a second video conversion function of converting light in an infrared region into a video signal; Remote control for transmitting and receiving a video signal and a command signal between the imaging means and the control means through the communication line. In the imaging system, a conversion function inquiry unit that transmits a function inquiry command to the imaging unit and inquires whether the first video conversion function or the second video conversion function is selected, and the imaging unit A conversion function switching command is transmitted according to the shooting state of the first video conversion function and the second video conversion function.
And a switching means for switching between the video conversion function and the video conversion function. 2. An imaging means having a first video conversion function of converting light in a visible light region into a video signal, and a second video conversion function of converting light in an infrared region into a video signal, and said imaging means Control means for controlling the operation of, a communication line connecting the imaging means and the control means, and a display means provided in the control means, the control means and the imaging means through the communication line In a remote imaging system for transmitting and receiving a video signal and a command signal between and displaying the video from the imaging unit on the display unit, generating a video signal while transmitting and controlling a command signal to the imaging unit, A video signal generating means for displaying the generated video signal on the display means, and a conversion function switching command when the video displayed on the display means is dark, and Remote imaging system and a second conversion function driving means, characterized by comprising the above control means so as to operate by the video conversion function. 3. An imaging means having a first video conversion function of converting light in a visible light region into a video signal, and a second video conversion function of converting light in an infrared region into a video signal, and said imaging means Control means for controlling the operation of the control means, storage means provided in the control means, and a communication line connecting the imaging means and the control means, and the imaging means and the control means through the communication line A remote imaging system for transmitting and receiving a video signal and a command signal between the AGC status inquiry means for transmitting a command for inquiring the level status of the AGC of the imaging means; If the light is small, a video signal storage means for storing the video signal obtained by converting the light in the visible light region into the storage means, and a conversion function switching command to the imaging means. A second conversion function driving means for transmitting a command to operate the imaging means with a second video conversion function; and storing the video signal obtained by converting the light in the infrared region and the storage means. A video signal synthesizing means for synthesizing a video signal obtained by converting light in a visible light region. 4. When the first video conversion function and the second video conversion function are alternately switched by a conversion function switching command sent via the communication line, switching is performed faster than a normal video sampling rate. Speed up,
The remote imaging system according to claim 3, wherein a video signal obtained by converting the light in the infrared region and a video signal obtained by converting the light in the visible light region are combined. 5. A disk is provided in front of the photoelectric conversion means provided in the imaging means, a visible light cut filter and an infrared light cut filter are mounted on the disk, and the first video conversion function and the second The remote imaging system according to claim 4, wherein the alternate switching is performed by rotating the disk in synchronization with a switching cycle of the second video conversion function. 6. An imaging means having a first video conversion function of converting light in a visible light region into a video signal, and a second video conversion function of converting light in an infrared region into a video signal, and said imaging means Remote control for transmitting and receiving a video signal and a command signal between the imaging means and the control means through the communication line. In the imaging system, a display unit for displaying a command signal transmitted from the control unit is provided in the imaging unit. 7. An image pickup device having display means typified by a viewfinder or a liquid crystal panel, control means for controlling the image pickup means, and a communication line connecting the image pickup means and the control means, In a remote imaging system for transmitting and receiving a video signal and a command signal between the imaging unit and the control unit through the communication line, a command signal for controlling an operation of the imaging unit or a command for inquiring a state of the imaging unit A command transmitting unit for transmitting a signal is provided in the control unit, and a power supply disconnecting unit for turning off the power of the display unit is provided in the imaging unit when a command signal for inquiring about the state is transmitted from the command transmitting unit. A remote imaging system, characterized in that: 8. An image pickup device having display means typified by a viewfinder or a liquid crystal panel, control means for controlling the image pickup means, and a communication line connecting the image pickup means and the control means, In a remote imaging system for transmitting and receiving a video signal and a command signal between the imaging unit and the control unit through the communication line, a command signal for controlling an operation of the imaging unit or a command signal for inquiring a state of the imaging unit And a screen inquiry means for transmitting a command for inquiring whether or not there is a viewer screen in the control means when the command signal is transmitted from the command transmission means. If the viewer screen is present in the control means, Remote imaging system power cutting means to cut, characterized in that provided in the image pickup means. 9. The remote imaging system according to claim 1, wherein said communication line is a communication line based on IEEE1394 or USB. 10. The remote imaging system according to claim 1, wherein the communication line conforms to IEEE1394 or USB, and the conversion function switching command and the function inquiry command conform to the AVC protocol. . 11. The remote communication system according to claim 3, wherein the communication line conforms to IEEE1394 or USB, and the conversion function switching command and the AGC status inquiry command conform to the AVC protocol. Imaging system. 12. An imaging means having a first video conversion function of converting light in a visible light region into a video signal, and a second video conversion function of converting light in an infrared region into a video signal, and said imaging means Control means for controlling the operation of the, and a communication line for connecting the imaging means and the control means, for transmitting and receiving video signals and command signals between the imaging means and the control means through the communication line In the remote imaging method for generating a video signal, a process of transmitting a function inquiry command to the imaging unit and inquiring which of the first video conversion function and the second video conversion function is selected; A function switching process for transmitting a switching command from the control unit to the imaging unit in accordance with an imaging state of the imaging unit, and switching a video conversion function selected by the imaging unit. Remote imaging method and performing and. 13. An imaging means having a first video conversion function of converting light in a visible light region into a video signal, and a second video conversion function of converting light in an infrared region into a video signal, and said imaging means Control means for controlling the operation of, a communication line connecting the imaging means and the control means, and a display means provided in the control means, the control means and the imaging means through the communication line A video signal and a command signal are transmitted and received between the remote control device and the display device so that the image from the image capturing device is displayed on the display device. A command signal is transmitted from the control device to the image capturing device via the communication line. A video signal generation process for generating a video signal while transmitting and controlling the video signal, and displaying the generated video signal on a display unit on the control unit; Transmitting a switching command from the control unit to the imaging unit, and performing a video conversion function switching process for operating the imaging unit with a second video conversion function. . 14. An imaging unit having a first video conversion function of converting light in a visible light region into a video signal, and a second video conversion function of converting light in an infrared region into a video signal, and the imaging unit Control means for controlling the control means, a storage means provided in the control means, a communication line connecting the imaging means and the control means, between the imaging means and the control means through the communication line In a remote imaging method for transmitting and receiving a video signal and a command signal to generate a video signal, a process of transmitting a command for inquiring an AGC level of the imaging means, and receiving a command for inquiring the AGC state, If the light in the visible light region is small, a video signal storing process of storing the video signal obtained by converting the light in the visible light region in the storage means, and sending a switching command to the imaging means And a video conversion function switching process for generating a video signal using the second video conversion function; and a video signal obtained by converting the infrared light and a visible light stored in the storage means. A video signal synthesizing process for synthesizing a video signal obtained by converting light in an area with a video signal. 15. When the first video conversion function and the second video conversion function are alternately switched by the conversion function switching command sent via the communication line, the switching speed is higher than the normal video sampling speed. The remote imaging method according to claim 14, wherein the video signal obtained by converting the light in the infrared region and the video signal obtained by converting the light in the visible light region are synthesized. 16. The processing for alternately switching between the first video conversion function and the second video conversion function includes the steps of: providing a disk in front of a photoelectric conversion unit provided in the imaging unit; The remote imaging method according to claim 14, wherein a cut filter and an infrared light cut filter are mounted, and the disk is rotated in synchronization with a switching cycle. 17. An imaging unit having a first video conversion function of converting light in a visible light region into a video signal, and a second video conversion function of converting light in an infrared region into a video signal, and the control unit A display unit provided on the imaging unit for displaying a command signal transmitted from the control unit, a control unit for controlling an operation of the imaging unit, and a communication line connecting the imaging unit and the control unit. A remote imaging method for transmitting and receiving a video signal and a command signal between the imaging means and the control means through the communication line to generate a video signal, wherein a command signal transmitted from the control means is transmitted to the imaging means on the imaging means. A remote imaging method for performing a process of displaying the image on a display unit provided in the camera. 18. An image pickup device having display means typified by a viewfinder or a liquid crystal panel, control means for controlling the operation of the image pickup means, and a communication line connecting the image pickup means and the control means. And a remote imaging method for transmitting and receiving a video signal and a command signal between the imaging unit and the control unit through the communication line to generate a video signal, wherein a command signal for controlling an operation of the imaging unit, or A remote imaging method, comprising: performing a process of turning off a display unit provided in the imaging unit when a command signal inquiring about a state of the imaging unit is sent from the control unit. 19. An image pickup device having display means typified by a viewfinder or a liquid crystal panel, control means for controlling the operation of the image pickup means, and a communication line connecting the image pickup means and the control means. And a remote imaging method for transmitting and receiving a video signal and a command signal between the imaging unit and the control unit through the communication line to generate a video signal, wherein a command signal for controlling an operation of the imaging unit, or When a command signal for inquiring about the state of the imaging unit is sent from the control unit, a process for inquiring whether or not there is a viewer screen in the control unit, and in response to the inquiry, when the viewer screen exists, Performing a process of turning off the power of the display means. 20. The communication line according to claim 12, wherein said communication line is a communication line conforming to IEEE1394 or USB.
10. The remote imaging method according to claim 9. 21. The communication system according to claim 19, wherein the communication line conforms to IEEE1394 or USB, and the conversion function switching command and the viewer screen presence / absence inquiry command conform to the AVC protocol. Remote imaging method. 22. The remote imaging method according to claim 14, wherein the communication line conforms to IEEE1394 or USB, and the conversion function switching command and the AGC status command conform to the AVC protocol. 23. A storage medium storing a program for causing a computer to function as each means according to claim 1. Description: 24. A storage medium storing a program for causing a computer to execute the procedure of the remote imaging method according to any one of claims 12 to 22.