JP3461194B2 - Imaging device and data processing method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus and a data processing method for capturing a picked-up image in a computer, and more particularly to an image pickup apparatus and a data processing method for directly controlling each image pickup function from a computer. .

[0002]

2. Description of the Related Art In recent years, a captured image is captured by a computer, and a DTP (Desk Top Publish)
g) and videophones are being implemented on computers. For this reason, the configuration shown in FIG. 4 has been used as a conventional method for capturing a captured image in a computer. In FIG. 4, reference numeral 400 is an image pickup apparatus, which is a block diagram showing the configuration of a normal video camera, and 420 is a video input board incorporated in a computer. The imaging device 400 and the video input board 420 are connected by the video cable 410, and the video input board 400 receives and processes the composite video signal output from the imaging device 200. First, the imaging device 400 includes the lens 101.
An optical image input from the image forming device is formed on the light receiving surface of the CCD 103 through a diaphragm (shutter) 102 to be converted into a video electric signal. Lens 101 and diaphragm (shutter) 1
Reference numeral 02 denotes the focus, zoom ratio, and iris (shutter speed) by driving the motor driver 106 and the driver circuit 10 under the control of the camera control circuit 401.
Etc. can be changed. Also CC
The timing signal for driving D103 is generated by the timing generator 108. The video electric signal obtained from the CCD 103 is a color signal corresponding to color separation access arranged on the front surface of the CCD 103 (not shown), and the video electric signal is subjected to various kinds of signal processing by the signal processing circuit 402 so as to have a luminance signal and a color. Converted to a signal. A minute color filter such as Cy, Mg, G, and Ye is arranged in the color separation filter in a predetermined cycle, and one color filter is arranged so as to correspond to each pixel. The luminance signal and the color difference signal are further converted into a composite video signal by a known encoder circuit 160 and input to the video input board 420. The video input board 420 reproduces a luminance signal and a color difference signal by subjecting the input composite video signal to a decoding process by a known decoder circuit 421. The luminance signal and the color difference signal output from the decoder circuit 221 are stored in the memory 156 under the control of the memory controller 157. The video input board 420 is configured as an expansion board built in the computer and is connected to the computer bus 155. The computer bus 155 indicates generally known ISA Bus, VL Bus, Nu Bus, etc., and includes an address bus, a data bus, an interrupt line,
It is composed of a clock, a read signal, a write signal, a power supply, a ground, and the like. A bus control unit 422 controls the memory controller 157 by decoding the address signal on the address bus of the computer bus 155 and reading and interpreting the data from the data bus when the video input board 400 is selected. Is configured to do. The memory 156 is connected to the computer bus 155, and the video data stored in the memory 156 is sent to the data bus of the computer bus 155 under the control of the memory controller 157. It is configured so that it can be transferred to another storage medium for storage.

[0003]

However, in the above conventional example, since the video camera is used as the image pickup device,
The video signal obtained from the CCD is once converted into a composite video signal, and the composite video signal is input to the video input board and decoded to Y (luminance signal),
Since it is configured to be converted into each signal of RY and BY (each color difference signal) and stored in the memory, the CCD
There is a problem that the image quality is deteriorated as compared with the case where the signal read out from is directly converted into the Y, RY, and BY signals. Along with this, there is also a problem that the circuit scale becomes large and the cost becomes high as compared with the case where each of the Y, RY, and BY signals is directly produced from the signal read from the CCD.

[0004]

According to the image pickup apparatus of the invention according to claim 1, in order to solve the above-mentioned problems, an optical system for forming an optical image of an object and the optical system formed by the optical system. A camera head unit including an image pickup means for converting the optical image into an electric image signal, and a signal for the electric image signal supplied from the camera head unit, which is connected to the camera head unit via a communication path. A signal processing means for performing processing and a storage means for storing the video signal obtained by the signal processing means are provided.
That an imaging signal processing unit on an expansion board mounted on the external computer, and wherein the camera head unit
By acquiring the attribute information of the imaging means by communicating,
Install the program corresponding to the acquired attribute information
From the computer to the signal processing means,
By causing the processing means to execute the loaded program
It has a 1st control means to process the electric imaging signal . In addition, the day of the invention according to claim 8
According to the data processing method, in order to solve the above-mentioned problems,
The electrical image signal of the optical image of the subject formed by the system
A camera head unit having an image pickup means for converting;
When connected to the camera head unit via a communication path
Both of the electric power supplied from the camera head unit are
Signal processing means for performing signal processing on the aerial image signal,
The video signal obtained by the signal processing means is accumulated.
A storage device equipped with an expansion device that is attached to an external computer.
Data processing using an imaging signal processing unit on a tension board
And communicating with the camera head unit.
By acquiring the attribute information of the imaging means,
A program corresponding to the attribute information is stored in the external computer.
To the signal processing means,
By executing the loaded program,
It is characterized in that the image pickup signal is processed.

[0005]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The configuration and operation of one embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of the present invention. In the figure, 100 is a block showing an image pickup unit, 101 is a lens for optically forming a subject image, and the motor driver 1
The control unit 06 is configured to control AF, zoom, and the like. Reference numeral 102 denotes an aperture (shutter), and 107
Is a driver circuit for driving the diaphragm (shutter) 102. Motor driver 106 and driver circuit 10
7 operates under the control of the imaging control unit 110. Further, 103 is a CCD which is a sensor as an image pickup means, and a subject image is CCD through the lens 101.
An image is formed on the light receiving surface of 103. Reference numeral 104 denotes a sample hold and AGC (Auto Gain Cont) for the video signal read from the CCD 103.
The output of this circuit is sent to the signal processing board 140 connected by the cable SL through the connector 111. Reference numeral 108 denotes a timing generator that generates a timing signal for driving the CCD 103 and the signal processing board 140, and also includes HD (horizontal synchronization signal) and VD (vertical synchronization signal) supplied from the signal processing board 140 through the connector 111. Further, various timing signals are generated and some of them are sent to the signal processing board 140 through the connector 111. Reference numeral 109 is a DC-DC converter for generating a stable power supply voltage for driving the CCD 104 from the power supply supplied from the signal processing board 140 through the connector 111. Reference numeral 110 denotes an imaging control unit that transmits and receives serial data to and from the signal processing board 140 through the connector 111, and controls the entire imaging unit 100 such as zoom and iris (shutter speed) according to control data from the signal processing board 140. is there. The connector 111 is connected to the signal processing board 1 by the cable SL.
It is connected to the connector 150 on the 40 side and includes video signals, various timing signals, serial communication signals, and signals such as power supply and ground. Moreover, you may communicate wirelessly instead of the cable SL. The signal processing board 140 is in the form of an expansion board built into the computer. The video signal supplied from the connector 150 to the signal processing board 140 is converted into a digital signal by the A / D converter 151 and input to the signal processing circuit 152. The signal processing circuit 152 generates a luminance signal Y and a color signal from a video signal obtained according to a color filter attached to the CCD 103. In order to generate a color signal, the video signal is synchronously detected by a color separation unit and matrix calculation is performed to separate into primary color signals R, G and B, white balance and gamma correction are performed, and then RY and B are calculated by a color difference matrix. A -Y color difference signal is generated, and this color difference signal is time-division multiplexed. The generated luminance signal Y and the multiplexed color difference signal are each converted into an analog signal by the D / A converter 154, and a synchronizing signal is added to the luminance signal by a not-shown synchronizing signal adding circuit, and the terminals 162 are respectively provided. , 163 to the outside, and the memory 1 is controlled by the memory controller 157.
56 is also configured to be able to be taken in.
The video data (luminance signal Y and color difference signal) once captured in the memory 156 is switched to the video data output from the signal processing circuit 152 by the switches 158 and 159 and sent to the encoder 160. The encoder circuit generates a composite video signal from the luminance signal and the color difference signal, converts the composite video signal into an analog signal, and outputs the analog signal from the terminal 161 to connect to an unillustrated external monitor. The image stored in 156 can be switched and viewed. Reference numeral 155 denotes a computer bus, which is usually composed of an address line, a data line, an interrupt line, a clock, a read signal, a write signal power source, a ground, etc., and the signal processing board of the present invention is this bus. Connected to the computer by 155. A bus control unit 153 decodes the address signal from the bus 155, interprets the data of the data line from the bus 155 when the image pickup apparatus of the present invention is selected, and performs signal processing according to the value of the data. Circuit 15
2. Control of memory controller 157 and connector 15
By transmitting / receiving serial data to / from the image pickup unit 100 via 0, the image pickup unit 100 can be controlled.

Next, the operation of the device of the present invention will be described in detail. First, in the embodiment of the present invention, the application software on the computer is configured so that commands and data can be transferred between the main CPU of the computer and the device of the present invention by accessing a specific address in the address space of the computer. ing. It should be noted that the specific address for accessing is configured to be changed by a dip switch (not shown). If this address is assigned to 2000H now, by writing a command to 2000H by the application software running on the computer,
The bus controller 153 decodes the address signal to identify that the device of the present invention is selected, receives a command from the data line, and interprets it. Bus control unit 15
A control unit 3 controls the signal processing circuit 152 and the memory controller 157 according to a command and controls each function of the image pickup unit 100 and reads various status information of the device of the present invention by serial communication. For example, if the command is to fetch the video signal into the memory 156, the bus control unit 153 controls the memory controller 157 to fetch the video signal for one frame into the memory 156, and also to read the video signal from the memory 156. For example, the bus control unit 153 initializes the memory address of the memory controller 157 to the beginning where the video is stored, increments the memory address according to the subsequent read operation from 2000H, and stores the video stored in the memory 156. Operates to output data on the data lines of bus 155. Although not shown, the main CPU does not output video data to the bus when the address of the address line is other than 2000H.
It does not affect the operation of. Conversely, the data can be written in the memory 156 from the main CPU. When the command is related to the control of the image pickup unit 100 such as zoom and focus, the bus control unit 153 puts the command on the serial communication line and connects the connector 150 to the image pickup unit 10.
0, and the imaging control unit 110 executes this command to control the imaging unit 100. As described above, the main CPU of the computer can control the device of the present invention by writing the command to the specific address and reading the data by the application software operating on the computer. In this case, what is written from the application software operating on the computer includes not only the command but also the parameters necessary for various controls. In the device of the present invention, one command is sent to the bus control unit 153.
In response to the command, the response status to the command is set in the status register in the bus control unit 153, and is sent to the data line of the bus 155 during the read operation to the next specific address, thereby returning the status to the main CPU. The operating state of the device of the present invention can be transmitted. If the command requests reading of the status or function of the device of the present invention, the information after the status corresponding to the command is set in the status register in the bus control unit 153 so that an unnecessary amount of data can be read. It has become.

(Second Embodiment) Next, the configuration and operation of the second embodiment will be described with reference to FIG. FIG. 2 is a block diagram showing a second embodiment of the present invention. The reference numerals given in the figure correspond to those in FIG. The second embodiment is a DS in which the signal processing circuit 152, which is configured as hardware in the first embodiment, can be program downloaded.
P (Digital Signal Processo)
r) 201. DSP201
By receiving a program downloaded from the main CPU via the computer bus 155 via the bus control unit 153, it is possible to perform programmable signal processing instead of fixed signal processing. Since the image pickup unit 100 and the signal processing board 140 are electrically connected, if the image pickup unit 100 is replaced, this can be detected by the bus control unit of the signal processing board 140. When the image pickup unit 100 is replaced using the flowchart of FIG.
The processing for switching the signal processing in 01 will be described.

First, when the bus controller 153 detects a new connection of the image pickup unit 100, the process of S301 is started. In step S302, the bus control unit 153 sends a CCD information read request command to the imaging control unit 110 of the imaging unit 100 via the serial communication line. CCD information includes the number of pixels of the CCD built in the image pickup unit 100, color filter information, and NTSC.
/ PAL information such as which method is included. The imaging control unit 110 that receives the command has a built-in memory that stores these data in advance.
The information is returned to the bus control unit 153 by serial communication.
The bus controller 153 waits for receipt of CCD information (S
303), after receiving CCD information, CC in S304
The imaging unit 1 connected to the D information is analyzed.
00 to request the main CPU to download a signal processing program suitable for the CCD 103 (S30
5). This processing is performed by interrupting the main CPU from the bus control unit 153 through the interrupt line of the bus 155. In the actual download, the program data is written from the main CPU to the address assigned to the device of the present invention at any time, so that the bus control unit 153 receives the program data from the data bus of the bus 155 and transfers it to the program memory area of the DSP 201. It is configured to store. When the program download is completed, the process moves to S307 and DSP2
The signal processing of the video signal sent from the image pickup unit 100 is not started until the bus control unit 153 is controlled to execute the downloaded program for 01, and is taken into the memory 156 or output from the external output terminal. It becomes possible to output a video signal. Further, when the electrical connection between the signal processing board 140 and the image pickup unit 100 is cut off (when the image pickup unit 100 is removed), the operation of the DSP 201 is stopped, and the operation is restarted. Needless to say.

In this embodiment, the bus controller 153 detects the connection between the signal processing board 140 and the image pickup unit 100 and downloads the program, but the main CPU itself performs these operations. It is also possible to do so. In this case, the imaging unit 1
When 00 is connected, the main CPU may be interrupted, and in this interrupt processing, the main CPU may read CCD information and download a program.

(Third Embodiment) FIG. 5 is a diagram in which the image pickup control section 153, which was on the image pickup unit 100 side, is also placed on the signal processing board 140 side, and the motor driver 106 of the image pickup unit 100 is inserted from the signal processing board side. And the driver circuit 107 can be directly controlled. In this case, a plurality of identification terminal pins (not shown) are provided between the connectors 111 and 150, and the ON / OFF information of the identification terminal pin is changed on the image pickup unit 100 side in accordance with the CCD information, whereby the signal The processing board 140 determines from the ON / OFF information of the identification terminal pin to CC
A program to be downloaded to the DSP 201 can be selected by configuring the D information to be identified.

Alternatively, these CCs may be provided in the image pickup unit 100.
A ROM for storing D information may be built in and read from this.

By mounting the signal processing unit on the PCMCIA card in the first to third embodiments, it becomes possible to use it as an image input means such as a notebook personal computer.

In this way, even if a video capture board or the like cannot be mounted on a notebook personal computer by mounting the signal processing unit on the PCMCIA card,
By mounting this PCMCIA card, the image input means can be easily obtained at low cost.

[0014]

As described above , according to the present invention,
An electric image signal obtained by the image pickup means of the camera head unit.
Issue on an expansion board that is attached to an external computer.
When processing by the signal processing means of the image signal processing unit,
By communicating with the camera head unit,
Acquires the attribute information, and the program corresponding to the acquired attribute information
Load the ram from an external computer into the signal processing means,
To execute the program loaded in the signal processing means
By processing the electrical imaging signal with
The expansion board hardware even if the
Suitable for imaging means after changing easily without changing
There is an effect that signal processing can be performed.

Further, when the signal processing section which is carried out by the expansion board built into the computer is carried out by the DSP capable of downloading the program, the hardware of the signal processing board is changed even when the number of pixels of the color filter or CCD in the image pickup unit is changed. There is also an effect that it can be dealt with by changing the program to be downloaded without changing.

[Brief description of drawings]

FIG. 1 is a block diagram showing a first embodiment of the present invention.

FIG. 2 is a block diagram showing a second embodiment of the present invention.

FIG. 3 is a flowchart for explaining the operation of the second embodiment.

FIG. 4 is a block diagram showing a conventional example.

FIG. 5 is a block diagram showing a third embodiment of the present invention.

[Explanation of symbols]

100 imaging unit 101 lens 102 aperture 103 CCD 104 Pre-processing part 106 motor driver 107 driver circuit 108 Timing Generator 109 DC-DC converter 110 Camera control unit 111 connector 140 signal processing board 150 connectors 151 A / D converter 152 signal processing circuit 153 Bus control unit 154 D / A converter 155 computer bus 156 memory 157 memory controller 158 and 159 switches 160 encoder 161, 162, 163 External output terminals

Claims (8)

(57) [Claims] 1. A camera head unit including an optical system for forming an optical image of a subject, and an image pickup means for converting the optical image formed by the optical system into an electric image signal, and communication with the camera head unit. A signal processing unit that is connected through a path and that performs signal processing on the electric video signal supplied from the camera head unit; and a storage unit that stores the video signal obtained by the signal processing unit. an imaging signal processing unit on an expansion board mounted on the external computer, before by communicating with said camera head unit
The attribute information of the image capturing means is acquired, and the acquired attribute information is
The corresponding program from the external computer to the signal
Loading to the processing means and loading to the signal processing means
The electric imaging signal is processed by executing a program
Imaging apparatus characterized by comprising first control means for management, the. 2. The image pickup apparatus according to claim 1, wherein the electric image signal is a color signal attached to a front surface of the image pickup means and corresponding to a color filter. 3. The image pickup apparatus according to claim 1, wherein the electric video signal includes a luminance signal and a color signal. 4. The camera head unit is the optical system.
Further comprising second control means for controlling the image pickup signal processing unit.
Control the camera head by sending and receiving data to and from
Communication means for controlling, the second control means in the camera head unit,
The image pickup apparatus according to claim 1, wherein the image pickup apparatus operates according to control information sent from the image pickup signal processing unit via the communication unit. 5. The information of the image pickup device is a pixel of the image pickup device.
Number, color filter information, transmission method of the imaging signal,
The imaging device according to claim 1, further comprising at least one . 6. The image pickup apparatus according to claim 4 , wherein the control information is issued from the external computer. 7. The image pickup apparatus according to claim 1 , wherein the storage means is configured to be readable and writable by the external computer. 8. The optics of a subject formed by an optical system
A camera provided with an image pickup means for converting an image into an electric image signal.
Communication unit and the camera head unit.
Connected via the camera head unit
Signal processing is performed on the electric video signal supplied from
Signal processing means, and obtained by the signal processing means
An external computer equipped with storage means for storing video signals.
Image signal processing unit on the expansion board mounted on the monitor
And a data processing method using the camera head unit by communicating with the camera head unit.
Acquires the attribute information of the image means and corresponds to the acquired attribute information.
The program from the external computer to the signal processing
To the signal processing means and the signal processing means to the loaded program.
The electrical imaging signal is processed by executing a program.
A data processing method characterized by: