JPH0719831A - Image recognition processing apparatus - Google Patents

Abstract

PURPOSE:To improve the executing rate of processing by image recognition by setting a plurality of judging references, and judging the agreement by the comparison with a plurality of judging references. CONSTITUTION:The image signal is inputted into a sample hold circuit 2 from a camera 1, and sampling is performed. The signal is converted with an A/D converter part 3. The signal is further inputted into a color judging part 7 and a shape judging part 8 through a control part 11. The color judging part 7 compares the level of each color signal in the specified region of on a screen with the reference data of each color which is preset and read out of a memory part 6 and outputs the signal when the specified agreement rate or more is obtained. The shape judging part 8 extracts the profile of the image, compares the profile with the reference data of the profile, which is preset profile from the memory part 6, and outputs the signal when the specified agreement rate or more is obtained. The distance data from a distance detecting part 4 are compared with the preset reference data in a distance judging part 9. The control part 11 outputs the signals through an output part 12 based on the signals indicating the agreement of the data from the judging parts 7, 8, 9 and the like and performs the required processing.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image recognition processing apparatus, and more particularly to an apparatus for executing preset processing based on image determination by a television camera (hereinafter abbreviated as camera).

[0002]

2. Description of the Related Art When a camera is installed on a production line to monitor the production line for the purpose of automation and labor saving of production equipment in a factory, for example, the focus adjustment of the camera is performed by a color preset from an image by the camera. Is detected and the image of this color is automatically adjusted, or when recognizing the image, the outline of the image is extracted by the camera, and when the required matching rate is obtained, the image is recognized. A method such as making a judgment is used. However, if the focus adjustment of the camera is adjusted according to the color of the image, it is difficult to judge the color because the illumination of the object has a shadow and the brightness is different.
Alternatively, in the case of performing image recognition by extracting contours,
There may be a problem that the object cannot be recognized as the object because the orientation of the object is slightly different, and if only one criterion is used, the determination may be incorrect.

[0003]

SUMMARY OF THE INVENTION In view of the above, the present invention sets a plurality of determination criteria and determines the coincidence by comparing the plurality of determination criteria with each other. To provide something that improves.

[0004]

In order to solve the above problems, the present invention provides a television camera for capturing an image,
Sample and hold A / D that samples and holds the video signal from the television camera and converts it to a digital signal
A conversion unit, a distance detection unit that detects distance, a temperature detection unit that detects temperature, a storage unit that stores reference data such as color, shape, distance, and temperature, and the sample hold / A /
The data from the D conversion unit, the data from the distance detection unit, or the data from the temperature detection unit is compared with the reference data read from the storage unit, and a determination unit that outputs a signal when they match, the television camera, the sample hold An image recognition processing device comprising an A / D conversion unit, a distance detection unit, a temperature detection unit, a storage unit, and a control unit that controls a determination unit, and outputs a required processing signal based on a signal from the determination unit. It is a thing.

[0005]

With the above arrangement, in the image recognition processing apparatus according to the present invention, the image captured by the camera is sample-held and converted into a digital signal,
Regarding this data, the color or shape is compared with preset reference data respectively, or the data from the distance detection unit and the data from the temperature detection unit are compared with preset reference data, respectively. When the required coincidence rates are obtained by the comparison, the object is determined to be the object to be processed, the processed signal is output, and the required processing is performed.

[0006]

Embodiments of the image recognition processing apparatus according to the present invention will be described in detail below. 1 is a block diagram of essential parts of an embodiment of an image recognition processing device according to the present invention, and FIG. 2 is a block diagram of essential parts of another embodiment of an image recognition processing device according to the present invention.

In FIG. 1, reference numeral 1 is a camera, for example, C
A CD (charge coupled device) is used as an image pickup device, and a color video signal obtained by image pickup is output. A sample and hold circuit 2 samples the video signal from the camera 1.
An A / D converter 3 converts the signal from the sample and hold circuit 2 into a digital signal. Reference numeral 4 denotes a distance detecting unit that emits an ultrasonic signal and calculates the distance from the arrival time of the reflected wave. Reference numeral 5 denotes a temperature detection unit, which detects radiant heat of an object by a pyroelectric heat-sensitive sensor or the like, converts it into temperature, and outputs it. Reference numeral 6 denotes a storage unit, which is a color used as a determination reference,
Predetermined reference data such as shape, distance, temperature, etc. are stored.

Reference numeral 7 is a color determination unit, for example, an A / D conversion unit 3
The signal level of each color signal in a predetermined area in one screen is compared with the reference data of each color read from the storage unit 6, and a signal is output when each is equal to or higher than a predetermined matching rate. Reference numeral 8 denotes a shape determination unit which extracts the contour of the image by differentiating the data from the A / D conversion unit 3 and compares it with the reference data of the contour read from the storage unit 6, and when it is equal to or higher than a predetermined matching rate. Output a signal. A distance determination unit 9 compares the data from the distance detection unit 4 with reference data of the distance read from the storage unit 6 and outputs a signal when the distance is within the allowable distance range. A temperature determination unit 10 compares the data from the temperature detection unit 5 with the reference data of the temperature read from the storage unit 6, and outputs a signal when the rate is equal to or higher than a predetermined matching rate. Reference numeral 11 denotes a control unit, and when the color determination unit 7, the shape determination unit 8, the distance determination unit 9, and the temperature determination unit 10 respectively output signals indicating a predetermined matching rate or more, a required processing signal is output via the output unit 12. Is output.

In FIG. 2, (a) is the image detection side,
(B) is the image recognition side. It should be noted that the camera 1 to the temperature detecting unit 5 are the same as those in FIG.
21 on the image detection side (a) is a spread spectrum modulation / demodulation unit, which is the A / D conversion unit 3, the distance detection unit 4, and the temperature detection unit 5.
Signal is modulated into a required high frequency signal by a spread spectrum modulation method, and the signal received by the transmitting / receiving unit 22 is demodulated. The transmission / reception unit 22 transmits the signal from the spread spectrum modulation / demodulation unit 21 as a weak radio wave and outputs the received signal to the spread spectrum modulation / demodulation unit 21. twenty three
Is an output unit for outputting the signal demodulated by the spread spectrum modulation / demodulation unit 21.

An image recognition side (b) 24 is a transmitter / receiver which receives radio waves from the transmitter / receiver 22 and transmits signals from the spread spectrum modulator / demodulator 25 as weak radio waves. The spread spectrum modulation / demodulation unit 25 includes a transmission / reception unit 24.
Signal is demodulated, and the signal input through the control unit 28 is modulated into a required high frequency signal by the spread spectrum modulation method and output to the transmission / reception unit 24. A storage unit 26 stores preset reference data such as a color, a shape, a distance, and a temperature for use as a determination reference. A determination unit 27 compares the level of each color signal in a predetermined area in one screen with the signal from the spread spectrum modulation / demodulation unit 25 with the reference data of each color read from the storage unit 26, and determines whether the level is equal to or higher than a predetermined matching rate. In this case, a signal is output, the contour of the image is extracted by differentiating the signal from the spread spectrum modulation / demodulation unit 25, and compared with the reference data of the contour read from the storage unit 26. The data from the distance detection unit 4 is compared with the reference data of the distance read from the storage unit 26, the signal is output when the distance is within the allowable distance range, and the data from the temperature detection unit 5 is output. The temperature is compared with the reference data of the temperature read from the storage unit 26, and a signal is output when the matching rate is equal to or higher than a predetermined value. Reference numeral 28 denotes a control unit, which outputs a required processing signal when the color determination unit 27 outputs a signal having a rate equal to or higher than the predetermined matching rate, modulates the signal by the spread spectrum modulation / demodulation unit 25, and transmits the signal. The signal is transmitted by a weak radio wave via the receiving unit 24.

Next, the operation of the image recognition processing apparatus according to the present invention will be described. First, in the case of FIG. 1, a video signal from the camera 1 is input to the sample and hold circuit 2, sampled at a required frequency, converted into a digital signal by the A / D conversion unit 3, and a color determination unit via the control unit 11. 7 and the shape determination unit 8 respectively. The color determination unit 7 reads the levels of the color signals of a predetermined area in one screen of the signal from the A / D conversion unit, for example, the central portion of the screen, from the storage unit 6 via the control unit 11 and sets the preset colors. Respectively, and outputs a signal when the matching rate is equal to or higher than a predetermined matching rate. Further, the shape determination unit 8 extracts the contour of the image by differentiating the data from the A / D conversion unit 3 and controls the data. It is compared with preset contour reference data read from the storage unit 6 via the unit 11, and a signal is output when the predetermined matching rate is exceeded.

Further, the distance detecting unit 4 emits an ultrasonic signal toward the recognition target direction, receives a reflected wave of this signal, and calculates the distance to the object reflected by the required signal processing. . The distance data from the distance detection unit 4 is input to the distance determination unit 9 via the control unit 11 and compared with preset reference data of the distance read from the storage unit 6, and when the distance is within the allowable distance range, a signal is output. Output. Further, the temperature detecting unit 5 detects the radiant heat of the object using, for example, a pyroelectric heat sensitive sensor or the like, converts it into temperature, and outputs it.
The temperature data from the temperature detection unit 5 is input to the temperature determination unit 10 and compared with preset temperature reference data read from the storage unit 6 and a signal is output when the matching rate is equal to or higher than a predetermined value.

The control unit 11 outputs a required signal via the output unit 12 based on the signal output from the color determination unit 7, the shape determination unit 8, the distance determination unit 9 or the temperature determination unit 10 indicating the coincidence of data. Output and perform required processing.

Further, in the case of FIG. 2, A on the image detection side (a)
The signal from the D / D converter 3, the signal from the distance detector 4, or the signal from the temperature detector 5 is modulated, for example, by a spread spectrum modulation / demodulation unit 21 into a required high frequency signal by a spread spectrum modulation method or the like, The transmitter / receiver 22 transmits a weak electric wave. This radio wave is received by the transmission / reception unit 24 on the image recognition side (b), and spread spectrum modulation / demodulation unit
Input to 25 and demodulated. The demodulated signal is input to the determination unit 27 via the control unit 28 and compared with each reference data read from the storage unit 26 via the control unit 28 to determine the matching rate. Similar to the storage unit 6, the storage unit 26 stores data to be used as a judgment reference of color, shape, distance and temperature, and the judgment unit 27 stores the data in the spread spectrum modulation / demodulation unit.
Each data demodulated in 25 is compared with each of these reference data, the matching rate and the like are determined, and a signal is output. Based on these signals, the control unit 28 outputs a required signal.

A signal from the control unit 28 is modulated by a spread spectrum modulation / demodulation unit 25 into a required high frequency signal by a spread spectrum modulation method, and a transmission / reception unit 24 transmits it as a weak radio wave. Then, the transmitter / receiver 22 receives this radio wave,
It is input to the spread spectrum modulation / demodulation unit 21, demodulated, and the demodulated signal is output via the output unit 23.

It should be noted that in the above, the recognition object is defined by color, shape,
It is assumed that the recognition is performed based on the distance to the camera and the surface temperature, and the preset processing is performed when all of them are equal to or higher than the predetermined matching rate. If it can be recognized, the required processing is performed with the signal from the color determination unit or the shape determination unit, or if the determination of the distance is indispensable, the signal from the color determination unit or the shape determination unit and the distance determination unit are used. The above determination items may be appropriately combined or other determination items may be added depending on the environmental conditions in which the device is installed, such as performing processing based on the signal of 1.

[0017]

As described below, according to the image recognition processing apparatus of the present invention, the color, shape, distance to the camera,
Multiple items are appropriately selected according to the installation conditions of the equipment such as surface temperature, and the judgment is made by comparing with each standard.Therefore, the standard value of each item should be lower than that when judging by one standard. By setting and clearing the respective criteria, it is determined that they are coincident, and accurate coincidence determination is possible. Also,
When separating the image detection side and the image recognition side, by transmitting and receiving signals between them by spread spectrum communication method, it is not affected by other signals or noise and does not interfere with other signals You can

[Brief description of drawings]

FIG. 1 is a block diagram of a main part of an embodiment of an image recognition processing device according to the present invention.

FIG. 2 is a block diagram of a main part of another embodiment of the image recognition processing device according to the present invention.

[Explanation of symbols]

 1 Television camera 2 Sample-and-hold circuit 3 A / D converter 4 Distance detector 5 Temperature detector 6 Memory 7 Color determiner 8 Shape determiner 9 Distance determiner 10 Temperature determiner 11 Controller 12 Output 21 Spread spectrum Modulation / demodulation section 22 Transmission / reception section 23 Output section 24 Transmission / reception section 25 Spread spectrum modulation / demodulation section 26 Storage section 27 Judgment section 28 Control section

Claims (7)

[Claims] 1. A television camera for capturing an image, and a sample hold A for sampling and holding a video signal from the television camera and converting it into a digital signal.
A / D conversion unit, a storage unit that stores color and shape reference data, and the data from the sample and hold / A / D conversion unit are compared with the reference data read from the storage unit. It comprises a determination unit that outputs a signal and a control unit that controls the television camera, the sample hold / A / D conversion unit, the storage unit and the determination unit, and outputs a required processing signal based on the signal from the determination unit. Image recognition processing device. 2. A television camera for capturing an image, and a sample hold A for sampling and holding a video signal from the television camera and converting it into a digital signal.
A / D conversion unit, a storage unit that stores color and shape reference data, and the data from the sample hold / A / D conversion unit are compared with the reference data read from the storage unit. It comprises a determination unit that outputs a signal and a control unit that controls the television camera, the sample hold / A / D conversion unit, the storage unit and the determination unit, and outputs a required processing signal based on the signal from the determination unit. Image recognition processing device. 3. A television camera for capturing an image and a sample hold A for sampling and holding a video signal from the television camera and converting it into a digital signal.
An A / D conversion unit, a distance detection unit for detecting a distance, a storage unit for storing reference data of color, shape and distance, data from the sample hold / A / D conversion unit and data from the distance detection unit. Compared with the reference data read from the storage unit, match the color or shape and distance, or
A determination unit that outputs a signal when color, shape, and distance match,
The television camera, the sample hold / A / D conversion unit, the distance detection unit, the storage unit, and the control unit for controlling the determination unit are configured to output a required processing signal based on the signal from the determination unit. Image recognition processing device. 4. A television camera for capturing an image, and a sample hold A for sampling and holding a video signal from the television camera and converting it into a digital signal.
A / D conversion unit, a temperature detection unit for detecting temperature, a storage unit for storing reference data of color, shape and temperature, data from the sample hold / A / D conversion unit and data from the temperature detection unit. Compared with the reference data read from the storage unit, match the color or shape and temperature, or
A determination unit that outputs a signal when the color, shape, and temperature match,
The television camera, the sample hold / A / D converter, the temperature detector, the storage, and the controller that controls the determination unit output a required processing signal based on the signal from the determination unit. Image recognition processing device. 5. A television camera for capturing an image, and a sample hold A for sampling and holding a video signal from the television camera and converting it into a digital signal.
/ D conversion unit, a distance detection unit that detects a distance, a temperature detection unit that detects a temperature, a storage unit that stores reference data of color, shape, distance, and temperature;
The data from the D / D conversion unit, the data from the distance detection unit, and the data from the temperature detection unit are compared with the reference data read from the storage unit to match the color or shape, the distance and the temperature, or the color, the shape, the distance. And a determination unit that outputs a signal based on the coincidence of temperature, the television camera, the sample hold / A / D conversion unit, the distance detection unit, the temperature detection unit,
An image recognition processing device comprising a storage unit and a control unit that controls the determination unit, and outputs a required processing signal based on a signal from the determination unit. 6. The sample hold / A / D conversion unit,
A first transmission / reception unit that transmits a signal from the distance detection unit or the temperature detection unit as a weak radio wave and a second transmission / reception unit that receives and demodulates the radio wave from the first transmission / reception unit are provided and demodulated by the second transmission / reception unit. Data is input to the determination unit, compared with reference data read from the storage unit, and a signal output in agreement is transmitted as a weak radio wave via the second transmission / reception unit, and this radio wave is transmitted to the first transmission / reception unit. Claim 1 and Claim 2 which received and demodulated by and output a required processing signal.
The image recognition processing device according to claim 3, claim 4, or claim 5. 7. The sample hold / A / D conversion unit,
A first transmission / reception unit that transmits a signal from the distance detection unit or the temperature detection unit as a weak radio wave by a spread spectrum communication method, and a second transmission / reception unit that receives and demodulates the radio wave from the first transmission / reception unit are provided. 2 The data demodulated by the transmitting / receiving unit is input to the determining unit, compared with the reference data read from the storing unit, and the signal output in agreement is weakened by the spread spectrum communication method via the second transmitting / receiving unit. The image according to claim 1, claim 2, claim 3, claim 4 or claim 5, wherein the image is transmitted by radio wave, and the radio wave is received and demodulated by the first transmitting / receiving unit and a required processing signal is output. Recognition processing device.