TW201931847A - Image sensor of enhancing image recognition resolution and application thereof greatly reducing usage costs of image sensors and further saving mechanical costs - Google Patents

Abstract

An image sensor of enhancing image recognition resolution and its application mainly comprise: a photosensitive pixel array and packaging circuit connected thereto, driving and controlling to capture outside beam to be converted into an combinational picture output signals, wherein the photosensitive pixel array can capture full color visible light and infrared ray invisible light to perform photoelectric conversion, and; an image enhancement process unit built in the packaging circuit to modulate images captured by the photosensitive pixel array, including: one visible light wide scope image signal, and at least two invisible light narrow scope image signals and re-integrating and stacking the one wide scope image signal and the two narrow scope image signals so that the composed image has front and rear depth three-dimensional feeling. By utilizing single image sensor, daylight and night images can be clearly captured. The composed image sensor module can be widely applied to various products, such as security monitoring, industry monitoring, human facial recognition equipment, and automobile reversing aid image photographing.

Description

Image sensor with enhanced image recognition and its application

The invention relates to the technical field of image sensors, in particular to an image sensor for enhancing image recognition and its application, which can be used for clearly capturing images of daytime and nighttime, and making the composition images have a three-dimensional sense of front and rear.

In order to effectively capture daytime and nighttime images, the commonly used methods of the image sensor on the market, as shown in Figure 9A, are through a single RGB color lens A and an ordinary MONO black and white lens. B is alternately implemented, or with the current starlight night vision lens (not shown). Even, as shown in Fig. 9B, because the nighttime light is not enough, the conventional product must also be surrounded by a plurality of fill lamps C on the side of the image sensor as an auxiliary light source. The waveform obtained is as shown in Fig. 10, that is, when there is sunlight in the day, the saturation is formed by the capture of red (R), green (G) and blue (B) (the so-called "visual light source" RGB). Saturated image, when the visible light source is very weak at night, it can change the visible range through infrared light capture, but in fact its night vision distance is only about 850nm, which is limited by the application, because the product night vision The short distance, poor effect and high cost, so that the current application range is still limited to the consumer market, expanding to the industrial grade market is limited.

Although the current advanced design has a single image sensor that integrates color and infrared rays, the related image processing functions in the application are still not perfect. Finally, the image signal waveform obtained is still the same as in Figure 10. The effect is not good.

More importantly, the photographic effects of the above two types of structures, the images captured during the day and night are still not clear enough, especially the effective distance of night vision is not too long, the image quality is not clear enough, the recognition is poor, and the image is presented. The lack of a three-dimensionality of the plane, and the problem that the exposure to strong light causes the overexposure to be overexposed is a major drawback.

In view of the above, the main object of the present invention is to provide an image sensor for enhancing image recognition and its application, which mainly includes:

A photosensitive pixel array and its associated package circuit (wafer) are driven to control the photosensitive pixel array to capture external light into an output combined image signal, wherein the photosensitive pixel array can capture RGB full color visible light and IR infrared non-visible light Perform photoelectric conversion, and;

An image enhancement processing unit is built in the package circuit to regulate images captured by the photosensitive pixel array, including: a full-color RGB visible light wide-area image signal, and the full-color RGB visible light wavelength includes a total bandwidth width a narrow-area image signal of between 300 nm and 350 nm ± 20 nm and at least two infrared IR non-visible light, wherein each of the infrared IR non-visible narrow-area image signals has a wavelength bandwidth of between 35 nm and 50 nm ± 20 nm;

The wide-area image signal and the two narrow-area image signals are re-integrated and stacked to form a clear output image having a three-dimensional sense of front and rear.

Preferably, the wide-area image signal has a spectral range between 400 nm and 700 nm, and the spectral range of the two narrow-domain image signals is spaced between 850 nm and 940 nm.

Thereby, the invention can be widely applied to various products such as security monitoring, industrial monitoring, face recognition equipment, network cameras, drones, robots, automobile reversing auxiliary image shooting and the like.

In order to facilitate the purpose of the present invention, the structural composition, the application function features and the effects thereof, further descriptions and disclosures will be made. The embodiments and the drawings are described in detail as follows: as shown in Figures 1 to 4, the present invention is An image sensor 1 for enhancing image recognition is characterized in that:

A photosensitive pixel array 10 and its associated package circuit 11 (wafer) are driven to control the photosensitive pixel array 10 to capture external light into an output combined image signal, wherein the photosensitive pixel array 10 can capture RGB full color visible light and IR Infrared non-visible light for photoelectric conversion, and;

An image enhancement processing unit 12 is built in the package circuit 11 to control the image captured by the photosensitive pixel array 10, including: a full-color RGB visible light wide-area image signal 101, and the full-color RGB visible light wavelength is covered. A narrow-band image signal 102, 103 having a total bandwidth Wd boundary between 300 nm and 350 nm ± 20 nm, and at least two infrared IR non-visible light, each of the infrared IR non-visible narrow-area image signals 102 or 103 wavelength bandwidth Wn bound Between 35 nm and 50 nm ± 20 nm;

Preferably, the wide-area image signal 101 has a spectral range between 400 nm and 700 nm, and the two narrow-domain image signals 102 and 103 have a spectral range between 850 nm and 940 nm, and the narrow-area image signal is 102 bits. 850 nm, and the narrow-area image signal is 103 bits at 940 nm;

After obtaining the image, the wide-area image signal 101 and the two narrow-area image signals 102 and 103 are re-integrated and stacked to form a clear image output signal 105 having a front-to-back layer stereoscopic effect.

Preferably, as shown in FIG. 4, the specific method of the present invention includes: 1. Constructing a single image sensor 1 , and constructing an image enhancement processing unit 12 in the single image sensor 1 . Photoelectric conversion to capture images of day and night. 2. Defining the captured image, the captured image includes: a wide-area image signal 101 of visible light, and at least two non-visible narrow-area image signals 102, 103. 3. Capture wide-area image, select the wide-area image signal 101 spectrum The range is between 400 nm and 700 nm. 4. Capture the narrow-area image, and select the two narrow-area image signals 102, 103 to have a spectral range interval between 850 nm and 940 nm, and each narrow-area image signal 102, 103 has a wavelength bandwidth between 35 nm and 50 nm ± 20 nm. . 5. Stacking the combined image, and recombining the above wide-area image signal 101 and the two narrow-area image signals 102, 103 to form a clear image of a stereoscopic effect.

Preferably, as shown in FIG. 2, the package circuit 11 of the present invention further includes: a row selection driver 111, a column selection driver 112, a control circuit 113, a register 114, an amplifier 115, an analog/digital converter. 116 and an image processor 117; wherein the row selection driver 111 is electrically connected to one side of the row of the photosensitive pixel array 10; the column selection driver 112 is electrically connected to one side of the column of the photosensitive pixel array 10; the control circuit 113 is connected and controlled The row select driver 111 and the column select driver 112 are switched between row and column address selection; the register 114 is connected and stored for the photoelectric signal that the column select driver 112 is turned on; the amplifier 115 is used to amplify the photoelectric signal from the register 114. The analog/digital converter 116 converts the amplified photoelectric analog signal into a digital signal, and the image processor 117 combines the processed digital signals into an image output signal 105.

Preferably, as shown in FIGS. 2 and 3, the image enhancement processing unit 12 is configured to control the control circuit 113 and the image processor 117 in a connected manner. The image sensor 1 can be effectively used to capture a wide-area image signal 101 of a full-color RGB visible light and at least two infrared-ray non-visible narrow-area image signals 102, 103 due to the built-in image enhancement processing unit 12. The optical image technology and the optical communication technology are effectively integrated with each other, and the wide-area image signal 101 and the two narrow-area image signals 102 and 103 are effectively re-integrated and stacked, so that the image output signal 105 appears before and after. Layered stereo and clarity.

In particular, because the combined image output signal 105 is transmitted through the two narrow-domain image signals 102, 103, infrared light waves with different spectral ranges distributed between 850 nm and 940 nm are stacked, so that the effective distance of the night vision is significantly longer than that of the conventional structure, and at the same time The stereoscopic and sharpness is enhanced, and the practical purpose of capturing day and night images clearly with a single image sensor 1 can be achieved.

Preferably, as shown in the first and fifth embodiments, the image enhancement processing unit 12 of the present invention can be implemented as a software or a firmware, which facilitates modification to increase the number of captured narrow-domain images, or to adjust the transmittance of the image. , the light transmittance can be bound between 30% and 95%. For example, when capturing, another narrow-area image signal 104 is located at a wavelength of 1050 nm, so that infrared light waves distributed between 850 nm, 940 nm, and 1050 nm in different spectral ranges by stacking three narrow-area image signals 102, 103, and 104 are stacked. That makes the night vision distance more obvious, and also enhances the stereoscopic and sharpness of its image.

The above is only for convenience of illustration. The number of narrow-area images added is not limited to this. In fact, it can be set to various specifications with different precisions. Customization provides suggestions according to different shooting angles, distances, effects, etc. Tailored to customers, it can be used as a day and night dual-use technology in a variety of different wavelengths, and is widely used in security monitoring, industrial monitoring, face recognition devices, webcams, drones, robots. , car reversing auxiliary image shooting and other products.

Preferably, as shown in FIG. 6 , an image sensor module 100 for enhancing image recognition is provided in the application example of the present invention, which mainly includes: a circuit board 5 having an image sensor 1 disposed thereon; A photosensitive resistor 2 is disposed on the side of the sensor 1 , and at least four LED lamps 3 are disposed at four corners of the image sensor 1 at intervals. The image sensor 1 is provided with a lens 4 . An image processing circuit 50 is disposed on the circuit board 5. One side of the circuit board 5 is provided with at least one connector 51 for outputting signals from the external wiring 6. As shown in the first and third figures, the image sensor 1 has a photosensitive pixel array 10 and its associated package circuit 11 for driving and controlling the photosensitive pixel array 10 to capture external light into an output combination diagram. An image enhancement processing unit 12 is built in the package circuit 11 to control a wide-area image signal 101 capturing a full-color RGB visible light, and at least two infrared-IR non-visible narrow-area image signals 102, 103, but actually Not limited to this. And the wide-area image signal 101 and the two narrow-area image signals 102 and 103 are re-integrated and stacked into an image output signal 105, and the formed image has a stereoscopic sense of front and rear layers, so that the image sensor 1 constitutes image sensing. The module 100 can actively receive the spectrum from 380 nm to 940 nm, and then debug with the software platform, that is, the single image sensor 1 can be used to clearly capture the day and night images. Of course, if you can use other wavelengths of auxiliary light source (810nm and 880nm), the image overlay effect can be better.

Preferably, as shown in FIG. 7, a lens 40 is disposed under the lens 4 to be disposed on the circuit board 5 (see FIG. 6) and covered on the image sensor 1. The lens 41 of the lens 4 is layered. There is an infrared filter 42. This special design can further enhance the effect of the present invention for capturing IR infrared non-visible light, increasing the stereoscopic effect and color saturation of the image. The structural design is different from the existing conventional lens, and the conventional lens will be The filter is placed at the bottom of the lens or without a filter, but the infrared filter 42 of the present invention is disposed on the upper layer of the lens 41, which is the greatest difference between the present invention and the conventional structure.

Therefore, the image sensor module 100 with enhanced image recognition can be widely applied to various monitoring systems, vehicles, face recognition devices, network cameras, drones, robots, etc. A variety of different products, wherein the monitoring system can include, but is not limited to, indoor and outdoor monitors for security or industrial use. Wherein the vehicle may include, but is not limited to, a locomotive, a car, a boat, or an aircraft. For example, as shown in FIG. 8A, the image sensor module 100 of the present invention is further configured to be used as a face recognition method on a handheld device. As shown in FIG. 8B, the image sensor module 100 of the present invention is further configured as an application example of a night vision system on a car. Or as shown in FIG. 8C, an application example of the image sensor module 100 of the present invention is further configured on an outdoor monitor. The above is only for convenience of explanation, but it is not limited to this. For example, it can also be used in car reversing auxiliary image shooting, and on electronic devices with Internet of Things (not shown).

The invention adopts a wide-area image signal 101 and at least two narrow-area image signals 102, 103 overlapped and combined, and the obtained image has excellent clear depth and can be used for accurately calculating the measured object and the surrounding distance, gesture action, Obstacle avoidance, etc., which is very important for future 3D emerging applications, can effectively provide 3D depth image ranging functions such as VR/AR, drone, and People/Things Counting, even to accurately detect objects. And the surrounding environment depth measurement capability, it can also provide future applications such as Artificial Intelligence and Computer Vision.

The invention enhances the advantages of the image sensor with clear image recognition:

1. The full color gamut of 380nm to 940nm has a wide range of receivable spectra. Can be applied to many different environments.

2. High-quality shooting, good effect, resolution up to 2K/4K, visual distance can be used according to different lenses.

3. A single module with software, can shoot a variety of effects at the same time.

4. A single module can be used for 24 hours, basically fulfilling the needs of day and night shooting.

5. The effect of the two modules can be achieved with only a single module, which greatly reduces the cost of using the image sensor.

6. Only one module is needed, so it can be shared with existing organizations, and can further save institutional costs.

In summary, the present invention can indeed achieve the foregoing objectives, and has actually complied with the provisions of the Patent Law, and has filed a patent application according to law. The above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto; therefore, the simple equivalent changes and modifications made by the scope of the patent application and the patent specification of the present invention, All should fall within the scope of the invention patent.

1‧‧‧Image Sensor

10‧‧‧Photosensitive pixel array

11‧‧‧Package circuit

12‧‧‧Image Enhancement Processing Unit

2‧‧‧Photoresistors

3‧‧‧LED lights

4‧‧‧ lens

40‧‧‧Base

41‧‧‧ lenses

42‧‧‧Infrared filter

5‧‧‧Circuit board

50‧‧‧Image Processing Circuit

51‧‧‧Connector

6‧‧‧ wiring

100‧‧‧Image Sensor Module

101‧‧‧ Wide area image signal

102‧‧‧Narrow-area image signal

103‧‧‧Narrow-area image signal

104‧‧‧Narrow-area image signal

105‧‧‧Image output signal

111‧‧‧ select drive

112‧‧‧ column selection drive

113‧‧‧Control circuit

114‧‧‧Scratch

115‧‧‧Amplifier

116‧‧‧ Analog/Digital Converter

117‧‧‧ image processor

A‧‧‧ color lens

B‧‧‧ black and white lens

C‧‧‧ fill light

Wd‧‧‧ bandwidth

Wn‧‧‧ bandwidth

Fig. 1 is a diagram showing an image sensor package circuit (wafer) of the present invention. Fig. 2 is an equivalent circuit diagram of an image sensor package circuit (wafer) of the present invention. Fig. 3 is a spectrum diagram of the receiving range of the image sensor of the present invention. Figure 4 is a flow chart of a method for constructing an image sensor of the present invention. Fig. 5 is a view showing a spectrum of a range of another embodiment of the image sensor of the present invention. Fig. 6 is a diagram showing the module of the image sensor of the present invention. Figure 7 is an exploded perspective view of the lens of the discriminating module of the present invention. 8A, 8B, and 8C are diagrams showing an application example of the viewing module of the present invention. Figures 9A and 9B are conventional structures and partial enlarged views. Figure 10 Spectrogram of the received range of the conventional structure.

Claims (12)

An image sensor for enhancing image recognition, comprising: a photosensitive pixel array and a connected package circuit thereof for driving and controlling the photosensitive pixel array to capture external light converted into an output combined image signal, wherein the photosensitive pixel array The RGB full-color visible light and the IR infrared non-visible light can be captured for photoelectric conversion, and an image enhancement processing unit is built in the package circuit to regulate the image captured by the photosensitive pixel array, including: a full-color RGB visible light Wide-area image signal, the full-color RGB visible light wavelength includes a total bandwidth width between 300 nm and 350 nm ± 20 nm, and at least two infrared IR non-visible narrow-area image signals, the narrow field of each infrared IR non-visible light The wavelength bandwidth of the image signal is between 35 nm and 50 nm ± 20 nm, and the wide-area image signal and the two narrow-area image signals are re-integrated and stacked to form a clear output image with a stereoscopic effect. The image sensor with enhanced image recognition is described in claim 1, wherein the wide-area image signal has a spectral range between 400 nm and 700 nm, and the spectral range of the narrow-range image signal is spaced between 850 nm and 940 nm. between. The image sensor with enhanced image recognition is described in claim 2, wherein the image enhancement processing unit adjusts the photosensitive pixel array to further capture and increase another narrow-area image signal to a spectral range of 1050 nm, and a wavelength bandwidth of 35 nm. To 50nm ± 20nm. The image sensor with enhanced image recognition is described in claim 1, wherein the wide-area image signal and the narrow-area image signal have a light transmittance of between 30% and 95%. The image sensor for enhancing image recognition is as described in claim 1, wherein the package circuit further comprises: a row selection driver, a column selection driver, a control circuit, a register, an amplifier, and/or an analogy/ a digital converter and an image processor; the row selection driver is electrically connected to one side of the photosensitive pixel array row; the column selection driver is electrically connected to one side of the photosensitive pixel array column; the control circuit is connected Controlling the row selection driver and the column selection driver to perform row and column address selection switching conduction; the buffer is connected and stored for the photoelectric signal of the column selection driver to be turned on; the amplifier is for amplifying the photoelectric signal from the register The analog/digital converter converts the amplified photoelectric analog signal into a digital signal; the image processor combines the processed digital signal into an image output signal, and the image enhancement processing unit The control circuit and the image processor are connected in connection. An image sensor module for enhancing image recognition clearly comprises: a circuit board having an image sensor disposed thereon, a photoresistor disposed on an edge of the image sensor, and at least four LED lights spaced apart The image sensor is disposed at four corners of the image sensor, and the image sensor is provided with a lens. The circuit board is provided with an image processing circuit, and one side of the circuit board is provided with at least one connecting seat for external wiring of a connector. An image output signal, wherein the image sensor has a photosensitive pixel array and an associated package circuit thereof for driving and controlling the photosensitive pixel array to capture external light to be converted into an output combined image signal, wherein the package circuit has a built-in The image enhancement processing unit adjusts and captures a wide-area image signal of a full-color RGB visible light, and the full-color RGB visible light wavelength covers a total bandwidth width between 300 nm and 350 nm ± 20 nm, and at least two infrared IR non-visible narrow-area images a signal, the narrow-field image signal of each infrared IR non-visible light has a wavelength bandwidth between 35 nm and 50 nm ± 20 nm, and the wide-area image signal and the second narrow domain Re-integration signal as a stack, with the composition before and after stereoscopic image level, to clearly capture images day and night. The image sensor module for enhancing image recognition is as described in claim 6 wherein the wide-area image signal has a spectral range between 400 nm and 700 nm, and the spectral range of the two narrow-domain image signals is spaced at 850 nm. Between 940nm. The image sensor module for enhancing image recognition is described in claim 6 , wherein the lens is provided with a base disposed on the circuit board and covered on the image sensor, and an infrared filter is disposed on the upper surface of the lens of the lens. Light film. The image sensor module for enhancing image recognition is described in claim 7 , wherein the image sensor module is further configured on a handheld device. The image sensor module for enhancing image recognition is described in claim 7 , wherein the image sensor module is further configured on an electronic device having an Internet of Things. The image sensor module for enhancing image recognition is described in claim 7 , wherein the image sensor module is further configured on a vehicle, including but not limited to a locomotive, a car, a ship, and One of the aircraft and the like. The image sensor module for enhancing image recognition is described in claim 7 , wherein the image sensor module is further configured on a monitoring system, including but not limited to an indoor and outdoor monitor.