WO2014032386A1

WO2014032386A1 - High speed image shooting method utilizing quick switch light source and application device

Info

Publication number: WO2014032386A1
Application number: PCT/CN2013/000477
Authority: WO
Inventors: 于燕斌
Original assignee: 广州市盛光微电子有限公司
Priority date: 2012-09-03
Filing date: 2013-04-26
Publication date: 2014-03-06
Also published as: CN102821251A; CN102821251B

Abstract

Disclosed are a high speed image shooting method utilizing a quick switch light source and an application device. The method comprises the following steps: a shooting device continuously shooting a target object; the quick switch light source emitting several monochromatic light rays of different colors successively and irradiating the light rays on the target object in each shutter time of the shooting device; extracting color separation images corresponding to the monochromatic light rays of different colors from mixed images; and arranging and integrating the color separation images in order according to irradiation time. Also disclosed is a high speed image shooting device utilizing an LED light source, which comprises a shooting module, an LED light source module, a switch control circuit module and an image processing module, wherein the shooting module comprises an image shooting lens and a shooting sensor corresponding to the image shooting lens; the LED light source module comprises several LED light-emitting components producing light rays of different colors; the switch control circuit module is used for controlling the LED light source module and the shooting module; and the image processing module is used for receiving and processing images shot by the shooting module.

Description

High-speed camera method and application device for applying fast switching light source

The present invention relates to the field of high speed camera systems, and more particularly to a high speed camera method for applying a fast switching light source, and a device for applying the method. Background technique

High-speed camera is a method of closely linking spatial information and time of high-speed motion change process to image recording. It can continuously record transient and high-speed processes, and uses image analysis equipment to perform quantitative calculation. In ballistic analysis, it has been gradually expanded from military to civilian, from industry to medical biology, from macroscopic mechanical movement to microscopic mechanism research. High-speed camera can quickly and multi-sample high-speed targets in a short period of time. When projected at regular speed, the changes in recorded objects are clearly and slowly presented to us. High-speed optoelectronic imaging technology has the outstanding advantages of real-time target capture, fast image recording, instant playback, and intuitive image clarity.

The traditional high-speed camera works by: High-speed moving targets are illuminated by natural light or artificially-assisted illumination, or the moving target itself emits light, and part of this light passes through the imaging objective of the high-speed imaging system. After imaging by the objective lens, it falls on the image sensing surface of the photoelectric imaging device, and the photoelectric device controlled by the driving circuit responds quickly to the target image on the image sensing surface, that is, according to the distribution of the target image light energy on the image sensing surface. Each sampling point, that is, a pixel, generates a charge packet of a response size, and completes photoelectric conversion of the image. Individual charge packets with image information are quickly transferred to the read registers. The read signal is processed by the signal and transmitted to the computer. The image is read, displayed and interpreted by the computer, and the result is output. Therefore, a complete high-speed imaging system consists of optical imaging, optoelectronic imaging, signal transmission, control, image storage and processing.

At present, general cameras and DVs can reach up to 50-6 (Γ300 frames per second, 30 frames/s for mobile phones, while general high-speed cameras can usually achieve 60 times per second (Γ 10,000 frames for speed recording, some military-specific high-speed cameras even It can reach 1 million to 10 million frames per second. In order to realize the technical effect of idle speed camera, traditional high-speed cameras and other high-speed imaging instruments pay more attention to capturing images with high time and frequency, and of course, as a high-speed camera. Means. In order to acquire image sample data at high frequencies, in addition to the sensitivity limitations of sensors and lighting devices, the sampling frequency is also subject to the shutter speed and sensor ADC speed and other related data processing bottlenecks. Therefore, high-speed camera sensors are required. It has special structures, processes and materials to enable it to be carried out at high speeds. If.

In addition, the use of artificial auxiliary lighting in the field of photography (commonly known as flash) has experienced the development process from magnesium flash, flash (flash gun) to electronic flash; the currently used sub-flash is based on the principle of gas discharge, using integrated circuits The photosensitive control circuit composed of the blue silicon tube can automatically control the extinguishing time according to the shooting distance and the intensity of the reflection. The above-mentioned flash lamp has its inadequacies, that is, it cannot realize the instantaneous fast switching: from 3⁄4, the power is started to emit light, and there is a certain delay time, which is commonly called preheating; from the power-off to the end of the illumination, there is also a certain delay time. , commonly known as afterglow. In the 3⁄4 speed camera, especially in the high-speed camera in the dark environment, the W-light continues to flash, Due to the presence of the delay time (afterglow), a very high flicker frequency cannot be achieved. Summary of the invention

An object of the present invention is to provide a high-speed imaging method using a fast switching light source, which realizes high-speed imaging by utilizing a high-speed flashing light source exposure at an existing shutter speed, which has low cost and high-speed imaging effect. The benefits.

Another object of the present invention is to provide an idling image pickup apparatus using the above method, which has the advantages of low cost and easy popularization with respect to the conventional image pickup apparatus.

The technical solution of the idle speed imaging method using the fast switching light source comprises: a shutter, a photographing sensor, an image processing module and a fast switching light source module; the fast switching light source module comprises at least two light sources having different color lights; The shutter is associated with the action of the fast switching light source module;

The method comprises the following steps - step one, shutter action, performing exposure;

Step 2: During the shutter exposure time, different color light sources of the fast switching light source module are sequentially switched; Step 3: The shooting sensor obtains a mixed image containing backgrounds of different color lights;

Step 4: The image processing module extracts a color separation image of different color light backgrounds in the mixed image;

Step 5: Combine the color separation images of the different color light backgrounds into a video according to the sequence of sequentially switching the light sources of different colors.

The fast switching light source of the invention refers to a light source capable of performing multiple switching operations in one shutter time, has good switching cutoff performance, and can perform switching operations in milliseconds or even microseconds, preferably using LED (Light Emmitting Diode). Light source, however, according to the principle of the invention, those skilled in the art can easily associate with other fast switching light sources, such as laser light sources, etc., which also belong to the protection range.

LED lighting sources have developed very fast in recent years, their lighting performance is getting better and better, and the price is relatively low, which is known as the green light source. Moreover, the switching time of the LED can be controlled with high accuracy and high speed in microseconds or even shorter times. The invention adopts the performance that the LED can be switched at a high speed, and the target object can reflect different color lights during the exposure time by keeping the shutter exposure time constant, so that the target object can reflect different color lights, thereby obtaining high frequency. Image signals that are "indexed" by different light colors, and then processed by the latter image, the mixed images with different light colors in the exposure time are extracted according to the pictures of different light colors "index", and then in chronological order. A video that combines high-speed camera effects. Compared with the prior art, the invention adopts the principle of relatively simple and low cost LED light source color separation cursor introduction, and completes high-speed imaging without increasing the shutter exposure frequency, and has the advantages of low cost and good high-speed imaging effect. effect.

The high-speed image pickup method of the present invention also utilizes the color combination principle of chromaticity, and a single color can be separated from the mixed color, thereby increasing the shooting speed.

Preferably, the LED light source emits a solid light of a single wavelength. According to the principle of color combination, the color can be separated from the mixed color. Preferably, the different color light sources are a combination of any two or all of a red LED, a green LED, and a blue LED. R, G, B tri-color light is a commonly used color processing solution in various digital fields. With the combination of R, G and B, it can be compatible with electronic processing equipment on the current market.

Preferably, the shutter is a mechanical shutter, and the shutter exposure time is a switching time of the mechanical shutter.

Preferably, the shutter is an electronic shutter, and the shutter exposure time is a photosensitive time of the photographing sensor. The electronic shutter (Light Shutter) is a term coined relative to the mechanical shutter function, which is equivalent to controlling the time of the photosensitive sensor, and is a concept well known in the field of imaging. Usually in cameras, the so-called electronic shutter principle is different from mechanical shutters in that it uses electronic means to control the time at which a sensor (such as CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) stores charge). , so as to achieve the requirements of shooting objects of different speeds.

Preferably, before the step 1, there is a step of establishing a reflection characteristic of the target object, wherein the LED light source module separately illuminates the target object with the color separation light and the mixed light composed of the plurality of color separation lights, and respectively captures the image thereof. And determining, according to the obtained color separation light image and the mixed light image, a combination relationship between the color separation light and the mixed light of the target object, and the combination relationship is a reflection characteristic of the target object.

Establishing the reflection characteristics of the target object has many uses.

Preferably, the reflection characteristic is used to calibrate the color separation image extracted in step four.

Preferably, the color separation image is extracted from the mixed image according to the reflection characteristic.

Preferably, in the step of establishing a reflection characteristic of the target object, the target object is in a stationary state and a non-lighting state, and the shooting environment is a matte environment. The reflection characteristic of the target object is established when the target object is stationary and the environment is dark, and the reflection characteristic is more accurate.

Preferably, in the fourth step, after extracting a color separation image of a different color light background from the mixed image, the color corresponding to the color separation image is extracted from the mixed image, and the next color separation to be extracted The image is extracted from the mixed image from which the corresponding color of the previous color separation image has been extracted.

The method of extracting one image each time, that is, subtracting the corresponding pixel points in the mixed image, makes the extraction rate higher and the image clearer.

Preferably, the steps 1 to 5 are repeated several times, and the video obtained in each step 5 is integrated in time sequence; or the steps 1 to 4 are repeated several times, and then step 5 is performed.

Repeat the steps one to four or one to five to obtain the motion video of the target object within the specified time. You can extract the color separation image while obtaining the mixed image; you can also get all the mixed images at once, and then extract the color separation image.

Preferably, the method includes deblurring, wherein the shooting is performed from different angles by using a plurality of synchronous shooting devices, and the blurred image is processed according to image data of different viewing angles at the same time point captured by different capturing devices. Or used to store 3D information of the sample.

Preferably, the camera device includes a plurality of imaging devices, wherein the camera device performs a filming process by using the methods of steps 1 to 5, wherein the camera device sequentially cycles through the images in a preset sequence, and the captured images are captured. The chronological order is integrated. So as to further improve the shooting rate. Preferably, the extracted color separation image is finally converted into a corresponding black and white image to synthesize a video file, which is convenient for viewing.

The invention also provides a high-speed camera device, in particular, a high-speed camera device with LED as a light source module in a preferred embodiment, the technical solution of which comprises: a camera module, an LED light source module, a light-opening control circuit module and an image processing module; The shooting module includes a shutter, an imaging lens, and a shooting sensor corresponding to the imaging lens; the LED light source module includes at least two LED lighting devices having different color lights; the switch control circuit module causes the LED light source module and the shutter to be linked, specifically In order to enable the LED light source module to sequentially perform switching operations of different color light sources during one shutter exposure time; the shooting sensor transmits the mixed image obtained during the shutter exposure time to the image processing module, and the image processing module extracts and integrates the image. .

The LED illumination source used in this high-speed camera has been developed very rapidly in recent years, and its daily and industrial applications are becoming more and more popular, and its lighting performance is getting better and better, and the price is relatively lower. The efficiency of the LED light source is very high, and the switching time of the LED can be controlled with high precision and high speed in microseconds or even shorter times. The high-speed camera device of the present invention has a large price advantage over the conventional high-speed camera, and is advantageous for popularization applications.

Preferably, the LED light source module is a combination of any two or all of a red LED, a green LED, and a blue LED. Preferably, the LED light source modules are arranged in an array form, specifically an array composed of LED lamp bead packages of different color lights or an array of different color LED chips.

Preferably, the LED light emitting devices of different illuminating colors are arranged in the light emitting array at intervals.

Preferably, in another aspect, the LED light source module is arranged in a projector manner, specifically, is packaged by LED lamp beads of different color lights to project light onto the object through one or more projection lenses.

Preferably, each of the illuminating color LED illuminating devices has a plurality of LED illuminating devices of all illuminating colors forming a planar illuminating array.

Preferably, the planar light-emitting array is a planar light-emitting array or a curved surface light-emitting array that facilitates collecting light.

By using various arrays, the LED illumination is more uniform and there is no dead angle, so as to fully meet the illumination requirements of high-speed moving targets.

Preferably, the LED light source module has a plurality of different light source modules that illuminate the target object from different angles.

Since the shooting module has a plurality of imaging lenses, multiple shooting angles, if a single lighting module is used, it is easy to partially illuminate the details of the partial angles. Therefore, a light-emitting module is arranged around the shooting module to make the light more uniform and the flash has no dead angle.

Preferably, the LED light source module is controlled simultaneously with a light control circuit module, or is controlled by different light-opening control circuit modules.

Preferably, the shutter is a mechanical shutter, specifically a mechanical structure that is mechanically opened and closed to control one exposure; or the shutter is an electronic shutter, specifically an electronic control module that controls the sensing time of the sensor.

Preferably, the image processing module includes an RGB signal collector, and the image data captured by the shooting module is transmitted to the image processing module through the RG signal collector.

Preferably, the imaging lens has a plurality of imaging lenses for respectively capturing the target objects from different viewing angles Body.

Preferably, the image pickup lens has a plurality of image pickup lenses for sequentially shooting in a predetermined order. Thereby further increasing the shooting rate.

Preferably, the photographing sensor has a plurality of, and the one photographing sensor corresponds to the plurality of photographing lenses or the photographing sensor and the photographing lens in one-to-one correspondence.

The camera lens and the photographing sensor are both arranged in a one-to-one correspondence manner, and all the photographing lenses are corresponding to one photographing sensor, the plurality of camera lenses correspond to one photographing sensor, and the other camera lenses respectively correspond to one photographing sensor, and one camera lens corresponds to more How to set the camera sensor and so on. Regarding the settings of the shooting sensor and camera lens, the corresponding method depends on the needs of post-processing and sensor settings. The method in which the same shooting sensor corresponds to a plurality of imaging lenses is advantageous for simplifying the processing technology of the imaging sensor.

Preferably, all of the imaging sensors form a sensor plane. In order to capture the sensor to process the data. Preferably, the imaging lenses are connected to each other by a fixed frame in an integrally formed or spliced manner. Make the camera lenses fit more closely together.

Preferably, all the camera lenses are arranged into a lens surface, and the lens surface is a flat surface, a curved surface having a curvature, or a combined surface which is spliced by a plurality of planes at a certain angle. This makes the lens arrangement more compact and reasonable.

The present invention utilizes illumination for high speed moving target objects and can be used to extend the time frequency during short power down periods. The present invention requires at least one LED light source illumination device that is controlled in synchronism with the shutter of the camera lens. The target object is preferably in a dark environment, normally does not emit light by itself, or even emits light, but is still reflective under the light source of the present invention. The situation of different light colors. The high-speed camera device of the invention can collect image information of a high-speed moving object, and can calculate and measure the motion mode and rules of the target object through calculation and image processing. The typical application is a high-speed camera required in the industry, and can also be applied. For other occasions where high-speed imaging is required. DRAWINGS

1 is a schematic overall structural view of an embodiment of a high speed camera device of the present invention;

2 is a schematic view showing the frame connection of an embodiment of the idle speed camera device of the present invention;

3 is a schematic view showing a lens arrangement of an embodiment of a high speed camera device of the present invention;

4 is a schematic diagram showing the relationship between a lens and a sensor according to an embodiment of the high speed camera of the present invention;

5 is a schematic diagram of an LED light source module of an embodiment of the idle speed camera of the present invention;

6 is a schematic diagram of projection light using a projection lens according to an embodiment of the present invention;

7 is a schematic view showing the working principle of an embodiment of the high speed camera device of the present invention;

8 is a schematic diagram of image acquisition under illumination of different color light sources according to an embodiment of the high speed camera of the present invention; FIG. 9 is a high speed camera algorithm and process for all camera lenses simultaneously operating under different color LED flashes according to an embodiment of the present invention; diagram;

FIG. 10 is a high-speed imaging algorithm and process analysis diagram of all the imaging lenses of the specific embodiment of the present invention operating under the same color ID flash at different times; FIG. 11 is a high-speed camera algorithm and process analysis diagram of the camera lens respectively operating in the same color and different color LED flashes according to an embodiment of the present invention;

The embodiment of the present invention will be further described with reference to the accompanying drawings. As shown in FIG. 1 to FIG. 5, an idle speed camera device using an LED light source includes a photographing module 2, and the photographing module 2 includes four camera lenses. The first imaging lens 2A, the second imaging lens 2B, the third imaging lens 2C, and the fourth imaging lens 2D are arranged in a rectangular manner, that is, in a rectangular arrangement.

As shown in FIG. 2, the four imaging lenses are arranged in a straight lens surface, and the imaging lenses have a certain gap therebetween, and are fixed to each other by integral or splicing by a fixing frame.

In other embodiments, the camera lens may also be two, arranged up and down, or three, arranged in a triangle, and four or more.

All the camera lenses are arranged in a lens surface. The lens surface can be a flat surface, or can be a curved arc surface, or a combined surface which is spliced by a plurality of planes with a certain angle of folding. The specific conditions of the target object depend on it. The camera lenses can be arranged closely or with a certain gap.

As shown in FIG. 1 , the photographing module 2 further includes four photographing sensors 9 corresponding to the four camera lenses, and the four photographing sensors 9 form a sensor surface, and each camera lens corresponds to an independent shooting. The sensor makes it easy for the camera to process the data. Commonly used shooting sensors are CCD sensors and the like.

The shutter includes a mechanical shutter and an electronic shutter. The electronic shutter (Light Shutter) is a term coined relative to the mechanical shutter function, which is equivalent to controlling the time of the photosensitive sensor, and is a well-known concept in the field of imaging. For the CCD sensor, since the essence of the CCD light is the accumulation of signal charge, the longer the light-sensing time, the longer the accumulation time of the signal charge, and the larger the amplitude of the output signal current. By adjusting the accumulated time of the photo-generated signal charge (that is, adjusting the width of the clock pulse), the function of controlling the CCD sensing time can be realized. In the case of a mechanical shutter, the shutter of the present invention is a mechanically controlled, fast-cut mechanical structure; in the case of an electronic shutter, the shutter of the present invention is an electron that controls the accumulation time of the sensor's photo-generated signal charge to control the sensor's light-sensing time. Control module.

In other embodiments, the camera lens and the photographing sensor may be arranged in a one-to-one manner, for example, all the camera lenses correspond to one photographing sensor, the plurality of camera lenses correspond to one photographing sensor, and the other camera lenses respectively correspond to one photographing sensor, and one The camera lens corresponds to multiple shooting sensors, and so on. Regarding the settings of the shooting sensor and camera lens, the corresponding method depends on the needs of post-processing and sensor settings. The method in which the same shooting sensor corresponds to a plurality of imaging lenses is advantageous for simplifying the processing technology of the imaging sensor.

As shown in FIG. 4, it is a schematic diagram of the cloth S between the imaging lens and the imaging sensor, the distance between the first imaging lens 2A and the object is P, and the diameter of the first imaging lens 2A is d, and the first imaging lens 2A is The distance between the first photographing sensors 9A is μ. The object image is projected onto the imaging sensor after passing through the imaging lens, and the imaging sensor records the object image to convert it from an optical signal into an electrical signal that is convenient for processing, and obtains a captured image.

The photographing module 2 of the present invention adds a certain number of keying lenses, between different camera lenses or auxiliary camera mirrors. The cooperation between the head and the main camera lens can improve the sharpness of the image; at the same time, in order to obtain a high time-frequency image, the shutters of different camera lenses have different time compensation. The exposure times of all camera lenses are interrelated and known.

As shown in Fig. 1, the high speed image pickup apparatus of this embodiment further includes an LED light source module 1, an image processing module 4, and a data line 7 that communicates each module.

The LED light source module 1 includes an LED light emitting array 6, and the LED light source module 1 of the embodiment corresponds to a flash of a high speed camera.

The LED light source module 1 shown in FIG. 5 is provided with an LED light-emitting array 6 on the light-emitting surface thereof, and the light-emitting array 6 is composed of three kinds of LEDs with red, green and blue colors respectively (unless otherwise specified in the specification) R, G, and B are used to represent red, green, and blue colors, respectively, and the LEDs of each color are arranged at intervals. In the light-emitting array 6 shown in Fig. 5, each column is an LED of the same illuminating color, and R, G, and B are sequentially arranged at intervals.

The LEDs of the respective colors are arranged in an orderly manner to form a planar LED illuminating array, which may be integrated in the same plane, or integrated into a radiant illuminating surface.

The LEDs constituting the LED light-emitting array may be LED package lamp beads or LED chips. The single LED package lamp beads may only encapsulate one color LED chip, and may also package two or three colors at the same time. LED chip; In addition, the light-emitting array can also be obtained by integrated packaging.

In other embodiments, a combination of other three colors, such as a combination of purple, yellow, and blue, may also be used; a combination of two colors, such as a combination of blue and yellow, a combination of cyan and red, a combination of purple, green, etc., may also be used. . At present, in digital image processing, a combination of R, G, and B is used, and LED products of 13⁄4, G, and B are also relatively common, and the price is low, and the light quality is good. Therefore, R, G is selected in this embodiment. , B combination method.

FIG. 6 shows an LED light source module in another embodiment, which is arranged in the manner of a projector, in particular, packaged by LED lamp beads 6 of different color lights to project light to an object through one or more projection lenses 7 . on.

The high speed camera device of FIG. 1 includes two LED light source modules 1, which are disposed on both sides of the photographing module 2. Since the shooting module 2 has a plurality of imaging lenses, a plurality of shooting angles, if a single lighting module is used, it is easy to make partial corner details not sufficiently illuminated. Therefore, a light-emitting module is arranged on both sides of the shooting module to make the light more uniform and the flash has no dead angle.

The switch control circuit module 5 is for controlling the illumination of the LED light source module 1 to work in cooperation with the shutter switch of the photographing module 2. Each of the different colored LEDs (R, G, B) is controlled by a switch control circuit. 5, LEDs of the same color are controlled simultaneously. To facilitate coordinated control, the shutter switch of the shooting module is also controlled by the switch control circuit module 5.

The switch control circuit module 5 of each color LED (R, G, B) works in cooperation with the lens shutter according to the set time frequency, and the LEDs of each color are in the time (one shutter time) at which the set lens exposure acquires an image. The light is sequentially illuminated according to the known time frequency, and then the image is acquired by the shooting sensor, the image includes three color separation images of R, G, and B, and the three images are corresponding to different time points, and the three images are respectively extracted. After coming out, you can get the moving image of the target object at three time points.

As shown in FIG. 1 and FIG. 2, the image processing module 4 of the speed imaging device of the wood embodiment includes an RGB letter collector 3. The photographing sensor 9 uploads the acquired image to the RGB signal collector 3, and the RGB signal collector 3 submits the image data to the image processing module 4 for data processing. The image processing module 4 synthesizes the image electronic information received from the RGB signal collector 3 into a dynamic video and forwards it to an external computer.

The image processing module 4 is further configured to adjust an operating state of the sensor and/or the lens according to an external control signal. Because the image processing module can adjust the working state of the sensor and/or the lens according to the control signal input by the external device, the device can always work in an ideal state, and the dynamic video signal collected and output is accurate.

As shown in FIG. 7, the working process of the idle speed camera device of the present embodiment is as follows:

1) Set the shutter frequency of multiple lenses and the switching frequency of each color LED light source array according to the required time frequency. The shutter opening time of the camera lens is associated with the LED light source off time.

2) When the target object 8 is moving, the shutter of the camera lens is opened, exposure is performed and an image is acquired. During the time when the shutter is turned on and off, the LED arrays with R, G, and B colors are sequentially turned off once. Each time the switch should first turn off the LED array of the current color, then turn on the LED array of the next color; The sensor acquires an image containing the background of R, G, B, and the sensor is sent to the RGB signal collector; according to this rule, the continuous shooting is performed, and the acquired series of images are sent to the RGB signal collector.

3) The image in the RGB signal collector is sent to the image processing module for processing, and the R, G, B color separation images are extracted from the mixed images of R, G, and B according to the time sequence of the LED array switches of each color. The algorithm is integrated to form a clear, continuous video. For easy viewing, each color separation image is uniformly converted into a black and white image.

The order of the above R, G, and B flashes is interchangeable.

In Figure 8, multiple time tracking points are calibrated during the exposure period of a normal video lens. In this figure, five time tracking points are calibrated. The first one is the white lighting tracking point, the second one is red, the third is blue, the fourth is green, and the fifth is red again. Get an image at 10 points in time

The high-speed camera device of the embodiment can collect image information of a high-speed moving object, and can calculate and measure the motion mode and rules of the target object through calculation and image processing. The typical application is a high-speed camera required in the industry, and can also It is used in other applications where high-speed imaging is required.

In this embodiment, by using a dot matrix LED light source and two or more lens settings, the same LED light source switch and the camera lens exposure time are used to collect a series of image information under different light backgrounds, thereby facilitating the formation of continuous through external computer calculation. The video image is used to solve the problem that the traditional high-speed camera cannot obtain the graphic information clearly and accurately.

This embodiment utilizes illumination for high speed moving target objects, and a short power down period can be used to extend the time frequency. The present invention requires at least one LED light source illumination device that is synchronously controlled with the shutter of the imaging lens. The target object is preferably in a dark environment and does not emit light by itself. Set the exposure time of a normal camera lens to a normal video rate of 30-40ms, for example, 25 or 30 frames per second. When the shutter is activated, the LED light source is also activated to a predetermined switch time.

For example: Set the shutter speed of the camera lens to 30 frames per second, that is, switch once for 33ms. If you use 3 LED light source colors, each color has 10ms illumination time and 1 ms dark time. Equivalent to the camera lens has a rate of 90 frames / sec. It can be seen that the device improves the shooting speed of the ordinary camera device. 9 to FIG. 11 are schematic diagrams showing an idle speed imaging method according to an embodiment of the present invention:

As shown in FIG. 9, the high-speed imaging method in which all the imaging lenses of the embodiment are simultaneously operated under different color LED flashes, when the object moves, the LED light sources (R, B, G) of different colors are successively irradiated, and all the imaging lenses are The shutter is simultaneously switched, and each camera lens obtains an image containing the background of R, B, G in a single shutter. During the single opening and closing of the shutter, the LED arrays with R, B, and G colors are sequentially turned on and off once. Each time the switch turns off the LED array of the current color, and then turns on the LED array of the next color.

From the obtained mixed image containing the background of 13⁄4, B, G, the R, B, G color separation images are extracted. Since the different color separation images represent the target objects at different time points, R, B, according to their order The G color separation images are arranged in sequence. Originally, a photo at one time point becomes three photos at three time points, which is equivalent to a three-fold increase in shooting rate.

Multi-lens and multi-sensors work together to solve the problem of unclear images and get more images. If the image is not clear, it can be considered as inaccurate. If only one camera lens is used, the direction of the target object cannot be accurately measured. By using multiple camera lenses, you can capture a larger number of images and synthesize them through algorithms to extract sharper images.

As shown in FIG. 10, in the embodiment, all of the imaging lenses of the embodiment are operated at the same time in the high-speed imaging of the same color LED flash, and the four imaging lens shutters are sequentially operated at the set frequency. Then, the images acquired in the same time interval are sequentially arranged, and after the algorithm is integrated, the corresponding video can be obtained, and the shooting rate is improved. The LED flash used in this method can be used in white or in monochrome.

As shown in FIG. 11 , it is a method of high-speed imaging in which the imaging lenses of the embodiment are respectively operated under the same color and different color LED flashes. In the figure, four camera lens shutters are sequentially operated at a set frequency, and a continuous image of a high-speed moving object is obtained by the method shown in FIG. 9; at the same time, each camera lens is obtained by the method shown in FIG. A mixed image of G, B, and R backgrounds, that is, red, blue, and green LED lights are sequentially illuminated according to the set frequency, and a background of blue, red, and green is obtained in one switching time of each camera lens shutter. The color mixed image is extracted from the obtained mixed image containing the background of R, B, and G, and the R, B, and G color separation images are extracted, thereby obtaining a continuous image of the high-speed moving target.

According to the imaging method of the embodiment shown in FIG. 11 , the frequency (flashing frequency) of the illumination action of the LED light source is increased accordingly, and the number of images that can be obtained will be multiplied by one time, and the corresponding shooting rate will be multiplied. . This greatly increases the raw data for analyzing the motion state of the image.

It can be seen that the method of high-speed camera shown in Fig. 11 has detailed steps:

Step 1. Set the working environment. Remove other lighting equipment, set the shooting environment to a dark environment, and the subject itself does not emit light.

The dark environment can make the LED light source defined by the invention appear much stronger than the ambient light, and can highlight all the LED light sources to illuminate the target object, and the obtained image will have better effect, and can also enhance the later obtained. The effect of the image.

Step 2. Calibrate the reflection characteristics of the 1:1 target object. Expose the target object with different LED light sources and shoot them separately White, red, green, and blue images, and determine the relationship between them to establish the reflection characteristics of the target object.

By testing the target object for the reflection characteristics of various colors, the reflection data of the target object itself for various color rays is obtained. This data will be used in future image extraction.

Step 3. Start shooting.

Shooting scheme for the camera lens: Take several (the four in Figure 10) camera lenses at the same shooting rate and cycle through the images at a preset time interval. For example, in FIG. 10, the first imaging lens, the second imaging lens, the third imaging lens, and the fourth imaging lens sequentially turn the shutter on and off once in a uniform time interval, and each camera lens takes one image; four cameras After the camera shoots one turn in turn, it starts shooting again from the first camera lens, until the end of the fourth camera lens, and so on. In order to make the shooting more precise, the time point at which each camera lens shutter is opened is after the time point when the shutter of the previous camera lens is closed, preferably coincident at the above two time points. The images captured by the different camera lenses are integrated in chronological order to obtain the corresponding video of the target object.

Exposure scheme for LED light source: During each exposure time of each camera lens shutter (ie, from the time the shutter is opened to closed), the LED light source is set according to a preset uniform time interval, according to 13⁄4, G, B The order of the light colors is exposed to the target object, and the single image obtained by the camera lens is a mixed image including three exposure time points of R, G, and B. Based on the LED light source's ability to respond quickly, the LED light source can emit light that approximates a square wave pulse, so that the R, G, and B rays complete a flash in a very short time without interfering with each other. For example, the shutter speed of the camera lens is set to 30 frames per second, that is, 33ms off. If you use 3 LED light source colors (R, G, B), each color has 10ms illumination time and 1ms dark time. Each light color does not interfere with each other.

Step 4. Extract the color separation image from the mixed image.

Extracting the first image: Extracting the color separation image corresponding to the first exposed color from the mixed image, and using the color separation image as the first image. In this embodiment, the first exposure is R, and all the red pixel points in the mixed image are extracted as the first image. According to the reflection characteristics of the target object established in the second step, the first image is calibrated to make the figure more accurate and clearer. The pixel points corresponding to the first image in the mixed image are subtracted.

Extracting the second image: according to the method of extracting the first image, extracting the color separation image corresponding to the color of the second exposure from the mixed image from which the pixel of the first image has been subtracted, and extracting the color separation image As the second image. In this embodiment, the second exposure is G, and all the green pixel points in the mixed image from which the R pixel points have been subtracted are extracted as the second image. According to the reflection characteristics of the target object established in the second step, the second image is calibrated to make the figure more accurate and clearer. The pixel corresponding to the second image is subtracted again from the mixed image in which the pixel corresponding to the first image has been subtracted.

Extracting the third image: Extracting the color separation image corresponding to the last exposed color as the third image. In this embodiment, the last exposure is B. When the first image and the second image are extracted, the mixed image has been subtracted from the corresponding R and (; like the point, the remaining B pixel is the third Image. According to the reflection characteristics of the target object established in the second step, the second image is calibrated to make the figure more accurate and clearer. The method of extracting one image, that is, subtracting the corresponding pixel points in the mixed image, makes the extraction rate higher and the image clearer.

Step 5. Integrate the video. According to the time sequence of successive shooting and successive exposures, all the color separation images corresponding to all the obtained imaging lenses are arranged and integrated to obtain a high-speed shooting video of the corresponding target object. In this embodiment, the three color separation images of R, G, and B corresponding to each camera lens are in the order of R, G, and B, and the three color separation images are arranged in the order of R, G, and B; The shooting sequence of the camera lens is from the first camera lens to the fourth camera lens, and then loops, and the R, G, and B images taken by each camera lens are placed in front, and the rear images are arranged in the back; , you can get the continuous video of the corresponding high-speed camera.

For the convenience of viewing, all color separation images are uniformly converted into black and white images.

In recent years, LED (Light Emitting Diode) has been developed rapidly, and its daily and industrial applications have become more and more popular, which has reduced production costs and improved performance. The efficiency of LED light sources is very high. Moreover, the switching time of the LED can be controlled with high accuracy and high speed in the microsecond or even shorter time. These two factors provide very good conditions for the invention.

Variations and modifications of the above-described embodiments may also be made by those skilled in the art in light of the above disclosure. Therefore, the present invention is not limited to the specific embodiments disclosed and described, and the modifications and variations of the invention are intended to fall within the scope of the appended claims.

Claims

claims

1. A high-speed camera method using a fast switching light source, including a shutter, a shooting sensor, an image processing module and a fast switching light source module; the fast switching light source module includes at least 2 different color light sources; the shutter and fast switching light source module associated with actions;

The method includes the following steps - Step 1, shutter action, exposure;

Step 2. During the shutter exposure time, the different color light sources of the fast switching light source module are switched on and off in sequence; Step 3. The shooting sensor obtains a mixed image containing different color light backgrounds;

Step 4: The image processing module extracts color separation images of different color light backgrounds in the mixed image;

Step 5: According to the order in which the light sources of different colors are turned on and off in sequence, the above-mentioned color separation images of different color light backgrounds are synthesized into a video.

2. According to the high-speed camera method of claim 1, the fast switching light source module is an LED light source.

3. The high-speed imaging method according to claim 2, characterized in that: the LED light source emits pure color light of a single wavelength.

4. The high-speed imaging method according to any one of claims 2-3, characterized in that: the different color light sources are any two or all combinations of red LED, green LED and blue LED.

5. The high-speed imaging method according to claim 1, characterized in that: the shutter is a mechanical shutter, and the shutter exposure time is one switching time of the mechanical shutter.

6. The high-speed imaging method according to claim 1, characterized in that: the shutter is an electronic shutter, and the shutter exposure time is a photosensitive time of the shooting sensor.

7. The high-speed imaging method according to claim 1, characterized in that: before the step 1, there is a step of establishing the reflection characteristics of the target object, and this step is: the rapid switch-on light source module illuminates the target objects respectively. Separate light and mixed light composed of multiple kinds of separated light, and take their images respectively. Based on the obtained separated color light image and mixed light image, determine the combination relationship of the target object with respect to the separated color light and mixed light. This combination relationship is the target object's Reflective properties.

8. The high-speed imaging method according to claim 7, characterized in that: the reflection characteristics are used to calibrate the color separation image extracted in step four.

9. The high-speed imaging method according to claim 7, characterized in that: a color separation image is extracted from the mixed image based on the reflection characteristics.

10. The high-speed imaging method according to claim 7, characterized in that: during the step of establishing the reflection characteristics of the target object, the target object is in a stationary and non-luminous state, and the shooting environment is a lightless environment.

11. The high-speed imaging method according to claim 1, characterized in that: in the step four, after extracting a color separation image with a different color light background from the mixed image, the color corresponding to the color separation image is Extracted from the mixed image, the next color separation image to be extracted is extracted from the mixed image in which the corresponding color of the previous color separation image has been extracted.

12. The high-speed camera method according to claim 1, characterized in that: repeat steps 1 to 1 several times, and integrate the videos obtained by performing step 1 each time in chronological order; or repeat Perform steps one through four several times, then perform step: once.

13. The high-speed camera method according to claim 1, characterized by: including a deblurring step, which step is to use multiple synchronous shooting shooting devices to shoot from different angles, based on the same time captured by different shooting devices. Point image data from different perspectives to process blurred images, or to store 3D information of samples.

14. The high-speed imaging method according to claim 1, characterized in that: it includes a plurality of photographing devices, and the photographing devices are devices that each use the method of steps one to five to photograph, and the photographing devices are configured according to the preset The shooting sequence is cycled in sequence, and the captured images are arranged and integrated according to the time sequence of shooting.

15. The high-speed camera method according to claim 1, characterized in that: the extracted color separation image is finally converted into a corresponding black and white image to synthesize a video file.

16. A high-speed camera device based on an LED light source applying the method of claim 2, characterized by: including a shooting module, an LED light source module, a lighting control circuit module and an image processing module;

The photography module includes a shutter, a camera lens and a camera sensor corresponding to the camera lens;

The LED light source module includes at least two types of LED light-emitting devices with different colors of light;

The switch control circuit module links the LED light source module and the shutter, specifically causing the LED light source module to sequentially perform switching actions of light sources of different colors within one shutter exposure time;

The shooting sensor transmits the mixed image obtained during the shutter exposure time to the image processing module, which extracts the image and integrates the video.

17. The high-speed camera device according to claim 16, characterized in that: the LED light source module is a combination of any two or all of red LED, green LED and blue LED.

18. The high-speed camera device according to claim 16 or 17, characterized in that: the LED light source modules are arranged in an array, specifically an array composed of LED lamp bead packages of different colors or an array composed of LED chips of different colors. .

19. The high-speed camera device according to claim 18, characterized in that: the LED light-emitting devices of different light-emitting colors are arranged at intervals in the light-emitting array.

20. The high-speed camera device according to claim 16 or 17, characterized in that: the LED light source module is arranged in a projector manner, specifically, LED lamp beads of different colors are packaged together to project the light through one or more projection lenses. Projected onto an object.

21. The high-speed camera device using LED light source according to claim 16, characterized in that: there are several LED light-emitting devices of each light-emitting color, and the LED light-emitting devices form a planar light-emitting array.

22. The high-speed camera device using LED light source according to claim 21, characterized in that: the planar light-emitting array is a planar light-emitting array or a curved light-emitting array that is conducive to light concentration.

23. The high-speed camera device using LED light source according to claim 16, characterized in that: the LED light source module has multiple, and different light source modules illuminate the target object from different angles.

24. The high-speed camera device using LED light source according to claim 23, characterized in that: the LED light source modules are controlled by the same lighting control circuit module at the same time, or are controlled by different lighting control circuit modules collaboratively.

25. Basically, the high-speed camera device using LED light source according to claim 16 is characterized in that: the shutter It is a mechanical shutter, specifically a mechanical structure that opens and closes mechanically to control one exposure;

Alternatively, the shutter is an electronic shutter, specifically an electronic control module that controls the photosensitive time of the photographing sensor.

26. The high-speed camera device using LED light source according to claim 16, characterized in that: the image processing module includes an RGB signal collector, and the image data captured by the shooting module is transmitted to the image processing through the RGB signal collector. module.

27. The high-speed camera device using LED light source according to claim 16, characterized in that: the camera lens has multiple cameras, and the multiple camera lenses are used to simultaneously capture target objects from different viewing angles.

28. The high-speed camera device using LED light source according to claim 16, characterized in that: the camera lens has a plurality of cameras, and the plurality of camera lenses are used to take pictures in a sequential cycle in a preset order.

29. The high-speed camera device using LED light source according to claim 27 or 28, characterized in that: there are multiple shooting sensors, and one shooting sensor corresponds to multiple shooting lenses or the shooting sensor and the shooting lens correspond one to one. .

30. The high-speed camera device using LED light source according to claim 29, characterized in that: all the shooting sensors form a sensor plane.

31. The high-speed camera device using LED light source according to claim 27 or 28, characterized in that: the camera lenses are connected to each other in an integrally formed or spliced manner through a fixed frame.

32. The high-speed camera device using LED light source according to claim 31, characterized in that: all the camera lenses are arranged into a lens surface, and the lens surface is a flat surface, a curved surface or a plurality of curved surfaces. A composite surface in which two flat surfaces are joined together at certain angles.