CN109905587B - imaging shooting system and method capable of filtering strong light or color cast light - Google Patents

Abstract

the invention relates to the technical field of image processing, in particular to an imaging shooting system and method capable of filtering strong light or color cast light, wherein the system comprises: the image sensor comprises a lens system, a filter optical wheel system, an image sensor and an image processing system, wherein the filter optical wheel system comprises a filter optical wheel which is divided into at least two areas along the circumferential direction and is respectively used for filtering optical signals of different types; different areas of the filter light wheel are respectively coated with different surface coatings, including a strong light filtering coating and/or a color cast light filtering coating with different colors, and the strong light filtering coating is used for filtering strong light; the color cast light filtering coating is used for filtering corresponding color light. The imaging shooting system and the imaging shooting method can simultaneously give consideration to the requirements of normal light and special light filtration, avoid the problems of overexposure of the imaging picture caused by strong light and color cast of the imaging picture caused by colored light, and effectively improve the image quality in a special environment.

Description

Imaging shooting system and method capable of filtering strong light or color cast light

[ technical field ] A method for producing a semiconductor device

The invention relates to the technical field of image processing, in particular to an imaging shooting system and method capable of filtering strong light or color cast light.

[ background of the invention ]

Along with the development of national economy, a video monitoring system is taken as a core part of the development of the security field and becomes a necessity for guaranteeing social stability and public and private property safety in the global range. Video monitoring related technology has long-term development along with the development of industry and network, but the technology of the camera itself still has certain defects. The popular camera at present can not meet the requirements of all weather and complex illumination conditions, and although the digital image processing technology can provide certain supplement and enhancement for the imaging effect of the camera, the imaging quality requirements under various complex light conditions can be fundamentally met only by the technical upgrading of the camera.

Under some special monitoring environments, such as road monitoring at a traffic intersection or license plate monitoring at a closed environment entrance, the situation that an imaging picture is overexposed or the imaging quality is poor due to over-lighting of lamps of passing vehicles or over-strong ambient light is often encountered; meanwhile, in monitoring environments such as airport building sites and the like, due to the fact that on-site light or natural light is too strong or the on-site light has special colors, the situation that a shot imaging picture is overexposed or seriously color-shifted and the imaging quality is poor is easily caused. For example, if the spot light is yellow, the overall color of the finally obtained image is yellow, which affects the imaging quality.

from the above, in this particular monitoring environment, if a normal image is desired (no overexposure or severe color cast), the light interference needs to be reduced by the filter; in the conventional imaging device, in order to ensure imaging under normal light, the situation that light interference needs to be reduced by a filter in the special environment cannot be considered at the same time, so that the situation of overexposure or color cast of an imaging picture still exists, and the imaging quality is poor.

In view of the above, it is an urgent problem in the art to overcome the above-mentioned drawbacks of the prior art.

[ summary of the invention ]

the technical problems to be solved by the invention are as follows:

Under some special environments, such as too strong ambient light or special colors of spot lights, if a conventional imaging shooting system is used, overexposure or severe color cast of a shot imaging picture is easily caused, and the imaging quality is poor.

The invention achieves the above purpose by the following technical scheme:

In a first aspect, the present invention provides an imaging shooting system capable of filtering strong light or color cast light, including a lens system 1, a filter light wheel system 2, an image sensor 3 and an image processing system 4, where the filter light wheel system 2 includes a rotatable filter light wheel 21 and a motor 22, the filter light wheel 21 is divided into at least two regions along a circumferential direction, and the regions are respectively used for filtering light signals of different types; the motor 22 is in transmission connection with the filter light wheel 21, so as to drive the filter light wheel 21 to rotate;

Different surface coatings are respectively carried out on different areas of the filter light wheel 21, the different surface coatings comprise strong light filtering coatings and/or color cast light filtering coatings with different colors, and the strong light filtering coatings are used for filtering strong light so as to enable the strong light with preset proportion of light intensity to pass through; the color cast light filtering coating is used for filtering corresponding color light so as to enable the color light with the light intensity of a preset proportion to pass through;

The lens system 1 is used for providing an optical path for light to enter; when the filter light wheel 21 rotates, different areas enter the light path in turn, and light is filtered and then divided into different types of light signals to pass through; the image sensor 3 is used for respectively imaging different types of optical signals; the image processing system 4 is used for carrying out synchronous synthesis processing on the imaging of different types of optical signals.

preferably, the different surface coatings further include any one or more of an antireflection coating, a near-infrared filter coating, a middle-infrared filter coating and a far-infrared filter coating; wherein the antireflection film, the near-infrared filter coating film, the mid-infrared filter coating film, and the far-infrared filter coating film are used for passing visible light, near-infrared light, mid-infrared light, and far-infrared light, respectively.

preferably, the filter photo wheel system 2 further includes a black mark sensor 23, a black mark position is disposed on the filter photo wheel 21 or the rotating wheel of the motor 22, and the black mark sensor 23 is configured to identify the black mark position when the filter photo wheel 21 rotates, so as to determine a filter photo wheel area currently located in the light path.

Preferably, a frame processor is arranged in the image sensor 3, and is used for generating a frame from the received optical signal; the black mark sensor 23 is connected with the frame processor, and when two adjacent areas are identified to be in the optical path at the same time, the frame processor skips the corresponding frame generation process; when any area is identified to be in the light path alone, the frame processor generates a frame from the received light signal;

or, the black mark sensor 23 is connected to the image processing system 4, and when it is recognized that any two adjacent areas are in the optical path at the same time, the image processing system 4 discards the corresponding images on the image sensor 3, and only performs the synthesis processing on the retained images.

Preferably, the image processing system 4 includes an image fusion module and a saturation adjustment module, and the image fusion module is configured to fuse images of different types of optical signals on the image sensor 3; and the saturation adjusting module is used for adjusting the saturation of the fused image.

in a second aspect, the present invention provides an imaging and capturing method capable of filtering strong light or color cast light, which can be implemented by the imaging and capturing system of the first aspect, wherein the filter optical wheel is divided into at least two regions along a circumferential direction, and different regions are respectively subjected to different surface coatings for filtering different types of optical signals; the different surface coatings comprise strong light filtering coatings and/or color cast light filtering coatings with different colors, and the different types of optical signals comprise strong light and/or colored light after filtering and correction; the method comprises the following steps:

the filter light wheel enables different areas to enter the light path in turn in the rotating process, and light is divided into different types of light signals to pass through after being filtered;

The different types of optical signals are imaged on the image sensor respectively;

And performing synchronous synthesis processing on the images corresponding to the different types of optical signals to obtain a required image.

Preferably, in the rotation process of the filter optical wheel, any one area is independently in the optical path and any two adjacent areas are simultaneously in the optical path; the method further comprises:

in the rotation process of the filter optical wheel, identifying the area of the filter optical wheel currently in the optical path through a black mark sensor; when synchronous synthesis processing is performed, images on the image sensor corresponding to any two adjacent regions in the optical path at the same time are discarded, and only the remaining images are subjected to synthesis processing.

preferably, when the filter optical wheel is divided into p regions and the rotation speed is n revolutions per second, the image of the image sensor per second is 2p × n frames, wherein the corresponding image of any two adjacent regions in the optical path is p × n frames, and the image is discarded during the synchronous synthesis processing; acquiring n frames of continuous synthetic images per second after synchronous synthetic processing; wherein p is more than or equal to 2.

Preferably, the synchronous synthesis processing of the images corresponding to the different types of optical signals to obtain a required image specifically includes:

Fusing images corresponding to the different types of optical signals to obtain a fused image;

and adjusting the saturation of the fused image to obtain a required image.

Preferably, the filter optic wheel is divided into two areas along the circumferential direction, and the two areas are respectively used for enabling the image sensor to respectively obtain images of an RGB image and a corrected color light image through visible light and color light with preset proportion light intensity; then, the fusing the images corresponding to the different types of optical signals to obtain a fused image specifically includes:

converting the obtained RGB image into YCbCr, and further decomposing to obtain a Y channel, a Cb channel and a Cr channel;

Converting the obtained color tone map into YCbCr, and further decomposing to obtain a Y channel, a Cb channel and a Cr channel;

Respectively fusing a Y channel, a Cb channel and a Cr channel of the RGB image with the channels corresponding to the color tone images to obtain a fused Y channel, a fused Cb channel and a fused Cr channel;

and re-synthesizing the fused Y channel, the fused Cb channel and the fused Cr channel into YCbCr, and converting the YCbCr to obtain a fused image of an RGB image and a color tone image.

Compared with the prior art, the invention has the beneficial effects that:

The imaging shooting system provided by the invention is characterized in that a filter light wheel is added in a light path, the filter light wheel is subjected to region division and film coating (strong light filtering film coating and color cast light filtering film coating) according to requirements, filtered strong light or color light passes through and images respectively during rotation, and finally the required images or videos are obtained through synthesis;

and the black mark sensor and the black mark position are arranged to identify the area in the light path, and the validity of the frame formed on the image sensor is judged, so that the invalid frame can be discarded during the synchronous synthesis processing, and only the continuous valid frames are selected for synthesis, thereby ensuring the synchronous effect and further obtaining clear images or videos.

[ description of the drawings ]

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments of the present invention will be briefly described below. It is obvious that the drawings described below are only some embodiments of the invention, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.

fig. 1 is a block diagram of an imaging photographing system capable of filtering out strong light or color cast light according to an embodiment of the present invention;

FIG. 2 is a schematic plan view of a filter wheel according to an embodiment of the present invention;

Fig. 3 is an exploded view of an imaging photographing system capable of filtering out strong light or color cast light according to an embodiment of the present invention;

FIG. 4 is a schematic plan view of a filter wheel system according to an embodiment of the present invention;

fig. 5 is a flowchart of an imaging photographing method capable of filtering strong light or color cast light according to an embodiment of the present invention;

FIG. 6 is a schematic diagram illustrating the rotation of a filter wheel in the optical path according to an embodiment of the present invention;

FIG. 7 is a flowchart of image composition according to an embodiment of the present invention;

FIG. 8 is a flow chart of a method for fusing an RGB map and a color map according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of a fusion of an RGB map and a color map provided by an embodiment of the present invention;

Fig. 10 is a structural diagram of an imaging and photographing apparatus based on a filter wheel according to an embodiment of the present invention;

Wherein the reference numbers are as follows:

the system comprises a lens system 1, a filter light wheel system 2, an image sensor 3, an image processing system 4 and a fixed bracket 5; the lens 11, the lens holder 12, the positioning piece 121 and the mounting groove 122; a filter light wheel 21, a motor 22, a black mark sensor 23 and a shock pad 24; light-passing hole 51, first screw 61, second screw 62, third screw 63, fourth screw 64.

[ detailed description ] embodiments

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In the description of the present invention, the terms "inside", "outside", "longitudinal", "lateral", "upper", "lower", "top", "bottom", "left", "right", "front", "rear", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of describing the present invention but do not require that the present invention must be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention.

In the embodiments of the present invention, the symbol "/" indicates the meaning of having both functions, and the symbol "a and/or B" indicates that the combination between the preceding and following objects connected by the symbol includes three cases of "a", "B", "a and B".

in addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other. The invention will be described in detail below with reference to the figures and examples.

Example 1:

The embodiment of the invention provides an imaging shooting system capable of filtering strong light or color cast light, which can be used for filtering the strong light or the color cast light in a special environment, so that different types of light signals respectively pass through and are imaged, and further, imaging corresponding to different light signals is synthesized into a required image or video according to requirements. The strong light in the embodiment of the present invention specifically refers to light with an illumination intensity greater than a certain preset value, where the preset value may be determined according to actual experience or simulation experiments, and when the external illumination intensity is greater than the preset value, an overexposure phenomenon starts to occur in a corresponding imaging picture.

As shown in fig. 1, the imaging shooting system provided by the embodiment of the invention includes a lens system 1, a filter optical wheel system 2, an image sensor 3 and an image processing system 4. With reference to fig. 2 and 3, the filter optical wheel system 2 includes a rotatable filter optical wheel 21, the filter optical wheel 21 is divided into at least two fan-shaped regions along a circumferential direction, different regions are respectively subjected to different surface coatings, so as to form different optical filters, and the different optical filters are respectively used for filtering optical signals of different types. In order to satisfy the light transmission performance, the filter wheel 21 may be made of a light transmission material such as glass or synthetic resin, which is not limited herein.

the different surface coatings comprise strong light filtering coatings and/or color cast light filtering coatings with different colors, and the strong light filtering coatings are used for filtering strong light in a strong light environment so as to enable the strong light with preset proportion of light intensity to pass through; the color cast light filtering coating is used for filtering corresponding color light, and then the color light with the preset proportion of light intensity passes through. The preset proportion is equivalent to the light transmittance of the corresponding coating, and the strong light and the colored light can be corrected into light with normal light intensity after being filtered by the corresponding coating. For example, when the light transmittance of the strong light filtering coating film is 50%, only half of the strong light with the light intensity passes through the strong light filtering coating film in a strong light environment, so that the transmitted light intensity is weakened, the strong light is filtered into the light with the normal light intensity, the corresponding image is a strong light correction image, and the overexposure phenomenon caused by the strong light can be avoided; when the color cast light filtering coating film is a yellow light filtering coating film and the light transmittance is 50%, only half of yellow light with light intensity passes through the film in a yellow light environment, so that the transmitted yellow light is weakened, the film is filtered into normal yellow light, the corresponding image is a yellow light correction image, and the color cast phenomenon caused by on-site lamplight can be avoided.

In the imaging shooting system, the lens system 1 is used for providing an optical path for light to enter; the filter light wheel 21 is used for enabling different areas to enter the light path in turn according to the arrangement sequence when rotating, and further filtering the light and dividing the light into different types of light signals to pass through; the image sensor 3 is positioned behind the filter light wheel 21 and is used for respectively imaging different types of light signals; the image processing system 4 is used for synthesizing the imaging of different types of optical signals.

With reference to fig. 1 to 3, the imaging process is specifically as follows: the light enters the lens system 1 first, then is filtered by the rotating filter light wheel 21 and then is divided into different types of light signals, the different types of light signals are imaged on the image sensor 3 respectively, and the images of the different types of light signals on the image sensor 3 are synchronously synthesized by the image processing system 4, so that the required images and videos are obtained and provided for users. Wherein the different types of optical signals comprise strong light and/or colored light filtered by the corresponding coating.

the imaging shooting system provided by the invention is simple and reliable, has lower cost, can simultaneously consider the requirements of normal light and special light filtration, avoids the problems of overexposure of imaging pictures caused by the strong light and color light color cast of the imaging pictures caused by the color light, and effectively improves the image quality in special environments.

The transmittance of the strong light filtering coating film and the color cast light filtering coating film can be selected according to the actual environment requirement, namely the light intensity in the external environment is higher, the more the light intensity needs to be filtered, the lower the transmittance which needs to be selected is, and then the strong light or the color light can be filtered into the light with normal light intensity. The used coating film can be purchased on the market directly according to the transmittance requirement and then attached to the corresponding area on the surface of the filter light wheel 21; the surface of the filter sheave 21 may be coated with a coating film by area as needed, and the lower the transmittance, the greater the thickness of the coating film. The color cast light filtering coating film can be a blue light filtering coating film, a red light filtering coating film, a yellow light filtering coating film, a green light filtering coating film and the like according to the light color in the actual environment, and further can correspondingly filter various colored lights which influence the quality of an imaging picture, such as blue light, red light, yellow light, green light and the like.

Further, the surface coating film of the filter wheel 21 may include any one or more of an antireflection film, a near-infrared filter coating film, a middle-infrared filter coating film, and a far-infrared filter coating film, in addition to the strong light filtering coating film and the color cast light filtering coating film; wherein, the corresponding areas of the anti-reflection film, the near infrared filter coating film, the middle infrared filter coating film and the far infrared filter coating film are respectively used for passing visible light, near infrared light, middle infrared light and far infrared light. The user can select the number of the areas divided by the filter wheel 21 and the type of the surface coating film according to actual needs, that is, all or part of the filters are selected to form the wheel according to needs, so that the corresponding different optical signals can be imaged and synthesized into a required image or video.

taking fig. 2 as an example, the filter wheel shown in fig. (a) is divided into A, B two areas, which can be used to pass two different light signals (such as strong light and yellow light); the filter wheel shown in figure (b) is divided C, D, E into three regions and thus is available for passing three different light signals (e.g., visible light, near infrared light, and glare); the filter wheel shown in figure (c) is divided into F, G, H, I four regions and is thus available for passing four different light signals (e.g., visible light, near infrared light, glare light, and yellow light). In the three filter optic wheels shown in fig. 2, all the area divisions are equal area divisions, but in practical application, each area can also be unequal area divisions on the premise that the rotation speed of the filter optic wheel 21 meets the requirement, and both division methods are within the protection scope of the present invention.

the following describes the structure of each part of the imaging and shooting system in detail with reference to the accompanying drawings:

As shown in fig. 3, the lens system 1 includes a lens 11 and a lens holder 12, and the lens holder 12 may be designed as an annular housing, so as to protect the lens 11. A positioning part 121 is arranged in the lens holder 12, and a hole is formed in the middle of the positioning part 121 for light to pass through. The lens 11 is fixedly installed on a first side (i.e. the left side in the drawing) of the lens mount 12, specifically, the right end of the lens 11 is coupled with the positioning part 121; the filter wheel 21 is disposed on a second side (i.e., the right side in the drawing) of the lens holder 12, and a partial area is located in the optical path. After entering the lens 11, the light passes through the hole on the positioning element 121 and reaches the filter light wheel 21, and when the filter light wheel 21 rotates, different areas of the filter light wheel 21 can enter the light path formed by the lens 11 in turn, so that different types of light signals can pass through under different time slices and reach the image sensor 3 for imaging.

Wherein, the rotation of the filter optical wheel 21 can be realized by the following structure: as shown in fig. 3 and 4, the filter optic wheel system 2 further includes a motor 22, and the motor 22 is in transmission connection with the filter optic wheel 21 and further used for driving the filter optic wheel 21 to rotate, so that different regions of the filter optic wheel 21 enter the optical path in turn. Therefore, the rotation speed of the filter light wheel 21 is controlled by the motor 22, and the user can adjust the rotation speed according to actual requirements. In the embodiment of the present invention, the filter wheel 21 is divided into A, B two regions (i.e. the filter wheel shown in fig. 1 (a)), so that the A, B region can enter the light path in turn when the filter wheel rotates; assuming that the filter wheel 21 rotates clockwise as shown in fig. 1(b), the regions enter the optical path in turn according to the sequence of C-D-E-C; assuming that the filter wheel 21 is rotated clockwise as shown in fig. 1 (c), the regions are alternately entered into the optical path in the order of F-G-H-I-F.

with continued reference to fig. 3, the imaging and photographing system further includes a fixing bracket 5 for connecting the lens system 1, the filter optical wheel system 2 and the image sensor 3. Wherein, a first side (i.e. left side in the figure) of the fixed bracket 5 is respectively connected with the filter optical wheel 21 and the lens mount 12, and a second side (i.e. right side in the figure) of the fixed bracket 5 is fixedly connected with the image sensor 3. In addition, the fixed support 5 is provided with a light-passing hole 51, and the light-passing hole 51 is located on the optical path, so that an optical signal can reach the image sensor 3 through the light-passing hole 51 to form an image after passing through the filter optical wheel 21. The connection between the fixed support 5 and each structure is as follows:

The filter light wheel 21 is connected with the fixed support 5 through the motor 22, and in order to reduce the influence of motor vibration on the stability of the fixed support 5, one end (i.e. the right end in fig. 3) of the motor 22 is fixedly connected with one or more shock pads 24, and then is connected with the fixed support 5 through the shock pads 24; the shock absorbing pad 24 may be made of rubber material to provide good shock absorbing and buffering effects. In order to facilitate the installation and the disassembly, the fixed support 5 and the shock pad 24, the lens mount 12 and the image sensor 3 can be fixedly connected through screws. The image sensor 3 is arranged on the PCB, and the fixing support 5, the shock absorption pad 24, the lens mount 12 and the PCB where the image sensor 3 is arranged are all provided with corresponding mounting holes for passing through screws. Referring to fig. 3 specifically, the fixing bracket 5 is fixedly connected to the shock pad 24 through a first screw 61, the fixing bracket 5 is fixedly connected to the lens mount 12 through a second screw 62, and the fixing bracket 5 is fixedly connected to the PCB where the image sensor 3 is located through a third screw 63. The image sensor 3 may be specifically a CMOS photosensitive chip or a CCD photosensitive chip.

During the rotation of the filter wheel 21, there are two situations in the light path: one is that any region is in the optical path separately, and then filtered to pass a single type of optical signal (such as visible light), which corresponds to the imaging on the image sensor 3 as a valid frame; the other is that any two adjacent regions are in the optical path at the same time, that is, the intersection of the adjacent regions rotates into the optical path, and at this time, two kinds of optical signals (such as visible light and yellow light) can pass through after filtering, and the corresponding image is an invalid frame, or a bad frame. When the image processing system 4 performs the synthesizing process, the part of bad frames needs to be discarded, and only the remaining valid frames are synthesized; this is because if the bad frame is not discarded, the synchronization effect of the image is affected, and the image is blurred and unclear after the composition. Considering that half of the time during rotation is across the filter area and the corresponding imaging cannot be used, half of the frame number needs to be discarded during synthesis.

In order to identify the filter area currently located in the optical path and further determine the validity of the frame, the filter photo wheel system 2 further includes a black mark sensor 23, the filter photo wheel 21 or the motor 22 is provided with a black mark position, and the black mark sensor 23 is configured to detect the black mark position when the filter photo wheel 21 rotates, so as to identify the filter photo wheel area currently located in the optical path according to the black mark position. Referring to fig. 4 (left view, front view and right view of the filter photo wheel system 2 from left to right respectively), a black mark m is disposed on the rotating wheel of the motor 22, and when the motor 22 rotates, the black mark m also rotates along with the rotating wheel, and the rotating state of the black mark m is consistent with that of the filter photo wheel 21. Therefore, by identifying the position of the black mark position m, whether the area a is in the optical path alone, the area B is in the optical path alone, or the area a and the area B are in the optical path together can be judged.

As shown in fig. 4, only one black mark position may be set, and the black mark position m may be detected by the black mark sensor 23 only when rotating to a certain specific position, and in the case of determining the rotating speed, the area currently located in the optical path may be determined according to the rotating speed of the filter wheel 21 and the area division condition. For example, the filter wheel 21 is divided into A, B two regions, each rotation takes 40ms, and assuming that when the black mark m is detected and within the following 10ms, it represents that the current region is a region a in the optical path, it can be determined that the current region is a + B region in the optical path from 10ms to 20ms, the current region is B region in the optical path from 20ms to 30ms, the current region is B + a region in the optical path from 30ms to 40ms, and the region condition in the optical path is determined according to the above method.

in an alternative, black mark positions may be provided in one circle outside the filter wheel 21 or one circle outside the rotating wheel of the motor 22, specifically, a whole black mark position may be provided uninterruptedly around the circumference, and the black mark positions at different positions have different widths to represent different regions. The black mark sensor 23 can always detect black mark positions at different positions during the rotation process, and determine the area currently located in the optical path according to the difference of the widths of the black mark positions.

in another alternative, a plurality of black marks may be provided on one of the outer circumference of the filter wheel 21 and the outer circumference of the rotating wheel of the motor 22, and the density of the black marks at different positions is different for representing different regions. The black mark sensor 23 can always detect black mark bits at different positions during the rotation process, and determine the current area in the optical path according to the difference of the density of the black mark bits.

Further, the black mark sensor 23 is connected to the image processing system 4, so that the image processing system 4 obtains the region identification result from the black mark sensor 23, and then discards the corresponding images on the image sensor 3 when any two adjacent regions are simultaneously in the optical path, and only synthesizes the images retained at the black mark sensor 23, thereby obtaining an image or video with a better synchronization effect. When the filter wheel 21 is divided into p (p is equal to or greater than 2) regions, an image of 2p frames can be formed on the image sensor 3 by one rotation of the filter wheel 21, wherein half (p frames) are invalid frames and half (p frames) are valid frames, and the consecutive valid frames of the p frames are combined into 1 frame. Similarly, when the filter optical wheel is divided into p regions and the rotating speed is n revolutions per second, the image of the image sensor per second is 2p × n frames, wherein the p × n frames are corresponding images when any two adjacent regions are in the optical path at the same time, namely invalid frames, and are discarded during the synthesis processing; then, in the synchronous synthesis process, consecutive effective frames of every p frames are synthesized into 1 frame, and n frames of consecutive synthesized images can be acquired per second.

For example, assuming that the filter wheel 21 is divided into A, B regions, as shown in fig. 3 and 4, the a region is coated with an anti-reflection film for passing visible light, and the B region is coated with a yellow filter coating for filtering yellow light in the environment. When the rotation speed of the filter wheel 21 is 60 rpm, the visible light passing through the area a and the yellow light passing through the area B form a picture on the image sensor 3 in 60 frames per second. Therefore, the image processor 3 can receive 120 effective images per second, output one image after synthesizing every 2 continuous frames, and the end user obtains 60 continuous synthesized images per second (120 frames formed correspondingly across regions cannot be used and are discarded). And each 2 continuous frames comprise 1 visible light image and 1 yellow light correction image, and 1 frame of fusion image can be obtained after synthesis.

With continued reference to fig. 3, for easy installation and disassembly, the black mark sensor 23 may also be fixedly installed on the fixing bracket 5 by screws, as follows: the black mark sensor 23 is arranged on the PCB, a mounting hole is formed in the corresponding PCB, a corresponding mounting hole is also formed in the fixing support 5, a fourth screw 64 sequentially penetrates through the corresponding mounting hole, and the fixing support 5 is fixedly connected with the black mark sensor 23. After the installation is completed, the black mark sensor 23 is located above the motor 22, so that the black mark position m on the motor 22 can be detected.

If a frame processor is further disposed in the image sensor 3, and is configured to form a frame from the received optical signal, in an optional scheme, the black mark sensor 23 may be further connected to the frame processor, so that the frame processor forms a frame according to the identification result of the black mark sensor 23 in the area. Specifically, when the black mark sensor 23 identifies that there is only one single area in the optical path, the frame processor forms the obtained optical signal into a frame; when two areas are identified to exist in the optical path at the same time, the frame processor skips the corresponding frame generation process, i.e. the obtained optical signal is not formed into a frame. Therefore, images on the image sensor 3 are all effective frames finally, and the image processing system 4 can directly perform synthesis processing on each effective frame to obtain an image or video with a good synchronization effect. In this alternative, the image sensor 3 reasonably skips the frame images that cannot be used subsequently in the process of generating frames, selectively generates frames, which can save storage space, and the image processing system 4 does not need to discard frames when performing synchronous synthesis, thereby simplifying the synthesis process and improving the processing efficiency.

In fig. 3, the lens system 1 is provided with only one lens 11, and the filter wheel 21 can be disposed behind the lens 11 or in front of the lens 11; compared with the multi-lens system which only can use a fixed focal length lens, the single-lens system can use a variable focal length lens, and when the single lens is used, the problem of uneven edges caused by the axle distance of the multi-lens system is avoided in picture synthesis. Certainly, according to the requirements of different applications of the user, the lens system 1 may also be a multi-lens system, that is, include a plurality of lenses, and when including a plurality of lenses, the filter wheel 21 may be located behind the plurality of lenses, may also be located in front of the plurality of lenses, may also be located between the plurality of lenses, and does not affect imaging shooting; these several arrangements are within the scope of the present invention.

Further, the image processing system 4 includes an image fusion module and a saturation adjustment module, and the image fusion module is configured to fuse images of different types of optical signals on the image sensor 3; the saturation adjusting module is used for performing saturation stretching on the fused image. For example, when the visible light and the yellow light passing through the filter wheel 21 need to be synthesized, the image fusion module is first used to fuse the RGB image (imaging of visible light) and the yellow light correction image to obtain a fused image of the RGB image and the yellow light correction image; and then, the saturation adjustment module is used for adjusting the saturation of the fused image so as to obtain the required image or video.

According to the embodiment of the invention, through the filter light wheel system, color cast light, strong light and the like can be organically separated for processing and filtering, which cannot be realized in the traditional system, so that the complexity and the cost of the system are greatly reduced, the problems of overexposure of an imaging picture caused by the strong light and color cast of the imaging picture caused by color light are avoided, the requirements of normal light and special light filtering can be simultaneously considered, and the image quality is effectively improved in a special environment; the image processing system can synthesize images of different types of optical signals, reduce image noise and improve imaging details. Compared with the original imaging system, the system provided by the invention is slightly changed, the cost and the influence on the whole system are reduced as much as possible, and the imaging quality can be greatly improved, so that the system can be used as a good upgrading and updating product of the existing imaging system.

Example 2:

On the basis of the foregoing embodiment 1, an embodiment of the present invention further provides an imaging and photographing method capable of filtering strong light or color cast light, which can be implemented by using the imaging and photographing system described in embodiment 1, that is, the filter optical wheel is divided into at least two regions along a circumferential direction, and different regions are respectively subjected to different surface coatings for filtering optical signals of different types; the different surface coatings comprise strong light filtering coatings and/or color cast light filtering coatings with different colors, and the different types of light signals comprise strong light and/or colored light after filtering and correction.

As shown in fig. 5, the imaging shooting method provided in the embodiment of the present invention specifically includes:

And step 10, enabling different areas to enter the light path in turn during the rotation process of the filter light wheel, filtering the light and dividing the light into different types of light signals to pass through.

In connection with embodiment 1, the light first enters the lens system 1 and then reaches the filter wheel 21 along the light path. The filter optical wheel 21 is connected with the motor 22 and further rotates under the driving action of the motor 22, so that different regions of the filter optical wheel 21 enter the optical path in turn according to the arrangement sequence, and further different types of optical signals respectively pass through and reach the image sensor 3.

The different types of optical signals are imaged on the image sensors, respectively, step 20.

With reference to embodiment 1, the image sensor 3 may specifically be a CMOS photosensitive chip or a CCD photosensitive chip, and is used for imaging different types of optical signals respectively. Therefore, after the light signal passes through the filter wheel 21, different images are formed on the image sensor 3 at different time slices. Because the strong light filtering coating film and the color cast light filtering coating film are used, the corresponding strong light or color light can be filtered and corrected under the strong light environment or the color light environment, the image corresponding to the image sensor is a strong light correction image or a color light correction image, and the problem of overexposure or color cast of the image is solved.

and step 30, synthesizing the images corresponding to the different types of optical signals to obtain the required image.

With reference to embodiment 1, different images formed on the image sensor 3 are transmitted to the image processing system 4, and are combined by a processing chip in the image processing system 4 to form a final image and video signal for a user.

In the imaging shooting method provided by the embodiment of the invention, the filter optical wheel is added in the optical path, the filter optical wheel is divided into at least two areas according to the requirements of users, strong light and special color light can be filtered and corrected respectively, different areas enter the optical path in turn during rotation, so that different types of optical signals respectively pass through and are imaged on the image sensor, and a required image or video is obtained after synthesis processing.

as can be seen from embodiment 1, during the rotation of the filter wheel 21, there are two situations in the optical path: one is that any region is in the light path independently, and the corresponding imaging is an effective frame at the moment; the other is that any two adjacent areas are in the optical path at the same time, and the corresponding imaging is an invalid frame. When the synthesizing process is performed, if all the formed frames are synthesized, the existence of invalid frames will affect the synchronization effect, and the problem of blurred and unclear picture after the synthesis occurs. Thus, the method further comprises:

In the rotation process of the filter optical wheel 21, the black mark sensor 23 identifies the area of the filter optical wheel currently located in the optical path, and the identification method is related to the setting manner of the black mark position, which may specifically refer to the related description of embodiment 1 and will not be described herein again. Then, when the combining process is performed in step 30, the corresponding images on the image sensor 3 when any two adjacent regions are simultaneously in the optical path are discarded, and only the remaining images are combined. The method can effectively improve the synchronization effect and obtain clear images or videos. Wherein, in the alternative, the frame processor may also form a frame according to the area identification result of the black mark sensor 23, that is, when there is only a single area in the optical path, the frame processor forms the obtained optical signal into a frame; when two regions exist in the optical path at the same time, the frame processor skips the corresponding frame generation process, which may specifically refer to the related description of embodiment 1 and is not described herein again.

When the filter light wheel is divided into p (p is more than or equal to 2) areas, an image of 2p frames can be formed on the image sensor 3 in each rotation, wherein half (p frames) are invalid frames, and half (p frames) are valid frames, and the p valid frames are synthesized into an image of 1 frame. Similarly, when the filter optical wheel is divided into p regions and the rotating speed is n revolutions per second, the images on the image sensor per second are 2p × n frames, wherein the p × n frames are corresponding images when any two adjacent regions are in the optical path at the same time and are discarded during the synthesis processing; then n frames of successive composite images per second may be acquired after the compositing process.

In practical application, an RGB image formed by corresponding visible light signals has image colors, and in the embodiment of the present invention, for example, a user desires to obtain a normal color image, and a spot light has yellow, in order to avoid a yellow-biased phenomenon of an imaging picture, the filter wheel 21 may be divided into A, B two regions, where an a region is coated with an antireflection film and can pass visible light, and a B region has a yellow-light filtering coating film on a surface thereof for filtering and correcting yellow light in an environment. When the filter wheel 21 rotates, the A, B area alternately enters the optical path, so that the visible light and the yellow light respectively pass through and reach the image sensor 3, an RGB image and a yellow light correction image are respectively formed on the image sensor 3 under different time slices, and finally, a composite image of the RGB image and the yellow light correction image is obtained after processing.

Four different states of the filter wheel 21 during rotation are shown in fig. 6, and four pictures can be respectively marked as a first state, a second state, a third state and a fourth state as indicated by arrows in the figure; the image sensor 3 (i.e. the small square in the right region of the figure) is arranged behind the filter wheel 21, fixed in position; the optical path range may cover approximately one quarter of the area of the filter wheel 21, as indicated by the dashed circle in the figure. One half of the filter wheel 21 (i.e., region a) is transparent to visible light and the other half (i.e., region B) is transparent to yellow light. The following describes details of the synchronization of the images during the rotation of the filter wheel 21 with reference to fig. 6:

the filter optical wheel 21 rotates clockwise, and within the exposure time of the 1 st frame image, the filter optical wheel 21 rotates from the first state to the second state, rotates by 90 °, and during the whole rotation process, only the B region is located in the optical path, and can filter and correct the yellow light, so that all the light received by the image sensor 3 is the filtered yellow light, and therefore, an effective yellow light correction frame is output.

In the exposure time of the 2 nd frame image, the filter wheel 21 rotates from the second state to the third state, rotates by 90 °, and is in the partial a region + the partial B region in the optical path during the whole rotation, so that the image sensor 3 receives both the visible light and the yellow light, outputs half RGB, and corrects the frame by half the yellow light, thereby forming a bad frame.

In the exposure time of the 3 rd frame image, the filter photo wheel 21 rotates from the third state to the fourth state by 90 °, during the whole rotation process, only the area a in the optical path is always in, and only visible light can pass through, so that all the received light by the image sensor 3 is visible light, and therefore, a valid RGB frame can be output.

During the exposure time of the 4 th frame image, the filter wheel 21 rotates from the fourth state to the first state, rotates by 90 °, and is in the partial a region + the partial B region in the optical path during the whole rotation, so that the image sensor 3 receives both the visible light and the yellow light, and similar to the 2 nd frame, outputs half RGB, and half yellow light corrects the frame, which becomes a bad frame.

When the image is divided into A, B two areas, 4 frames are one period (i.e. one rotation), the 5 th frame image is output as the 1 st frame, and is the 1 st frame in the new period; and forming subsequent frame images and the like. And forming 4 frames of images in each period, wherein 2 frames are bad frames which are discarded during image synthesis, two remaining frames are RGB frames and yellow light correction frames, and synthesizing 2 continuous RGB frames and yellow light correction frames to output a frame of synthesized image. Therefore, when the rotation speed of the filter wheel 21 is 60 revolutions per second, 120 frames of bad frames and 120 frames of effective images are formed on the image sensor 3 per second (the RGB image and the yellow light correction image are 60 frames, respectively), and one image is output after every 2 continuous effective frames are synthesized, so that a continuous synthesized image of 60 frames per second can be finally obtained.

In addition to using a method of discarding bad frames to ensure synchronization, the following methods may be used in the alternative: the black mark sensor 23 is connected with the frame processor, and when only one single area in the optical path is identified, the frame processor forms the obtained optical signal into a frame; when two areas are identified to exist in the optical path at the same time, the frame processor skips the corresponding frame generation process, i.e. the obtained optical signal is not formed into a frame. Therefore, images on the image sensor 3 are all effective frames finally, and the image processing system 4 can directly perform synthesis processing on each effective frame to obtain an image or video with a good synchronization effect. In this alternative, the image sensor 3 directly skips over the frame images that cannot be used subsequently in the process of generating frames, selectively generates frames, and finally generates valid frames, so that the image processing system 4 does not need to discard frames during synchronous synthesis, thereby simplifying the synthesis process and improving the processing efficiency.

further, the synthesizing the images corresponding to the different types of optical signals to obtain the required image (i.e. step 30), which can be referred to fig. 7 accordingly, includes:

Step 301, fusing the images corresponding to the different types of optical signals to obtain a fused image. In this embodiment, the image fusion module fuses the corresponding RGB image and the yellow light correction image, so that the color cast phenomenon can be avoided on the basis of the RGB image; the specific implementation process can refer to fig. 8 and 9, and includes:

step 3011, convert the RGB map into YCbCr, and further decompose it to obtain Y channel, Cb channel, and Cr channel. Where YCbCr denotes one of color spaces, Y denotes a luminance component of a color, Cb denotes a density offset component of blue, and Cr denotes a density offset component of red.

And step 3012, converting the obtained color tone map into YCbCr, and further decomposing to obtain a Y channel, a Cb channel and a Cr channel. In this embodiment, the yellow optical correction map is channel decomposed.

and 3013, fusing the Y channel, the Cb channel, and the Cr channel of the RGB map with the channels corresponding to the color tone map, respectively, to obtain a fused Y channel, a fused Cb channel, and a fused Cr channel.

the fusion of each channel can adopt a weighted fusion mode, and the weight is related to the dark primary color of the RGB image; after many experiments in this example, the weights were determined as follows:

dark(p)＝min{R(p),G(p),B(p)}

Wherein, R (p), G (p) and B (p) respectively represent the pixels of three primary colors of red, green and blue in the RGB image, and dark primary color pixels of the RGB image are represented by dark (p); w represents a fusion weight value of the yellow corrected image at the time of image fusion. Taking the fusion of the Y channels as an example, the actual weighting process satisfies the following formula:

y (p) represents a pixel of a Y-channel of an RGB map, Yellow (p) represents a pixel of a Y-channel of a Yellow light correction map, and Y_fusedAnd (p) represents a pixel of a fused Y channel after the Y channel of the RGB image and the Y channel of the yellow light correction image are fused. The fusion process of the other two channels is similar to that of the Y channel, and the above formula may also be referred to, which is not described herein again.

and step 3014, resynthesizing YCbCr from the fused Y channel, the fused Cb channel, and the fused Cr channel, and converting the YCbCr to obtain a fused image of an RGB image and a color tone image. After the fusion of each channel, the finally obtained fusion image has no color cast phenomenon through testing.

and 302, performing saturation adjustment on the fused image to obtain a required image.

for the fused image, if the saturation is insufficient, the visual effect is affected. Therefore, the saturation S is usually further adjusted in the HSV space by the saturation adjustment module, specifically, the fused image is decomposed into an H channel, an S channel, and a V channel, and is adjusted on the S channel, and then the adjusted S channel is fused with the original H channel and V channel, so as to obtain the image with the adjusted saturation.

in the whole imaging process, the black mark sensor 23 may be in a working state all the time, that is, the black mark position is detected every revolution, and then the area currently located in the light path is determined. In a preferred embodiment, the black mark sensor 23 is connected to the frame processor, and in order to save power and improve processing efficiency, the operating state of the black mark sensor 23 may be controlled as follows: in the working process of the black mark sensor 23, the image framing time of the frame processor is matched with the detection time of the black mark sensor 23 for detecting the black mark position, when the matching is successful, the black mark sensor 23 is closed, so that the area identification in the light path is not required to be carried out by the black mark sensor 23 in the subsequent process, and the effective frame formed by the frame processor is directly synthesized.

Wherein, the successful matching means f1 ═ p × f2, and when it is determined that the current region in the light path is a single region by detecting black mark bits, the frame processor just frames the image once; p is the number of regions into which the filter wheel 21 is divided, f1 represents the image framing frequency of the frame processor, i.e., the number of frames of images formed per second, and f2 represents the detection frequency of black bits detected by the black mark sensor 23, i.e., the number of times black bits are detected per second (when only one black mark bit is set). The image framing frequency of the frame processor may be set in advance, for example, the filter wheel 21 is divided into A, B two regions, the rotation speed is 100 rpm, a black mark bit is detected once per revolution, the black mark sensor can detect 100 times of black mark bits per second, if the frame processor forms 200 frames of images per second, and when a black mark bit is detected (a corresponding single region is in the optical path), image acquisition is performed exactly once, it can be considered that the two frequencies are successfully matched, the frame processor forms an effective frame, and then the frame processor directly synthesizes the frame images according to the frame processor, and the black mark sensor is turned off, so that power is saved, and the processing efficiency is improved. Besides, the image framing time of the frame processor can be dynamically set directly according to the detection time of the black mark sensor, the frame processor and the black mark sensor are matched successfully, and then the black mark sensor is turned off.

in another preferred embodiment, the black mark sensor 23 is connected to the image processing system 4, and in order to save power and improve processing efficiency, the operating state of the black mark sensor 23 can be controlled as follows: in the working process of the black mark sensor 23, the image discarding time of the image processing system 4 is matched with the detection time of the black mark sensor 23 for detecting the black mark position, when the matching is successful, the black mark sensor 23 is closed, so that the area identification in the light path is not required to be carried out by the black mark sensor 23 in the subsequent process, and the images reserved on the image sensor 3 are directly synthesized.

Wherein, the successful matching means f3 ═ p × f2, and when it is determined that two regions are currently located in the optical path by detecting black mark bits, the image processing system 4 performs image discarding exactly once; f3 represents the image discarding frequency of the image processing system 4, i.e., the number of image frames discarded per second. The image discarding frequency of the image processing system 4 may be set in advance, for example, the filter wheel 21 is divided into A, B two regions, the rotation speed is 100 rpm, a black mark position is detected once per revolution, the black mark sensor can detect 100 times of black mark positions per second, if the image processing system 4 discards 200 frames of images per second, and when a black mark position is detected (corresponding to a single region in the optical path), the acquired images are just reserved, it can be considered that the two frequencies are successfully matched, the image processing system 4 reserves all valid frames, and then directly synthesizes the reserved images, and the black mark sensor is turned off, which can save power and improve the processing efficiency. Alternatively, the image discarding time of the image processing system 4 may be dynamically set directly according to the detection time of the black mark sensor, so that the image processing system and the black mark sensor are successfully matched, and then the black mark sensor is turned off.

furthermore, the two preferred schemes are particularly suitable for the situation that the rotating speed is constant, and the black mark sensor can be periodically started to perform the corresponding matching process again in consideration of the situation that the rotating speed is possibly unstable in the whole process, and the black mark sensor is closed after the matching is confirmed to be successful again. Therefore, the power saving effect can be achieved, and the framing of the frame processor or the frame dropping action of the image processing system can be ensured to be reasonable and effective.

In the embodiment of the present invention, the filter wheel 21 is divided into two regions, and the two regions are illustrated by respectively using visible light and yellow light, but the present invention is not limited thereto. In practical use, if the image characteristics required by the user require more different types of light to synthesize the image, the filter wheel 21 may be divided into more regions and correspondingly coated to pass through the corresponding types of light signals, and the corresponding imaging and shooting method may refer to the method described above in the embodiment of the present invention.

For example, the RGB image formed by the visible light signal has image colors, but the image details are not high, and especially the long shot in the image is hardly visible; and the image details of the NIR image formed by the near-infrared light signal are high, the long-range view in the image is visible, but the image has no color, and the RGB image and the NIR image can be considered to be synthesized. If the spot light has yellow, in order to avoid the phenomenon of yellow deviation of an imaging picture, the filter light wheel 21 can be divided into A, B, C three areas, and the area A is plated with an antireflection film and can pass visible light; the surface of the area B is provided with a yellow light filtering coating film for filtering and correcting yellow light in the environment; the surface of the area C is coated with a near infrared filter and can pass near infrared light. At this time, three images of an RGB image, an NIR image, and a yellow light correction image can be formed on the image sensor 3, and a fused image of the three images is finally obtained, so that not only is the color cast phenomenon avoided, but also the image details are significantly improved, the color of the image is ensured, the picture quality is improved, and a good visual effect is exhibited.

For another example, if the filter wheel 21 is divided into two regions, and a near-infrared filter membrane and a yellow light filter membrane are respectively plated on the two regions, an NIR image and a yellow light correction image can be formed on the image sensor 3, and finally a fused image of the two images is obtained; since the NIR image has no color, saturation adjustment may not be required for the fused image. For another example, if the light intensity of the external environment is too high, a strong light filtering coating is performed on the corresponding area of the filter wheel 21 according to the requirement, and a strong light correction image is formed on the image sensor 3.

In summary, compared with the prior art, the imaging shooting method provided by the embodiment of the invention has the following advantages:

After light is filtered by the rotating filter light wheel in different areas, strong light, chromatic light and the like can be organically separated out for filtering treatment, corresponding correction images are respectively formed on the image sensor, and finally required images or videos are obtained through synthesis;

The method comprises the steps of identifying a filter area currently rotated to a light path in the rotation process of a filter light wheel, judging the property of a formed frame, only synthesizing continuous effective frames during final processing, and discarding corresponding invalid frames when two adjacent areas are simultaneously positioned in the light path, so that the synchronization effect of images can be effectively improved, and clear images or videos can be obtained.

example 3:

On the basis of the foregoing embodiment 1 and embodiment 2, an imaging and shooting device based on a filter wheel is further provided in the embodiment of the present invention, as shown in fig. 10, which is a schematic diagram of a device architecture in the embodiment of the present invention. The filter wheel based imaging camera of the present embodiment includes one or more processors 71 and a memory 72. In fig. 10, one processor 71 is taken as an example.

The processor 71 and the memory 72 may be connected by a bus or other means, and fig. 10 illustrates the connection by a bus as an example.

The memory 72, as a non-volatile computer-readable storage medium for an imaging photographing method capable of filtering strong light or color cast light, may be used to store a non-volatile software program, a non-volatile computer-executable program, and modules, such as the imaging photographing method capable of filtering strong light or color cast light in embodiment 1. The processor 71 executes various functional applications and data processing of the filter wheel-based imaging and photographing device by executing nonvolatile software programs, instructions and modules stored in the memory 72, that is, implements the imaging and photographing method of embodiment 2 capable of filtering strong light or color cast light.

The memory 72 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the memory 72 may optionally include memory located remotely from the processor 71, and these remote memories may be connected to the processor 71 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

the program instructions/modules are stored in the memory 72 and, when executed by the one or more processors 71, perform the imaging capture method capable of filtering highlight or color cast light in embodiment 2 described above, for example, perform the respective steps shown in fig. 5, 7, and 8 described above.

Those of ordinary skill in the art will appreciate that all or part of the steps of the various methods of the embodiments may be implemented by associated hardware as instructed by a program, which may be stored on a computer-readable storage medium, which may include: a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic or optical disk, or the like.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.

Claims (8)

1. an imaging shooting system capable of filtering strong light or color cast light is characterized by comprising a lens system, a filter light wheel system, an image sensor and an image processing system, wherein the filter light wheel system comprises a filter light wheel and a motor; the motor is in transmission connection with the filter light wheel so as to drive the filter light wheel to rotate;

different areas of the filter light wheel are respectively subjected to different surface coatings, the different surface coatings comprise strong light filtering coatings and/or color cast light filtering coatings with different colors, and the strong light filtering coatings are used for filtering strong light so as to enable the strong light with preset proportion of light intensity to pass through; the color cast light filtering coating is used for filtering corresponding color light so as to enable the color light with the light intensity of a preset proportion to pass through;

The lens system is used for providing an optical path for light to enter; when the filter optical wheel rotates, different areas alternately enter the optical path, and light is filtered and then divided into different types of optical signals to pass through; the image sensor is used for respectively imaging different types of optical signals; the image processing system is used for synchronously synthesizing the images of different types of optical signals;

The filter light wheel system also comprises a black mark sensor, wherein a black mark position is arranged on the filter light wheel or a rotating wheel of the motor, and the black mark sensor is used for identifying the black mark position when the filter light wheel rotates so as to identify the area of the filter light wheel currently in the light path according to the black mark position;

In the working process of the black mark sensor, matching the image framing time of a frame processor with the detection time of the black mark sensor for detecting a black mark position, closing the black mark sensor when the matching is successful, and directly synthesizing effective frames formed by the frame processor without depending on the black mark sensor to identify areas in a light path in the subsequent process; periodically starting the black mark sensor to perform the corresponding matching process again, and closing the black mark sensor after confirming that the matching is successful again;

wherein, the successful matching means f1= p × f2, and when it is determined that the current area in the optical path is a single area by detecting black mark bits, the frame processor performs image framing exactly once; p is the number of the areas divided by the filter light wheel, f1 represents the image framing frequency of the frame processor, and f2 represents the detection frequency of the black mark sensor detecting the black mark bits; the image framing frequency of the frame processor is set in advance; and dynamically setting the image framing time of the frame processor according to the detection time of the black mark sensor directly to enable the frame processor and the black mark sensor to be matched successfully, and then closing the black mark sensor.

2. the imaging and capturing system of claim 1, wherein the different surface coatings further comprise one or more of an anti-reflection coating, a near infrared filter coating, a middle infrared filter coating, and a far infrared filter coating; wherein the antireflection film, the near-infrared filter coating film, the mid-infrared filter coating film, and the far-infrared filter coating film are used for passing visible light, near-infrared light, mid-infrared light, and far-infrared light, respectively.

3. An imaging capture system of claim 1 wherein the black mark sensor is coupled to the image processing system, and wherein when the black mark sensor identifies that any two adjacent regions are in the optical path at the same time, the image processing system discards the corresponding images from the image sensor so that the image processing system only synthesizes the remaining images from the image sensor.

4. an imaging shooting method capable of filtering strong light or color cast light is characterized in that a filter optical wheel is divided into at least two areas along the circumferential direction, and different areas are respectively subjected to different surface coating films and used for filtering optical signals of different types; the different surface coatings comprise strong light filtering coatings and/or color cast light filtering coatings with different colors, and the different types of optical signals comprise strong light and/or colored light after filtering and correction; the method comprises the following steps:

The filter light wheel enables different areas to enter the light path in turn in the rotating process, and light is divided into different types of light signals to pass through after being filtered;

the different types of optical signals are imaged on the image sensor respectively;

Synchronously synthesizing the images corresponding to the different types of optical signals to obtain a required image;

the black mark sensor is used for identifying a black mark position when the filter optical wheel rotates so as to identify the area of the filter optical wheel currently in the optical path according to the black mark position;

In the working process of the black mark sensor, matching the image framing time of a frame processor with the detection time of the black mark sensor for detecting a black mark position, closing the black mark sensor when the matching is successful, and directly synthesizing effective frames formed by the frame processor without depending on the black mark sensor to identify areas in a light path in the subsequent process; periodically starting the black mark sensor to perform the corresponding matching process again, and closing the black mark sensor after confirming that the matching is successful again;

Wherein, the successful matching means f1= p × f2, and when it is determined that the current area in the optical path is a single area by detecting black mark bits, the frame processor performs image framing exactly once; p is the number of the areas divided by the filter light wheel, f1 represents the image framing frequency of the frame processor, and f2 represents the detection frequency of the black mark sensor detecting the black mark bits; the image framing frequency of the frame processor is set in advance; and dynamically setting the image framing time of the frame processor according to the detection time of the black mark sensor directly to enable the frame processor and the black mark sensor to be matched successfully, and then closing the black mark sensor.

5. the method as claimed in claim 4, wherein during the rotation of the filter wheel, there are two states, one of which is in the optical path and the other is in the optical path; the method further comprises:

in the rotation process of the filter optical wheel, identifying the area of the filter optical wheel currently in the optical path through a black mark sensor; when synchronous synthesis processing is performed, images on the image sensor corresponding to any two adjacent regions in the optical path at the same time are discarded, and only the remaining images are subjected to synthesis processing.

6. The method of claim 5, wherein when the filter wheel is divided into p regions and the rotation speed is n revolutions per second, 2p x n frames are imaged per second on the image sensor, wherein when any two adjacent regions are in the optical path simultaneously, the corresponding images are discarded during the synchronous combining process; acquiring n frames of continuous synthetic images per second after synchronous synthetic processing; wherein p is more than or equal to 2.

7. the method as claimed in claim 4, wherein the step of synchronously combining the images corresponding to the different types of optical signals to obtain a desired image comprises:

fusing images corresponding to the different types of optical signals to obtain a fused image;

And adjusting the saturation of the fused image to obtain a required image.

8. The imaging shooting method capable of filtering strong light or color cast light according to claim 7, wherein the filter wheel is divided into two areas along the circumferential direction, and the two areas are respectively used for obtaining the images of the RGB image and the corrected color light image on the image sensor through the visible light and the color light with the preset proportion of light intensity; then, the fusing the images corresponding to the different types of optical signals to obtain a fused image specifically includes:

converting the obtained RGB image into YCbCr, and further decomposing to obtain a Y channel, a Cb channel and a Cr channel;

converting the obtained color tone map into YCbCr, and further decomposing to obtain a Y channel, a Cb channel and a Cr channel;

respectively fusing a Y channel, a Cb channel and a Cr channel of the RGB image with the channels corresponding to the color tone images to obtain a fused Y channel, a fused Cb channel and a fused Cr channel;

And re-synthesizing the fused Y channel, the fused Cb channel and the fused Cr channel into YCbCr, and converting the YCbCr to obtain a fused image of an RGB image and a color tone image.