TWI594630B - Night photography system and its method - Google Patents

Description

Night photography system and method thereof

The invention relates to a nighttime photography system and a method thereof, in particular to a nighttime light source capable of being able to capture a clear image in an environment where a low light source or a low light source can be captured by a light source that is not easily perceived by the human eye. Photography system and method therefor.

Generally, when shooting, since the light of the photographing environment is supplied by a light source (such as natural light, fluorescent tube, fluorescent tube, etc.) mixed with various sources, the light source is sufficient, so that a clear image can be taken.

However, when the brightness of ambient light is low, most of them need to be complemented with a flash to improve the overall brightness of the captured image to obtain a clear image. However, in low-light photography situations (such as night photography), the ambient light in which the background object is located is often a dim light with a warmer color temperature, so the white light produced by the flash is projected on a closer object (such as a character). The white bright block that forms the cold color temperature is incompatible with the background. That is to say, the color temperature of the object to which the flash is projected is inconsistent with the color temperature of other backgrounds, which will make the overall picture uncoordinated.

In addition, if the light source is insufficient to capture the image, it will also be used with the infrared-assisted light source for night photography. However, the image captured by this infrared light can only be an achromatic image, so it is still not enough to meet the hope. The need for color and high resolution images.

Therefore, how to shoot an image in an environment with insufficient light source does not require a flash or an infrared auxiliary light source to assist the illumination, but provides a light source that is not easily perceived by the human eye during the shooting process, and is difficult to control the human eye. The illuminating parameter of the illuminating light source and the image capturing frequency and the sensing period of the photographic lens enable the photographic lens to be imaged after being imaged in a low light source or a low light source environment, and then can be obtained by image processing. A clear image should be the best solution.

The present invention provides a nighttime photography system and a method thereof, which are a nighttime photography system capable of obtaining a clear image through a light source that is not easily perceived by the human eye, and which enables the photographic lens to be used in a low light source or an insufficient light source. And its method.

The above-mentioned nighttime photography system can be achieved, comprising: a photographing device comprising at least one photo sensor and a photographing lens, wherein the photographing device is used for capturing a captured image; and at least one night photographing light source device is one person a light source that is not easily perceived by the eye, for illuminating at least one of the photographic elements to cause the photographic lens to capture an image in an environment of low or insufficient light source; a control module coupled to the photographic device and the photographic device The night light source device is electrically connected, and the control module includes an illumination intensity control unit for controlling an average power value of the night light source device, so that the night light source device can emit a human eye and is not easily perceived. a light source; an illumination period control unit for controlling an illumination frequency or an illumination time of the night light source device for shortening an illumination time of the night light source device, so that the night light source device can emit a human eye is difficult a light source that is perceived; a light sensing period control unit for controlling a sensing period of the light sensor of the photographing device for shortening the light sensing The sensing time is such that the photographic lens can capture the light source illuminated by the night light source device in a very short time, so that the photographic lens can be captured in an environment of low light source or insufficient light source. a clear image; and an image adjustment unit for adjusting the image captured by the photographic lens to a clearer image.

More specifically, the low light source or the environment lacking the light source represents a brightness of less than 0.5 lumens representing the surrounding environment.

More specifically, the illumination intensity control unit can control the average power value of the night light source device to be less than 0.01 W.

More specifically, the illumination period control unit can control the illumination time of the night light source device to be less than 20 ms.

More specifically, the control module further includes an image capturing frequency control unit for controlling the image capturing frequency of the photographic lens to control the photographic lens to capture images every second. Quantity.

More specifically, the image capturing frequency control unit can control the number of captured images captured by the photographic lens every second to be between 8 and 1000.

More specifically, the light sensing period control unit can control the sensing period of the photo sensor of the photographing device to be between 20 ms and 1 us.

More specifically, the night light source device is constructed of at least one light emitting diode of any color.

More specifically, the night light source device is a light source device capable of controlling its irradiation time or irradiation frequency.

More specifically, the photographic lens is CCD, CMOS or high resolution CMOS.

More specifically, the control module further includes an image adjustment unit capable of correcting the image captured by the photographic lens, adjusting the color gradation or chromatic aberration.

More specifically, the adjustment of the correction is based on the value of the reflection feedback obtained by the light source and the intensity of the ambient light, and the image obtained by the photographing of the photographing lens is adjusted so that the acquired image can enhance the image. brightness.

More specifically, the control module further includes an image resolution adjustment unit that can control the night light source devices of different colors to perform illumination, and obtain the values of the reflection feedback according to the light sources of different colors and The intensity of ambient light is adjusted to capture the image taken by the photographic lens to improve the image resolution of the acquired image.

More specifically, the image captured by the photographic lens is a moving image or a still image.

The night photography method can be achieved by: (1) capturing a photograph of at least one of the photographing devices having the photographing lens and the photosensor; and (2) controlling the illumination parameters of the light source and the The image capturing frequency and sensing period of the photographic lens are provided to provide a light source that is not easily perceived by a human eye, so that the photographic lens can capture images in a low light source or an insufficient light source environment, and then through the image processing The captured image is adjusted to a sharper image.

More specifically, the low light source or the environment lacking the light source represents a brightness of less than 0.5 lumens representing the surrounding environment.

More specifically, the illumination parameters include illumination intensity and illumination period.

More specifically, the average range of the irradiation intensity can be controlled to be less than 0.01 W.

More specifically, the range of the illumination period can be controlled to be less than 20 ms.

More specifically, the image capturing frequency of the photographic lens is more controllable, and the image capturing frequency is the number of captured images that the photographic lens can capture every second, and the range of the image capturing frequency can be controlled between 8 ~1000 between.

More specifically, the light sensing period is used to control the sensing period of the light sensor in the photographing device, and the range of the light sensing period can be controlled between 20 ms and 1 us.

More specifically, the light source that is not easily perceived by the human eye is at least one light-emitting diode of any color.

More specifically, the photographic lens is CCD, CMOS or high resolution CMOS.

More specifically, the night photography method is capable of correcting, clearing, or chromatic aberration of the sharp image captured by the photographic lens.

More specifically, the adjustment of the correction is based on the value of the reflection feedback obtained by the light source and the intensity of the ambient light, and the image obtained by the photographing of the photographing lens is adjusted so that the acquired image can enhance the image. brightness.

More specifically, the night photography method is capable of controlling a light source that is not easily perceived by a human eye of different colors, and is based on the value of the reflection feedback obtained by the light source of different colors and the intensity of the ambient light. The image taken by the lens is adjusted to improve the image resolution of the acquired image.

More specifically, the image captured by the photographic lens is a moving image or a still image.

Other details, features, and advantages of the present invention will be apparent from the following description of the preferred embodiments.

Please refer to FIGS. 1A and 1B , which are schematic diagrams showing the overall architecture of the night photography system and the method thereof, and the internal architecture of the control module. As can be seen from the figure, the night photography system includes a photographing device 1 and at least one night shot. The light source device 2 and a control module 3, wherein the camera device 1 includes at least one light sensor 11 and a photographic lens 12, and the camera device 1 is used for capturing a captured image. a moving image or a still image, wherein the photographing device 1 is a CCD, a CMOS or a high-resolution CMOS;

The night light source device 2 is composed of at least one light emitting diode (LED) of any color (and the light emitting diode of the night light source device 2 must be able to be controlled by the irradiation time or the irradiation frequency), and can Providing a light source that is difficult for a human eye to perceive, so when at least one of the photographs is illuminated, if the photographing lens is in a low light source or an insufficient light source environment (the ambient light brightness is less than 0.5 lumens) When shooting images, you can capture a clear image;

However, in addition to the use of the night light source device 2, it is necessary to control the illumination parameters of the light source, the image capturing frequency of the photographing device 1, and the sensing period through the control module 3, and the control module 3 includes An illumination intensity control unit 31, an illumination period control unit 32, an image capture frequency control unit 33, a light sensing period control unit 34, an image adjustment unit 35, and an image resolution adjustment unit 36, wherein the illumination intensity control The unit 31 is configured to control the average power value of the night light source device 2, so that the night light source device 2 can emit a light source that is not easily perceived by a human eye, and the average power value of the night light source device 2 is less than 0.01. W, and the optimal control range is between 10 ^-3 ~ 10 ^-6 W, which enables the night light source device 2 to emit a light source that is not easily perceived by a human eye;

For example, in a normal state, if 1W can provide enough light source to capture a clear image, in order to illuminate a light source that is not easily perceived by the human eye, when the irradiation time is adjusted to 0.001 second, it can be provided in a time range of 0.001 second. The 1W illumination (ie, the average power value of the 1 second illumination is 0.001 W), so that sufficient light source is provided in a short time, one is not easily noticeable, and one can provide sufficient brightness for shooting;

In order to illuminate the light source that is difficult to be perceived by the human eye, it is possible to adjust the illumination parameters (irradiation intensity and illumination period) of the control light source, the imaging frequency of the photographic lens, and the sensing period to achieve a light source that is not easily perceived by the human eye. the goal of;

Although capturing the image in a very short time may result in insufficient color gradation or insufficient chromatic aberration, in the color gradation, when the image adjusting unit 35 determines that the gradation is insufficient, the multiplier can be multiplied to enlarge the image, and Color difference adjustment is also a similar technique, so there is no additional description.

The illumination period control unit 32 is configured to control the illumination frequency or the illumination time of the night light source device 2 to shorten the illumination time of the night light source device 2 (the shorter the illumination time, the less easily the human eye can detect). In order to enable the night light source device 2 to emit a light source that is not easily perceived by a human eye; wherein the illumination period control unit 32 can control the illumination time of the night light source device to be less than 0.01 W, but the optimal control range is Between 20ms~1us;

The image capturing frequency control unit 33 is configured to control the image capturing frequency of the photographing device 1 to control the number of images that the photographing device 1 can capture every second (when the irradiation time is shorter, the photographing device 1 must The image capturing frequency control unit 33 can control the number of captured images that can be captured by the photographing device 1 every second to be between 8 and 1000, but the optimal control range is to control the image capturing device 33. The number of images that can be captured by the photographing device 1 every second is between 20 and 1000;

The light sensing period control unit 34 is configured to control the sensing period of the photo sensor 11 of the photographing device 1 to shorten the sensing time of the photo sensor 11 so that the photographing device 1 can be The light source irradiated by the night light source device 2 is captured in a short time, so that the photographing device 1 can capture a clear image in an environment of low light source or insufficient light source, and the light sensing cycle is performed. The control unit 34 can control the sensing period of the photo sensor 11 of the photographing device 1 to be between 20 ms and 1 us, but the optimal control range is to control the sensing period of the photo sensor 11 to be between 1 ms and 10 us. ;

The image adjusting unit 35 can correct the clear image captured by the photographing device 1 , adjust the color scale or the color difference, wherein the adjustment of the color scale or the color difference is known as the content of the foregoing description, so only the corrected image is used. It is to be noted that the adjustment of the correction can be based on the value of the reflection feedback obtained by the light source and the intensity of the ambient light, and the image obtained by the photographing of the photographing lens is adjusted so that the acquired image can improve the brightness of the image.

In addition, the image resolution adjustment unit 36 is further capable of controlling the night light source device 2 of different colors to perform illumination, and capturing the value of the reflection feedback and the intensity of the ambient light according to the light source of different colors. The image is adjusted so that the acquired image improves its image resolution;

For example, there are three active light sources of different colors, and the image resolution adjusting unit 36 can be photographed one by one with the first active light source (red light source), the second active light source (green light source), and the third active light source (blue light source). The object is irradiated with light sources of different colors, and when the different active light sources are irradiated, images (moving images or still images) are captured, and then the control module 3 overlaps the images captured by the different colors. The images after the overlap can be rendered in primary colors;

The above-mentioned images obtained by illuminating different colors are superimposed. The principle is that when the subject is illuminated by three active light sources of different colors, the signal of the reflection feedback is obtained by the photographing device 1 ( Reflex feedback value), and then, according to the intensity of the ambient light and the range of the intensity of the illumination source of the active light source, the image obtained by the shooting is adjusted so that the image obtained by the shooting can have The chromaticity in a normal light source environment, since the composition of a general image mostly has resolution, brightness, and chromaticity, and chromaticity refers to the purity of color. Broadly speaking, black and white ash is the color of "chroma = 0". However, in various color models, there are different quantization modes for chromaticity.

Among them, chromaticity contains the properties of chromogen and saturation (bright chromaticity), while chromaticity is related to the intensity of light and the intensity distribution at different wavelengths. The highest chromaticity is generally achieved by a single wavelength of strong light (such as a laser). In the case where the wavelength distribution is constant, the weaker the light intensity, the lower the chromaticity. Therefore, the present invention can further vary depending on the color light source. The color gamut is made under the environment of lumens (the intensity of ambient light), and by adjusting the range of the intensity of the illumination source that illuminates the subject with the active light source, an advanced gamut map can be made, so The photographing device 1 obtains a signal of reflection feedback (a value of reflection feedback, representing a different color light source), and then, according to the intensity of ambient light and the range of the intensity of the illumination source of the subject illuminated by the active light source, according to the advanced color gamut The regression analysis of the graph enables the image to be returned to chromaticity in different light intensity environments.

Next, it is further explained why the present invention uses active light source illumination, for example, in the case of two pixels on the subject, the RGB values of the two pixels are not illuminated by any active light source (in the RGB value here) Contains chromaticity) (0.5-0-0), (0-0-0), and the two pixels It is 0.5, so it is very difficult to distinguish; but if it is illuminated by the first active light source 14, the RGB values of the two-point pixels become (5.0-0-0), (0-0-0), and the two points Picture Then it becomes 5.0, so it is easy to distinguish the red color. It can also be seen from this that (5.0-0-0) this point should be more reddish, so when the first active light source 14 is irradiated, the R value is significantly increased.

In addition, if the RGB values of any two pixels are (0.5-0-0), (0-0.5-0), and the two pixels are 0.5, 0.5 ( It is 1.0), so it is very difficult to distinguish, but after the first active light source and the second active light source are irradiated, and the images captured by the first active light source and the second active light source are superimposed, the two are made. The RGB values of the dot pixels become (5-0-0), (0-5-0), so the two-pixel pixel Then become 5.0, 5.0 ( It is 10), so that it can be distinguished from the color, and it is also more capable of distinguishing images.

In addition, the control module 3 can perform regression analysis on the value of the reflection feedback obtained by the light source of different colors and according to the intensity of the ambient light, so as to adjust the image obtained by the shooting, so that the image obtained by the shooting can be obtained. Presented in a primary color, for example, when the second active light source is irradiated with a green plate, the green plate can measure the relative intensity of the green light to 100 (the second active light source has not been irradiated) under the condition of 1000 lumens of the environment, and thus 100 as the unlit reference (preset to the intensity of the primary color image in the normal light source environment);

After that, when the green plate is in the environment of 10 lumens, the relative intensity of the green light is 1 (the second active light source 15 has not been irradiated), and when the second active light source is irradiated on the green plate, the obtained The relative intensity is 11 (the intensity of the unlit light plus the light intensity 10 of the second active light source 10), therefore, the regression analysis must first deduct the measured relative intensity from the active light source regardless of the environmental lumens. After the light intensity, the intensity of the unlit light can be obtained, and finally, the intensity of the unlit light is multiplied by the multiple of the environmental lumen, and the image can be returned to the environment of 1000 lumens;

Therefore, when the green panel is illuminated by the second active light source, the control module 3 can obtain the value of the reflection feedback obtained by the green light to be 10.1, so the control module 3 will After deducting the light intensity 10 of the active light source from 10.1, it is possible to determine that the intensity of the green color of the image captured by the photographing device 1 is 0.1, and then multiplying the intensity by 1000, the green plate can be obtained under the condition of the environment 1 lumen. The image is restored to a condition of 1000 lumens of the environment, so that even in a low or insufficient light source environment (environment 1 lumen, 0.1 lumen or lower), the value of the reflection feedback obtained by illuminating the light source of different colors is based on the ambient light. The intensity of the image can be adjusted so that the acquired image can present a primary color image in a normal light source environment.

2 is a schematic flow chart of a nighttime photography system and a method thereof according to the present invention. The steps are as follows: (1) A camera having a photographic lens and a photosensor is provided to at least one of the photographic devices. And performing (2) controlling an illumination parameter of the light source and an image capturing frequency and a sensing period of the photographic lens to provide a light source that is not easily perceived by a human eye, so that the photographic lens can be at a low light source or In the environment of insufficient light source, a clear image 202 can be captured.

The advantages of the nighttime photography system and the method thereof provided by the present invention when compared with other conventional techniques are as follows: 1. The present invention does not require the use of a flashlight or an infrared auxiliary light source when shooting an image in an environment where the light source is insufficient. Auxiliary illumination enables a clear image to be captured when shooting images. 2. The present invention can provide a light source that is not easily perceived by a human eye during shooting, and can control the illumination parameter of the light source that is not easily perceived by the human eye, and the imaging frequency and sensing period of the photographic lens. The photographic lens captures a sharp image when shooting images in low-light or low-light environments. 3. The present invention can restore the image of night photography back to the image viewed in the normal daytime in the night vision environment, and can display the color image in nighttime photography. 4. The present invention is further capable of illuminating a subject with a different source of light by an active light source during the shooting process, and illuminating light sources of different colors to obtain different values of reflection feedback, which can be further based on ambient light. Intensity, to adjust the image obtained by shooting, so that the obtained image can show the image resolution in the environment of normal light source.

The present invention has been disclosed in the above embodiments, and is not intended to limit the present invention. Any of those skilled in the art can understand the foregoing technical features and embodiments of the present invention without departing from the invention. In the spirit and scope, the scope of patent protection of the present invention is subject to the definition of the claims attached to the present specification.

1‧‧‧Photographing device

11‧‧‧Light sensor

12‧‧‧Photographic lens

2‧‧‧ night shot light source device

3‧‧‧Control Module

31‧‧‧Emission intensity control unit

32‧‧‧illumination cycle control unit

33‧‧‧Image acquisition frequency control unit

34‧‧‧Light sensing cycle control unit

35‧‧‧Image Adjustment Unit

36‧‧‧Image resolution adjustment unit         

[Fig. 1A] is a schematic view showing the overall structure of the night photography system and method of the present invention. [Fig. 1B] is a schematic diagram showing the internal structure of the control module of the night photography system and the method thereof. [Fig. 2] is a flow chart showing the nighttime photography system of the present invention and its method.

1‧‧‧Photographing device

11‧‧‧Light sensor

12‧‧‧Photographic lens

2‧‧‧ night shot light source device

3‧‧‧Control Module

Claims (18)

A nighttime photography system includes: a photographing device comprising at least one photo sensor and a photographing lens, wherein the photographing device is used to capture a captured image; and at least one night shot light source device is controlled by an average The power value, the illumination frequency or the illumination time to provide a light source that is not easily perceived by the human eye, for illuminating at least one of the objects, so that the photographic lens can capture images in a low light source or an insufficient light source environment. The environment of the low light source or the insufficient light source represents that the brightness of the surrounding environment is less than 0.5 lumens; a control module is electrically connected to the photographing device and the night light source device, and the control module includes An illumination intensity control unit is configured to control the average power value of the night light source device to be less than 0.01 W, so that the night light source device can emit a light source that is not easily perceived by a human eye; and an illumination cycle control unit is For controlling the illumination frequency or the illumination time of the night light source device, to shorten the illumination time of the night light source device to be less than 20 ms, so that the night shot The source device can emit a light source that is not easily perceived by a human eye; a light sensing period control unit is configured to control a sensing period of the photo sensor of the photographing device to shorten the sensing time of the photo sensor So that the photographic lens can capture the light source illuminated by the night light source device in a very short time, so that the photographic lens can capture images in a low light source or an insufficient light source environment; an image adjusting unit, The image resolution for adjusting the image captured by the photographic lens to a normal light source; and an image resolution adjusting unit capable of controlling night shots of different colors The light source device performs illumination, and adjusts the image obtained by the photographing of the photographing lens according to the value of the reflection feedback obtained by the light source of different colors and the intensity of the ambient light, so that the acquired image can improve the image resolution. The night photography system of claim 1, wherein the control module further comprises an image capturing frequency control unit, wherein the image capturing frequency control unit is configured to control an image capturing frequency of the photographic lens to control the photographic lens. The number of images that can be captured in seconds. The night photography system of claim 2, wherein the image capturing frequency control unit is capable of controlling the number of captured images captured by the photographic lens every second to be between 8 and 1000. The night photography system of claim 1, wherein the light sensing period control unit is capable of controlling a sensing period of the photo sensor of the photographing device to be between 20 ms and 1 us. The nighttime photography system of claim 1, wherein the night light source device is constructed of at least one light emitting diode of any color. The night photography system of claim 1, wherein the night light source device is a light source device capable of controlling an illumination time or an illumination frequency. The night photography system of claim 1, wherein the photographic lens is CCD, CMOS or high resolution CMOS. The night photography system of claim 1, wherein the control module further comprises an image adjustment unit, wherein the image adjustment unit is capable of correcting the image captured by the photographic lens, adjusting the color gradation or chromatic aberration. The nighttime photography system of claim 8, wherein the adjustment of the correction is based on the value of the reflection feedback obtained by the light source and the intensity of the ambient light, and the image obtained by the photographing of the photographing lens is adjusted to obtain The image improves the brightness of the image. The night photography system of claim 1, wherein the captured image captured by the photographic lens is a moving image or a still image. A nighttime photography method is characterized in that: a photographing device having a photographing lens and a photosensor is used to image an image of at least one of the photographs; and the illumination parameter including the illumination intensity and the illumination period and the photographing are controlled. The light sensing period of the lens, wherein the average range of the irradiation intensity is controlled to be less than 0.01 W or the range of the irradiation period is controlled to be less than 20 ms, thereby providing a light source that is not easily perceived by the human eye, so that the photographic lens can The image can be captured in an environment with low light source or insufficient light source, and then the image processed can be adjusted to the image resolution of the normal light source through image processing, wherein the low light source or the environment with insufficient light source The brightness of the surrounding environment is less than 0.5 lumens; in addition, it is more capable of controlling the light sources of different colors for illumination, and according to the value of the reflection feedback obtained by the light source of different colors and the intensity of the ambient light, the photographic lens is taken The acquired image is adjusted so that the acquired image can be improved in image resolution. The night photography method of claim 11, wherein the image capturing frequency of the photographic lens is more controllable, and the image capturing frequency is a number of captured images that can be captured every second of the photographic lens, and the range of the image capturing frequency is Can control between 8~1000. The night photography method of claim 11, wherein the light sensing period is used to control a sensing period of the photo sensor in the photographing device, and the range of the light sensing period can be controlled between 20 ms and 1 us. between. The night photography method of claim 11, wherein the light source that is not easily perceived by the human eye is at least one light-emitting diode of any color. The night photography method of claim 11, wherein the photographic lens is a CCD, CMOS or high resolution CMOS. The night photography method of claim 11, wherein the clear image captured by the photographic lens is more capable of being corrected, gradation or chromatic aberration. The night photography method of claim 16, wherein the adjustment of the correction is based on the value of the reflection feedback obtained by the light source and the intensity of the ambient light, and adjusting the image obtained by the photographing of the photographing lens to obtain the obtained image. The image improves the brightness of the image. The night photography method of claim 11, wherein the image captured by the photographic lens is a motion image or a still image.