CN113490316B - Light supplementing system and light supplementing lamp - Google Patents
Light supplementing system and light supplementing lamp Download PDFInfo
- Publication number
- CN113490316B CN113490316B CN202110731183.4A CN202110731183A CN113490316B CN 113490316 B CN113490316 B CN 113490316B CN 202110731183 A CN202110731183 A CN 202110731183A CN 113490316 B CN113490316 B CN 113490316B
- Authority
- CN
- China
- Prior art keywords
- light
- light supplementing
- lamp
- real
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000001502 supplementing effect Effects 0.000 title claims abstract description 132
- 238000012545 processing Methods 0.000 claims abstract description 20
- 230000000007 visual effect Effects 0.000 claims abstract description 18
- 238000000034 method Methods 0.000 claims description 21
- 238000012544 monitoring process Methods 0.000 claims description 12
- 238000003491 array Methods 0.000 claims description 11
- 238000013507 mapping Methods 0.000 claims description 11
- 230000002093 peripheral effect Effects 0.000 claims description 6
- 230000004313 glare Effects 0.000 abstract description 10
- 238000004422 calculation algorithm Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 12
- 239000013589 supplement Substances 0.000 description 12
- 230000001276 controlling effect Effects 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 230000004927 fusion Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000001105 regulatory effect Effects 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 241000283070 Equus zebra Species 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000001678 irradiating effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/105—Controlling the light source in response to determined parameters
- H05B47/115—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings
- H05B47/125—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by using cameras
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
- G03B15/02—Illuminating scene
- G03B15/03—Combinations of cameras with lighting apparatus; Flash units
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Abstract
The invention discloses a light supplementing system and a light supplementing lamp, relates to the technical field of optics, and solves the technical problems of glare generated by light supplementing, poor photographed image quality and narrow light supplementing dynamic range in the prior art. The light supplementing system at least comprises: the light supplementing lamp consists of a plurality of light emitting microstructures and the image acquisition processing control device; the image acquisition processing control device is used for acquiring image information of a shot object in a visual field in real time, determining a corresponding area to be processed, which accords with preset conditions, in the image, determining a real-time distance between the shot object and the light supplementing lamp, determining the luminous state of each luminous microstructure according to the real-time distance and the area to be processed, generating a control signal for controlling the luminous state of each luminous microstructure to change, and sending the control signal to the light supplementing lamp; and the light supplementing lamp is used for controlling the light emitting state of each corresponding light emitting microstructure to change according to the control signal.
Description
Technical Field
The invention relates to the technical field of optics, in particular to a light supplementing system and a light supplementing lamp.
Background
The monitoring system is one of the most applied systems in production and life, and the most important point of video monitoring is to clearly reflect the picture of the monitoring terminal, however, due to various reasons such as small dynamic range of a sensor of a camera, large difference between the brightness of a shot object and ambient light, long distance between the shot object and the camera and the distance between the shot object and the light supplementing lamp, overexposure of some areas of an image and complete blackness of some areas of the image seriously affect the image quality.
Meanwhile, the light supplementing lamp of the camera in the prior art can generate the effect of dazzling or glare, if the vehicle or the pedestrian is snapped, visual interference is easily caused to drivers, passengers and pedestrians, and potential safety hazards exist.
In addition, the current intelligent light filling lamp can not realize regional light filling or the dynamic range of regional light filling is very narrow, and is very little to promoting the wide dynamic effect of image.
Disclosure of Invention
The invention provides a light supplementing system and a light supplementing lamp, which solve the technical problems of glare generated by shooting, unclear shooting images and narrow light supplementing dynamic range in the prior art.
In a first aspect of the present invention, an embodiment of the present invention provides a light supplementing system, including:
the light supplementing lamp consists of a plurality of light emitting microstructures and the image acquisition processing control device;
the image acquisition processing control device is used for acquiring image information of a shot object in a visual field in real time, determining a corresponding area to be processed, which accords with preset conditions, in the image, determining a real-time distance between the shot object and the light supplementing lamp, determining the luminous state of each luminous microstructure according to the real-time distance and the area to be processed, generating a control signal for controlling the luminous state of each luminous microstructure to change, and sending the control signal to the light supplementing lamp;
and the light supplementing lamp is used for controlling the light emitting state of each corresponding light emitting microstructure to change according to the control signal.
According to the light supplementing system, the corresponding to-be-processed area meeting the preset condition is determined through dynamically tracking the image information of the shot object acquired in the visual field, the corresponding to-be-processed area meeting the preset condition can be a human eye area, a bright and dark area or other areas needing important attention, the light emitting state of the light supplementing lamp is dynamically and real-timely adjusted according to different conditions and changes of different requirements of different areas, so that the required requirements are met, and the scheme can be suitable for various conditions and various situations, and various requirements are met.
Optionally, in some embodiments, the specific manner of determining the light emitting state of each light emitting microstructure according to the real-time distance and the area to be processed is: and determining the light emitting state of each light emitting microstructure of the region to be processed under the real-time distance according to the predetermined mapping relation between the shooting coordinate system and the light supplementing lamp coordinate system under different distances.
According to the embodiment of the invention, the luminous states of the luminous microstructures corresponding to the to-be-processed area in the real-time distance are determined according to the mapping relation between the shooting coordinate system and the light supplementing lamp coordinate system in different predetermined distances, the luminous states of the luminous microstructures corresponding to the to-be-processed area can be rapidly determined, the states of the luminous microstructures are determined to generate required control signals, and the light supplementing lamp can rapidly adjust the brightness in real time according to the control signals, so that the real-time dynamic adjustment requirement of the current light supplementing system can be met.
Optionally, in some embodiments, the corresponding area to be processed is a human eye area determined by analyzing the image information; the light supplementing lamp body is used for controlling the light sources of the light emitting microstructures corresponding to the human eye areas to be turned off according to the control signals.
The region to be processed in the embodiment of the invention is the human eye region determined by analyzing the image information, when the human face is analyzed, the human eye region is determined by an algorithm, the light sources of all the light-emitting microstructures corresponding to the human eye region are turned off, the interference of the sight caused by the glare generated by the light supplementing is prevented, the discomfort caused by the light supplementing is reduced, the light-emitting microstructures of the light supplementing lamp can be dynamically adjusted in real time according to the different positions of the driver and/or the pedestrian, the glare of the driver and/or the pedestrian in the visual range of the light supplementing system is ensured, the glare-free light supplementing is realized, the light is prevented from directly irradiating the eyes of the pedestrian or the driver, and the safety of the driver and the pedestrian is improved.
Optionally, in some embodiments, the corresponding area to be processed is a bright-dark area determined by parsing the image information; the light supplementing lamp body is used for: and controlling the light sources of the light-dark areas corresponding to the light-emitting microstructures according to the control signals to reduce the light-compensating intensity of the over-bright areas and/or improve the light-compensating intensity of the over-dark areas.
The corresponding area to be processed in the embodiment of the invention is a bright-dark area determined by analyzing the image information, when the partial area of the analyzed image has an excessively bright and excessively dark image, the bright-dark area of the current image is judged, the luminous intensity of the light-compensating lamp which corresponds to the bright-dark area and needs to be adjusted is analyzed and calculated in real time, the light-compensating lamp rapidly reduces the light-compensating intensity of the excessively bright area or the brightness of the excessively dark area is instantaneously improved according to a control signal, the luminous intensity of the light-compensating lamp is dynamically adjusted according to the change of the image by the light-compensating system, the definition of the image is greatly increased, the details of the image are ensured to be clearly visible, and the wide dynamic range of the image is greatly improved.
Optionally, in some embodiments, the corresponding area to be processed is a ground area around a person and/or a vehicle determined by analyzing the image information; the light supplementing lamp body is used for: and controlling the brightness of the light source corresponding to each light-emitting microstructure in the ground area according to a control signal determined by a preset pattern, and projecting the pattern.
The area to be processed in the embodiment of the invention is the area around the person and/or the vehicle determined by analyzing the image information, when the person and/or the vehicle passes through, different symbols or information can be projected according to different preset patterns set under different environments and different requirements so as to remind or inform the person, the vehicle and the like passing through the field of view, and different symbols can be set according to different requirements so as to meet various requirements.
Optionally, in some embodiments, the image acquisition processing control device includes: a ranging component and a monocular camera; the distance measuring component is used for measuring the real-time distance between the shot object and the light supplementing lamp and sending real-time distance information to the monocular camera; the monocular camera is used for collecting image information of a shot object in a visual field in real time, determining a corresponding area to be processed in the image, which accords with preset conditions, determining the luminous state of each luminous microstructure according to the received real-time distance information and the area to be processed, generating a control signal for controlling the luminous state of each luminous microstructure to change, and sending the control signal to the light supplementing lamp.
Optionally, in some embodiments, the ranging component is a ranging sensor.
Optionally, in some embodiments, the image acquisition processing control device includes: a binocular sensor and a processor; the binocular sensor is used for collecting image information of a shot object in a visual field in real time and sending the image information to the processor; the processor is used for receiving the image information in the binocular sensor, determining a corresponding area to be processed, which accords with a preset condition, in the image, determining the real-time distance between the shot object and the light supplementing lamp, determining the light emitting state of each light emitting microstructure according to the real-time distance and the area to be processed, generating a control signal for controlling the light emitting state of each light emitting microstructure to change, and sending the control signal to the light supplementing lamp.
In a second aspect of the present invention, an embodiment of the present invention provides a hybrid light-compensating lamp, including a plurality of light-emitting microstructures disposed on a light panel and a control chip, where the control chip is configured to control a light-emitting state of the plurality of light-emitting microstructures to change according to a control signal.
The mixed light supplementing lamp is composed of a plurality of light emitting microstructures with control chips, the control chips can independently switch on, switch off and regulate current of each independent light emitting microstructure, each light emitting microstructure is made to be an independently controllable pixel in a light type, therefore, the mixed light supplementing lamp can be regulated and controlled completely according to the needs of scenes, and the light supplementing effect is controlled by combining the needed design, so that the mixed light supplementing lamp is suitable for various scenes and has wide application fields.
Optionally, in some embodiments, the plurality of light emitting microstructures includes a micro LED array and a discrete LED array, and the micro LED array and the discrete LED array are arranged in a regular structure.
The light-emitting microstructures of the hybrid light supplementing lamp comprise micro LED arrays and discrete LED arrays which are arranged in a regular structure, different arrays are arranged according to the needs of different scenes, the micro LED arrays are integrated on a chip, each pixel can be individually addressed and individually driven to light, pixel-level control can be realized in the application process, the control is accurate, and the discrete LEDs are used for supplementing the brightness of the peripheral part of the field of view of the micro LED arrays, so that the light extraction degree is ensured.
Optionally, in some embodiments, the micro LED array is disposed in a central region of the lamp panel, and the discrete LED array is disposed in a peripheral region of the lamp panel.
In a third aspect of the present invention, an embodiment of the present invention provides a monitoring system, including an image capturing device and a hybrid light compensating lamp composed of a plurality of light emitting microstructures;
the image pick-up device is used for collecting image information of a shot object in a visual field in real time, determining a corresponding area to be processed in the image, which accords with a preset condition, determining a real-time distance between the shot object and the mixed light supplementing lamp, determining a control signal corresponding to the light emitting state of the mixed light supplementing lamp to be controlled according to the real-time distance and the area to be processed, and sending the control signal to the mixed light supplementing lamp;
the mixed light supplementing lamp is used for controlling the light emitting states of the corresponding light emitting microstructures to change according to the control signals so as to supplement light for the image pickup device.
In a fourth aspect of the present invention, an embodiment of the present invention provides a smart camera having any one of the light supplementing systems according to the first aspect of the present invention.
Technical effects brought by implementation manners of the third aspect to the fourth aspect in the embodiments of the present invention may refer to technical effects brought by corresponding implementation manners of the first aspect, which are not described herein again.
Based on the technical scheme, the embodiment of the invention solves the technical problem of no glare light filling, can improve the definition of the image, and greatly improves the wide dynamic range of the image.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a block diagram of a light supplementing system according to an embodiment of the present invention;
fig. 2 is a block diagram of another light supplementing system according to an embodiment of the present invention;
FIG. 3 is a flow chart of a monocular/binocular camera glare-free scheme provided by an embodiment of the present invention;
FIG. 4 is a flow chart of a scheme for improving image definition according to an embodiment of the present invention;
fig. 5-1, fig. 5-2, fig. 5-3 are schematic structural diagrams of a hybrid light compensating lamp according to an embodiment of the invention;
FIG. 6 is a block diagram of a monitoring system according to an embodiment of the present invention;
fig. 7 is a flowchart of a scheme for projecting symbols and/or logos according to an embodiment of the present invention.
Detailed Description
In order to enable a person skilled in the art to better understand the technical solutions of the present invention, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. The implementations described in the following exemplary examples do not represent all implementations consistent with the invention. Rather, they are merely examples of apparatus and methods consistent with aspects of the invention as detailed in the accompanying claims.
It should be noted that, in the embodiments of the present invention, a plurality refers to two or more than two; and/or, the association relationship describing the association object, the representation may have three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship. In addition, it should be understood that in the description of the present invention, the words "first," "second," and the like are used merely to distinguish between descriptions, and are not to be construed as indicating or implying a relative importance or order.
The image quality that the control class equipment was gathered at the camera is relatively poor under low illumination environment, can't clearly demonstrate the control picture, consequently, often need adopt the light filling lamp to carry out the light filling for the camera. When the light supplementing lamp is used for supplementing light for the camera, because the brightness of light rays generated by the light supplementing lamp is higher, when someone walks into the irradiation range of the white light lamp, glare is easily generated, and the definition of the image is influenced by over-brightness and over-darkness, so that the shooting is unclear.
Based on the technical problems, the embodiment of the invention provides a light supplementing system, a mixed light supplementing lamp and a monitoring system. The light supplementing system of the embodiment of the invention can be applied to, but is not limited to, equipment and monitoring equipment which need light supplementing, such as a monitoring camera arranged beside a street or at a community entrance, an intelligent camera with a light supplementing system and the like.
In some embodiments, a block diagram of a light supplementing system 100 is provided, as shown in fig. 1, including a light supplementing lamp 11 and an image acquisition and processing control device 12, where the device for acquiring images is a monocular camera, the image acquisition and processing control device 12 includes a ranging component 121 and a monocular camera 122.
Wherein, the distance measuring part 121 is configured to measure a real-time distance between the photographed object and the light compensating lamp 11, and send real-time distance information to the monocular camera 122; the monocular camera 122 is configured to collect image information of a photographed object in a field of view in real time, determine a corresponding area to be processed in the image, determine a light emitting state of each light emitting microstructure according to the received real-time distance information and the area to be processed, generate a control signal for controlling the light emitting state of each light emitting microstructure to change, and send the control signal to the light supplementing lamp 11; the light supplementing lamp 11 is configured to control the light emitting states of the corresponding light emitting microstructures to change according to the control signal.
The ranging unit 121 may be one of ranging sensors, such as an ultrasonic ranging sensor, a laser ranging sensor, an infrared ranging sensor, a 24GHZ radar sensor, etc., in the practical application process, where the ranging sensor measures the distance between the photographed object and the light compensating lamp 11 in real time and sends real-time distance information to the monocular camera 122, and in the practical application, a suitable ranging sensor may be selected according to comprehensive considerations such as the application scenario, environment, and cost.
In some embodiments, there is also provided a block diagram of another light supplementing system 100, including a light supplementing lamp 11 and an image acquisition and processing control device 12, where the device for acquiring images is a binocular camera, the image acquisition and processing control device 12 includes a processor 123 and a binocular sensor 124, as shown in fig. 2.
The binocular sensor 124 is configured to collect image information of a photographed object in a field of view in real time and send the image information to the processor; the processor 123 is configured to receive the image information in the binocular sensor 124, determine a corresponding area to be processed in the image, which meets a preset condition, determine a real-time distance between the photographed object and the light supplementing lamp 11, determine a light emitting state of each light emitting microstructure according to the real-time distance and the area to be processed, generate a control signal for controlling the light emitting state of each light emitting microstructure to change, and send the control signal to the light supplementing lamp 11; the light supplementing lamp 11 is configured to control the light emitting states of the corresponding light emitting microstructures to change according to the control signal.
The processor 123 may be a digital signal processor.
In some embodiments, a procedure of a glare-free light supplementing scheme of a monocular/binocular camera is provided, as shown in fig. 3, where the glare-free light supplementing is implemented by the technical scheme, so that a region to be processed focused in the technical scheme is a human eye region determined by analyzing the image, when a human face appears in the image by analysis, the human eye region is determined by different algorithms, light sources of light emitting microstructures corresponding to the human eye region are turned off, line of sight interference caused by glare generated by light supplementing is prevented, and discomfort caused by light supplementing is reduced, and the specific technical scheme is as follows:
s301: collecting image information of a shot object in a visual field in real time, and analyzing face information in the image;
the photographed object includes, but is not limited to, pedestrians and drivers, and faces in the image can be resolved by face recognition algorithms, which are existing empirical algorithms, and are performed by the monocular camera 122 if the image capturing device is a monocular camera, and by the processor 123 if the image capturing device is a binocular camera.
S302: whether a face is detected;
if a face is detected, the flow proceeds to steps S3031 and S3032, and if no face is detected, the current flow is ended, and whether the face appears in the acquisition field of view is continuously detected.
S3031: identifying the position of human eyes in the image through a human eye identification algorithm;
s3032: measuring the distance between the shot object and the light supplementing lamp through a radar ranging/binocular ranging algorithm;
the steps S3031 and S3032 are performed simultaneously, and the human eye recognition algorithm in S3031 is an existing empirical algorithm, and if the device for collecting the image is a monocular camera, the algorithm is completed by the monocular camera 122; the distance measuring unit 121 measures the distance between the photographed object and the light compensating lamp by a distance measuring method, and transmits the current distance information to the monocular camera 122 in real time, and in the embodiment of the present invention, the distance measuring is performed by using a radar, however, other distance measuring units, such as an acoustic distance measuring sensor, a laser distance measuring sensor, an infrared distance measuring sensor, etc., may be used, and the distance between the photographed object and the light compensating lamp measured by the radar is merely an example and is not limited thereto.
If the device for capturing images is a binocular camera, the human eye recognition algorithm is completed by the processor 123, and the distance between the person and the light supplement lamp is measured by the binocular distance measurement algorithm.
In some embodiments, binocular sensor 124 transmits the acquired black and white images and color images to processor 123 in real time using a combination of black and white sensors and color sensors; the processor 123 receives the black-and-white image and the color image information of the binocular sensor 124 in real time and analyzes the received black-and-white image, and if a human face is detected, the processor 123 invokes a human eye recognition algorithm to recognize the position of the human eye in the image; and meanwhile, a binocular distance measuring algorithm is called to measure the distance between the person and the light supplementing lamp.
In specific implementation, since no white light supplement is applied to the human eye portion in the next frame, the human eye color information of the color image is affected, so that in the next frame of the light-emitting microstructure of the light supplement lamp 11 corresponding to the closed human eye region, the fusion of the binocular image is required, and the color information of the human face and the forehead is supplemented to the human eye portion, so that the color image effect of human eyes is generated, and whether the human face is detected or not, the fusion of the binocular image is required, and the process is executed in parallel with the above process.
Therefore, if the device for capturing images is a binocular camera, a step of binocular image fusion is additionally added, and compared with a monocular camera, a separate distance measuring component 121 is not needed, so that in the actual application process, the selection can be performed according to the problems of environment, use cost and the like.
S304: and determining the coordinates of the light emitting microstructure of the light supplementing lamp corresponding to the human eye region under the real-time distance according to the mapping relation between the shooting coordinate system and the light supplementing lamp coordinate system.
In order to find out the coordinates of the light supplement lamp corresponding to the human eye region more quickly, a lookup table of the mapping relation between the shooting coordinate system and the light supplement lamp coordinate system under different distances is stored in the image acquisition processing control device 12 in advance, the coordinates of the light supplement lamp corresponding to the human eye region can be positioned quickly by obtaining the mapping relation between the shooting coordinate system under different distances and the light supplement lamp coordinate system, and then the light emitting microstructure of the light supplement lamp 11 corresponding to the human eye region under the real-time distance is determined.
Of course, the coordinates of the light-compensating lamps corresponding to the eye regions at different distances can be obtained by calculation, and the calculation process can be completed by the monocular camera 122 or the processor 123, and because the calculation method has extremely high requirements on the monocular camera 122 or the processor 123, when the number of the shot objects in the acquired view field increases, the calculation amount can be greatly increased, so that the method of storing the mapping relation between the shooting coordinate systems at different distances and the light-compensating lamp coordinate systems in advance and determining the light-emitting states of the light-emitting microstructures corresponding to the region to be processed at the real-time distance is preferable.
S305: generating corresponding control signals according to the determined light-supplementing lamp light-emitting microstructure coordinates, and turning off corresponding light sources;
according to the embodiment, the light-emitting microstructures of the light-supplementing lamps can be dynamically adjusted according to the positions of the driver and/or the pedestrian in real time, so that the driver and/or the pedestrian can not generate glare in the visual range of the light-supplementing system, the light-emitting microstructures of the light-supplementing lamps can be dynamically adjusted according to the positions of the driver and/or the pedestrian in real time, the driver and/or the pedestrian can not generate glare in the visual range of the light-supplementing system, the glare-free light supplementing is realized, the light is prevented from directly shining on the eyes of the pedestrian or the driver, and the safety of the driver and the pedestrian is improved.
In some embodiments, a scheme flow chart capable of improving the image definition is provided, as shown in fig. 4, the scheme can improve the image definition and can greatly improve the wide dynamic range of an image, therefore, a to-be-processed area is a bright-dark area determined by analyzing the image information, when a part of the analyzed image area has an excessively bright and excessively dark image, the bright-dark area of the current image is judged, the luminous intensity of a light-compensating lamp corresponding to the bright-dark area and needing to be adjusted is analyzed and calculated in real time, and the light-compensating lamp can quickly reduce the light-compensating intensity of the excessively bright area or instantly improve the brightness of the excessively dark area according to a control signal, and the specific technical scheme is as follows:
s401: collecting image information in real time, and analyzing the bright and dark areas of the image information;
because of the change of the external environment, such as day, night, cloudy day, rainy day, etc., or the reasons of shielding, etc., the definition of the collected image information is affected due to the over-brightness and over-darkness of the image, if the image collecting device is a monocular camera, the analysis process is completed by the monocular camera 122, and if the image collecting device is a binocular camera, the analysis process is completed by the processor 123.
S402: whether there is a bright-dark area;
if the analysis is performed to an excessively bright or dark area, the flow proceeds to steps S4031 and S4032, and if the analysis is not performed, the current flow is ended.
S4031: determining specific areas which are too bright and/or too dark and corresponding light supplementing lamp coordinates;
s4032: determining an ideal brightness value in the current environment;
if the device that acquired the image is a monocular camera, determining the specific area that is too bright and/or too dark is done by monocular camera 122, and if the device that acquired the image is a binocular camera, then the process is done by processor 123. The coordinates of the light compensating lamps corresponding to the specific areas that are too bright and/or too dark can be determined through the determined mapping relation between the specific areas that are too bright and/or too dark and the coordinate system of the image acquisition equipment and the coordinate system of the light compensating lamps, and the mode of determining the coordinates of the light compensating lamps corresponding to the specific areas that are too bright and/or too dark can be calculated, which is not limited herein.
Because of different external environments, the ideal brightness value is also different, for example, the ideal brightness value in the day, night, cloudy day and rainy day can be adjusted according to the environment, and the image acquisition processing control device calculates the theoretical ideal brightness value in the current environment according to the different external environment brightness, so that the theoretical brightness compensation of the clear image can be obtained.
S404: generating corresponding control signals to the light supplementing lamp according to the coordinates and the ideal brightness value;
s405: the light supplementing lamp reduces the light supplementing intensity of the over-bright area and/or improves the light supplementing intensity of the over-dark area according to the control signal.
According to the embodiment, the definition of the image can be greatly increased, the wide dynamic range of the image is greatly improved, when the partial area of the image is analyzed to have an excessively bright and excessively dark image, the bright and dark area of the current image is judged, the luminous intensity of the light supplementing lamp which corresponds to the bright and dark area and needs to be adjusted is analyzed and calculated in real time, the light supplementing lamp can quickly reduce the light supplementing intensity of the excessively bright area or instantly improve the brightness of the excessively dark area according to a control signal, the luminous intensity of the light supplementing lamp is dynamically adjusted by the light supplementing system according to the change of the image, the definition of the image is greatly increased, the details of the image are guaranteed to be clearly visible, and the wide dynamic range of the image is greatly improved.
In some embodiments, a hybrid light-compensating lamp is provided, the hybrid light-compensating lamp includes a plurality of light-emitting microstructures disposed on a lamp panel and a control chip, the control chip is configured to control the light-emitting states of the light-emitting microstructures to change according to a control signal.
The control chip of the embodiment can independently switch and regulate current for each independent light-emitting microstructure, so that each light-emitting microstructure becomes an independently controllable pixel in the light type, and therefore, the light-compensating effect can be regulated and controlled completely according to the scene requirement, and the light-compensating effect can be controlled by combining the required design, so that the light-compensating device is suitable for various scenes and has wide application fields.
In some embodiments, the plurality of light emitting microstructures includes a micro LED array and a discrete LED array, and the micro LED array and the discrete LED array are arranged in a regular structure.
According to the embodiment, different array arrangements can be carried out according to the needs of different scenes, the micro LED array is an integrated high-density micro-sized LED array on a chip, each pixel can be independently addressed and driven to be lighted, pixel-level control can be realized in the application process, the control is accurate, and discrete LEDs are used for supplementing the brightness of the edge part of the field of view of the micro LED array, so that the brightness is ensured.
In some embodiments, the micro led array is disposed in a central region of the lamp panel; the discrete LED array is arranged in the peripheral area of the lamp panel.
5-1, 5-2 and 5-3, wherein FIG. 5-1 is a mixed light supplementing lamp of a micro LED pixel array and a discrete LED array, and the upper part of the light supplementing lamp is a micro LED array and the lower part of the light supplementing lamp is a discrete LED array; fig. 5-2 and 5-3 are combinations of different lamp-type micro LED arrays disposed in a central region of a lamp panel and discrete LED arrays disposed in a peripheral region of the lamp panel.
In this embodiment, the central area of the hybrid light supplementing lamp panel is a micro LED pixel array, and the peripheral area of the lamp panel is a discrete LED to supplement light, so that the layout mode can support an ultra-large visual field, can cover different visual fields according to different configurations, has wide application field and flexible layout form, and can be manufactured into different shapes according to different requirements.
According to the micro LED pixel array, each led is designed by combining a silicon substrate, a driving control circuit and a wafer together, namely, a matrix CMOS control circuit is integrated in a silicon substrate of a chip, and all leds are packaged into a chip with a smaller size by combining the chip processed by the matrix microstructure, so that the functions of independently switching on, switching off and current regulation on each independent light-emitting microstructure on the chip are realized, each light-emitting microstructure is an independently controllable pixel in a light type, the pixel power is high, the adjustability is strong, therefore, accurate judgment and regulation can be made completely according to control requirements, the control of pixel level is realized, different designs are combined, different light supplementing effects are controlled, the functional light supplementing requirements are realized, and the application field is wide.
In some embodiments, a monitoring system is provided, as shown in fig. 6, including an image pickup device 22 and a hybrid light supplement lamp 21 composed of several light emitting microstructures;
the image capturing device 22 is configured to collect image information of an object to be captured in a field of view in real time, determine a corresponding area to be processed in the image, determine a real-time distance between the object to be captured and the hybrid light compensating lamp 21, determine a control signal corresponding to a light emitting state of the hybrid light compensating lamp 21 to be controlled according to the real-time distance and the area to be processed, and send the control signal to the hybrid light compensating lamp 21; the hybrid light-compensating lamp 21 is the hybrid light-compensating lamp 21 described in the above embodiment, and is configured to control the light-emitting states of the corresponding light-emitting microstructures to change according to the control signal, so as to compensate light for the image capturing device.
The monitoring system in the embodiment of the invention can dynamically track the image information of the shot object acquired in the visual field, analyze the state of the image of the attention point of the current shot object in real time, can be a human eye area determined by the image information and can also be a bright and dark area determined by the image information.
The monitoring system of the embodiment of the invention can also adjust the light-emitting microstructure of the hybrid light-compensating lamp 21 according to the definition of the image, for example, the light-compensating intensity of the over-bright area is reduced and/or the light-compensating intensity of the over-dark area is improved to increase the definition of the image, so that the acquired image of the shot object reaches an ideal state, and the definition of the image is improved.
In some embodiments, a scheme of projecting a symbol and/or an identifier is provided, as shown in fig. 7, the photographed object is a pedestrian and/or a vehicle, the area to be processed is a ground area around the pedestrian and/or the vehicle determined by analyzing the image information, and the light supplement lamp controls the brightness of the light source corresponding to each light emitting microstructure in the ground area according to a control signal determined by a preset pattern, so as to project the pattern.
When a pedestrian or a vehicle appears in the current view, an indicative symbol or a sign is projected in front of the vehicle running or around the pedestrian to remind other passing vehicles or pedestrians to pay attention to avoid, or indicative information is provided for the pedestrian and the vehicle.
The method comprises the following specific steps:
s701: collecting and analyzing image information in real time, and judging whether pedestrians and/or vehicles are detected or not; if yes, executing step S702, otherwise ending the current flow;
s702: acquiring a real-time distance between a person/vehicle and a light supplementing lamp;
s703: acquiring/calculating the coordinates of the light supplementing lamp corresponding to the person/vehicle;
s704: and generating control signals to the light supplementing lamps according to the coordinates of the light supplementing lamps, and projecting symbols and reminding information to the road in front and/or the periphery of a person/vehicle.
In the embodiments of the present invention, the processes may be implemented by those skilled in the art in combination with the specific steps of the foregoing examples and the present embodiments, and thus, each step will not be described in detail herein.
The embodiment can project a designated symbol according to the requirements of the environment or sending task instructions, such as an indication mark for prompting the speed limit of the vehicle can be projected in front of the vehicle when the vehicle is detected in rainy days, the embodiment can also be applied to pedestrians, such as the zebra stripes are projected to the front road when the pedestrians are detected to pass through, so as to indicate the pedestrians, and display marks can be projected around the vehicle when the vehicles are detected to pass through, so that other pedestrians are prompted to pay attention to the passing vehicles.
The area to be processed in the embodiment of the invention is the ground area around the person and/or the vehicle determined by analyzing the image information, when the person and/or the vehicle passes through, different symbols or information are projected according to different preset patterns set under different environments and different requirements, so as to remind or inform the person, the vehicle and the like passing through in the acquisition view, and different symbols can be set according to different requirements, thus meeting various requirements.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present application without departing from the spirit or scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims and the equivalents thereof, the present application is intended to cover such modifications and variations.
Claims (9)
1. A light supplementing system, comprising:
the light supplementing lamp consists of a plurality of light emitting microstructures and the image acquisition processing control device;
the image acquisition processing control device is used for acquiring image information of a shot object in a visual field in real time, determining a corresponding area to be processed, which accords with preset conditions, in the image, determining a real-time distance between the shot object and the light supplementing lamp, determining the luminous state of each luminous microstructure according to the real-time distance and the area to be processed, generating a control signal for controlling the luminous state of each luminous microstructure to change, and sending the control signal to the light supplementing lamp;
the light supplementing lamp is used for controlling the light emitting state of each corresponding light emitting microstructure to change according to the control signal;
the method for determining the light emitting state of each light emitting microstructure according to the real-time distance and the region to be processed specifically comprises the following steps: determining the light emitting state of each light emitting microstructure of the region to be processed under the real-time distance according to the predetermined mapping relation between the shooting coordinate system and the light supplementing lamp coordinate system under different distances; the mapping relation is used for determining the coordinates of the light supplementing lamp;
the corresponding area to be processed is a human eye area determined by analyzing the image information;
and the light supplementing lamp controls the light sources of the light emitting microstructures corresponding to the human eye areas to be turned off according to the control signals.
2. The light supplementing system according to claim 1, wherein the corresponding region to be processed is a bright-dark region determined by analyzing the image information;
and the light supplementing lamp controls the light sources of the light-dark areas corresponding to the light-emitting microstructures according to the control signals to reduce the light supplementing intensity of the over-bright areas and/or improve the light supplementing intensity of the over-dark areas.
3. The light supplementing system according to claim 1, wherein the corresponding area to be processed is a ground area around a person and/or a vehicle determined by analyzing the image information;
and the light supplementing lamp controls the brightness of the ground area corresponding to the light source of each light emitting microstructure according to the control signal determined by the preset pattern, and projects the pattern.
4. The light supplementing system according to claim 1, wherein the image acquisition processing control means comprises: a ranging component and a monocular camera;
the distance measuring component is used for measuring the real-time distance between the shot object and the light supplementing lamp and sending real-time distance information to the monocular camera;
the monocular camera is used for collecting image information of a shot object in a visual field in real time, determining a corresponding area to be processed in the image, which accords with preset conditions, determining the luminous state of each luminous microstructure according to the received real-time distance information and the area to be processed, generating a control signal for controlling the luminous state of each luminous microstructure to change, and sending the control signal to the light supplementing lamp.
5. A light filling system as defined in claim 4, wherein the distance measuring component is a distance measuring sensor.
6. The light supplementing system according to claim 1, wherein the image acquisition processing control means comprises: a binocular sensor and a processor;
the binocular sensor is used for collecting image information of a shot object in a visual field in real time and sending the image information to the processor;
the processor is used for receiving the image information in the binocular sensor, determining a corresponding area to be processed, which accords with a preset condition, in the image, determining the real-time distance between the shot object and the light supplementing lamp, determining the light emitting state of each light emitting microstructure according to the real-time distance and the area to be processed, generating a control signal for controlling the light emitting state of each light emitting microstructure to change, and sending the control signal to the light supplementing lamp.
7. The system of claim 1, wherein the light-compensating lamp comprises a plurality of light-emitting microstructures arranged on the lamp panel and a control chip, and the control chip is used for controlling the light-emitting states of the light-emitting microstructures to change according to control signals;
the light-emitting microstructures comprise micro LED arrays and discrete LED arrays, and the micro LED arrays and the discrete LED arrays are arranged in a regular structure;
wherein, the micro LED array is arranged in the central area of the lamp panel; the discrete LED array is arranged in the peripheral area of the lamp panel.
8. The monitoring system is characterized by comprising a camera device and a mixed light supplementing lamp consisting of a plurality of light-emitting microstructures;
the image pick-up device is used for collecting image information of a shot object in a visual field in real time, determining a corresponding area to be processed in the image, which accords with a preset condition, determining a real-time distance between the shot object and the mixed light supplementing lamp, determining a control signal corresponding to the light emitting state of the mixed light supplementing lamp to be controlled according to the real-time distance and the area to be processed, and sending the control signal to the mixed light supplementing lamp;
the hybrid light-compensating lamp is the light-compensating lamp in claim 7, and is used for controlling the light-emitting state of each corresponding light-emitting microstructure to change according to the control signal so as to compensate light for the image-capturing device;
the method for determining the control signal corresponding to the light emitting state of the mixed light supplementing lamp to be controlled according to the real-time distance and the area to be processed specifically comprises the following steps: determining the light emitting states of all the light emitting microstructures of the region to be processed under the real-time distance according to the predetermined mapping relation between the shooting coordinate system and the light supplementing lamp coordinate system under different distances, and generating control signals for controlling the light emitting states of all the light emitting microstructures to change; the mapping relation is used for determining the coordinates of the light supplementing lamp;
the corresponding area to be processed is a human eye area determined by analyzing the image information;
and the light supplementing lamp controls the light sources of the light emitting microstructures corresponding to the human eye areas to be turned off according to the control signals.
9. A smart camera having a light supplementing system according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110731183.4A CN113490316B (en) | 2021-06-30 | 2021-06-30 | Light supplementing system and light supplementing lamp |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110731183.4A CN113490316B (en) | 2021-06-30 | 2021-06-30 | Light supplementing system and light supplementing lamp |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113490316A CN113490316A (en) | 2021-10-08 |
| CN113490316B true CN113490316B (en) | 2024-04-12 |
Family
ID=77936459
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110731183.4A Active CN113490316B (en) | 2021-06-30 | 2021-06-30 | Light supplementing system and light supplementing lamp |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113490316B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114222071A (en) * | 2021-11-04 | 2022-03-22 | 深圳市锐明技术股份有限公司 | Method for controlling light supplement lamp and camera system |
| CN113962238B (en) * | 2021-12-06 | 2023-11-28 | 苏州华星光电技术有限公司 | Light supplementing light source and identification code scanning device |
| CN114859629A (en) * | 2022-04-14 | 2022-08-05 | 浙江高信技术股份有限公司 | Light supplement lamp, light supplement control system and method for vehicle snapshot |
| CN115050082B (en) * | 2022-08-12 | 2022-12-09 | 深圳市三千米光电科技有限公司 | Light filling monitoring system based on infrared laser lamp |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104618661A (en) * | 2015-03-05 | 2015-05-13 | 广东欧珀移动通信有限公司 | Camera light supplementing control method and device |
| CN105245787A (en) * | 2015-09-14 | 2016-01-13 | 努比亚技术有限公司 | Photographing control method and mobile terminal thereof |
| CN207815053U (en) * | 2018-01-12 | 2018-09-04 | 中盾金卫激光科技（昆山）有限公司 | A kind of multispectral mixed type monitoring camera light compensating lamp |
| WO2019084595A1 (en) * | 2017-10-31 | 2019-05-09 | Seeing Machines Limited | System and method for improving signal to noise ratio in object tracking under poor light conditions |
| CN109842763A (en) * | 2017-11-29 | 2019-06-04 | 深圳市海洋王照明工程有限公司 | A kind of automatic light-supplementing method, system and video camera |
| CN111246119A (en) * | 2018-11-29 | 2020-06-05 | 杭州海康威视数字技术股份有限公司 | Camera and light supplement control method and device |
| CN211792128U (en) * | 2019-11-26 | 2020-10-27 | 施光义 | Colorful lamp plate of low energy consumption |
| CN112965323A (en) * | 2021-02-02 | 2021-06-15 | 复旦大学 | Method for reducing glare of light supplement lamp of road traffic system |
-
2021
- 2021-06-30 CN CN202110731183.4A patent/CN113490316B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104618661A (en) * | 2015-03-05 | 2015-05-13 | 广东欧珀移动通信有限公司 | Camera light supplementing control method and device |
| CN105245787A (en) * | 2015-09-14 | 2016-01-13 | 努比亚技术有限公司 | Photographing control method and mobile terminal thereof |
| WO2019084595A1 (en) * | 2017-10-31 | 2019-05-09 | Seeing Machines Limited | System and method for improving signal to noise ratio in object tracking under poor light conditions |
| CN109842763A (en) * | 2017-11-29 | 2019-06-04 | 深圳市海洋王照明工程有限公司 | A kind of automatic light-supplementing method, system and video camera |
| CN207815053U (en) * | 2018-01-12 | 2018-09-04 | 中盾金卫激光科技（昆山）有限公司 | A kind of multispectral mixed type monitoring camera light compensating lamp |
| CN111246119A (en) * | 2018-11-29 | 2020-06-05 | 杭州海康威视数字技术股份有限公司 | Camera and light supplement control method and device |
| CN211792128U (en) * | 2019-11-26 | 2020-10-27 | 施光义 | Colorful lamp plate of low energy consumption |
| CN112965323A (en) * | 2021-02-02 | 2021-06-15 | 复旦大学 | Method for reducing glare of light supplement lamp of road traffic system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113490316A (en) | 2021-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113490316B (en) | Light supplementing system and light supplementing lamp | |
| CN103213540B (en) | Vehicle driving environment recognition apparatus | |
| US9090205B2 (en) | Light distribution controller | |
| CN103373274B (en) | For compensating the method for headlight orientation error and large lamp apparatus | |
| EP2448251B1 (en) | Bundling night vision and other driver assistance systems (DAS) using near infra red (NIR) illumination and a rolling shutter | |
| US9639764B2 (en) | Image recognition system for vehicle for traffic sign board recognition | |
| CN102197418B (en) | Device for monitoring surrounding area of vehicle | |
| JP4853437B2 (en) | Vehicle perimeter monitoring system | |
| CN106295494B (en) | Vehicle exterior environment recognition device | |
| CN109963744A (en) | Lighting device | |
| JP5772714B2 (en) | Light detection device and vehicle control system | |
| CN106778534B (en) | Method for identifying ambient light during vehicle running | |
| CN109204120B (en) | Light system for a motor vehicle | |
| CN106295493B (en) | exterior environment recognition device | |
| JP6420650B2 (en) | Outside environment recognition device | |
| EP2933143B1 (en) | Irradiation apparatus | |
| US20130242073A1 (en) | Image-capturing control apparatus and control method of capturing image | |
| EP3605497A1 (en) | Illumination image capture device | |
| WO2018225516A1 (en) | Image processing device | |
| JP2004086417A (en) | Method and device for detecting pedestrian on zebra crossing | |
| CN105745670B (en) | System and method for forming nighttime images for a motor vehicle | |
| JP2006252363A (en) | Detector for object around vehicle, and method of detecting object around vehicle | |
| GB2586802A (en) | System and method for identifying light emitter flicker | |
| US20240071032A1 (en) | Apparatus and method for a vehicle recognizing an object using pattern recognition | |
| JP2006211456A (en) | Image presentation device for vehicle and method therefor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |