CN114915734B - Method and device for automatically controlling starting of HDR mode - Google Patents
Method and device for automatically controlling starting of HDR mode Download PDFInfo
- Publication number
- CN114915734B CN114915734B CN202210515544.6A CN202210515544A CN114915734B CN 114915734 B CN114915734 B CN 114915734B CN 202210515544 A CN202210515544 A CN 202210515544A CN 114915734 B CN114915734 B CN 114915734B
- Authority
- CN
- China
- Prior art keywords
- dimensional data
- preset
- hdr mode
- surface area
- measured
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000004927 fusion Effects 0.000 claims description 8
- 230000004913 activation Effects 0.000 claims description 6
- 230000000977 initiatory effect Effects 0.000 claims 2
- 238000004422 calculation algorithm Methods 0.000 abstract description 13
- 238000004364 calculation method Methods 0.000 abstract description 9
- 238000004904 shortening Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 5
- 238000005259 measurement Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000005452 bending Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000001579 optical reflectometry Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20208—High dynamic range [HDR] image processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30244—Camera pose
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Image Analysis (AREA)
Abstract
The invention relates to a method and a device for automatically controlling the starting of an HDR mode, wherein the method for automatically controlling the starting of the HDR mode comprises the following steps: acquiring preset camera parameters; adjusting the camera parameters to shoot the measured object to obtain a plurality of groups of three-dimensional data of the measured object; and controlling the starting of the HDR mode according to the comparison result of the plurality of groups of three-dimensional data. The invention acquires a plurality of groups of three-dimensional data based on a plurality of times of downsampling, and can realize the intelligent starting of an HDR mode by utilizing the comparison of the plurality of groups of three-dimensional data, thereby greatly accelerating the speed of a three-dimensional reconstruction algorithm and shortening the calculation time.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a method and a device for automatically controlling starting of an HDR mode.
Background
The hardware of the structured light three-dimensional imaging (hereinafter referred to as a 3D camera) mainly comprises a camera and a projector, wherein the structured light is projected to active structure information of the surface of a measured object through the projector, such as laser stripes, gray codes, sine stripes and the like; then, shooting the surface to be tested through a single or a plurality of cameras to obtain a structured light image; finally, three-dimensional reconstruction is realized through three-dimensional image analysis and calculation based on a triangulation principle.
Based on such design principle, when the material and the color of the measured object are different, the light reflectivity of the object is different, so that the structured light with the same intensity is projected onto the surface of the measured object, the brightness of the image collected by the camera is different, and the final three-dimensional reconstruction result is obviously affected. The light intensity of the structured light and the exposure time of the camera are generally comprehensively adjusted in the industry to cope with measured objects with different materials and colors, so that the projection details of the structured light can be seen by images collected by the camera, and the three-dimensional reconstruction accuracy is ensured. When the object to be measured is formed by combining multiple different materials or colors, multiple sets of three-dimensional reconstruction data are obtained by adopting multiple measurements (different structured light intensities or camera exposure times) in the industry, and then fusion is performed, which is similar to the thought of an HDR mode in a camera (fusion is performed after multiple exposures, so that a bright scene object can be seen and a dark scene object can be seen), and is called as an HDR mode. Whether the current 3D camera HDR mode is on is generally determined by a user according to experience, and the current 3D camera HDR mode is manually turned on or off, which brings inconvenience to the user. Therefore, how to design an automatic detection of whether the HDR mode needs to be turned on is a problem to be solved.
Disclosure of Invention
In view of the foregoing, there is a need for providing a method and apparatus for automatically controlling the start of an HDR mode, which are used for overcoming the inconvenience caused by manually selecting the HDR mode in the prior art.
In order to solve the above technical problems, the present invention provides a method for automatically controlling the start of an HDR mode, including:
acquiring preset camera parameters;
adjusting the camera parameters to shoot the measured object to obtain a plurality of groups of three-dimensional data formed by downsampling the measured object;
and controlling the starting of the HDR mode according to the comparison result of the plurality of groups of three-dimensional data.
Further, the camera parameters include structural brightness and exposure time of the camera, and the adjusting the camera parameters to shoot the measured object to obtain multiple sets of three-dimensional data of the measured object includes:
adding preset structural brightness and preset exposure time, and determining first three-dimensional data of an object to be measured;
and determining second three-dimensional data of the object to be measured according to the preset structure brightness and the preset exposure time.
Further, the increasing the preset structural brightness and the preset exposure time determine first three-dimensional data of the measured object, including:
after the preset structural brightness and the preset exposure time are increased, image acquisition is carried out on the detected object, and a first picture group is determined;
and carrying out downsampling on the first picture group, carrying out three-dimensional reconstruction on the downsampled first picture group, and determining the first three-dimensional data.
Further, the determining the second three-dimensional data of the object to be measured according to the preset structural brightness and the preset exposure time includes:
image acquisition is carried out on the detected object according to the preset structural brightness and the preset exposure time, and a second picture group is determined;
and carrying out downsampling on the second picture group, carrying out three-dimensional reconstruction on the downsampled second picture group, and determining the second three-dimensional data.
Further, the plurality of sets of three-dimensional data includes first three-dimensional data and second three-dimensional data, and the controlling the start of the HDR mode according to the comparison result of the plurality of sets of three-dimensional data includes:
determining a first object surface area of the measured object within a preset depth of field according to the first three-dimensional data;
determining the second object surface area of the measured object within the preset depth of field according to the second three-dimensional data;
and controlling the starting of an HDR mode according to the first object surface area and the second object surface area.
Further, the controlling the start of the HDR mode according to the first object surface area and the second object surface area includes:
judging whether the difference between the first object surface area and the second object surface area meets a preset condition;
if the preset condition is met, controlling the starting of an HDR mode;
and if the preset condition is not met, not starting the HDR mode.
Further, the predetermined condition includes a difference between the first object surface area and the second object surface area being greater than a predetermined ratio.
Further, the plurality of sets of three-dimensional data includes first three-dimensional data and second three-dimensional data, and after the step of controlling the start of the HDR mode according to the comparison result of the plurality of sets of three-dimensional data, the method further includes:
increasing the area position of the surface area of the object of the measured object, and respectively finding out a corresponding first image area and a corresponding second image area in the first three-dimensional data and the second three-dimensional data;
calculating a first average brightness and a second average brightness corresponding to the first image area and the second image area respectively;
according to the first average brightness and the second average brightness, camera parameters are adjusted again, image acquisition is carried out on the measured object, and a third image group is determined;
and carrying out three-dimensional reconstruction and fusion according to the second image group and the third image group, and determining a final three-dimensional reconstruction image of the measured object.
Further, the camera parameters include structural brightness and exposure time of the camera, and the adjusting the camera parameters again according to the first average brightness and the second average brightness, performing image acquisition on the measured object, and determining a third image group includes:
determining readjusted structural brightness and readjusted exposure time according to the first average brightness and the second average brightness;
and acquiring an image of the detected object according to the readjusted structural brightness and the readjusted exposure time, and determining the third image group.
The invention also provides a device for automatically controlling the starting of the HDR mode, which comprises the following steps:
the acquisition unit is used for acquiring preset camera parameters;
the adjusting unit is used for adjusting the camera parameters to shoot the measured object to obtain a plurality of groups of three-dimensional data formed by downsampling the measured object;
and the control unit is used for controlling the starting of the HDR mode according to the comparison result of the plurality of groups of three-dimensional data.
Compared with the prior art, the invention has the beneficial effects that: firstly, camera parameters preset by a user are effectively acquired; then, adjusting preset camera parameters for a plurality of times, and shooting a measured object by using the adjusted camera parameters to obtain a plurality of groups of three-dimensional data; and finally, judging the three-dimensional information by utilizing the comparison results of a plurality of groups of three-dimensional data, saving development cost, and effectively judging whether the HDR mode is started or not by utilizing the three-dimensional information. In conclusion, the invention acquires a plurality of groups of three-dimensional data through multiple sampling, and can realize the intelligent starting of the HDR mode by utilizing the comparison of the plurality of groups of three-dimensional data, thereby greatly accelerating the speed of a three-dimensional reconstruction algorithm and shortening the calculation time.
Drawings
FIG. 1 is a schematic diagram of a prior art grating projection technique;
FIG. 2 is a flowchart illustrating an embodiment of a method for automatically controlling the HDR mode on according to the present invention;
fig. 3 is a flowchart of an embodiment of step S202 in fig. 2 according to the present invention;
fig. 4 is a flowchart of an embodiment of step S301 in fig. 3 according to the present invention;
FIG. 5 is a flowchart illustrating an embodiment of step S302 in FIG. 3 according to the present invention;
fig. 6 is a flowchart of an embodiment of step S203 in fig. 2 according to the present invention;
fig. 7 is a flowchart of an embodiment of step S603 in fig. 6 according to the present invention;
FIG. 8 is a flowchart illustrating an embodiment of the steps after step S203 in FIG. 2 according to the present invention;
FIG. 9 is a schematic diagram showing the effect of an embodiment of automatic HDR mode activation provided by the present invention;
FIG. 10 is a schematic diagram of an embodiment of an apparatus for automatically controlling the on of an HDR mode according to the present invention;
fig. 11 is a schematic structural diagram of an embodiment of an electronic device according to the present invention.
Detailed Description
Preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings, which form a part hereof, and together with the description serve to explain the principles of the invention, and are not intended to limit the scope of the invention.
In the description of the present invention, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. Furthermore, the meaning of "a plurality of" means at least two, such as two, three, etc., unless specifically defined otherwise.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the invention. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly understand that the described embodiments may be combined with other embodiments.
The invention provides a method and a device for automatically controlling the starting of an HDR mode, which control the starting of the HDR mode by utilizing the comparison result of a plurality of groups of three-dimensional data and provide a new idea for further realizing the intelligence of the starting of the HDR mode.
Before the description of the embodiments, the related words are interpreted:
HDR mode: the HDR mode refers to high dynamic illumination rendering images, compared with a common image, more dynamic range and image details can be provided, and the final HDR image is synthesized by utilizing the LDR image with the optimal details corresponding to each exposure time, so that the visual effect in the real environment can be better reflected;
3D image principle: the camera manufactured by using the 3D lens is generally provided with more than two shooting lenses, the distance between the two shooting lenses is similar to the distance between eyes, and different images aiming at the same scene, which are seen by similar eyes, can be shot.
Based on the description of the technical terms, referring to fig. 1, fig. 1 is a schematic diagram of a grating projection technique in the prior art, and the fringe projection technique actually belongs to a broad area structured light. The main principle is shown in the following diagram, namely, sinusoidal stripes are generated through computer programming, the sinusoidal stripes are projected to an object to be measured through projection equipment, the bending degree of the stripes modulated by the object is shot by utilizing a single or a plurality of cameras, the bending stripes are demodulated to obtain phases, and the phases are converted into the height of a full field. In the prior art, whether the 3D camera HDR mode is turned on is generally determined by a user according to experience, and the 3D camera HDR mode is turned on or turned off manually, which brings inconvenience to the user. Thus, the present invention aims to propose an intelligent HDR mode opening method.
Specific embodiments are described in detail below:
an embodiment of the present invention provides a method for automatically controlling HDR mode on, and referring to fig. 2, fig. 2 is a flow chart of an embodiment of the method for automatically controlling HDR mode on provided by the present invention, including steps S201 to S203, wherein:
in step S201, preset camera parameters are acquired;
in step S202, the camera parameters are adjusted to capture the object to be measured, so as to obtain a plurality of groups of three-dimensional data formed after the object to be measured is downsampled;
in step S203, the HDR mode is controlled to be turned on according to the comparison result of the plurality of sets of three-dimensional data.
In the embodiment of the invention, firstly, camera parameters preset by a user are effectively acquired; then, adjusting preset camera parameters for a plurality of times, and shooting a measured object by using the adjusted camera parameters to obtain a plurality of groups of three-dimensional data; and finally, judging the three-dimensional information by utilizing the comparison results of a plurality of groups of three-dimensional data, saving development cost, and effectively judging whether the HDR mode is started or not by utilizing the three-dimensional information.
As a preferred embodiment, referring to fig. 3, fig. 3 is a flowchart of an embodiment of step S202 in fig. 2 provided by the present invention, including steps S301 to S302, where:
in step S301, adding the preset structural brightness and the preset exposure time, and determining first three-dimensional data of the measured object;
in step S302, second three-dimensional data of the object to be measured is determined according to the preset structural brightness and the preset exposure time.
In embodiments of the present invention, the relative structural brightness and exposure time are adjusted to determine multiple sets of three-dimensional data.
As a preferred embodiment, as seen in fig. 4, fig. 4 is a flowchart of an embodiment of step S301 in fig. 3 provided by the present invention, including steps S401 to S402, wherein:
in step S401, after adding the preset structural brightness and the preset exposure time, performing image acquisition on the measured object, and determining a first picture group;
in step S402, the first picture group is downsampled, and the downsampled first picture group is three-dimensionally reconstructed to determine the first three-dimensional data.
In the embodiment of the invention, after the brightness and the exposure time of the structure are increased, the image acquisition is carried out, then the downsampling is carried out, the data quantity is effectively reduced through the downsampling, the algorithm efficiency is improved, and the first three-dimensional data is effectively determined.
In a specific embodiment of the present invention, the first three-dimensional data is denoted as A2, and the determination procedure is as follows:
the brightness of the structured light set by a user is recorded as L, and the exposure time of the camera is E;
adding L to L1, adding E to E1, collecting a group of pictures, and recording as a picture group A (a first picture group);
downsampling the picture group A, and reducing the resolution of the picture group A to obtain a picture group A1;
and carrying out three-dimensional reconstruction on the picture group A1 to obtain initial three-dimensional data A2 (first three-dimensional data) of the detected object.
As a preferred embodiment, referring to fig. 5, fig. 5 is a flowchart of an embodiment of step S302 in fig. 3 provided by the present invention, including steps S501 to S502, where:
in step S501, performing image acquisition on the object to be measured according to the preset structural brightness and the preset exposure time, and determining a second image group;
in step S502, the second image group is downsampled, and the downsampled second image group is three-dimensionally reconstructed, so as to determine the second three-dimensional data.
In the embodiment of the invention, after the brightness and the exposure time of the structure are increased, the image acquisition is carried out, then the downsampling is carried out, the data quantity is effectively reduced through the downsampling, the algorithm efficiency is improved, and the second three-dimensional data is effectively determined.
In a specific embodiment of the present invention, the second three-dimensional data is denoted as B2, and the determination procedure is as follows:
collecting a group of pictures, which are marked as a picture group B (second picture group), by using the brightness L of the structured light set by the user and the exposure time E of the camera;
downsampling the picture group B, and reducing the resolution of the picture group B to obtain a picture group B1;
and carrying out three-dimensional reconstruction on the picture group B1 to obtain initial three-dimensional data B2 (second three-dimensional data) of the detected object.
As a preferred embodiment, referring to fig. 6, fig. 6 is a flowchart of an embodiment of step S203 in fig. 2 provided by the present invention, including steps S601 to S603, wherein:
in step S601, determining a first object surface area of the measured object within a preset depth of field according to the first three-dimensional data;
in step S602, determining, according to the second three-dimensional data, a second object surface area of the object to be measured within the preset depth of field range;
in step S603, the HDR mode is controlled to be turned on according to the first object surface area and the second object surface area.
In the embodiment of the invention, the starting of the HDR mode is intelligently determined through the effective comparison of the first three-dimensional data and the second three-dimensional data.
As a preferred embodiment, as seen in fig. 7, fig. 7 is a flowchart of an embodiment of step S603 in fig. 6 provided by the present invention, including steps S701 to S703, wherein:
in step S701, it is determined whether or not a difference between the first object surface area and the second object surface area satisfies a preset condition;
in step S702, if the preset condition is met, controlling the start of the HDR mode;
in step S703, if the preset condition is not satisfied, the HDR mode is not turned on.
In the embodiment of the invention, the three-dimensional information is reflected according to the difference value between the first object surface area and the second object surface area, and whether the HDR mode is started or not is determined efficiently according to the three-dimensional information.
As a preferred embodiment, the above-mentioned preset condition includes that the difference between the first object surface area and the second object surface area is larger than a preset ratio. In the embodiment of the invention, the preset condition is set to effectively judge whether the three-dimensional information of the surface area of the first object and the surface area of the second object meets the starting requirement of the HDR mode.
In a specific embodiment of the present invention, comparing the data of A2 and B2, i.e. the first three-dimensional data and the second three-dimensional data, if the object surface area of A2 is larger than the object surface area of B2 by a certain ratio in the depth of field range (the minimum depth of field is denoted as C1 and the maximum depth of field is denoted as C2), it is determined that the HDR mode should be turned on, otherwise it is determined that the HDR mode is not turned on.
As a preferred embodiment, the plurality of sets of three-dimensional data includes first three-dimensional data and second three-dimensional data, and as seen in fig. 8, fig. 8 is a schematic flow chart of an embodiment of steps after step S203 in fig. 2 provided in the present invention, including steps S801 to S804, where:
in step S801, increasing the area position of the object surface area of the object to be measured, and finding a corresponding first image area and second image area in the first three-dimensional data and the second three-dimensional data, respectively;
in step S802, calculating a first average luminance and a second average luminance corresponding to the first image area and the second image area, respectively;
in step S803, according to the first average brightness and the second average brightness, camera parameters are adjusted again, image acquisition is performed on the measured object, and a third image group is determined;
in step S804, three-dimensional reconstruction and fusion are performed according to the second image group and the third image group, so as to determine a final three-dimensional reconstruction image of the measured object.
In the embodiment of the invention, the first average brightness and the second average brightness are effectively determined according to the first three-dimensional data and the second three-dimensional data, the image acquisition is carried out again, the three-dimensional reconstruction and fusion are carried out based on the second image group and the third image group, and the accuracy of the final three-dimensional reconstructed image is ensured.
As a preferred embodiment, step S803 specifically includes:
determining readjusted structural brightness and readjusted exposure time according to the first average brightness and the second average brightness;
and acquiring an image of the detected object according to the readjusted structural brightness and the readjusted exposure time, and determining the third image group.
In the embodiment of the invention, the camera parameters are adjusted again according to the first average brightness and the second average brightness, so that the third picture group is effectively determined.
In a specific embodiment of the present invention, the calculation objective of L2 and E2 is to make the HDR region in the group C of pictures at reasonable brightness (gray scale value 100-200, target value 150,0 is completely black, 255 is completely white), and the linear calculation formula l2= (D2-150) (L1-L)/(D2-D1) +l, e2= (D2-150) (E1-E)/(D2-D1) +e) is adopted in actual measurement.
In a specific embodiment of the present invention, if the HDR mode is required to be turned on, finding a corresponding image area (picture group A1 and B1) according to the area position for increasing the surface area of the object, calculating average brightness values D1 and D2 of the image area, calculating brightness L2 of the structured light of the collected picture and exposure time E2 of the camera in the HDR mode, and collecting a group of pictures, which are denoted as picture group C (third picture group); if in HDR mode, final three-dimensional reconstruction and fusion is performed with group B and group C. If not in HDR mode, the final three-dimensional reconstruction is performed with group of pictures B.
Referring to fig. 9, fig. 9 is a schematic diagram showing the effect of an embodiment of automatic HDR mode activation provided by the present invention, and a specific application example is used to better explain the technical scheme of the present invention as follows:
in a first step, L is typically set by controlling the power of the lamp in the projector, E is set by controlling the camera;
second, the purpose of increasing the values of L and E is to increase the brightness of the low-reflection object surface in the image captured by the camera so that this portion can be seen. In terms of the strategy of increasing the values of L and E, the increasing amplitude is dependent on the data actually measured by the device, and the value of L is preferentially increased, and l1=l1.4 is currently used for actual measurement; if L is close to the set upper limit (related to the maximum power of the lamp physically) then e=e×1.4 is increased. The number of the group of pictures corresponds to the number of the group of structured lights;
and thirdly, reducing the correlation between the resolution of the picture and the resolution of the original picture, wherein the purpose is to obtain the balance between the resolution of the object and the three-dimensional reconstruction speed. Currently, the resolution of the original image is 2048x1536, and the downsampled fraction ratio is 128x96. Since the downsampling algorithm of the picture belongs to a general algorithm, the method is not described. In addition, the device uses FPGA hardware for image acquisition, and the downsampling algorithm also uses the FPGA hardware for calculation;
fourth, steps 4, 7, 10 are generic to the three-dimensional reconstruction algorithm, except that the input picture component ratios are different. Because the three-dimensional reconstruction algorithm is complex, the flow is quite plentiful, and the method belongs to the existing pre-method and is not described;
fifth to seventh steps refer to the first to fourth steps;
eighth, the depth of field range is an inherent property of the device, determined by the optical structure of the device, and is the effective scan distance of the 3D camera. Because A2 and B2 are three-dimensional data taking a camera as a coordinate system, whether the point is in the depth space in the coordinate system is judged, and the surface area of the object is calculated through the surface (triangle stitching). Because surface computation of three-dimensional data is a general algorithm, the method is not described. Currently, it is believed that the HDR mode needs to be turned on if the surface area of A2 is greater than 20% or more of the surface area of B2;
ninth, the specific area A2 corresponds to the area on the original picture, and this process is only needed to be approximately corresponding, and the middle part of the specific area may be selected. The calculation objective of L2 and E2 is to make the HDR region in group C at reasonable brightness (gray value 100-200, target value 150,0 completely black, 255 completely white), and currently, the actual measurement is performed using a linear calculation formula, l2= (D2-150) (L1-L)/(D2-D1) +l, e2= (D2-150) (E1-E)/(D2-D1) +e);
tenth, the algorithm for fusing the three-dimensional reconstructed data of the image groups B and C includes, but is not limited to, a plurality of reconstruction fusion algorithms, which are not described herein;
the embodiment of the present invention further provides a device for automatically controlling the start of an HDR mode, and as shown in fig. 10, fig. 10 is a schematic structural diagram of an embodiment of the device for automatically controlling the start of an HDR mode, where the device 1000 for automatically controlling the start of an HDR mode includes:
an obtaining unit 1001, configured to obtain preset camera parameters;
the adjusting unit 1002 is configured to adjust the camera parameters to capture the object to be measured, so as to obtain a plurality of groups of three-dimensional data formed by downsampling the object to be measured;
a control unit 1003, configured to control the on of the HDR mode according to the comparison result of the multiple sets of three-dimensional data.
For a more specific implementation of each unit of the apparatus for automatically controlling the HDR mode on, reference may be made to the description of the method for automatically controlling the HDR mode on, and similar advantages will be obtained, which will not be repeated here.
The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, which when being executed by a processor, implements a method for automatically controlling the start of an HDR mode as described above.
In general, the computer instructions for carrying out the methods of the present invention may be carried in any combination of one or more computer-readable storage media. The non-transitory computer-readable storage medium may include any computer-readable medium, except the signal itself in temporary propagation.
The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
Computer program code for carrying out operations of the present invention may be written in one or more programming languages, or combinations thereof, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" language or similar programming languages, and in particular, the Python language suitable for neural network computing and TensorFlow, pyTorch-based platform frameworks may be used. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The embodiment of the present invention further provides an electronic device, and as shown in fig. 11, fig. 11 is a schematic structural diagram of an embodiment of the electronic device provided by the present invention, where the electronic device 1100 includes a processor 1101, a memory 1102, and a computer program stored in the memory 1102 and capable of running on the processor 1101, and when the processor 1101 executes the program, the method for automatically controlling the HDR mode to be turned on as described above is implemented.
As a preferred embodiment, the electronic device 1100 further includes a display 1103 for displaying the data processing result after the processor 1101 performs the method for automatically controlling the HDR mode to be turned on.
By way of example, a computer program may be partitioned into one or more modules/units that are stored in the memory 1102 and executed by the processor 1101 to perform the present invention. One or more of the modules/units may be a series of computer program instruction segments capable of performing particular functions to describe the execution of a computer program in the electronic device 1100. For example, the computer program may be divided into the acquisition unit 1001, the adjustment unit 1002, and the control unit 1003 in the above embodiments, and specific functions of the respective units are described in the above embodiments, which are not described in detail herein.
The electronic device 1100 may be a desktop computer, notebook, palm top computer, or smart phone device with an adjustable camera module.
The processor 1101 may be an integrated circuit chip, and has signal processing capability. The processor 1101 may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The Memory 1102 may be, but is not limited to, random access Memory (Random Access Memory, RAM), read Only Memory (ROM), programmable Read Only Memory (Programmable Read-Only Memory, PROM), erasable Read Only Memory (Erasable Programmable Read-Only Memory, EPROM), electrically erasable Read Only Memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc. The memory 1102 is configured to store a program, and the processor 1101 executes the program after receiving an execution instruction, and the method for defining a flow disclosed in any one of the foregoing embodiments of the present invention may be applied to the processor 1101 or implemented by the processor 1101.
The display 1103 may be an LCD display screen or an LED display screen. Such as a display screen on a cell phone.
It is to be appreciated that the configuration shown in fig. 11 is merely a schematic diagram of one configuration of the electronic device 1100, and that the electronic device 1100 may include more or fewer components than shown in fig. 11. The components shown in fig. 11 may be implemented in hardware, software, or a combination thereof.
The computer readable storage medium and the electronic device according to the above embodiments of the present invention may be implemented with reference to what is specifically described in the method for implementing automatic HDR mode on according to the present invention, and have similar advantages as the method for automatically controlling HDR mode on according to the present invention, which will not be described herein.
The invention discloses a method and a device for automatically controlling the starting of an HDR mode, firstly, effectively acquiring camera parameters preset by a user; then, adjusting preset camera parameters for a plurality of times, and shooting a measured object by using the adjusted camera parameters to obtain a plurality of groups of three-dimensional data; and finally, judging the three-dimensional information by utilizing the comparison results of a plurality of groups of three-dimensional data, saving development cost, and effectively judging whether the HDR mode is started or not by utilizing the three-dimensional information.
According to the technical scheme, multiple sets of three-dimensional data are acquired through multiple times of sampling, the intelligent starting of the HDR mode can be realized by utilizing the comparison of the multiple sets of three-dimensional data, the speed of a three-dimensional reconstruction algorithm can be greatly increased, and the calculation time is shortened.
The present invention is not limited to the above-mentioned embodiments, and any changes or substitutions that can be easily understood by those skilled in the art within the technical scope of the present invention are intended to be included in the scope of the present invention.
Claims (9)
1. A method for automatically controlling the activation of an HDR mode, comprising:
acquiring preset camera parameters;
adjusting the camera parameters to shoot the measured object to obtain a plurality of groups of three-dimensional data formed by downsampling the measured object;
and controlling the start of an HDR mode according to a comparison result of the plurality of sets of three-dimensional data, wherein the plurality of sets of three-dimensional data comprise first three-dimensional data and second three-dimensional data, determining a first object surface area of a measured object within a preset depth of field according to the first three-dimensional data, determining a second object surface area of the measured object within the preset depth of field according to the second three-dimensional data, and controlling the start of the HDR mode according to the first object surface area and the second object surface area.
2. The method of claim 1, wherein the camera parameters include a structural brightness and an exposure time of a camera, and wherein the adjusting the camera parameters to capture the object to be measured, and obtaining multiple sets of three-dimensional data of the object to be measured, comprises:
adding preset structural brightness and preset exposure time, and determining first three-dimensional data of an object to be measured;
and determining second three-dimensional data of the object to be measured according to the preset structure brightness and the preset exposure time.
3. The method of automatically controlling HDR mode initiation of claim 2, wherein the increasing the preset structured light intensity and the preset exposure time determines first three-dimensional data of the object under test, comprising:
after the preset structural brightness and the preset exposure time are increased, image acquisition is carried out on the detected object, and a first picture group is determined;
and carrying out downsampling on the first picture group, carrying out three-dimensional reconstruction on the downsampled first picture group, and determining the first three-dimensional data.
4. The method of automatically controlling HDR mode initiation of claim 2, wherein the determining second three-dimensional data of the object under test based on the preset structural light intensity and the preset exposure time comprises:
image acquisition is carried out on the detected object according to the preset structural brightness and the preset exposure time, and a second picture group is determined;
and carrying out downsampling on the second picture group, carrying out three-dimensional reconstruction on the downsampled second picture group, and determining the second three-dimensional data.
5. The method of automatically controlling the activation of an HDR mode of claim 1, wherein the controlling the activation of an HDR mode based on the first object surface area and the second object surface area comprises:
judging whether the difference between the first object surface area and the second object surface area meets a preset condition;
if the preset condition is met, controlling the starting of an HDR mode;
and if the preset condition is not met, not starting the HDR mode.
6. The method of claim 5, wherein the predetermined condition comprises a difference between the first object surface area and the second object surface area being greater than a predetermined ratio.
7. The method of automatically controlling the start of the HDR mode according to claim 1, wherein the plurality of sets of three-dimensional data includes first three-dimensional data and second three-dimensional data, and further comprising, after the step of controlling the start of the HDR mode according to the comparison result of the plurality of sets of three-dimensional data:
increasing the area position of the surface area of the object of the measured object, and respectively finding out a corresponding first image area and a corresponding second image area in the first three-dimensional data and the second three-dimensional data;
calculating a first average brightness and a second average brightness corresponding to the first image area and the second image area respectively;
according to the first average brightness and the second average brightness, camera parameters are adjusted again, image acquisition is carried out on the measured object, and a third image group is determined;
and carrying out three-dimensional reconstruction and fusion according to the second image group and the third image group, and determining a final three-dimensional reconstruction image of the measured object.
8. The method of claim 7, wherein the camera parameters include a structural brightness and an exposure time of a camera, and wherein readjusting the camera parameters based on the first average brightness and the second average brightness, performing image acquisition on the object to be measured, and determining the third group of pictures comprises:
determining readjusted structural brightness and readjusted exposure time according to the first average brightness and the second average brightness;
and acquiring an image of the detected object according to the readjusted structural brightness and the readjusted exposure time, and determining the third image group.
9. An apparatus for automatically controlling the activation of an HDR mode, comprising:
the acquisition unit is used for acquiring preset camera parameters;
the adjusting unit is used for adjusting the camera parameters to shoot the measured object to obtain a plurality of groups of three-dimensional data formed by downsampling the measured object;
the control unit is used for controlling the start of the HDR mode according to the comparison result of the plurality of sets of three-dimensional data, wherein the plurality of sets of three-dimensional data comprise first three-dimensional data and second three-dimensional data, the first object surface area of the object to be measured in a preset depth of field range is determined according to the first three-dimensional data, the second object surface area of the object to be measured in the preset depth of field range is determined according to the second three-dimensional data, and the start of the HDR mode is controlled according to the first object surface area and the second object surface area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210515544.6A CN114915734B (en) | 2022-05-12 | 2022-05-12 | Method and device for automatically controlling starting of HDR mode |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210515544.6A CN114915734B (en) | 2022-05-12 | 2022-05-12 | Method and device for automatically controlling starting of HDR mode |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114915734A CN114915734A (en) | 2022-08-16 |
| CN114915734B true CN114915734B (en) | 2024-03-19 |
Family
ID=82766671
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210515544.6A Active CN114915734B (en) | 2022-05-12 | 2022-05-12 | Method and device for automatically controlling starting of HDR mode |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114915734B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109194946A (en) * | 2018-09-30 | 2019-01-11 | Oppo广东移动通信有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN110097624A (en) * | 2019-05-07 | 2019-08-06 | 洛阳众智软件科技股份有限公司 | Generate the method and device of three-dimensional data LOD simplified model |
| CN112967381A (en) * | 2021-03-05 | 2021-06-15 | 北京百度网讯科技有限公司 | Three-dimensional reconstruction method, apparatus, and medium |
| CN114223015A (en) * | 2019-08-15 | 2022-03-22 | 杜比实验室特许公司 | Efficient user-defined SDR to HDR conversion using model templates |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10630901B2 (en) * | 2017-05-23 | 2020-04-21 | Google Llc | Systems and methods for selectively activating high dynamic range in a video capture system |
-
2022
- 2022-05-12 CN CN202210515544.6A patent/CN114915734B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109194946A (en) * | 2018-09-30 | 2019-01-11 | Oppo广东移动通信有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN110097624A (en) * | 2019-05-07 | 2019-08-06 | 洛阳众智软件科技股份有限公司 | Generate the method and device of three-dimensional data LOD simplified model |
| CN114223015A (en) * | 2019-08-15 | 2022-03-22 | 杜比实验室特许公司 | Efficient user-defined SDR to HDR conversion using model templates |
| CN112967381A (en) * | 2021-03-05 | 2021-06-15 | 北京百度网讯科技有限公司 | Three-dimensional reconstruction method, apparatus, and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114915734A (en) | 2022-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3198852B1 (en) | Image processing apparatus and control method thereof | |
| US7957639B2 (en) | Method and system for determining optimal exposure of structured light based 3D camera | |
| CN103379281B (en) | For carrying out image processing equipment and the image processing method of image synthesis | |
| JP4985651B2 (en) | Light source control device, light source control method, and light source control program | |
| JP2018503066A (en) | Accuracy measurement of image-based depth detection system | |
| KR20180018736A (en) | Method for acquiring photographing device and depth information | |
| US10078907B2 (en) | Distance measurement apparatus, distance measurement method, and storage medium | |
| US10362235B2 (en) | Processing apparatus, processing system, image pickup apparatus, processing method, and storage medium | |
| JP2012083233A (en) | Three-dimensional shape measurement apparatus, three-dimensional shape measurement method and computer program | |
| CN114915734B (en) | Method and device for automatically controlling starting of HDR mode | |
| CN109427089B (en) | Mixed reality object presentation based on ambient lighting conditions | |
| JP6425406B2 (en) | INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM | |
| CN111105365B (en) | Color correction method, medium, terminal and device for texture image | |
| JP2009236696A (en) | Three-dimensional image measurement method, measurement system, and measurement program for subject | |
| JP2004117235A (en) | 3-dimensional form measuring method and 3-dimensional form measuring apparatus | |
| CN106101542B (en) | A kind of image processing method and terminal | |
| Koc et al. | Estimation of environmental lighting from known geometries for mobile augmented reality | |
| JP7213686B2 (en) | Shape measuring device, control method and program | |
| KR20110074442A (en) | Image processing apparatus, image processing method and recording medium | |
| US11997396B2 (en) | Processing apparatus, processing system, image pickup apparatus, processing method, and memory medium | |
| CN114500870B (en) | Image processing method and device and electronic equipment | |
| JP2021004762A (en) | Measurement device, imaging device, measurement system, control method, program and recording medium | |
| US20200320725A1 (en) | Light projection systems | |
| CN113572974B (en) | Image processing method and device and electronic equipment | |
| JP2019129469A (en) | Image processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |