WO2022213340A1 - Procédé de mise au point, dispositif photographique, système photographique et support d'enregistrement lisible - Google Patents

Procédé de mise au point, dispositif photographique, système photographique et support d'enregistrement lisible Download PDF

Info

Publication number
WO2022213340A1
WO2022213340A1 PCT/CN2021/086073 CN2021086073W WO2022213340A1 WO 2022213340 A1 WO2022213340 A1 WO 2022213340A1 CN 2021086073 W CN2021086073 W CN 2021086073W WO 2022213340 A1 WO2022213340 A1 WO 2022213340A1
Authority
WO
WIPO (PCT)
Prior art keywords
lens position
photographing device
target
photographing
shooting
Prior art date
Application number
PCT/CN2021/086073
Other languages
English (en)
Chinese (zh)
Inventor
滕文猛
胡涛
朱张豪
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2021/086073 priority Critical patent/WO2022213340A1/fr
Priority to CN202180087692.6A priority patent/CN116686299A/zh
Publication of WO2022213340A1 publication Critical patent/WO2022213340A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules

Definitions

  • the present application generally relates to the field of manual focusing, and more particularly, to a focusing method, a photographing device, a photographing system, and a readable storage medium.
  • Manual focusing is a commonly used focusing method in the field of film machines (video machines).
  • the follow focus operator controls the focus motor by rotating the follow focus wheel.
  • the movement of the focus motor will change the focus of the picture.
  • the current manual focus relies more on the experience of the follow focus engineer to control the position and speed of the follow focus.
  • a first aspect of the embodiments of the present application provides a focusing method, and the method includes:
  • the current lens position of the shooting device and the target lens position of the shooting device are acquired in real time, wherein when the shooting device is at the target lens position, the shooting target is in the shooting device is in focus in the shooting screen;
  • the current lens position and the focus prompt information are displayed through the display device, so as to prompt the user to focus on the shooting device according to the current lens position and the focus prompt information, and the current lens position is adjusted to the desired position by the user's operation.
  • a second aspect of the embodiments of the present application provides a focusing method, and the method includes:
  • a first lens position and a second lens position for enabling the shooting target to be in focus in the shooting picture of the shooting device, wherein the first lens position is determined based on the first focusing method, and the second lens position is determined based on the first focusing method.
  • the position is determined based on a second focusing method, and the first focusing method is different from the second focusing method;
  • a target lens position is determined according to the first lens position and the second lens position, so that the photographing device can be adjusted from the current lens position to the target lens position.
  • a third aspect of the embodiments of the present application provides a photographing device, where the photographing device includes:
  • At least one processor and a memory stores computer-executed instructions, and the at least one processor executes the computer-executed instructions stored in the memory, so that the following steps are implemented when the computer-executed instructions are executed: during the focusing process of the photographing device , obtain the current lens position of the shooting device and the target lens position of the shooting device in real time, wherein, when the shooting device is at the target lens position, the shooting target is in focus in the shooting screen of the shooting device state;
  • the current lens position and the focus prompt information are displayed through the display device, so as to prompt the user to focus on the shooting device according to the current lens position and the focus prompt information, and the current lens position is adjusted to the desired position by the user's operation.
  • a fourth aspect of the embodiments of the present application provides a photographing device, and the photographing device includes:
  • At least one processor and a memory stores computer-executed instructions, and the at least one processor executes the computer-executed instructions stored in the memory, so that the following steps are implemented when executing the computer-executed instructions:
  • a first lens position and a second lens position for enabling the shooting target to be in focus in the shooting picture of the shooting device, wherein the first lens position is determined based on the first focusing method, and the second lens position is determined based on the first focusing method.
  • the position is determined based on a second focusing method, and the first focusing method is different from the second focusing method;
  • a target lens position is determined according to the first lens position and the second lens position, so that the photographing device can be adjusted from the current lens position to the target lens position.
  • a fifth aspect of the embodiments of the present application provides a shooting system, including: a pan/tilt and the shooting device described in the third aspect; the pan/tilt is used to carry the shooting device.
  • a sixth aspect of an embodiment of the present application provides a shooting system, including: a pan/tilt and the shooting device described in the fourth aspect; the pan/tilt is used to carry the shooting device.
  • a seventh aspect of the embodiments of the present application provides a readable storage medium, where a computer program is stored on the readable storage medium; when the computer program is executed, the focusing method as described above is implemented.
  • the present application provides a focusing method, a photographing device, and a readable storage medium for the photographing system.
  • the display device will display the current lens position and focusing prompt information, and the user can focus the shooting device according to the current lens position and the focusing prompt information, so that the current lens position can be displayed by the user
  • the operation is adjusted to the target lens position, so that the shooting target is in focus in the shooting picture of the shooting device; and the focus prompt information includes an estimated lens position range formed based on the target lens position.
  • the method described in the present application provides focusing prompt information, and manual focusing can be performed more accurately through the focusing prompt information, without the need for the user to rely on the output image of the image sensor to judge and focus, thereby avoiding focusing caused by poor performance of the image sensor. Bad question.
  • FIG. 1 shows a schematic structural diagram of a photographing system provided by an embodiment of the present application
  • FIG. 2 shows a schematic diagram of a focusing process in a second focusing method provided by an embodiment of the present application
  • FIG. 3 shows a schematic diagram of a current lens position and an estimated lens position range displayed in a display device provided by an embodiment of the present application
  • FIG. 4 shows a schematic diagram of a display device provided in an embodiment of the present application in a focus state
  • FIG. 5 shows a schematic flowchart of a focusing method in an embodiment of the present application
  • FIG. 6 shows a schematic flowchart of a focusing method in another embodiment of the present application.
  • FIG. 7 shows a schematic structural diagram of a photographing device in another embodiment of the present application.
  • a first aspect of the present application provides a focusing method, as shown in FIG. 5 , the method includes:
  • Step 110 During the focusing process of the photographing device, acquire the current lens position of the photographing device and the target lens position of the photographing device in real time, wherein when the photographing device is at the target lens position, the photographing target is at the target lens position.
  • the shooting picture of the shooting equipment is in focus state;
  • Step 120 Display the current lens position and focus prompt information through a display device, so as to prompt the user to focus on the shooting device according to the current lens position and the focus prompt information, and make the current lens position manipulated by the user Adjusting to the target lens position, wherein the focus prompt information includes an estimated lens position range formed based on the target lens position.
  • the photographing device can operate independently as the execution subject, and can also be set on the gimbal, and the gimbal is used as the carrying subject for shooting.
  • the photographing system may include a distance sensor 110 and a photographing device 130 .
  • the distance sensor 110 includes a transmitting device 111, a receiving device 112 and a control device 113, which are used to control the transmitting device 111 to transmit an optical signal through the control device 113, and receive the reflected optical signal through the receiving device 112, so as to collect distance sensing data,
  • the real-time distance between the photographing target and the photographing device 130 is obtained according to the distance sensing data.
  • the receiving device 112 may be a receiving array.
  • the sensing data collected by the distance sensor 110 may include the measured distances M between the distance sensor 110 and the shooting target corresponding to different sampling moments.
  • the real-time distance between the photographing target and the photographing device 130 can be determined according to M and L.
  • the real-time distance between the shooting device 130 and the shooting target is the value M-L obtained by subtracting the distance difference L from the measured distance M .
  • the calculation and processing of the real-time distance may be performed by the distance sensor 110, the photographing device 130 or the pan/tilt head, which is not limited in this embodiment.
  • the photographing system may further include a follow focus motor 120, the follow focus motor 120 is an actuator that drives the rotation of the lens 131 of the photographing device 130, and includes a position controller 121 and a gear, the position controller 121 is used for according to the follow focus motor.
  • the follow focus motor 120 is engaged with the follow focus ring 0 of the lens 131 in the photographing device 130 .
  • the focus wheel 140 may be an independent control device, or may be integrated on the PTZ.
  • the follow focus motor 120 is connected in communication with the gimbal, and is used for receiving a user's control instruction for the follow focus motor 120 .
  • the operating member of the follow focus motor 120 can be provided on the hand-held part of the gimbal, and the operating member is used to receive a user's control command for the follow focus motor and further drive the follow focus motor according to the control command, so as to control the photographing device 130 to focus.
  • the operating member may include, but is not limited to, the focus wheel 140 .
  • the photographing device 130 includes a lens 131 and a camera body 132 , and the lens 131 is provided on the camera body 132 .
  • the photographing device 130 can photograph the photographing target to obtain an image.
  • the camera body 132 may be a camera body of a handheld single-lens reflex camera or a mirrorless camera.
  • the lens 131 in this embodiment can support manual focus.
  • the photographing system may further include a pan/tilt head.
  • the photographing device 130 and the follow focus motor 120 are carried on the gimbal.
  • the follow focus motor 120 and the bottom of the camera body 132 can be fixedly connected by using the accessories of the gimbal. After the lens 131 is mounted on the camera body 132 through the bayonet, the follow focus motor 120 can drive the lens 131 to rotate through the follow focus ring.
  • the photographing system may further include a follow focus wheel 140 , and the follow focus wheel 140 can push the current rotational position and rotational speed data of the follow focus wheel 140 to the follow focus motor 120 , so that the follow focus motor 120 rotates to the same level as the follow focus wheel 140 . the corresponding specified location.
  • parameters can be calibrated, for example, the follow focus motor 120 can be driven by the follow focus wheel 140 to reach at least two focus calibration points, so as to complete the mapping between the real-time distance between the shooting device 130 and the shooting target and the rotation position of the follow focus motor 120 Calibration of the relationship.
  • the display device 150 is used to display the current lens position and focus prompt information, so as to prompt the user how to focus.
  • the display device 150 may be provided in the photographing device 130, for example, an interactive interface inherent in the photographing device 130 for displaying various information, and the focus prompt information is directly displayed to the user through the interactive interface during the photographing process.
  • the display device may be provided outside the photographing device 130, independent of the photographing device 130, but connected in communication with the photographing device 130, and transmits the focus prompt information determined by the photographing device 130 to the display device by means of the communication connection and Display a focus prompt message to the user.
  • the display device 150 may also be disposed on the pan/tilt, such as a handheld part integrated in the pan/tilt.
  • the display device 150 is detachably arranged on the mounting seat of the pan/tilt (eg, connected to the handle), and the display device 150 is connected to the pan/tilt in communication, and the photographing device 130 is communicatively connected to the pan/tilt, and the photographing device 130 acquires the focus prompt information and transmits it After reaching the PTZ, the PTZ then transmits the focusing prompt information to the display device 150 and displays it to the user through the display device 150 for focusing.
  • the display device 150 is not limited to the listed installation positions, and the display device 150 may also be installed at other positions of the pan/tilt.
  • the photographing device 130 in addition to manual focusing, can also focus automatically. Based on this, the user can also select a mode by inputting a selection instruction on the display device 150 and switch the auto follow focus mode to the manual follow focus mode, thereby realizing flexible switching between the manual follow focus mode and the automatic follow focus mode.
  • the focus can be achieved by using the follow focus wheel 140 to control the position of the follow focus motor 120, or by directly manually rotating the position of the lens to focus.
  • the follow focus motor 120 can obtain a user's control instruction for the follow focus motor 120; and drive the follow focus motor 120 according to the control instruction, output torque, and drive and follow focus through gear transmission
  • the lens that engages the camera's motor is focused so that the subject is in focus in the shooting device's frame.
  • the photographing system may also not include the follow focus motor 120, but manually move the lens, so that the current lens position is manually adjusted to the target lens position by the user, thereby achieving focusing .
  • the photographing device 130 may not be installed on the pan/tilt, and the focusing method of the present application may be implemented independently by the photographing device 130, wherein the composition and operation method of the photographing device 130 described above are not carried on the pan/tilt and do not mutually Under the premise of contradiction, all relevant explanations and descriptions may be introduced into the photographing device 130 , which will not be repeated here.
  • the execution subject of the focusing method may be a processing device with independent computing capabilities, such as the follow focus motor 120, the distance sensor 110, the photographing device 130 or the pan/tilt in the embodiment shown in FIG. 1 .
  • the method can also be performed by one device to perform some steps, and another device to perform other steps, that is, it can be performed by any combination of the follow focus motor 120, the distance sensor 110, the photographing device 130 and the pan/tilt head, for example, to follow focus Taking the combination of the follower motor 120 and the pan/tilt as an example, the follow focus motor 120 may perform some steps, and the pan/tilt may perform the remaining steps, so that the follow focus motor 120 and the pan/tilt jointly perform the focusing method provided in this embodiment.
  • the follow focus motor 120 can be engaged with the follow focus ring of the lens 131 in the photographing device 130, then the follow focus motor 120 can be determined according to the current position of the follow focus motor 120. to determine the current position of the lens of the photographing device 130 .
  • the current position of the follow focus motor 120 can be detected by an angle sensor.
  • the current lens position of the photographing device can also be determined by other methods, for example, it can be calculated according to the current focusing degree, and the focusing degree can be determined according to a specific focusing method.
  • the target lens position of the photographing device 130 refers to the in-focus position of the lens of the photographing device 130 .
  • the focus prompt information is an estimated lens position range including the target lens position
  • the estimated lens position range is a numerical range, not a point value.
  • the estimated lens position range is a numerical range with the target lens position as the median.
  • the method for determining the target lens position and outputting the estimated lens position range formed based on the target lens position includes: obtaining the first lens position and the second lens position respectively through different methods, wherein the photographing device 130 is respectively at the first lens position and the second lens position, the shooting target can be in the in-focus state in the shooting picture of the shooting device 130 .
  • the first lens position is determined based on the first focusing method
  • the second lens position is determined based on the second focusing method
  • the first focusing method is different from the second focusing method.
  • the estimated lens position ranges respectively determined by the first lens position and the second lens position may be the same, may partially overlap or be completely different.
  • the first lens position and the second lens position may have different confidences, that is, the first lens position has the first confidence.
  • the second lens position has a second confidence level.
  • the target lens position may be determined based on the confidence to focus the photographing device 130 .
  • determining the target lens position based on the acquired first lens position and the second lens position specifically includes: comparing the first confidence level and the second confidence degree, and taking the first lens position and the second lens position with a higher confidence degree One is the target lens position.
  • the confidence level may be used to characterize the accuracy of the determined lens position, that is, the first confidence level may be used to characterize the determined accuracy of the first lens position, and the second confidence level may be used to characterize the determined accuracy of the first lens position The accuracy of the second lens position.
  • the confidence level can be negatively correlated with the size of the corresponding estimated lens position range, that is, the higher the confidence level, the smaller the corresponding estimated lens position range, and the lower the confidence level, the corresponding estimated lens position range. bigger. In this way, when the accuracy of the lens position determined based on the corresponding focusing method is low, the problem of jumping in the estimated lens position range can be avoided.
  • the target lens position will also be adjusted (for example, caused by the real-time switching of the focusing method), and the predicted lens position will be adjusted accordingly.
  • the estimated lens position range will also be adjusted, so it is possible to move from the range of B-D to a range such as C-E; and if the estimated lens position range is large, as the current lens position gets closer and closer to the target lens position, when the estimated lens position
  • the lens position range is adjusted with the target lens position, it can change from the range of A-E to the range of C-E, so it seems that the estimated lens position range is only adjusted within the original range, becoming more accurate, not happening. The overall movement of the original range and lead to the phenomenon of jumping.
  • the method further includes comparing the first confidence level and the second confidence level a step of performing a normalization process for comparing the first confidence level and the second confidence level under the same unit measure to determine the confidence level in the first shot position and the second shot position higher one.
  • the target lens position may also be determined according to other methods.
  • a weighting method may be used, that is, the first lens position and the second lens position are respectively provided with corresponding weights, and the weighted result may be used as the target lens position.
  • the respective weights of the first lens position and the second lens position can be dynamically adjusted according to their confidence.
  • the first focusing method includes the use of a distance sensor 110 that can provide multi-point ranging, has a high resolution, and can provide depth map information.
  • the image distance can be calculated when the object distance is known. Knowing the image distance is You can know the current focus state.
  • the photographing target refers to an object to be photographed and imaged, such as a person, an object, a scene, and the like.
  • the camera body generally marks the position of the focal plane, and the real-time distance between the photographing device 130 and the photographing target can be the distance between the focal plane of the camera body of the photographing device 130 and the photographing target, represented by d, so d is equal to the object distance u and the image distance v can be expressed as:
  • the image distance and the object distance satisfy the Gaussian imaging formula:
  • determining the first lens position based on the first focusing method includes: determining the distance d between the shooting target and the shooting device 130 by using the distance sensor 110; calculating the focusing object distance according to the distance d ; Then calculate the target image distance according to the focus object distance according to formulas (2) and (3), and determine the first lens position according to the target image distance.
  • the installation positions of the distance sensor 110 can be various, as long as the real-time distance between the photographing device 130 and the photographing target can be determined according to the sensing data collected by the distance sensor 110:
  • the distance sensor 110 is detachably provided on the photographing device 130 .
  • the distance sensor 110 may be disposed on the hot shoe of the photographing device 130.
  • the ranging reference plane of the distance sensor 110 and the focal plane of the lens of the photographing device 130 may be substantially coincident within a certain error range.
  • the distance measuring reference plane of the distance sensor 110 can also be installed at a fixed distance from the focal plane of the lens of the photographing device 130, as long as the fixed distance is taken into account in subsequent calculations.
  • the photographing device The real-time distance between 130 and the shooting target is the value M-L obtained by subtracting L from the measured distance M of the distance sensor 110 . This embodiment does not limit this.
  • the photographing device 130 is detachably carried on the bearing seat of the gimbal
  • the distance sensor 110 is detachably carried on the bearing seat of the gimbal.
  • both the photographing device 130 and the distance sensor 110 are carried by the pan/tilt.
  • the balance adjustment function of the pan/tilt can be used to ensure the balance of the photographing device 130, and on the other hand, the photographing device 130 and the distance sensor 110 can be ensured.
  • the distance sensor 110 can be set relatively fixedly, so as to realize the accurate calculation of the real-time distance between the above-mentioned photographing device 130 and the photographing target.
  • the shooting target in this embodiment may be selected by the user.
  • the specific selection method is that the photographing device 130 is detachably carried on the bearing seat of the gimbal, the gimbal is communicatively connected to the photographing device 130, the display device 150 is provided on the hand-held part of the gimbal, and the photographing target is Determined by detecting a user's selection operation on the display device 150 displaying the captured image of the capturing device 130 .
  • the distance sensor 110 includes a transmitting device for transmitting optical signals and a receiving device for receiving optical signals reflected by the photographing target.
  • the distance between the photographing device 130 and the photographing target is obtained according to the sensing data collected by the distance sensor 110 .
  • the real-time distance includes: determining the distance between the shooting target and the shooting device 130 according to the light signal received by the receiving device.
  • the distance sensor 110 may further include a transmitting device for emitting optical signals and a receiving device for receiving optical signals emitted by the photographing target.
  • the photographing device 130 and the photographing target are acquired according to the sensing data collected by the distance sensor 110 .
  • the real-time distance between them includes: determining the distance between the photographing target and the photographing device 130 according to the acoustic signal received by the receiving device.
  • the distance sensor 110 can be a single-point ranging sensor or a 3D ranging sensor, and the distance sensor 110 can be a TOF (Time Of Flight, time-of-flight) ranging sensor. This embodiment does not limit this.
  • the focus or follow focus of the lens generally keeps the position of the shooting target and the position of the focal plane of the camera body of the shooting device 130 unchanged.
  • the thread converts the rotation angle of rotation into the forward and backward translation distance of the lens group of the lens, which is equivalent to driving the lens manually or with the follow focus motor 120 under the condition that the real-time distance between the shooting device 130 and the shooting target remains unchanged. Rotate to adjust the object distance u and image distance v so that the shooting screen is in focus.
  • the effect will not be affected in low light or low contrast environments.
  • CMOS with phase sensor or CMOS with phase ranging more pixels, better focusing performance, but the image quality will be worse
  • so for the image sensor there is no loss of image quality, and it has better performance. high blur.
  • the first confidence level is positively correlated with the signal-to-noise ratio of the collected data of the distance sensor 110, that is, the smaller the distortion caused by the noise of the distance sensor 110, the greater the reflected light intensity of the distance sensor 110, and the higher the signal-to-noise ratio of the distance sensor 110.
  • the higher the first confidence level the higher the first confidence level.
  • the second focusing method is an ambiguity-based focusing method, and the method uses a point spread function (PSF) to focus, and the point spread function (PSF) is a function describing the ability of an optical system to resolve a point source. Because the point source will form an enlarged image point due to diffraction after passing through any optical system, the image information can be extracted more accurately by measuring the point spread function of the system.
  • PSF point spread function
  • the blur-based focusing method is to calculate the focusing curve according to different images captured at different focusing positions and their respective blur degrees (for example, represented by PSF), and then obtain the focusing positions.
  • PSF1 is equal to PSF1(d)
  • PSF2 is equal to PSF2(d)
  • picture1 convolving PSF2(d) is equal to picture2 convolving PSF1(d).
  • Picture0 is the ideal picture in the in-focus state
  • Picture1 is the image captured at the first position
  • PSF1 is the first blur of the lens when the target is captured at the first position
  • Picture2 is captured at the second position
  • PSF2 is the second blur degree of the lens when shooting the target at the second position
  • PSF1 (d) and PSF2 (d) are the blur degrees calibrated to the lens of the shooting device 130 on the focusing stroke, that is, the PSF database ambiguity in .
  • the shooting position of the shooting device 130 is calibrated on the focusing stroke, and different shooting positions correspond to different image blur degrees. Therefore, when focusing, the shooting device 130 can be controlled to shoot the shooting target at the first position and the second position respectively, and the first position is different from the second position; and the first position of the lens when shooting the shooting target at the first position can be obtained. a blur degree, and the second blur degree of the lens when the shooting target is photographed at the second position; then, the second lens position is determined according to the acquired first blur degree and the second blur degree.
  • determining the second lens position according to the first blurriness degree and the second blurriness degree includes: determining a curve for focusing according to the first blurriness degree and the second blurriness degree; then determining the second lens position according to the curve lens position. Among them, the position corresponding to the vertex in the curve is the target lens position.
  • the first ambiguity and the second ambiguity can be obtained by using the content corresponding to the above formula, and the method for determining the curve used for focusing according to the ambiguity can refer to the prior art, which will not be repeated here.
  • the target lens position in addition to determining the target lens position through the curve, the target lens position can also be obtained by obtaining a focusing data table and looking up the table, and the above focusing method is only exemplary.
  • the second focusing method has a second confidence level, and the second confidence level is positively correlated with the curvature of the curve, that is, the larger the curvature of the focusing curve, the smaller the opening degree, the higher the second confidence level, on the contrary, the smaller the curvature of the focusing curve is. , the greater the degree of opening, the lower the second confidence.
  • the focus prompt information includes, but is not limited to, at least one of a moving direction and a moving distance of the lens of the photographing device 130 .
  • the display device 150 can display the current position of the photographing device 130 and the estimated lens position range, and the display device 150 can display the specific numerical value of the current position of the photographing device 130 and estimate the specific numerical value of the lens position range, so that The user can determine the direction and distance that the photographing device 130 needs to move according to the specific numerical value of the current position of the photographing device 130 and the specific numerical value of the estimated lens position range and the positional relationship between the two.
  • the display device 150 displays that the photographing device 130 is currently located at a position of 0.3, and the estimated value of the lens position range is 0.4-0.7. Through the positional relationship between the two It can be known how the lens of the photographing device 130 needs to be adjusted so as to enter the estimated lens position range. In addition, for further prompting, the direction of movement may also be marked in the display device 150 .
  • the display mark corresponding to the current lens position can be changed to remind the user that the current lens position has reached the target lens position, and the rotation of the lens can be stopped.
  • the current lens position, the estimated lens position range, the moving direction and other related information may have their own display marks, and different display marks may have corresponding display methods such as color, shape, dynamic and static changes.
  • the display device may display a position adjustment progress bar, and distance data may be displayed above the position adjustment progress bar, and the distance data may be used to represent the current lens position and the estimated lens position;
  • the identification of the lens position and the identification of the estimated lens position range can be close to or far away from the identification of the estimated lens position range.
  • the color of the identification of the current lens position and the identification of the estimated lens position range And the size can be different; at the same time, a sign of the moving direction is provided on one side of the sign of the current lens position, and the sign of the moving direction is used to indicate the moving direction of the current lens position, so as to be close to the estimated lens position range, and is consistent with the moving direction.
  • the target lens positions are coincident. In this way, the user can better realize manual focusing by pressing the operation through the above-mentioned display.
  • the change of the display logo includes at least one of color change, shape change, and size change.
  • the color change may further include the change of the color or the dynamic flickering of the display mark, etc., and is not limited to a certain one.
  • the identification of the estimated lens position range corresponding to the target lens position continues to converge during the focusing process.
  • the current lens position and the target lens position The positions overlap and can be treated differently with bright green.
  • the lens positions of two adjacent frames are sampled, and the in-focus position range is displayed according to the result of the current frame (the estimated lens position range calculated with the target lens position as the center, the estimated lens position range is determined by the second confidence
  • the current lens position and the estimated lens position range are updated every frame.
  • the indicator corresponding to the estimated lens position range will also continue to converge during the focusing process.
  • the current lens position and the target lens position coincide, which can be treated differently by bright green.
  • the focusing method includes a first focusing method and a second focusing method, and the two focusing methods have their own advantages.
  • This application combines the advantages of the two focusing methods to further improve the accuracy of focusing.
  • the first focusing method of the distance sensor 110 determines that the position of the first lens has sufficient resolution and accuracy, and can satisfy ranging within a certain distance. Therefore, within the specifications of the first focusing method, manual focusing assistance can be satisfied. In cases outside the specifications of the first focusing method, a second focusing method is required to estimate the in-focus position and improve the effect of manual focus assistance.
  • the maximum ranging range in the first focusing method will not exceed 10 meters, but some lenses need to meet the manual focus assistance of more than 10 meters; the general first focusing method determines the position of the first lens with an accuracy of about 5%, but some lenses When the lens is at a relatively close distance, the accuracy requirements are very high, maybe around 1%. Therefore, when the first focusing method cannot satisfy the in-focus estimation, the second focusing method can be used to estimate the in-focus position.
  • the accuracy of the second focusing method in determining the position of the second lens is [-1F ⁇ , 1F ⁇ ], and in a low-contrast scene, the accuracy of determining the position of the second lens by the second focusing method is [-2F ⁇ , 2F ⁇ ], wherein the F ⁇ is the size of the diffused spot, which can meet the requirements of manual focus assistance.
  • the accuracy of determining the position of the second lens by the second focusing method will decrease accordingly. In this case, focusing can be performed by the first focusing method.
  • a high-contrast scene means that the subject and the ambient background have a large contrast and/or have good lighting conditions, for example, the shooting background is black, and the shooting target is white, and/or has good lighting, which is high contrast.
  • the color of the subject and the environment background are similar, and the lighting conditions are poor, it is a low-contrast scene.
  • the relationship between the accuracy of determining the position of the first lens by the first focusing method and the accuracy of determining the position of the second lens by the second focusing method and the application scene can be finally reflected in the confidence described above. Therefore, The target lens position selected based on the confidence can be better used for focusing in different dynamic and static, different contrast, and different distance application scenarios.
  • the present application combines the respective advantages of the second focusing method and the first focusing method to assist manual focusing and improve its accuracy.
  • the target lens position is included in the estimated lens position range.
  • the target lens position is the midpoint position of the estimated lens position range.
  • the first focusing method cannot meet the accuracy requirements, and the second focusing method is required to estimate the in-focus position.
  • the accuracy requirements are different in different contrast scenarios, and different accuracy requirements will cause the estimated lens position range to be different. Meet the requirements of manual focus and improve the focus accuracy.
  • the display device 150 will display the current lens position and focusing prompt information.
  • the focusing prompt information includes an estimated lens position range formed based on the target lens position.
  • the user can focus the shooting device 130 according to the current lens position and the focusing prompt information. , so that the current lens position is adjusted to the target lens position through a user operation, so that the shooting target is in the in-focus state in the shooting screen of the shooting device 130 .
  • the method of the present application provides focusing prompt information, and manual focusing can be performed more accurately through the focusing prompt information, and the scope of application is wider.
  • a second aspect of the embodiments of the present application provides a focusing method, as shown in FIG. 6 , the method includes:
  • Step S210 Acquire a first lens position and a second lens position for enabling the shooting target to be in focus in the shooting screen of the shooting device, wherein the first lens position is determined based on the first focusing method, and the first lens position is determined based on the first focusing method.
  • the second lens position is determined based on a second focusing method, and the first focusing method is different from the second focusing method;
  • Step S220 Determine a target lens position according to the first lens position and the second lens position, so that the photographing device can be adjusted from the current lens position to the target lens position.
  • the focusing method may be either automatic focusing or manual focusing, which is not limited herein.
  • a follow focus motor is coupled to the lens of the photographing device, and the follow focus motor is used to drive the lens of the photographing device to rotate, so that the photographing device can be adjusted from the current lens position to The target lens position.
  • the photographing device and the follow focus motor are carried on the gimbal.
  • the photographing device is connected to the PTZ in communication, wherein: the display device is arranged on the hand-held part of the PTZ; or
  • the display device is detachably arranged on the mounting seat of the PTZ, and the display device is connected in communication with the PTZ.
  • the follow focus motor is connected in communication with the pan/tilt, and the operating element of the follow focus motor is provided on the hand-held part of the pan/tilt, and the operating element is used for receiving user control instructions for the follow focus motor.
  • the current lens position and the target lens position are displayed through the display device.
  • the photographing device may not be installed on the pan/tilt, and the photographing device independently acts as an execution subject for focusing and photographing.
  • the specific structure of the photographing device, the execution body, and the setting method of the display device can all be referred to the explanations and descriptions related to the first aspect of the present application, and will not be repeated here.
  • the method further includes: normalizing the first confidence level and the second confidence level, so as to be used for comparing the first confidence level and the second confidence level.
  • determining the first lens position based on the first focusing method includes:
  • the target image distance is calculated according to the focused object distance, and the position of the first lens is determined according to the target image distance.
  • the signal-to-noise ratio of the collected data of the distance sensor is positively correlated with the first confidence level.
  • determining the first lens position based on the first focusing method includes:
  • the second lens position is determined based on the first blurriness and the second blurriness.
  • determining the second lens position according to the first ambiguity and the second ambiguity includes:
  • the second lens position is determined according to the curve.
  • the second confidence level is positively related to the curvature of the curve.
  • the size of the estimated lens position range is negatively correlated with the first confidence level or the second confidence level.
  • the target lens position is the midpoint position of the estimated lens position range.
  • the focus prompt information further includes the moving direction and/or the moving distance of the lens of the photographing device.
  • the moving distance is characterized by a set distance between the photographing target and the photographing device.
  • the display identifier corresponding to the current lens position changes.
  • the change includes at least one of color change, shape change, and size change.
  • both the first focusing method and the second focusing method may refer to the relevant descriptions and explanations in the first aspect of the present application, which will not be repeated here.
  • the present application combines the respective advantages of the second focusing method and the first focusing method to assist manual focusing and improve its accuracy.
  • the method can perform manual focusing more accurately, does not depend on the image sensor, and is applicable to a wider range.
  • a third aspect of the embodiments of the present application provides a photographing device, which is used to respectively execute the focusing methods provided in the first aspect and the second aspect.
  • the photographing device 700 in this embodiment may include: at least one processor 701 and a memory 702 .
  • the processor 701 and the memory 702 are connected through a bus 703 .
  • the memory 702 stores computer-executed instructions
  • at least one processor 701 executes the computer-executed instructions stored in the memory 702, so that the following steps are implemented when executing the computer-executed instructions:
  • the current lens position of the shooting device and the target lens position of the shooting device are acquired in real time, wherein, when the shooting device is at the target lens position, the shooting target is in the in-focus state in the shooting screen of the shooting device;
  • the current lens position and focus prompt information are displayed on the display device to prompt the user to focus on the shooting device according to the current lens position and focus prompt information, and the current lens position is adjusted to the target lens position through user operation, wherein the focus prompt information includes The estimated lens position range formed by the target lens position.
  • the photographing device includes:
  • At least one processor and a memory stores computer-executed instructions, and at least one processor executes the computer-executed instructions stored in the memory, so that the following steps are implemented when executing the computer-executed instructions:
  • a first lens position and a second lens position for enabling the shooting target to be in focus in the shooting picture of the shooting device, wherein the first lens position is determined based on the first focusing method, and the second lens position is determined based on the first focusing method.
  • the position is determined based on a second focusing method, and the first focusing method is different from the second focusing method;
  • a target lens position is determined according to the first lens position and the second lens position, so that the photographing device can be adjusted from the current lens position to the target lens position.
  • a fourth aspect of the present application provides a shooting system, comprising: a pan/tilt and the shooting device described in the third aspect; the pan/tilt is used to carry the shooting device.
  • pan/tilt in this embodiment can be used to implement the technical solutions of the above method embodiments of the present application, and the implementation principles and technical effects thereof are similar, and will not be repeated here.
  • a fifth aspect of the present application also provides a computer storage medium on which a computer program is stored.
  • One or more computer program instructions may be stored on the computer-readable storage medium, and the computer program contains at least one piece of code, and at least one piece of code can be executed by the computer to control the computer to perform the aforementioned focusing method.
  • Embodiments of the present application further provide a computer storage medium, where program instructions are stored in the computer storage medium, and when the program is executed, some or all of the steps of the focusing method of the first aspect or the second aspect may be included.
  • the above-mentioned readable storage medium may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.
  • SRAM Static Random Access Memory
  • EEPROM Electrically Erasable Programmable Read-Only Memory
  • EPROM Erasable Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Magnetic or Optical Disk Magnetic Disk
  • An exemplary readable storage medium is coupled to the processor such that the processor can read information from, and write information to, the readable storage medium.
  • the readable storage medium can also be an integral part of the processor.
  • the processor and the readable storage medium may be located in an application specific integrated circuit (Application Specific Integrated Circuits, ASIC for short).
  • ASIC Application Specific Integrated Circuits
  • the processor and the readable storage medium may also exist in the device as discrete components.
  • the functions in the embodiments of the present application (implemented by the processor) and/or other desired functions can be realized, for example, to execute the corresponding steps of the focusing method according to the embodiments of the present application, and stored in a computer-readable storage
  • Various application programs and various data such as various data used and/or generated by the application program, can also be stored in the medium.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented.
  • Various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof.
  • a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some modules according to the embodiments of the present application.
  • DSP digital signal processor
  • the present application can also be implemented as a program of apparatus (eg, computer programs and computer program products) for performing part or all of the methods described herein.
  • Such a program implementing the present application may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Lens Barrels (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un procédé de mise au point, un dispositif photographique, un système photographique et un support d'enregistrement lisible. Le procédé comprend les étapes consistant à : pendant un processus de mise au point d'un dispositif photographique, acquérir, en temps réel, la position actuelle de l'objectif du dispositif photographique et une position cible d'objectif du dispositif photographique, et lorsque le dispositif photographique se trouve à la position cible de l'objectif, une cible de photographie se trouve dans un état mis au point dans une image de photographie du dispositif photographique ; et afficher la position actuelle de l'objectif et mettre au point des informations d'invite au moyen d'un appareil d'affichage, de façon à inviter un utilisateur à mettre au point le dispositif photographique conformément à la position actuelle de l'objectif et aux informations d'invite de mise au point, et permettre le réglage de la position actuelle de l'objectif sur la position cible de l'objectif au moyen d'une mise en œuvre par l'utilisateur, les informations d'invite de mise au point comprenant une plage de positions d'objectif estimée, formée sur la base de la position cible de l'objectif. Au moyen de ce procédé, des informations d'invite de mise au point sont fournies, et au moyen des informations d'invite de mise au point, une mise au point manuelle peut être effectuée de manière plus précise sans recours à un capteur d'image ; et le procédé comprend une plage d'application plus étendue.
PCT/CN2021/086073 2021-04-09 2021-04-09 Procédé de mise au point, dispositif photographique, système photographique et support d'enregistrement lisible WO2022213340A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2021/086073 WO2022213340A1 (fr) 2021-04-09 2021-04-09 Procédé de mise au point, dispositif photographique, système photographique et support d'enregistrement lisible
CN202180087692.6A CN116686299A (zh) 2021-04-09 2021-04-09 对焦方法、拍摄设备、拍摄系统以及可读存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/086073 WO2022213340A1 (fr) 2021-04-09 2021-04-09 Procédé de mise au point, dispositif photographique, système photographique et support d'enregistrement lisible

Publications (1)

Publication Number Publication Date
WO2022213340A1 true WO2022213340A1 (fr) 2022-10-13

Family

ID=83544995

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/086073 WO2022213340A1 (fr) 2021-04-09 2021-04-09 Procédé de mise au point, dispositif photographique, système photographique et support d'enregistrement lisible

Country Status (2)

Country Link
CN (1) CN116686299A (fr)
WO (1) WO2022213340A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101126833A (zh) * 2006-08-16 2008-02-20 佳能株式会社 自动聚焦设备和摄像设备
CN103929586A (zh) * 2013-01-14 2014-07-16 三星电子株式会社 对焦辅助系统
CN108513709A (zh) * 2017-08-25 2018-09-07 深圳市大疆创新科技有限公司 手动对焦辅助方法、装置以及无人飞行器
CN111052725A (zh) * 2018-04-26 2020-04-21 深圳市大疆创新科技有限公司 控制装置、摄像装置、控制方法以及程序
WO2021013143A1 (fr) * 2019-07-23 2021-01-28 深圳市大疆创新科技有限公司 Appareil, appareil photographique, corps mobile, procédé et programme

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101126833A (zh) * 2006-08-16 2008-02-20 佳能株式会社 自动聚焦设备和摄像设备
CN103929586A (zh) * 2013-01-14 2014-07-16 三星电子株式会社 对焦辅助系统
CN108513709A (zh) * 2017-08-25 2018-09-07 深圳市大疆创新科技有限公司 手动对焦辅助方法、装置以及无人飞行器
CN111052725A (zh) * 2018-04-26 2020-04-21 深圳市大疆创新科技有限公司 控制装置、摄像装置、控制方法以及程序
WO2021013143A1 (fr) * 2019-07-23 2021-01-28 深圳市大疆创新科技有限公司 Appareil, appareil photographique, corps mobile, procédé et programme

Also Published As

Publication number Publication date
CN116686299A (zh) 2023-09-01

Similar Documents

Publication Publication Date Title
JP7145208B2 (ja) デュアルカメラベースの撮像のための方法および装置ならびに記憶媒体
CN109451244B (zh) 一种基于液体镜头的自动调焦方法及系统
US8335393B2 (en) Image processing apparatus and image processing method
JP6512810B2 (ja) 撮像装置および制御方法とプログラム
JP3937678B2 (ja) 電子スチルカメラ
JP2003131121A (ja) 自動焦点調節装置及び方法
WO2022061519A1 (fr) Procédé et appareil de commande de photographie, cardan et moteur de suivi de mise au point
JP6377295B2 (ja) 距離計測装置及び距離計測方法
KR20200041371A (ko) 더블 카메라 기반 이미징 방법 및 장치
JP2002325199A (ja) 電子撮像装置
JP2002296494A (ja) 結像位置検出プログラムおよびカメラ
KR100958352B1 (ko) 감시카메라 시스템을 통한 감시 방법
JP2001141982A (ja) 電子カメラの自動焦点調節装置
WO2022213340A1 (fr) Procédé de mise au point, dispositif photographique, système photographique et support d'enregistrement lisible
WO2022213339A1 (fr) Procédé de mise au point, dispositif de photographie, système de photographie et support de stockage lisible
JP6834988B2 (ja) 制御装置
JP2001141984A (ja) 電子カメラの自動焦点調節装置
US10943328B2 (en) Image capturing apparatus, method for controlling same, and storage medium
JP2006319901A (ja) 電子カメラおよび画像処理プログラム
JP2001141983A (ja) 電子カメラの自動焦点調節装置
WO2024203228A1 (fr) Dispositif et procédé de commande de mise au point, dispositif d'imagerie, programme, et support d'enregistrement
JP2016142853A (ja) 撮像装置の制御装置
JP2020046615A (ja) 制御装置、撮像装置、制御方法、プログラム、および、記憶媒体
WO2023029046A1 (fr) Dispositif photographique et procédé de mise au point associé, et système photographique et support de stockage lisible
JP6627116B1 (ja) 制御装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21935569

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202180087692.6

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21935569

Country of ref document: EP

Kind code of ref document: A1