CN112673621A - Automatic focusing method, device, holder, equipment and storage medium - Google Patents

Automatic focusing method, device, holder, equipment and storage medium Download PDF

Info

Publication number
CN112673621A
CN112673621A CN202080004992.9A CN202080004992A CN112673621A CN 112673621 A CN112673621 A CN 112673621A CN 202080004992 A CN202080004992 A CN 202080004992A CN 112673621 A CN112673621 A CN 112673621A
Authority
CN
China
Prior art keywords
target object
lens
focusing
user
visual field
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080004992.9A
Other languages
Chinese (zh)
Inventor
封旭阳
张李亮
胡晓翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Publication of CN112673621A publication Critical patent/CN112673621A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16MFRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
    • F16M11/00Stands or trestles as supports for apparatus or articles placed thereon Stands for scientific apparatus such as gravitational force meters
    • F16M11/02Heads
    • F16M11/04Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules

Abstract

The embodiment of the application provides an automatic focusing method, an automatic focusing device, automatic focusing equipment and a storage medium, wherein the method is applied to a shooting device with a first lens and a second lens, and comprises the following steps: acquiring a target object in a first lens visual field area; registering the target object; presenting the registered target object; and in response to the operation of the user on the target object, executing the focusing operation of the second lens on the target object. According to the scheme, the first lens is used for completing the registration of the target object, so that the second lens can quickly and accurately complete focusing operation from the current lens view field area according to the target object which is registered in advance; in the process of continuous multi-target object shooting, the efficiency of the second lens for continuously switching and focusing the multi-target object in the current visual field area can be improved.

Description

Automatic focusing method, device, holder, equipment and storage medium
Technical Field
The present invention relates to the field of control, and in particular, to an auto-focusing method, an auto-focusing apparatus, a pan/tilt head, a device, and a storage medium.
Background
The camera generally has an automatic focusing function, and a user can see clear images through the automatic focusing function.
The current focusing schemes focus on a specific target object, and in the focusing process, a user needs to manually mark a focusing area in a currently shot image, wherein the focusing area is an image area containing the target object. When the image contains a plurality of objects needing focusing, the focusing method is inconvenient to operate and low in focusing efficiency.
Disclosure of Invention
The invention provides an automatic focusing method, an automatic focusing device, a holder, equipment and a storage medium, which are used for solving the problems of low focusing process efficiency and unsmooth target object switching process in the image shooting process in the prior art.
A first aspect of the present invention is to provide an auto-focusing method, including:
acquiring a target object in a first lens visual field area;
registering the target object;
presenting the registered target object;
and responding to the operation of the user on the target object, and executing the focusing operation of the second lens on the target object.
A second aspect of the present invention is to provide an automatic focusing apparatus, the control device including:
a memory for storing a computer program;
a processor for acquiring a target object in a first lens field of view region;
registering the target object;
presenting the registered target object;
and responding to the operation of the user on the target object, and executing the focusing operation of the second lens on the target object.
A third aspect of the present invention is directed to a head, comprising at least:
the bracket is used for connecting the shooting device; the shooting device comprises a first lens, a second lens and the shooting device and is used for acquiring a target object in a first lens visual field area;
registering the target object;
presenting the registered target object;
and responding to the operation of the user on the target object, and executing the focusing operation of the second lens on the target object.
A fourth aspect of the present invention is to provide a photographing apparatus comprising:
a body;
the power system is arranged on the machine body and used for providing power for the machine body;
in the automatic focusing device of the first aspect, the automatic focusing device is disposed on the body.
A fifth aspect of the present invention is to provide a computer-readable storage medium, wherein the storage medium is a computer-readable storage medium, and program instructions are stored in the computer-readable storage medium, and the program instructions are used for the automatic focusing method according to the first aspect.
According to the automatic focusing method, the automatic focusing device, the holder, the equipment and the storage medium, the first lens is used for acquiring the target object in the first lens visual field area, and the target object is identified and registered. When focus shooting for a target object is performed through the second lens, the registered target object is recognized from the second lens visual field area. And controlling the second lens to quickly and accurately focus the target object according to the operation of the user on at least one target object. In the process of shooting the target object by using the scheme, the first lens is firstly utilized to complete the registration of the target object, so that the second lens can quickly and accurately complete the focusing operation from the current lens view field area according to the target object which is registered in advance; in the process of continuous multi-target object shooting, the efficiency of the second lens for continuously switching and focusing the multi-target object in the current visual field area can be improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic flowchart of an auto-focusing method according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of a focusing operation process according to an embodiment of the present disclosure;
fig. 3a and 3b are schematic diagrams of another focusing operation process provided in the embodiment of the present application;
FIG. 4 is a schematic diagram of another focusing operation process provided in the embodiment of the present application;
fig. 5 is a schematic diagram of auto-focusing in a monitored scene according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram illustrating an effect of a multi-target shooting process according to an embodiment of the present application;
fig. 7 is a flowchart illustrating a multi-target shooting process according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an automatic focusing apparatus according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of a pan/tilt head provided in the embodiment of the present application;
fig. 10 is a schematic structural diagram of a shooting device provided in an embodiment of the present application;
fig. 11 is a schematic structural diagram of another autofocus device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.
In order to facilitate understanding of the technical solutions and technical effects of the present application, the following briefly describes the prior art:
the technical scheme is mainly applied to the shooting device comprising at least two lenses, so that the focusing operation on the multi-target object can be realized. For ease of understanding, the following description will be given taking an example in which the imaging apparatus includes two lenses. In order to distinguish the two lenses, the two lenses are defined as a first lens and a second lens, respectively, and the first lens has a wider field angle than the second lens. Therefore, in the case where the first lens and the second lens capture the same object, at least a part of the first lens visual field region includes the second lens visual field region, which can be understood as: the first lens field of view area completely overlaps the second lens field of view area, or the second lens field of view area completely overlaps a portion of the first lens field of view area). From the imaging effect, all target objects in the second lens field of view region are contained in the first lens field of view region. The target object is preprocessed through the first lens, for example, the target object is identified and registered, and then the second lens is guided to realize quick and accurate focusing operation on the target object.
Fig. 1 is a flowchart illustrating an auto-focusing method according to an embodiment of the present disclosure, where the method can be applied to a camera, and the camera at least includes a first lens and a second lens. The method comprises the following steps:
101: a target object in a first lens field of view region is acquired.
102: registering the target object.
103: and displaying the registered target object.
104: and responding to the operation of the user on the target object, and executing the focusing operation of the second lens on the target object.
After the shooting device is started, a frame of image can be acquired through the first lens, and the frame of image represents a first lens visual field area. Further, the target object is acquired from the first lens field of view region. The target object referred to herein is an object that requires the second lens to perform a focusing operation. As mentioned before, the first lens is typically a wide angle lens, meaning that the first lens field of view is also larger.
The manner of acquiring the target object from the first lens field of view region may include: in the first lens visual field area, a frame image of environment information including a target object is obtained. Target objects in the first lens field of view and other objects in the background environment are received by the light sensing device.
After the environment information is obtained, the first lens view area can be displayed through the display terminal, so that the user can visually see various objects (including target objects and non-target objects) through the display terminal. And the user identifies a required target object through the display terminal and selects the target object to be registered and subjected to focusing operation from the middle frame. The user actively identifies the target object through the first visual field area, so that the diversified identification requirements of the user can be met, and a larger selection range of the target object is provided for the user.
Furthermore, the target object in the first field of view region may also be identified without user involvement. After the first lens view area is acquired through the first lens, the target object and the non-target object may not be displayed through any display terminal. And the target object and the non-target object in the first lens visual field area collected by the photosensitive device are sent to the processor, and then the processor identifies the target object from the first lens visual field area according to a preset mathematical model or algorithm. The identification process does not need the participation of users, the identification speed is higher, and the workload of the users is reduced. Of course, when necessary, when aiming at the identification of some special target objects, the personnel can intervene to identify the target objects with small volume and unobvious characteristics, such as identifying leaves, pens, cups and the like. The preset recognition algorithm includes a recognition algorithm based on human face feature points, a recognition algorithm based on whole human face images, a recognition algorithm based on templates, a recognition algorithm based on neural networks, a recognition algorithm based on support vector machines, and the like, and may also be a combination of multiple algorithms.
For example, a Convolutional Neural Networks (CNN) algorithm is employed to identify the target object in the first lens field of view region. Before the identification, the category to be identified needs to be set in advance. The category may be a general category, such as a ball category, a rectangle category, etc., so as to identify a target object such as a soccer ball, a basketball, etc.; specific categories are also possible, such as: human face, books, etc. Assuming that the preset category is a face, a face target object contained in the first lens visual field area is identified according to feature points formed by eyes and a mouth of the face, so as to guide the second lens to realize focusing operation on the target object.
After the target object is identified, the target object identified in the field of view of the first lens needs to be further registered, so that the second lens can be guided to perform focusing processing on the target object. Registering the target object to obtain the registration information of the target object, wherein the registration information may represent the registration information of a certain category of target object or represent the registration information of a specific target object. Assuming that the registration information indicates registration information of a specific target object, the registration process may be understood as recording feature information of the target object and synchronously sending the recorded feature information to the second lens, so that the second lens may know which feature information all the target object includes, and the second lens may quickly identify the target object from the second lens view area according to the feature information.
The registration target object referred to herein may also be understood as storing the recorded feature information in the storage device. When the target object in the visual field area of the second lens needs to be identified, the second lens extracts the characteristic information from the storage device.
The registration of the target object as referred to herein may also be understood as storing image information of the target object directly into a storage device, and when it is necessary to identify the target object in the second lens field of view, the second lens extracts feature information from the storage device.
It should be noted that the information about the target object registered here for providing the second lens with the focusing operation is not limited to the characteristic information of the target object, but may also include information about the focusing position of the target object in the field of view area of the lens, the distance between the target object and the lens (for example, the distance between the target object and the lens may be measured by monocular or binocular distance measurement), the depth of focus, and so on. And, these related information can be acquired through the first shot and registered together with the characteristic information. In addition, in the registration process, a plurality of target objects are automatically identified based on the first lens visual field area, a registration list of the target objects to be confirmed is output, and a user can select the target objects needing to be registered from the list. According to the user selection result, the target object is associated with registration information including, but not limited to, feature information of the target object, focus position information, target object distance information, focus depth, and the like.
In practical applications, the target object will be focused through the second lens after the target object is registered. Therefore, in order to improve the focusing efficiency, it is necessary that the first lens field angle is not smaller than the second lens field angle, and the first lens focal depth includes the second lens focal depth. The following specifically describes a process in which the second lens performs focusing processing on the registration target object.
After the registration of the target object in the first lens view region is completed, a new one-frame image representing the target object and the non-target object of the second lens view region is acquired through the second lens. Furthermore, a new frame of image may be displayed by the display terminal, and the displayed content may include all the target objects in the second lens view field area.
The second lens vision area contains much environmental information, and a plurality of objects can be identified from the second lens vision area according to a preset algorithm or based on a preset mathematical model, for example, a car in the second lens vision area is identified according to the preset algorithm. Then, it is determined which of the plurality of objects is the target object according to the recognition result of the automobile in the second lens view field area, the registration information (for example, the vehicle shape feature information) of the target object, and the like, for example, it is determined that the automobile is the target object from the plurality of pedestrians, the plurality of bicycles, and the plurality of automobiles.
It should be noted that, when a new frame image corresponding to the second lens view field is displayed through the display terminal, the second lens does not perform a focusing operation on a certain target object, but only displays all the contents including the target object through the display terminal, so that the user can visually see all the contents through the display terminal.
In practical application, after the target object is identified by the second shot, the target object is continuously tracked, and the characteristic information of the target object is correspondingly updated, so that the target object is prevented from being lost. For example, the target object included in the second lens field of view is a walking person, and it is easily understood that the angle and distance of the face of the person relative to the second lens change during the walking process, and therefore the feature information presented by the target object in the second lens field of view also changes. In order to ensure that the second lens can accurately and quickly identify the target object, the characteristic information of the target object needs to be updated in real time in the process of tracking the target object, so that the continuous tracking of the target object by the latest characteristic information is facilitated. It is easily understood that after the target object is recognized by the second shot, continuous tracking of the target object may be achieved through the first shot. It should be noted that if the first lens or the second lens has higher pixels, the continuous tracking can be realized after the dimension reduction sampling is performed on the target object. Due to the fact that the related information of the target object needs to be frequently and dynamically updated in the continuous tracking process, the image processing burden of the device can be relieved through dimension reduction sampling processing, and the processing efficiency is improved.
After the target object is identified through the second lens, a focusing operation may be performed in response to a user's operation on the target object, may also be performed according to a dynamic characteristic of the target object, and may also be performed according to a preset focusing sequence. After the registration information of the registered target object is obtained through the first lens, the second lens can quickly and accurately realize the switching focusing between the target objects according to the registration information. A professional focus-following operator is not required for the focusing operation. On the basis of ensuring the focusing fluency and accuracy, the focusing operation difficulty is reduced. For ease of understanding, various alternative focusing operation modes will be described below.
As an alternative embodiment, it is assumed that a user sees a plurality of target objects displayed on a display terminal, and then performs a selection operation on a certain displayed target object through a mouse or performs a focusing operation on a certain displayed target object through a gesture. If the target object corresponding to the selection operation is the target object identified from the second lens visual field area, the second lens executes the focusing operation on the target object according to the focusing parameters such as the focal depth and the focusing position provided by the first lens. For example, fig. 2 is a schematic diagram of a focusing operation process according to an embodiment of the present disclosure. In fig. 2, the frame image displayed on the display terminal corresponds to the environment information included in the second lens visual field region, and it can be seen that there are many objects including the registered target object. The registered target object is shown with a dashed box, and the unregistered common object is shown without a dashed box. After a user selects a target object in the current frame image through a mouse, the second lens executes focusing operation on the target object, and adjusts the focusing position to the target object, so that the target object can be clearly presented on the display terminal, and the target object which is not focused currently and the non-target object are relatively and fuzzily presented on the display terminal. It is easy to understand that when the user performs the selection operation, there may be a certain error in the clicked position, that is, the clicked position of the user may not have the target object, so when performing the focusing operation, the target object closest to the center is taken as the target object that needs to perform the focusing operation this time with the clicked position of the user as the center.
As an alternative embodiment, the dynamic characteristic of the target object may be used as a trigger instruction for triggering the second lens to perform the focusing operation. That is, after the dynamic feature of the target object is recognized, the second lens performs a focusing operation on the target object according to the preset focal depth. For example, fig. 3a and 3b are schematic diagrams of another focusing operation process provided in the embodiment of the present application. In fig. 3a, the frame image displayed on the display terminal corresponds to the environment information included in the second lens view field, and many objects can be seen from the image. It is assumed that "person" with a dashed box is a registered target object, and other "persons" not marked with a dashed box are ordinary objects that are not registered. It is assumed that the dynamic feature information is a mouth opening action of "person". As shown in fig. 3b, when the "person" marked with the dotted line frame speaks in mouth opening, and the mouth opening action of the "person" is recognized through the second lens visual field area, the second lens is controlled to perform the focusing operation on the "person", and the focal length is adjusted, so that the "person" can be clearly presented on the display terminal.
In addition, the dynamic characteristics information may include variable state information such as human voice information and body movement information, and may be variable state information such as shape change information, position change information, and color change information of other animals or objects.
As an alternative embodiment, the focusing operation for the multi-target object may be performed according to a preset focusing order. For example, fig. 4 is a schematic diagram of another focusing operation process provided in the embodiment of the present application. As shown in fig. 4, the frame image displayed on the display terminal corresponds to the environment information included in the second lens visual field region, and many objects can be seen from the image. The object marked with the dashed box is a registered target object, and other objects not marked with the dashed box are registered common objects. The user numbers the target object marked with the dashed box, and the number can be displayed beside the dashed box, so that the user can visually see the number of the target object. After the target object is numbered, the focusing operation may be performed in response to the operation of the user on the target object, or may be performed according to the dynamic characteristic of the target object, which may be specifically performed according to the scheme shown in the above embodiment, and thus, the details are not repeated here.
It should be noted that after the focusing operation is started in the above manner, the second lens will sequentially perform focusing operations for all target objects according to the numbers. For example, focusing operation is performed on a target object numbered as I, and the target object I can be clearly seen through a display terminal; then, the second lens performs focusing operation on the target object numbered II, and at the moment, the focal length of the second lens is adjusted, so that the target object I becomes clearer and the target object II becomes clearer.
In practical applications, when focusing operations are required for a plurality of target objects, focus switching is required during focusing from one target object to another target object. In different shooting scenes, the focal point switching speed may be different, and the shooting effect is also affected by the high and low focal point switching speed. Accordingly, the user can select an appropriate focus switching speed for the target object. For example, in combination with the above-described embodiments, when the user sets the focusing order of each target object, the focus switching speed of each target object may be selected, the target object (r) sets the corresponding focus switching speed to V1, and the target object (r) sets the corresponding focus switching speed to V2. Through the embodiment, when the focusing operation is switched among the multiple target objects, the focusing switching can be completed more accurately and smoothly, so that a user can obtain better focusing switching experience.
The focus switching speed here may be a speed at which the angle of the lens in the imaging device is switched, and the focus position may be switched by adjusting the angle of the lens. The speed of lens stretching (from the perspective of the user, the speed of the target object from blurring to clear presentation) can also be the speed of lens adjustment such as focal depth and focal length. In practical applications, the focusing operation of the target object is performed, and the lens angle switching speed and the lens parameter adjusting speed may be set at the same time. When the focusing operation is switched among the multiple target objects, the focusing switching can be completed more accurately and smoothly, so that a user can obtain better focusing switching experience.
In the scheme, the shooting device comprises two lenses, wherein the first lens is mainly used for acquiring a first lens visual field area, identifying a target object in the first lens visual field area and registering the identified target object. Before the second lens takes a picture, the target object which needs to be focused is acquired in advance, that is, the registration information of the registered target object is sent to the second lens, and when the second lens performs a focusing operation, it can be clearly known which target object is, at what position in the second lens view field, what the focusing parameters (such as focal depth, focal length, angular point switching speed, etc.) need to be adjusted. Specifically, the focal depth of the first lens is also greater than the focal depth of the second lens, and the first lens viewing angle is greater than the second lens viewing angle, in other words, the focal depth range of the first lens includes the focal depth range of the second lens, and the first lens viewing area includes the second lens viewing area, that is, the target object enters the first lens viewing area before entering the second lens viewing area. The first lens is mainly used for identifying and registering a target object which just enters the first lens visual field area but does not enter the second lens visual field area; and the second lens rapidly locks the target object in the second lens visual field area according to the registration result of the first lens, and adjusts the focusing parameters, so that a clear frame image of the target object can be rapidly obtained. For example, fig. 5 is a schematic diagram of auto focus in a monitored scene according to an embodiment of the present application. It is assumed that a two-lens photographing device is included in the road surface monitoring system. The first lens can clearly acquire frame images of all objects within the range of 3 meters to 10 meters, and the second lens is used for acquiring frame images of high-definition objects with the distance of 5 meters. The figure shows that three vehicles are respectively marked as (i) and (ii), when one vehicle drives from a far position to a monitoring range, the vehicle starts to enter a first lens visual field area when the vehicle drives to a position 10 meters away from a monitoring shooting device, the first lens identifies an object, and after the object is identified as the vehicle, the vehicle (the vehicle) is registered through a circular broken line frame in the figure), and a registration result is sent to a second lens. When the vehicle (c) continues to travel to a position 5 meters away from the monitoring and shooting device and enters the visual field area of the second lens, the second lens performs focusing operation on the target object according to the registration information (the vehicle (c) is focused by a rectangular broken line frame in the figure), for example, shooting parameters such as focal depth and focal length are adjusted, so that a clear frame image of the vehicle can be obtained.
For convenience of understanding, the following specifically exemplifies a process of image capturing by the technical solution of the present application. Fig. 6 is a schematic diagram illustrating the effect of the multi-target shooting process according to the embodiment of the present application; fig. 7 is a flowchart illustrating a multi-target shooting process according to an embodiment of the present application.
For example, as shown in fig. 6, it is now required to take a shot of an actor a who handed a cup to an actor B, and the target objects to be focused are the actor a and the actor B in turn. As shown in fig. 7, first, the photographing apparatus is turned on, and a first lens field of view region including a target object is rapidly acquired through the first lens. Since the first lens has a large angle of view, the first lens includes actor C and actor D in addition to actor a and actor B, and other environmental information in the first lens field of view. It should be noted that the first lens view region described herein is not displayed on any display terminal, but the control device directly identifies the target object in the acquired first lens view region, and registers the identified target object. Specifically, registration processing is performed on the actor a and the actor B in the first lens visual field area, and registration information of the actor a and the actor B is acquired.
After the registration of all the target objects in the first lens visual field area is completed, the second lens is started to acquire the second lens visual field area, and then the second lens can be controlled to carry out focusing processing on the target objects. As can be seen from fig. 6, in the second lens view area, actor a, actor B, some environmental background information, and so on are included. The control apparatus identifies the target object in the second lens field of view based on registration information of the target object acquired from the first lens (e.g., feature information of actor a). The second lens view area may be displayed through a display terminal for the photographer to observe. The photographer sees actor a, actor B, and some environmental background information in the display terminal. Since the second lens view area is smaller than the first lens view area, the actor C and the actor D cannot be displayed in the display terminal. Meanwhile, the photographer may select the target object through a scroll wheel or a number key, and in order to highlight the target object, the target object may be displayed in the display terminal in a frame selection manner, for example, a visible frame is added to the outer edges of the actor a and the actor B (the frame is a dashed frame in fig. 6, and in an actual application, other marks with a significant prompting effect, such as a colored wire frame, and the like, may be used), and when the target object moves relative to the second lens, the frame moves along with the target object, so as to achieve the effect of real-time tracking. Meanwhile, the focal point switching speed can be selected through a roller or a number key. And after the shooting parameters are set, controlling a motor of the second lens to perform focusing operation on the target object.
After receiving the operation of the user on any target object in the second lens visual field area, the second lens is controlled to perform the focusing operation on the target object. The focusing operation is used for clearly presenting a target object in the display terminal by adjusting a photographing parameter such as a focal length.
In the shooting process of the present embodiment, continuous tracking shooting needs to be performed on three target objects, and in the shooting process, the focus target object needs to be switched. At this time, the actor a and the actor B in the second lens visual field area are displayed in real time on the display terminal. The photographer can number these target objects sequentially and set the focus switching speed of each target object. After receiving the clicking operation of the user on the actor A in the second lens visual field area, the second lens automatically completes the focusing operation on the actor B according to the serial number and the focusing switching speed. Therefore, a coherent image shot by automatically focusing the multi-target object can be obtained.
Fig. 8 is a schematic structural diagram of an auto-focusing apparatus according to an embodiment of the present disclosure. As can be seen from the figure, the apparatus comprises: the camera comprises a memory, a processor, a first lens and a second lens; wherein the memory has stored thereon executable code that, when executed by the processor, causes the processor to:
acquiring a target object in a first lens visual field area;
registering the target object;
presenting the registered target object;
and in response to the operation of the user on the target object, executing the focusing operation of the second lens on the target object.
Optionally, the processor is further configured to: identifying a target object in the first lens visual field area according to a preset category; and registering the target object according to the identification result.
Optionally, at least a partial region of the first lens field of view region includes a second lens field of view region.
Optionally, the processor is further configured to: identifying an object in the second lens field of view region according to a preset model or algorithm; determining the target object contained in the object; and displaying the target object in the second lens visual field area on the display terminal.
Optionally, the processor is further configured to: and in response to the selection operation of the target object by the user, executing the focusing operation of the second lens on the target object.
Optionally, acquiring a focal depth and a focusing position of the target object; and executing the focusing operation of the second lens on the target object according to the focal depth and the focusing position.
Optionally, the processor is further configured to: in response to an operation of a user on the target object, determining a focusing sequence of the target object in the second lens visual field area; and executing the focusing operation of the second lens on the target object in sequence according to the focusing sequence.
Optionally, the processor is further configured to: determining a focus switching speed of the target object in response to a selection operation of the focus switching speed by a user; and executing the focusing operation of the second lens on the target object according to the focus switching speed.
Fig. 9 is a schematic structural diagram of a pan/tilt head provided in the embodiment of the present application. This cloud platform includes at least:
the bracket is used for connecting the shooting device; the shooting device comprises a first lens, a second lens and the shooting device and is used for acquiring a target object in a first lens visual field area;
registering the target object;
presenting the registered target object;
and responding to the operation of the user on the target object, and executing the focusing operation of the second lens on the target object.
Fig. 10 is a schematic structural diagram of a shooting device according to an embodiment of the present application. The apparatus comprises:
a body;
the power system is arranged on the machine body and used for providing power for the machine body;
and the automatic focusing device is arranged on the machine body.
Optionally, the apparatus is configured to: acquiring a target object in a first lens visual field area; registering the target object; presenting the registered target object; and responding to the operation of the user on the target object, and executing the focusing operation of the second lens on the target object.
Optionally, the apparatus is further configured to: identifying a target object in the first lens visual field area according to a preset category; and registering the target object according to the identification result.
Optionally, at least a partial region of the first lens field of view region includes a second lens field of view region.
Optionally, the apparatus is further configured to: identifying an object in the second lens field of view region according to a preset model or algorithm; determining the target object contained in the object; and displaying the target object in the second lens visual field area on the display terminal.
Optionally, the apparatus is further configured to: and in response to the selection operation of the target object by the user, executing the focusing operation of the second lens on the target object.
Optionally, the apparatus is further configured to: acquiring the focal depth and the focusing position of the target object;
and executing the focusing operation of the second lens on the target object according to the focal depth and the focusing position.
Optionally, the apparatus is further configured to: in response to an operation of a user on the target object, determining a focusing sequence of the target object in the second lens visual field area; and executing the focusing operation of the second lens on the target object in sequence according to the focusing sequence.
Optionally, the apparatus is further configured to: determining a focus switching speed of the target object in response to a selection operation of the focus switching speed by a user; and executing the focusing operation of the second lens on the target object according to the focus switching speed.
The embodiment of the present application further provides a computer-readable storage medium, where the storage medium is a computer-readable storage medium, and program instructions are stored in the computer-readable storage medium, where the program instructions are used to implement an auto-focusing method. The method comprises the following steps:
acquiring a target object in a first lens visual field area;
registering the target object;
presenting the registered target object;
and responding to the operation of the user on the target object, and executing the focusing operation of the second lens on the target object.
Optionally, the method further comprises: identifying a target object in the first lens visual field area according to a preset category; and registering the target object according to the identification result.
Optionally, at least a partial region of the first lens field of view region includes a second lens field of view region.
Optionally, the method further comprises: identifying an object in the second lens field of view region according to a preset model or algorithm; determining the target object contained in the object; and displaying the target object in the second lens visual field area on the display terminal.
Optionally, the method further comprises: and in response to the selection operation of the target object by the user, executing the focusing operation of the second lens on the target object.
Optionally, the method further comprises: acquiring the focal depth and the focusing position of the target object; and executing the focusing operation of the second lens on the target object according to the focal depth and the focusing position.
Optionally, the method further comprises: in response to an operation of a user on the target object, determining a focusing sequence of the target object in the second lens visual field area; and executing the focusing operation of the second lens on the target object in sequence according to the focusing sequence.
Optionally, the method further comprises: determining a focus switching speed of the target object in response to a selection operation of the focus switching speed by a user; and executing the focusing operation of the second lens on the target object according to the focus switching speed.
FIG. 11 is a schematic structural diagram of another auto-focusing apparatus according to an embodiment of the present disclosure; referring to fig. 11, the apparatus comprises:
an acquiring module 111, configured to acquire a target object in a first lens view area;
a registration module 112, configured to register the target object;
a presentation module 113 for presenting the registered target object;
an executing module 114, configured to, in response to an operation of the target object by a user, execute a focusing operation of the second lens on the target object.
It should be noted that the apparatus shown in fig. 11 may also perform the method of the embodiment shown in fig. 1-7, and reference may be made to the related description of the embodiment shown in fig. 1-7 for a part not described in detail in this embodiment. The implementation process and technical effect of the technical solution refer to the descriptions in the embodiments shown in fig. 1 to 7, and are not described herein again.
In one possible design, the apparatus shown in fig. 11 may be implemented as an electronic device, which may be a mobile phone, a computer, a server, or the like.
In the process of shooting the target object by using the scheme, the first lens is firstly utilized to complete the registration of the target object, so that the second lens can quickly and accurately complete the focusing operation from the current lens view field area according to the target object which is registered in advance; in the process of continuous multi-target object shooting, the efficiency of the second lens for continuously switching and focusing the multi-target object in the current visual field area can be improved. Not only lightened shooting personnel work load, still promoted shooting effect and user experience.
In addition, the technical scheme can also be applied to a plurality of technical scenes such as video monitoring shooting and automatic driving video shooting.
The technical solutions and the technical features in the above embodiments may be used alone or in combination in case of conflict with the present disclosure, and all embodiments that fall within the scope of protection of the present disclosure are intended to be equivalent embodiments as long as they do not exceed the scope of recognition of those skilled in the art.
In the embodiments provided in the present invention, it should be understood that the disclosed correlation detection apparatus (e.g., IMU) and method may be implemented in other ways. For example, the above-described remote control device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, remote control devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer Processor (Processor) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes performed by the present specification and drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (19)

1. An auto-focusing method applied to a shooting device, the shooting device at least comprising a first lens and a second lens, the method comprising:
acquiring a target object in a first lens visual field area;
registering the target object;
presenting the registered target object;
and responding to the operation of the user on the target object, and executing the focusing operation of the second lens on the target object.
2. The method of claim 1, wherein registering the target object comprises:
identifying a target object in the first lens visual field area according to a preset category;
and registering the target object according to the identification result.
3. The method of claim 1, further comprising:
at least a partial region of the first lens field of view region includes a second lens field of view region.
4. The method of claim 1, wherein exposing the registered target object comprises:
identifying an object in the second lens field of view region according to a preset model or algorithm;
determining the target object contained in the object;
and displaying the target object in the second lens visual field area on the display terminal.
5. The method according to claim 1, wherein the performing the focusing operation of the second lens on the target object in response to the operation of the target object by the user comprises:
and responding to the selection operation of the user for the target object, and executing the focusing operation of the second lens on the target object.
6. The method of claim 1, wherein the performing the focusing operation of the second lens on the target object comprises:
acquiring the focal depth and the focusing position of the target object;
and executing the focusing operation of the second lens on the target object according to the focal depth and the focusing position.
7. The method according to claim 1, wherein the performing the focusing operation of the second lens on the target object in response to the user's selection operation on the target object comprises:
in response to an operation of a user on the target object, determining a focusing sequence of the target object in the second lens visual field area;
and executing the focusing operation of the second lens on the target object in sequence according to the focusing sequence.
8. The method according to claim 1, wherein the performing the focusing operation of the second lens on the target object in response to the user's selection operation on the target object comprises:
determining a focus switching speed of the target object in response to a selection operation of the focus switching speed by a user;
and executing the focusing operation of the second lens on the target object according to the focus switching speed.
9. An auto-focusing apparatus, comprising: the camera comprises a memory, a processor, a first lens and a second lens; wherein the memory has stored thereon executable code that, when executed by the processor, causes the processor to:
acquiring a target object in a first lens visual field area;
registering the target object;
presenting the registered target object;
and in response to the operation of the user on the target object, executing the focusing operation of the second lens on the target object.
10. The apparatus of claim 9, wherein the processor is further configured to:
identifying a target object in the first lens visual field area according to a preset category;
and registering the target object according to the identification result.
11. The apparatus of claim 9,
at least a partial region of the first lens field of view region includes a second lens field of view region.
12. The apparatus of claim 9, wherein the processor is further configured to:
identifying an object in the second lens field of view region according to a preset model or algorithm;
determining the target object contained in the object;
and displaying the target object in the second lens visual field area on the display terminal.
13. The apparatus of claim 9, wherein the processor is further configured to:
and in response to the selection operation of the target object by the user, executing the focusing operation of the second lens on the target object.
14. The apparatus of claim 9, wherein the processor is further configured to:
acquiring deepening and focusing positions of the target object;
and executing the focusing operation of the second lens on the target object according to the focal depth and the focusing position.
15. The apparatus of claim 9, wherein the processor is further configured to:
in response to an operation of a user on the target object, determining a focusing sequence of the target object in the second lens visual field area;
and executing the focusing operation of the second lens on the target object in sequence according to the focusing sequence.
16. The apparatus of claim 9, wherein the processor is further configured to:
determining a focus switching speed of the target object in response to a selection operation of the focus switching speed by a user;
and executing the focusing operation of the second lens on the target object according to the focus switching speed.
17. A head, characterized in that it comprises at least:
the bracket is used for connecting the shooting device; the shooting device comprises a first lens, a second lens and the shooting device and is used for acquiring a target object in a first lens visual field area;
registering the target object;
presenting the registered target object;
and responding to the operation of the user on the target object, and executing the focusing operation of the second lens on the target object.
18. A photographing apparatus, characterized by comprising:
a body;
the power system is arranged on the machine body and used for providing power for the machine body;
the autofocus device of any of claims 9-16, disposed on the body.
19. A computer-readable storage medium, characterized in that the storage medium is a computer-readable storage medium in which program instructions for implementing the auto-focusing method according to any one of claims 1 to 8 are stored.
CN202080004992.9A 2020-03-20 2020-03-20 Automatic focusing method, device, holder, equipment and storage medium Pending CN112673621A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/080354 WO2021184338A1 (en) 2020-03-20 2020-03-20 Automatic focusing method and apparatus, gimbal, device, and storage medium

Publications (1)

Publication Number Publication Date
CN112673621A true CN112673621A (en) 2021-04-16

Family

ID=75413947

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080004992.9A Pending CN112673621A (en) 2020-03-20 2020-03-20 Automatic focusing method, device, holder, equipment and storage medium

Country Status (2)

Country Link
CN (1) CN112673621A (en)
WO (1) WO2021184338A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022266915A1 (en) * 2021-06-24 2022-12-29 深圳市大疆创新科技有限公司 Focusing control method and device for lens and photographing device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090046157A1 (en) * 2007-08-13 2009-02-19 Andrew Cilia Combined wide-angle/zoom camera for license plate identification
CN102148965A (en) * 2011-05-09 2011-08-10 上海芯启电子科技有限公司 Video monitoring system for multi-target tracking close-up shooting
CN102291569A (en) * 2011-07-27 2011-12-21 上海交通大学 Double-camera automatic coordination multi-target eagle eye observation system and observation method thereof
CN105338248A (en) * 2015-11-20 2016-02-17 成都因纳伟盛科技股份有限公司 Intelligent multi-target active tracking monitoring method and system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110493527B (en) * 2019-09-24 2022-11-15 Oppo广东移动通信有限公司 Body focusing method and device, electronic equipment and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090046157A1 (en) * 2007-08-13 2009-02-19 Andrew Cilia Combined wide-angle/zoom camera for license plate identification
CN102148965A (en) * 2011-05-09 2011-08-10 上海芯启电子科技有限公司 Video monitoring system for multi-target tracking close-up shooting
CN102291569A (en) * 2011-07-27 2011-12-21 上海交通大学 Double-camera automatic coordination multi-target eagle eye observation system and observation method thereof
CN105338248A (en) * 2015-11-20 2016-02-17 成都因纳伟盛科技股份有限公司 Intelligent multi-target active tracking monitoring method and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022266915A1 (en) * 2021-06-24 2022-12-29 深圳市大疆创新科技有限公司 Focusing control method and device for lens and photographing device

Also Published As

Publication number Publication date
WO2021184338A1 (en) 2021-09-23

Similar Documents

Publication Publication Date Title
US11860511B2 (en) Image pickup device and method of tracking subject thereof
JP5178553B2 (en) Imaging device
US8265474B2 (en) Autofocus system
CN108737718B (en) Shooting method and device and intelligent equipment
JP5171468B2 (en) IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD
CN105282443A (en) Method for imaging full-field-depth panoramic image
US20150302029A1 (en) Image processing apparatus, image processing method, and non-transitory storage medium storing image processing program
WO2021134179A1 (en) Focusing method and apparatus, photographing device, movable platform and storage medium
JP7358530B2 (en) Object recognition device and method of controlling the object recognition device
CN111355891A (en) Micro-distance focusing method based on ToF, micro-distance shooting method and shooting device thereof
CN110278366B (en) Panoramic image blurring method, terminal and computer readable storage medium
WO2021184341A1 (en) Autofocus method and camera system thereof
CN112995507A (en) Method and device for prompting object position
CN106170061B (en) Panning index shows equipment and processing method
JP2017034569A (en) Imaging apparatus and control method therefor
CN112673621A (en) Automatic focusing method, device, holder, equipment and storage medium
CN114641983A (en) System and method for obtaining intelligent panoramic image
US20130044212A1 (en) Imaging device and distance information detecting method
US11949976B2 (en) Systems and methods for obtaining a smart panoramic image
CN115103094A (en) Camera module far-view angle adjusting method and system based on fixation point
WO2023272485A1 (en) Control method, image capture apparatus, and image capture system
CN117837153A (en) Shooting control method, shooting control device and movable platform
CN113010009A (en) Object sharing method and device
CN113421231A (en) Bleeding point detection method, device and system
JP2021125867A (en) Image processing device, imaging device, control method of image processing device, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20210416