CN115542513A

CN115542513A - Focusing method and device for shooting component

Info

Publication number: CN115542513A
Application number: CN202211141155.8A
Authority: CN
Inventors: 童伟峰; 朱延武; 李庆庄; 张亮
Original assignee: Bestechnic Shanghai Co Ltd
Current assignee: Bestechnic Shanghai Co Ltd
Priority date: 2022-09-20
Filing date: 2022-09-20
Publication date: 2022-12-30

Abstract

The embodiment of the application provides a focusing method and a focusing device for a shooting component, which relate to the technical field of computers, and the method comprises the following steps: first media information of a target object is acquired through a first shooting component. And then performing action recognition on the first media information, and starting a focusing function for the second shooting component when determining that the action recognition result is matched with a preset focusing starting action for the second shooting component. The distance change characteristic between the target object and the head-mounted display device is monitored, the second shooting component is focused based on the distance change characteristic, target media information collected by the second shooting component after focusing is displayed in the display component, and a user does not need to continuously search a button of the head-mounted display device worn on the head to realize focusing, so that the focusing efficiency is improved, and meanwhile, the definition of the collected media information is improved. Moreover, the focusing mode of the method and the device for focusing the image accords with the use habit of the user, and is more visual and convenient.

Description

Focusing method and device for shooting component

Technical Field

The embodiment of the application relates to the technical field of computers, in particular to a focusing method and a focusing device for a shooting component.

Background

With the development of scientific technology, the market of intelligent glasses such as Augmented Reality (AR) glasses/Virtual Reality (VR) glasses has gradually risen. Head Mounted Display devices (HMD for short) such as AR glasses/VR glasses can present images to a user through a Display screen, giving the user an immersive experience.

In the related art, when objects with different distances are shot, a user is supported to adjust a rotary button on the intelligent glasses manually to focus a shooting component so as to obtain a clear image or video. However, when wearing the smart glasses, it is difficult for the user to see the rotation button of the smart glasses, and therefore the user needs to continuously search the rotation button to realize focusing, which results in low focusing efficiency and inconvenience for the user.

Disclosure of Invention

The embodiment of the application provides a focusing method and device of a shooting component, which are used for improving the focusing efficiency and convenience of the shooting component.

In one aspect, an embodiment of the present application provides a focusing method for a shooting component, which is applied to a head-mounted display device, and includes:

acquiring first media information of a target object through a first shooting component;

performing action recognition on the first media information, and starting a focusing function aiming at a second shooting component when determining that an action recognition result is matched with a preset focusing starting action aiming at the second shooting component;

monitoring a distance change characteristic between the target object and the head-mounted display device, focusing the second shooting component based on the distance change characteristic, and displaying target media information acquired by the second shooting component after focusing in a display component.

The monitoring of the distance change characteristic between the target object and the display component comprises:

acquiring second media information of the target object through the first shooting component;

and obtaining the distance change characteristic between the target object and the head-mounted display equipment by performing action recognition on the second media information.

Optionally, the method further comprises:

acquiring third media information of the target object through the first shooting component;

and performing action recognition on the third media information, and closing a focusing function aiming at the second shooting component when determining that the action recognition result is matched with a preset focusing closing action aiming at the second shooting component.

Optionally, the distance variation feature comprises: a target distance variation between the target object and the head-mounted display device;

the focusing the second photographing part based on the distance change feature includes:

adjusting the focal length of the second photographing part based on a focal length adjustment amount corresponding to a unit distance variation and the target distance variation; alternatively, the first and second electrodes may be,

and adjusting the image distance of the second shooting part based on the image distance adjustment amount corresponding to the unit distance variation and the target distance variation.

Optionally, the adjusting the focal length of the second photographing part based on the focal length adjustment amount corresponding to the unit distance variation and the target distance variation includes:

if the target distance variation is larger than 0, increasing the focal length of the second shooting component based on a focal length adjustment amount corresponding to a unit distance variation and the target distance variation;

and if the target distance variation is smaller than 0, reducing the focal length of the second shooting component based on the focal length adjustment amount corresponding to the unit distance variation and the target distance variation.

Optionally, the adjusting the image distance of the second photographing part based on the image distance adjustment amount corresponding to the unit distance variation and the target distance variation includes:

if the target distance variation is larger than 0, reducing the image distance of the second shooting component based on the image distance adjustment amount corresponding to the unit distance variation and the target distance variation;

and if the target distance variation is smaller than 0, increasing the image distance of the second shooting component based on the image distance adjustment amount corresponding to the unit distance variation and the target distance variation.

Optionally, the first photographing part and the second photographing part are the same photographing part.

Optionally, the first photographing component is a depth camera.

In one aspect, an embodiment of the present application provides a focusing apparatus for a shooting component, which is applied to a head-mounted display device, and includes:

the acquisition module is used for acquiring first media information of a target object through the first shooting component;

the matching module is used for performing action recognition on the first media information and starting a focusing function aiming at a second shooting component when the action recognition result is matched with a preset focusing starting action aiming at the second shooting component;

and the focusing module is used for monitoring the distance change characteristic between the target object and the head-mounted display equipment, focusing the second shooting component based on the distance change characteristic, and displaying the target media information acquired by the second shooting component in a display component after focusing.

Optionally, the focusing module is specifically configured to:

Optionally, the matching module is further configured to:

the focusing module is specifically configured to:

Optionally, the focusing module is specifically configured to:

Optionally, the first photographing component is a depth camera.

In one aspect, an embodiment of the present application provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the focusing method for the shooting component when executing the program.

In one aspect, embodiments of the present application provide a computer-readable storage medium storing a computer program executable by a computer device, the program, when running on the computer device, causing the computer device to perform the steps of the above-described focusing method of a photographing part.

In the embodiment of the application, the collected first media information is subjected to action recognition, when the action recognition result is determined to be matched with the preset focusing starting action for the second shooting component, the second shooting component is focused based on the distance change characteristic between the target object and the head-mounted display device, and the focused target media information collected by the second shooting component is displayed in the display component without the need that a user continuously searches for a button of the head-mounted display device worn on the head to realize focusing, so that the focusing efficiency is improved, and meanwhile, the definition of the collected media information is improved. Moreover, the focusing mode of the method and the device for focusing the image accords with the use habit of the user, and is more visual and convenient.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1 is a schematic structural diagram of a system architecture according to an embodiment of the present application;

fig. 2 is a first schematic flowchart of a focusing method of a shooting component according to an embodiment of the present disclosure;

fig. 3 is a second flowchart illustrating a focusing method for a display and shooting component according to an embodiment of the present disclosure;

FIG. 4 is a first schematic diagram illustrating a gesture provided in an embodiment of the present application;

FIG. 5 is a first schematic diagram illustrating a hand moving direction according to an embodiment of the present disclosure;

fig. 6 is a second schematic view illustrating a hand moving direction according to an embodiment of the present disclosure;

FIG. 7 is a second schematic diagram illustrating a gesture provided in an embodiment of the present application;

fig. 8 is a schematic structural diagram of a focusing device of a shooting component according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more clearly apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

For convenience of understanding, terms referred to in the embodiments of the present invention are explained below.

Focal length: in convex lens imaging, focal length refers to the distance from the center of the convex lens to the focal point.

Image distance: in convex lens imaging, the image distance refers to the distance from the imaging plane to the convex lens, and in this application, the image distance also refers to the distance between the image sensor (photosensitive member) of the photographing part and the lens.

Focusing of the shooting component: and the process of enabling the shooting component to collect clear images or videos by adjusting the focal length or the image distance.

Referring to fig. 1, which is a schematic structural diagram of a head-mounted display device to which an embodiment of the present disclosure is applicable, the head-mounted display device 100 includes a first shooting component 101, a second shooting component 102, and a display component 103, where the first shooting component 101 and the second shooting component 102 may be the same shooting component or different shooting components. The display section 103 includes a left-eye display screen and a right-eye display screen.

In AR glasses or VR glasses, the first camera 101 and the second camera 102 may be used to capture a vision-based tracking and positioning image, a motion recognition image, or other required images or videos. The display part 103 can be used for displaying the target media information collected by the second shooting part 102 after focusing, so that the user can determine whether to further focus the second shooting part 102 based on the definition degree of the target media information displayed on the display part 103 until the second shooting part 102 obtains a clear image.

Based on the system architecture diagram shown in fig. 1, an embodiment of the present application provides a flow of a focusing method for a shooting component, as shown in fig. 2, where the flow of the method is executed by a computer device, and the computer device may be a head-mounted display device shown in fig. 1, and includes the following steps:

step S201, first media information of a target object is captured by a first capturing component.

Specifically, the first photographing part may be a depth camera mounted on the head-mounted display apparatus, or may be a general camera mounted on the head-mounted display apparatus. The target object may be a hand, a foot, a head, etc., and the first media information includes, but is not limited to, an image, a video.

Step S202, performing action recognition on the first media information, and starting a focusing function for the second shooting component when determining that the action recognition result is matched with a preset focusing starting action for the second shooting component.

Specifically, the second photographing part may be a general camera mounted on the head-mounted display apparatus. And performing action recognition on the first media information by adopting a model-driven (model-driven) mode or a data-driven (data-driven) mode to obtain an action recognition result. The corresponding recognition process is also different for different target objects.

For example, when the target object is a hand, performing gesture recognition on an image to be recognized of the hand to obtain a gesture recognition result, wherein the gesture recognition performed in a model-drive (model-drive) manner specifically includes the following steps: and generating a series of gesture geometric models by using the hand pose parameters or the node positions in advance, and establishing a search space, wherein the search space comprises all possible gesture geometric models. When gesture recognition is carried out, a gesture geometric model matched with the image to be recognized is inquired from the search space, and hand pose parameters of the matched gesture geometric model are used as a gesture recognition result.

When the gesture recognition is carried out in a data-driven (data-drive) mode, the method specifically comprises the following steps: the method comprises the steps of firstly collecting training samples and corresponding labels, and then learning the mapping from the training samples to the labels by adopting a machine learning algorithm to obtain a gesture recognition model, wherein the machine learning algorithm comprises but is not limited to a random forest, a support vector machine, a neural network and the like. When gesture recognition is carried out, the image to be recognized is input into a gesture recognition model, and a prediction label corresponding to the image to be recognized is output, wherein the prediction label is a gesture recognition result.

The focus start action for the second photographing part may be set according to actual requirements. For example, the focus start operation may be to hold a particular hand over a preset time period, or may be to combine a plurality of consecutive hands. By setting a special hand shape as a focusing starting gesture, the focusing starting gesture can be effectively distinguished from gestures of other functions, and the focusing function is prevented from being started by mistake.

In some embodiments, the first and second capture components are the same capture component. For example, the first shooting component and the second shooting component are the same common camera.

Step S203, monitoring the distance change characteristic between the target object and the head-mounted display device, focusing the second shooting component based on the distance change characteristic, and displaying the target media information collected by the second shooting component in the display component after focusing.

Specifically, the target media information includes, but is not limited to, images, videos. The distance variation characteristics include: and the target distance variable quantity is a difference value between the spacing distance between the target object obtained by the current detection and the head-mounted display equipment and the spacing distance between the target object obtained by the previous detection and the head-mounted display equipment.

When the target distance variation is greater than 0, indicating that the moving direction of the target object is far away from the head-mounted display device; when the target distance variation is less than 0, indicating that the moving direction of the target object is close to the head-mounted display device; when the target distance variation amount is equal to 0, it indicates that the separation distance between the target object and the head-mounted display device is not changed.

And correspondingly focusing the second shooting component based on the target distance variation, acquiring target media information through the focused second shooting component after each focusing, and displaying the target media information on the display component, so that a user can view the target media information on the display component.

When the target media information becomes clear, the target object continues to move along the original moving direction, and further focusing is triggered until the definition of the target media information reaches a preset requirement. When the target media information becomes blurred, the target object moves in the opposite direction of movement and triggers further focusing until the sharpness of the target media information meets the preset requirements.

In some embodiments, third media information of the target object is captured by the first photographing part. And then performing action recognition on the third media information, and closing the focusing function of the second shooting component when the action recognition result is determined to be matched with the preset focusing closing action of the second shooting component.

Specifically, the third media information may be an image or video captured by the first photographing part. The focus closing action for the second photographing part may be set according to actual requirements. For example, the focus closing operation may be to hold a particular hand over a preset time period, or may be to combine a plurality of consecutive hands. By setting a special hand type as a focusing closing gesture, the focusing closing gesture can be effectively distinguished from gestures of other functions, and the focusing function is prevented from being closed by mistake.

Optionally, in step S203, the embodiment of the present application monitors a distance variation characteristic between the target object and the head-mounted display device by using at least the following several implementations:

in the first embodiment, the second media information of the target object is acquired through the first shooting component. And then, by performing motion recognition on the second media information, obtaining a distance change characteristic between the target object and the head-mounted display device.

Specifically, the second media information includes, but is not limited to, images, videos. And performing motion recognition on the second media information in a model-driven (model-driven) mode or a data-driven (data-driven) mode to obtain the distance change characteristic between the target object and the head-mounted display device.

For the purpose of unfolding the target object as the hand, the image to be recognized of the hand is collected through the first shooting part, and then gesture recognition is carried out on the image to be recognized, so that the increased or decreased spacing distance between the target object and the head-mounted display device is obtained.

In an embodiment, the distance between the target object and the head-mounted display device is monitored through the wireless device bound with the target object and the wireless device bound with the head-mounted display device. A distance variation characteristic between the target object and the head-mounted display device is then determined based on the obtained plurality of separation distances.

Specifically, the wireless device bound to the target object sends a wireless signal periodically according to a convention, and after receiving the wireless signal, the wireless device bound to the head-mounted display device calculates the separation distance between the target object and the head-mounted display device based on the receiving time of the wireless signal and the sending time of the wireless signal. Based on the separation distance obtained by the two previous and subsequent calculations, the distance variation between the target object and the head-mounted display device is obtained.

In the embodiment of the application, the action recognition module is used for carrying out action recognition on the collected media information of the target object, or the wireless device is bound on the target object and the head-mounted display device, so that the distance change characteristic between the target object and the head-mounted display device is detected, the second shooting component is focused based on the distance change characteristic, the focusing efficiency and convenience are improved, and meanwhile, the definition of the shot media information is improved.

Optionally, in step S203, the embodiment of the present application performs focusing on the second shooting component by using at least the following several implementations:

in the first embodiment, focusing is performed by adjusting the focal length, that is, the focal length of the second photographing part is adjusted based on the focal length adjustment amount corresponding to the unit distance change amount and the target distance change amount.

Specifically, the focal length adjustment amount corresponding to the unit distance variation may be set and adjusted according to actual conditions. The lens in the second shooting component can be a zoom lens or a combined zoom lens, namely the focal length can be adjusted within a certain range, so that clear images or videos can be obtained when a short-distance object and a long-distance object are shot, wherein the zoom lens comprises a liquid zoom lens, and the focal length of the zoom lens is controlled by different voltages.

In practical applications, when taking images or videos of distant objects, it is necessary to increase the focal length to obtain sharp images or videos. When capturing images or video of close objects, it is necessary to reduce the focal length to obtain a sharp image or video. Therefore, when adjusting the focal length based on the target distance variation, the following adjustment methods are specifically adopted:

if the target distance variation is greater than 0, it indicates that the moving direction of the target object is far away from the head-mounted display device, and also indicates that the user needs to shoot a distant object at the moment, the focal length of the second shooting component is increased based on the focal length adjustment amount corresponding to the unit distance variation and the target distance variation. If the target distance variation is smaller than 0, it indicates that the moving direction of the target object is close to the head-mounted display device, and also indicates that the user needs to shoot a close-range object at the moment, the focal length of the second shooting component is reduced based on the focal length adjustment amount corresponding to the unit distance variation and the target distance variation.

After the focal length is adjusted, the focused second shooting component is used for collecting target media information and displaying the target media information on the display component, so that a user can view the target media information on the display component. When the target media information becomes clear, the target object continues to move along the original moving direction, and further focus adjustment is triggered until the definition of the target media information reaches a preset requirement. When the target media information becomes blurred, the target object moves in the opposite direction of movement and triggers further focus adjustment until the sharpness of the target media information meets the preset requirements.

In the embodiment of the application, when the moving direction of the target object is far away from the head-mounted display device, the focal length of the second shooting component is increased, so that a clear video or image is obtained when a long-distance object is shot; when the moving direction of the target object is close to the head-mounted display device, the focal length of the second shooting component is reduced, so that a clear video or image can be obtained when a close-distance object is shot.

In the second embodiment, focusing is performed by adjusting the image distance, that is, the image distance of the second photographing part is adjusted based on the image distance adjustment amount corresponding to the unit distance change amount and the target distance change amount.

Specifically, adjusting the image distance means adjusting the distance of the image sensor (photosensitive member) from the lens. The image distance adjustment amount corresponding to the unit distance variation can be set and adjusted according to the actual situation. In practical applications, when taking images or videos of distant objects, it is necessary to reduce the image distance to obtain a clear image or video. When an image or video of a close-distance object is photographed, it is necessary to increase the image distance to obtain a clear image or video. Therefore, when adjusting the image distance based on the target distance variation, the following adjustment method is specifically adopted:

if the target distance variation is greater than 0, it indicates that the moving direction of the target object is far away from the head-mounted display device, and also indicates that the user needs to shoot a distant object at the moment, the image distance of the second shooting component is reduced based on the image distance adjustment amount corresponding to the unit distance variation and the target distance variation. If the target distance variation is smaller than 0, which indicates that the moving direction of the target object is close to the head-mounted display device, and also indicates that the user needs to shoot a close-range object at the moment, the image distance of the second shooting component is increased based on the image distance adjustment amount corresponding to the unit distance variation and the target distance variation.

After the image distance is adjusted, the focused second shooting component is used for collecting the target media information and displaying the target media information on the display component, so that a user can view the target media information on the display component. When the target media information becomes clear, the target object continues to move along the original moving direction, and further image distance adjustment is triggered until the definition of the target media information reaches a preset requirement. When the target media information becomes fuzzy, the target object moves along the opposite moving direction, and further image distance adjustment is triggered until the definition of the target media information reaches the preset requirement.

In the embodiment of the application, when the moving direction of the target object is far away from the head-mounted display device, the image distance of the second shooting component is reduced, so that a clear video or image is obtained when a long-distance object is shot; when the moving direction of the target object is close to the head-mounted display device, the image distance of the second shooting part is increased so as to obtain a clear video or image when a close-distance object is shot.

In some embodiments, the separation distance between the target object and the head-mounted display device is within a range, i.e., after the target object is at a distance away from or near the head-mounted display device, the target object will not or not easily continue to move away from or near the head-mounted display device. That is to say, after the second photographing part is focused for a plurality of times based on the target distance variation, if the definition of the target media information photographed by the second photographing part still does not meet the preset requirement, focusing on the second photographing apparatus cannot or is not easily resumed. In view of this, the embodiments of the present application propose to perform focusing by a combination of a focusing start action and a focusing close action.

Specifically, by the focus start action, the focus function for the second photographing part is started. When photographing a distant object, the target object moves in a direction away from the head-mounted display apparatus. The head-mounted display device monitors and obtains a target distance variation larger than 0, and then the focal length of the second shooting component is increased based on the focal length adjustment amount corresponding to the unit distance variation and the target distance variation; or the image distance of the second imaging means is reduced based on the image distance adjustment amount corresponding to the unit distance variation amount and the target distance variation amount. The focused second shooting component is used for collecting the target media information and displaying the target media information on the display component, so that a user can view the target media information on the display component.

At this time, if the definition of the target media information does not meet the preset requirement and the target object cannot or cannot easily continue to be away from the head-mounted display device, the focusing function for the second photographing part is turned off through the focusing off action, and then the distance between the target object and the head-mounted display device is shortened. And restarting a focusing function of the second shooting component by utilizing a focusing starting action, and at the moment, when the target object moves in the direction far away from the head-mounted display equipment, continuing focusing until the definition of the target media information acquired by the second shooting equipment reaches a preset requirement.

Accordingly, when a close-distance object is photographed, the target object moves in a direction close to the head-mounted display device. The head-mounted display device monitors and obtains a target distance variation smaller than 0, and then reduces the focal length of the second shooting component based on the focal length adjustment amount corresponding to the unit distance variation and the target distance variation; or the image distance of the second imaging means is increased based on the image distance adjustment amount corresponding to the unit distance change amount and the target distance change amount. The focused second shooting component is used for collecting the target media information and displaying the target media information on the display component, so that a user can view the target media information on the display component.

At this time, if the definition of the target media information does not meet the preset requirement and the target object cannot or cannot easily continue to approach the head-mounted display device, the focusing function for the second shooting component is turned off through the focusing closing action, and then the distance between the target object and the head-mounted display device is increased. And restarting a focusing function of the second shooting component by utilizing a focusing starting action, and at the moment, when the target object moves along the direction close to the head-mounted display equipment, continuing focusing until the definition of the target media information acquired by the second shooting equipment reaches a preset requirement.

In the embodiment of the application, the second shooting device is focused through the combination of the focusing starting action and the focusing closing action, so that the focusing range can be effectively enlarged, and the focusing convenience and efficiency are improved.

To better explain the embodiments of the present application, a focusing method for a shooting component provided in the embodiments of the present application is described below with reference to specific implementation scenarios, where a flow of the method may be executed by a head-mounted display device shown in fig. 1, and includes the following steps, as shown in fig. 3:

step S301, an image A of the hand is collected through the first camera.

Specifically, image A is shown in FIG. 4, including a bixin gesture. The first camera is a depth camera or a common camera.

Step S302, performing gesture recognition on the image A to obtain a gesture recognition result.

Step S303, when it is determined that the gesture recognition result matches a preset focus start gesture for the second camera, a focus function for the second camera is started.

Specifically, the second camera is a general camera. In some embodiments, when the first camera is a normal camera, the first camera and the second camera may refer to the same normal camera.

In step S304, the hand is moved in a direction away from the head mounted display device.

As shown in particular in fig. 5, the hand is gradually moved away from the head mounted display device.

Step S305, monitoring the target distance variation between the hand and the head-mounted display device through the gesture recognition module.

Step S306, the focal length of the second camera is increased based on the focal length adjustment amount corresponding to the unit distance variation and the target distance variation.

And step S307, displaying the target image acquired by the focused second camera in a display part.

Step S308, determining whether the sharpness of the target image meets a preset requirement, if so, performing step S312, otherwise, performing step S309.

Step S309, determine whether the sharpness of the target image is increased, if yes, execute step S304, otherwise execute step S310.

In step S310, the hand moves in a direction approaching the head mounted display device.

As shown in fig. 6 in particular, the hand gradually approaches the head mounted display device.

In step S311, the focal length of the second camera is reduced based on the focal length adjustment amount corresponding to the unit distance variation and the target distance variation, and then step S307 is executed.

Step S312, an image B of the hand is captured by the first camera.

Specifically, image B, as shown in fig. 7, includes a fist gesture.

Step 313, performing gesture recognition on the image B to obtain a gesture recognition result.

And step S314, when the gesture recognition result is matched with a preset focusing closing gesture aiming at the second camera, closing the focusing function aiming at the second camera.

Based on the same technical concept, the embodiment of the present application provides a schematic structural diagram of a focusing apparatus of a shooting component, which is applied to a head-mounted display device, as shown in fig. 8, the apparatus 800 includes:

the acquisition module 801 is used for acquiring first media information of a target object through a first shooting component;

a matching module 802, configured to perform action recognition on the first media information, and start a focusing function for a second shooting component when it is determined that an action recognition result matches a preset focusing start action for the second shooting component;

a focusing module 803, configured to monitor a distance change characteristic between the target object and the head-mounted display device, focus the second shooting component based on the distance change characteristic, and display target media information acquired by the second shooting component after focusing in a display component.

Optionally, the focusing module 803 is specifically configured to:

Optionally, the matching module 802 is further configured to:

the focusing module 803 is specifically configured to:

Optionally, the focusing module 803 is specifically configured to:

Optionally, the first photographing component is a depth camera.

Based on the same technical concept, the embodiment of the present application provides a computer device, which may be a head-mounted display device as shown in fig. 1, as shown in fig. 9, including at least one processor 901 and a memory 902 connected to the at least one processor, and a specific connection medium between the processor 901 and the memory 902 is not limited in this embodiment, and the processor 901 and the memory 902 are connected through a bus in fig. 9 as an example. The bus may be divided into an address bus, a data bus, a control bus, etc.

In the embodiment of the present application, the memory 902 stores instructions executable by the at least one processor 901, and the at least one processor 901 may execute the steps of the focusing method of the shooting component described above by executing the instructions stored in the memory 902.

The processor 901 is a control center of the computer device, and can connect various parts of the computer device by using various interfaces and lines, and implement focusing of the photographing part by executing or executing instructions stored in the memory 902 and calling up data stored in the memory 902. Optionally, the processor 901 may include one or more processing units, and the processor 901 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application program, and the like, and the modem processor mainly processes wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 901. In some embodiments, the processor 901 and the memory 902 may be implemented on the same chip, or in some embodiments, they may be implemented separately on separate chips.

The processor 901 may be a general-purpose processor, such as a Central Processing Unit (CPU), a digital signal processor, an Application Specific Integrated Circuit (ASIC), a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof, and may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present Application. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in a processor.

The memory 902, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. The Memory 902 may include at least one type of storage medium, which may include, for example, a flash Memory, a hard disk, a multimedia card, a card-type Memory, a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Programmable Read Only Memory (PROM), a Read Only Memory (ROM), a charged Erasable Programmable Read Only Memory (EEPROM), a magnetic Memory, a magnetic disk, an optical disk, and so on. The memory 902 is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computing device, but is not limited to such. The memory 902 of the embodiments of the present application may also be circuitry or any other device capable of performing a storage function for storing program instructions and/or data.

Based on the same inventive concept, embodiments of the present application provide a computer-readable storage medium storing a computer program executable by a computer apparatus, which, when the program is run on the computer apparatus, causes the computer apparatus to perform the steps of the above-described focusing method of a photographing part.

It should be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer device or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer device or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer device or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer device or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A focusing method of a photographing part, applied to a head-mounted display device, is characterized by comprising the following steps:

2. The method of claim 1, wherein the monitoring a distance change characteristic between a target object and the display component comprises:

3. The method of claim 1, further comprising:

4. The method of claim 1, wherein the distance variation feature comprises: a target distance variation between the target object and the head-mounted display device;

5. The method according to claim 4, wherein the adjusting the focal length of the second photographing part based on the focal length adjustment amount corresponding to the unit distance change amount and the target distance change amount includes:

6. The method according to claim 4, wherein the adjusting the image distance of the second photographing part based on the image distance adjustment amount corresponding to the unit distance change amount and the target distance change amount comprises:

7. The method of any of claims 1 to 6, wherein the first and second camera are the same camera.

8. The method of claim 7, wherein the first camera component is a depth camera.

9. A focusing apparatus of a photographing part applied to a head-mounted display device, comprising:

and the focusing module is used for monitoring the distance change characteristic between the target object and the head-mounted display equipment, focusing the second shooting component based on the distance change characteristic, and displaying the target media information acquired by the second shooting component in the display component after focusing.

10. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the method of any one of claims 1 to 8 are performed when the program is executed by the processor.

11. A computer-readable storage medium, in which a computer program is stored which is executable by a computer device, and which, when run on the computer device, causes the computer device to carry out the steps of the method according to any one of claims 1 to 8.