CN110049252B

CN110049252B - Focus-following shooting method and device and computer-readable storage medium

Info

Publication number: CN110049252B
Application number: CN201910473341.3A
Authority: CN
Inventors: 覃攀
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2019-05-31
Filing date: 2019-05-31
Publication date: 2021-11-02
Anticipated expiration: 2039-05-31
Also published as: CN110049252A

Abstract

The application discloses a focus-following shooting method, a device and a computer-readable storage medium, wherein the method comprises the following steps: acquiring a wearing state of the wearing equipment, acquiring a first reference object related to a photographer through a first camera and acquiring a second reference object related to a shooting scene through a second camera in the wearing state; then, a shooting preview area of the wearable device is determined according to the wearing state, and in the focus-following preview area, real-time tracking indication is carried out in the focus-following preview area by combining the shooting scene and the relative speed of the second reference object. The control scheme for quickly tracking the focus is realized, the focus tracking control can be quickly and accurately performed without the need of using extra hands by a user, the operation efficiency is improved, and the user experience is enhanced.

Description

Focus-following shooting method and device and computer-readable storage medium

Technical Field

The present application relates to the field of mobile communications, and in particular, to a focus-following shooting method and apparatus, and a computer-readable storage medium.

Background

Among the prior art, along with the rapid development of intelligent terminal equipment, wearable equipment different from conventional smart phones appears, for example, wearable equipment such as smart watches or smart bracelets. Because wearable equipment is compared in traditional smart mobile phone, particularity such as its software, hardware environment, operation methods and operation environment, if with traditional smart mobile phone's the scheme of controlling transfer to wearable equipment, then may bring inconvenience, user experience for user's operation not good.

Disclosure of Invention

In order to solve the technical defects in the prior art, the invention provides a focus-following shooting method, which comprises the following steps:

acquiring a wearing state of the wearing equipment, acquiring a first reference object related to a photographer through a first camera and acquiring a second reference object related to a shooting scene through a second camera in the wearing state;

determining a shooting preview area of the wearable device according to the wearing state, and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object;

determining a coverage area corresponding to the visual focus in the shooting preview area, and taking an object contained in the coverage area as the second reference object in combination with the shooting scene;

determining a focus-following preview area of the wearable device according to the wearing state, and performing real-time tracking indication in the focus-following preview area by combining the shooting scene and the relative speed of the second reference object in the focus-following preview area.

Optionally, the obtaining a wearing state of the wearing device, and, in the wearing state, obtaining a first reference object related to a photographer through a first camera, and obtaining a second reference object related to a shooting scene through a second camera include:

acquiring the wearing state of the wearable equipment;

and determining the first camera shooting component and the second camera shooting component which are started currently by combining the wearing state.

Optionally, the acquiring a wearing state of the wearable device, and acquiring a first reference object related to a photographer through a first camera and acquiring a second reference object related to a shooting scene through a second camera in the wearing state further includes:

acquiring a first reference object related to a photographer through a first camera in a first camera assembly, wherein the first reference object comprises a body part of the photographer;

and acquiring a second reference object related to a shooting scene through a second camera in the second camera assembly, wherein the second reference object belongs to a shooting object in the shooting scene.

Optionally, the determining a shooting preview area of the wearable device according to the wearing state, and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object include:

in the wearing state, the shooting preview area is obtained by dividing in a display area of the wearing equipment in combination with the first reference object;

and detecting the position relation of the first reference object compared with the shooting preview area in a preset detection time period, and determining that the first reference object corresponds to the visual focus in the shooting preview area according to the position relation.

Optionally, the determining a coverage area corresponding to the visual focus in the shooting preview area, and taking an object included in the coverage area as the second reference object in combination with the shooting scene, includes:

acquiring the vertical distance between the first reference object and the shooting preview area within the preset detection time period;

and determining the area range of the coverage area according to the vertical distance.

Optionally, the determining a coverage area corresponding to the visual focus in the shooting preview area, and taking an object included in the coverage area as the second reference object in combination with the shooting scene, further includes:

determining a coverage area corresponding to the visual focus in the shooting preview area in combination with the area range of the coverage area;

and identifying a display object in the coverage area, converting the display object into a real object in the shooting scene by combining the shooting scene, and taking the real object as the second reference object.

Optionally, the determining, according to the wearing state, a focus-following preview area of the wearing device, and performing real-time tracking indication in the focus-following preview area in combination with the shooting scene and the relative speed of the second reference object include:

under the wearing state, dividing a display area of the wearing equipment to obtain two focus-following preview areas which are adjacent to the shooting preview area at the left and the right;

and respectively arranging a plurality of left and right adjacent focus tracking sub-areas in the two focus tracking preview areas.

Optionally, the determining, according to the wearing state, a focus-following preview area of the wearing device, and performing real-time tracking indication in the focus-following preview area in combination with the shooting scene and the relative speed of the second reference object, further includes:

acquiring the rotation angular speed of the wearable device, and determining a corresponding reference speed according to the rotation angular speed;

and in the focus-following preview area, determining the movement speed of the second reference object by combining the shooting scene and the relative speed of the second reference object, comparing the reference speed and the movement speed in real time, and tracking and indicating the difference value of the reference speed and the movement speed through each focus-following sub-area in the focus-following preview area.

The present invention also provides a focus-following photographing apparatus, including:

a memory, a processor, and a computer program stored on the memory and executable on the processor;

the computer program, when executed by the processor, implements the steps of the method of any one of the above.

The present invention also proposes a computer-readable storage medium having stored thereon a focus-following shooting program which, when executed by a processor, implements the steps of the focus-following shooting method as defined in any one of the above.

The method has the advantages that by acquiring the wearing state of the wearing equipment, and in the wearing state, acquiring the first reference object related to a photographer through the first camera, and acquiring the second reference object related to a shooting scene through the second camera; then, determining a shooting preview area of the wearable device according to the wearing state, and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object; then, determining a coverage area corresponding to the visual focus in the shooting preview area, and taking an object contained in the coverage area as the second reference object in combination with the shooting scene; and finally, determining a focus-following preview area of the wearable device according to the wearing state, and performing real-time tracking indication in the focus-following preview area by combining the shooting scene and the relative speed of the second reference object. The control scheme for quickly tracking the focus is realized, the focus tracking control can be quickly and accurately performed without the need of using extra hands by a user, the operation efficiency is improved, and the user experience is enhanced.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.

Fig. 1 is a schematic hardware structure diagram of an implementation manner of a wearable device according to an embodiment of the present invention;

fig. 2 is a hardware schematic diagram of an implementation of a wearable device provided in an embodiment of the present application;

fig. 3 is a hardware schematic diagram of an implementation of a wearable device provided in an embodiment of the present application;

fig. 4 is a hardware schematic diagram of an implementation of a wearable device provided in an embodiment of the present application;

fig. 5 is a hardware schematic diagram of an implementation manner of a wearable device provided in an embodiment of the present application;

FIG. 6 is a flow chart of a first embodiment of a focus-following photographing method of the present invention;

FIG. 7 is a flowchart of a second embodiment of a focus-following photographing method according to the present invention;

fig. 8 is a flowchart of a third embodiment of the focus-following photographing method of the present invention;

fig. 9 is a flowchart of a focus-following photographing method according to a fourth embodiment of the present invention;

fig. 10 is a flowchart of a focus-following photographing method according to a fifth embodiment of the present invention;

fig. 11 is a flowchart of a focus-following photographing method according to a sixth embodiment of the present invention;

fig. 12 is a flowchart of a focus-following photographing method according to a seventh embodiment of the present invention;

fig. 13 is a flowchart of an eighth embodiment of the focus-following photographing method of the present invention.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.

The wearable device provided by the embodiment of the invention comprises a mobile terminal such as an intelligent bracelet, an intelligent watch, an intelligent mobile phone and the like. With the continuous development of screen technologies, screen forms such as flexible screens and folding screens appear, and mobile terminals such as smart phones can also be used as wearable devices. The wearable device provided in the embodiment of the present invention may include: a Radio Frequency (RF) unit, a WiFi module, an audio output unit, an a/V (audio/video) input unit, a sensor, a display unit, a user input unit, an interface unit, a memory, a processor, and a power supply.

In the following description, a wearable device will be taken as an example, please refer to fig. 1, which is a schematic diagram of a hardware structure of a wearable device for implementing various embodiments of the present invention, where the wearable device 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the wearable device structure shown in fig. 1 does not constitute a limitation of the wearable device, and that the wearable device may include more or fewer components than shown, or combine certain components, or a different arrangement of components.

The following describes the various components of the wearable device in detail with reference to fig. 1:

the rf unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, the rf unit 101 may transmit uplink information to a base station, in addition, the downlink information sent by the base station may be received and then sent to the processor 110 of the wearable device for processing, the downlink information sent by the base station to the radio frequency unit 101 may be generated according to the uplink information sent by the radio frequency unit 101, or may be actively pushed to the radio frequency unit 101 after detecting that the information of the wearable device is updated, for example, after detecting that the geographic location where the wearable device is located changes, the base station may send a message notification of the change in the geographic location to the radio frequency unit 101 of the wearable device, and after receiving the message notification, the message notification may be sent to the processor 110 of the wearable device for processing, and the processor 110 of the wearable device may control the message notification to be displayed on the display panel 1061 of the wearable device; typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 may also communicate with a network and other devices through wireless communication, which may specifically include: the server may push a message notification of resource update to the wearable device through wireless communication to remind a user of updating the application program if the file resource corresponding to the application program in the server is updated after the wearable device finishes downloading the application program. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex Long Term Evolution), and TDD-LTE (Time Division duplex Long Term Evolution).

In one embodiment, the wearable device 100 may access an existing communication network by inserting a SIM card.

In another embodiment, the wearable device 100 may be configured with an esim card (Embedded-SIM) to access an existing communication network, and by using the esim card, the internal space of the wearable device may be saved, and the thickness may be reduced.

It is understood that although fig. 1 shows the radio frequency unit 101, it is understood that the radio frequency unit 101 does not belong to the essential constituents of the wearable device, and can be omitted entirely as required within the scope not changing the essence of the invention. The wearable device 100 may implement a communication connection with other devices or a communication network through the wifi module 102 alone, which is not limited by the embodiments of the present invention.

WiFi belongs to short-distance wireless transmission technology, and the wearable device can help a user to send and receive e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband Internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the wearable device, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the wearable device 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the wearable device 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

In one embodiment, the wearable device 100 includes one or more cameras, and by turning on the cameras, capturing of images can be realized, functions such as photographing and recording can be realized, and the positions of the cameras can be set as required.

The wearable device 100 also includes at least one sensor 105, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the wearable device 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), and the like.

In one embodiment, the wearable device 100 further comprises a proximity sensor, and the wearable device can realize non-contact operation by adopting the proximity sensor, so that more operation modes are provided.

In one embodiment, the wearable device 100 further comprises a heart rate sensor, which, when worn, enables detection of heart rate by proximity to the user.

In one embodiment, the wearable device 100 may further include a fingerprint sensor, and by reading the fingerprint, functions such as security verification can be implemented.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

In one embodiment, the display panel 1061 is a flexible display screen, and when the wearable device using the flexible display screen is worn, the screen can be bent, so that the wearable device is more conformable. Optionally, the flexible display screen may adopt an OLED screen body and a graphene screen body, in other embodiments, the flexible display screen may also be made of other display materials, and this embodiment is not limited thereto.

In one embodiment, the display panel 1061 of the wearable device may take a rectangular shape to wrap around when worn. In other embodiments, other approaches may be taken.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the wearable device. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.

In one embodiment, the side of the wearable device 100 may be provided with one or more buttons. The button can realize various modes such as short-time pressing, long-time pressing, rotation and the like, thereby realizing various operation effects. The number of the buttons can be multiple, and different buttons can be combined for use to realize multiple operation functions.

Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 1, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the wearable device, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the wearable device, and is not limited herein. For example, when receiving a message notification of an application program through the rf unit 101, the processor 110 may control the message notification to be displayed in a predetermined area of the display panel 1061, where the predetermined area corresponds to a certain area of the touch panel 1071, and perform a touch operation on the certain area of the touch panel 1071 to control the message notification displayed in the corresponding area on the display panel 1061.

The interface unit 108 serves as an interface through which at least one external device is connected to the wearable apparatus 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the wearable apparatus 100 or may be used to transmit data between the wearable apparatus 100 and the external device.

In one embodiment, the interface unit 108 of the wearable device 100 is configured as a contact, and is connected to another corresponding device through the contact to implement functions such as charging and connection. The contact can also be waterproof.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the wearable device, connects various parts of the entire wearable device by various interfaces and lines, and performs various functions of the wearable device and processes data by running or executing software programs and/or modules stored in the memory 109 and calling up data stored in the memory 109, thereby performing overall monitoring of the wearable device. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The wearable device 100 may further include a power source 111 (such as a battery) for supplying power to various components, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

Although not shown in fig. 1, the wearable device 100 may further include a bluetooth module or the like, which is not described herein. The wearable device 100 can be connected with other terminal devices through Bluetooth, so that communication and information interaction are realized.

Please refer to fig. 2-4, which are schematic structural diagrams of a wearable device according to an embodiment of the present invention. The wearable device in the embodiment of the invention comprises a flexible screen. When the wearable device is unfolded, the flexible screen is in a strip shape; when the wearable device is in a wearing state, the flexible screen is bent to be annular. Fig. 2 and 3 show the structural schematic diagram of the wearable device screen when the wearable device screen is unfolded, and fig. 4 shows the structural schematic diagram of the wearable device screen when the wearable device screen is bent.

Based on the above embodiments, it can be seen that, if the device is a watch, a bracelet, or a wearable device, the screen of the device may not cover the watchband region of the device, and may also cover the watchband region of the device. Here, the present application proposes an optional implementation manner, in which the device may be a watch, a bracelet, or a wearable device, and the device includes a screen and a connection portion. The screen can be a flexible screen, and the connecting part can be a watchband. Optionally, the screen of the device or the display area of the screen may partially or completely cover the wristband of the device. As shown in fig. 5, fig. 5 is a hardware schematic diagram of an implementation manner of a wearable device provided in an embodiment of the present application, where a screen of the device extends to two sides, and a part of the screen is covered on a watchband of the device. In other embodiments, the screen of the device may also be entirely covered on the watchband of the device, and this is not limited in this application.

Example one

Fig. 6 is a flowchart of the first embodiment of the focus-following photographing method of the present invention. A focus-following photographing method, the method comprising:

s1, acquiring the wearing state of the wearing equipment, and acquiring a first reference object related to a photographer through a first camera and acquiring a second reference object related to a shooting scene through a second camera in the wearing state;

s2, determining a shooting preview area of the wearable device according to the wearing state, and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object;

s3, determining a coverage area corresponding to the visual focus in the shooting preview area, and regarding an object included in the coverage area as the second reference object in combination with the shooting scene;

and S4, determining a focus-following preview area of the wearable device according to the wearing state, and performing real-time tracking indication in the focus-following preview area by combining the shooting scene and the relative speed of the second reference object.

In the embodiment, firstly, a wearing state of the wearing device is obtained, and in the wearing state, a first reference object related to a photographer is obtained through a first camera, and a second reference object related to a shooting scene is obtained through a second camera; then, determining a shooting preview area of the wearable device according to the wearing state, and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object; then, determining a coverage area corresponding to the visual focus in the shooting preview area, and taking an object contained in the coverage area as the second reference object in combination with the shooting scene; and finally, determining a focus-following preview area of the wearable device according to the wearing state, and performing real-time tracking indication in the focus-following preview area by combining the shooting scene and the relative speed of the second reference object.

In particular, in various shooting scenes, focus-following shooting is generally a shooting mode which is difficult to master, and has a high viewing effect, but the shooting process often occurs because the lens moves and follows in place, so that the shooting effect is poor. In the embodiment, by identifying the wearing state of the wearing device, when the wearing state is in a horizontal shooting preview state, two reference objects of the wearing device are obtained, a camera facing a user is obtained as a first reference object, a camera facing a direction to be shot is obtained as a second reference object, when the wearing device is in a shooting preview state and is in a horizontal rotation state, rotation information of the horizontal rotation is identified, meanwhile, a visual focus in the first reference object and the shooting preview area is identified, a second reference object corresponding to the rotation information is determined in a shooting preview image according to the visual focus and the rotation information, and meanwhile, the reference object is used as a shooting focus following object in the current shooting preview process of the wearing device.

For example, the reference object is used to divide a following display area in the display area of the wearable device, the shooting preview image is displayed in the dynamic area, meanwhile, multiple candidate areas are displayed in the left and right side areas of the dynamic area, and shooting focus-following objects in different directions in the current shooting preview image or shooting focus-following objects in different movement speeds are displayed in the multiple candidate areas, that is, multiple shooting focus-following objects in different directions and/or different movement speeds are extracted from the shooting preview image.

It can be understood that, in this embodiment, the shot focus tracking object may be one or more shot subjects and one or more shot backgrounds, the shot focus tracking objects are extracted respectively, and are placed in the multiple candidate areas according to a certain rule by combining the position information and/or the speed information of each shot focus tracking object, and meanwhile, the rotation state of the wearable device is monitored, and the current shot focus tracking object is determined according to the rotation state and the corresponding relationship of the reference object, and the area where the shot focus tracking object is located is used as the focus tracking area where the focus is located, so that a fast focus tracking regulation and control scheme is implemented, fast and accurate focus tracking regulation and control can be performed without a user using an extra hand for operation, the operation efficiency is improved, and the user experience is enhanced.

The method has the advantages that by acquiring the wearing state of the wearing device, and in the wearing state, acquiring the first reference object related to a photographer through the first camera, and acquiring the second reference object related to a shooting scene through the second camera; then, determining a shooting preview area of the wearable device according to the wearing state, and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object; then, determining a coverage area corresponding to the visual focus in the shooting preview area, and taking an object contained in the coverage area as the second reference object in combination with the shooting scene; and finally, determining a focus-following preview area of the wearable device according to the wearing state, and performing real-time tracking indication in the focus-following preview area by combining the shooting scene and the relative speed of the second reference object. The control scheme for quickly tracking the focus is realized, the focus tracking control can be quickly and accurately performed without the need of using extra hands by a user, the operation efficiency is improved, and the user experience is enhanced.

Example two

Fig. 7 is a flowchart of a second embodiment of the focus-following shooting method according to the present invention, and based on the above embodiment, the acquiring a wearing state of the wearable device, and in the wearing state, acquiring a first reference object related to a photographer by a first camera, and acquiring a second reference object related to a shooting scene by a second camera includes:

s11, acquiring the wearing state of the wearable device;

and S12, determining the first camera shooting component and the second camera shooting component which are enabled currently by combining the wearing state.

In this embodiment, first, a wearing state of the wearable device is acquired; then, the current enabled first camera shooting component and the current enabled second camera shooting component are determined according to the wearing state.

Optionally, when the wearable device has one camera, the camera is started to simultaneously acquire a first reference object of the user and a second reference object of the object to be shot;

optionally, when the wearable device has two or more cameras, determining one of the cameras as the first camera component of the embodiment, and determining another camera as the second camera component of the embodiment;

optionally, if the wearable device has two or more cameras, the wearing state of the wearable device is obtained, for example, when the wearable device is in a longitudinal shooting state, according to the state, it is determined that two of the cameras are respectively used as the first camera component and the second camera component of this embodiment.

The beneficial effect of the embodiment is that the wearing state of the wearing equipment is obtained; then, the current enabled first camera shooting component and the current enabled second camera shooting component are determined according to the wearing state. The control scheme of focusing is realized more conveniently, the user can quickly and accurately control focusing without using extra hands, the operation efficiency is improved, and the user experience is enhanced.

EXAMPLE III

Fig. 8 is a flowchart of a third embodiment of the focus-following shooting method according to the present invention, and based on the above embodiment, the method further includes the steps of acquiring a wearing state of the wearable device, and acquiring, in the wearing state, a first reference object related to a photographer by using a first camera, and acquiring, by using a second camera, a second reference object related to a shooting scene, where:

s13, acquiring a first reference object related to the photographer through a first camera in the first camera assembly, wherein the first reference object comprises a body part of the photographer;

and S14, acquiring a second reference object related to the shooting scene through a second camera in the second camera assembly, wherein the second reference object belongs to the shooting object in the shooting scene.

In the embodiment, first, a first reference object related to a photographer is acquired through a first camera in a first camera assembly, wherein the first reference object comprises a body part of the photographer; then, a second reference object related to the shooting scene is acquired through a second camera in the second camera shooting assembly, wherein the second reference object belongs to a shooting object in the shooting scene.

Optionally, a first reference object related to the photographer is acquired through a first camera in the first camera assembly, where the first reference object includes a body part of the photographer, and the body part includes a nose, a mouth, eyes, and the like of the photographer;

optionally, a second reference object related to the shooting scene is acquired by a second camera in the second camera assembly, where the second reference object belongs to a shooting object in the shooting scene, and it can be understood that, in this step, only a shooting preview image corresponding to the shooting scene is acquired by the second camera, and the shooting preview image includes the second reference object required in this embodiment, but the second reference object does not determine which shooting object is.

The method has the advantages that a first reference object related to a photographer is acquired through a first camera in a first camera assembly, wherein the first reference object comprises a body part of the photographer; then, a second reference object related to the shooting scene is acquired through a second camera in the second camera shooting assembly, wherein the second reference object belongs to a shooting object in the shooting scene. The control scheme of focusing is realized more conveniently, the user can quickly and accurately control focusing without using extra hands, the operation efficiency is improved, and the user experience is enhanced.

Example four

Fig. 9 is a flowchart of a fourth embodiment of a focus-following shooting method according to the present invention, in which the determining a shooting preview area of the wearable device according to the wearing state and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object according to the above embodiments includes:

s21, in the wearing state, combining the first reference object, and dividing the display area of the wearing equipment into the shooting preview area;

and S22, detecting the position relation of the first reference object compared with the shooting preview area in a preset detection time period, and determining that the first reference object corresponds to the visual focus in the shooting preview area according to the position relation.

In this embodiment, first, in the wearing state, the shooting preview area is obtained by dividing the display area of the wearable device in combination with the first reference object; then, in a preset detection time period, detecting the position relation of the first reference object compared with the shooting preview area, and determining that the first reference object corresponds to the visual focus in the shooting preview area according to the position relation.

Optionally, in the wearing state, the shooting preview area is obtained by dividing in the display area of the wearing device in combination with the first reference object, wherein in the display area of the wearing device, in combination with the position of the first reference object relative to the wearing device and the body part of the first reference, the shooting preview area adapted to the eyes of the user is divided, so that the user can view the shooting preview area conveniently;

optionally, in a preset detection time period, detecting a position relationship between the first reference object and the shooting preview area, and determining a visual focus of the first reference object in the shooting preview area according to the position relationship, where the visual focus in the shooting preview area is determined according to a center point of an eye, it can be understood that the visual focus of the first reference object in the shooting preview area can be determined according to the position relationship between the first reference object and the shooting preview area.

The embodiment has the advantages that the shooting preview area is obtained by dividing the display area of the wearable device in combination with the first reference object in the wearing state; then, in a preset detection time period, detecting the position relation of the first reference object compared with the shooting preview area, and determining that the first reference object corresponds to the visual focus in the shooting preview area according to the position relation. The control scheme of focusing is realized more conveniently, the user can quickly and accurately control focusing without using extra hands, the operation efficiency is improved, and the user experience is enhanced.

EXAMPLE five

Fig. 10 is a flowchart of a focus-following shooting method according to a fifth embodiment of the present invention, in which, based on the above embodiment, the determining a coverage area corresponding to the visual focus in the shooting preview area, and using an object included in the coverage area as the second reference object in combination with the shooting scene includes:

s31, acquiring the vertical distance between the first reference object and the shooting preview area in the preset detection time period;

and S32, determining the area range of the coverage area according to the vertical distance.

In this embodiment, first, in the preset detection time period, a vertical distance between the first reference object and the shooting preview area is obtained; then, the area range of the coverage area is determined according to the vertical distance.

Optionally, in the preset detection time period, acquiring a vertical distance between the first reference object and the shooting preview area, wherein the corresponding detection time period is determined according to a current shooting scene or a motion speed of a shooting object in a preview image;

optionally, the area range of the coverage area is determined according to the vertical distance and a proportional relationship between the corresponding distance and the range.

The method has the advantages that the vertical distance between the first reference object and the shooting preview area is acquired within the preset detection time period; then, the area range of the coverage area is determined according to the vertical distance. The control scheme of focusing is realized more conveniently, the user can quickly and accurately control focusing without using extra hands, the operation efficiency is improved, and the user experience is enhanced.

EXAMPLE six

Fig. 11 is a flowchart of a sixth embodiment of the focus-following shooting method according to the present invention, in which based on the above embodiment, the determining a coverage area corresponding to the visual focus in the shooting preview area, and using an object included in the coverage area as the second reference object in combination with the shooting scene further includes:

s33, determining a coverage area corresponding to the visual focus in the shooting preview area by combining the area range of the coverage area;

and S34, identifying the display object in the coverage area, combining the shooting scene, converting the display object into a real object in the shooting scene, and taking the real object as the second reference object.

In this embodiment, first, a coverage area corresponding to the visual focus is determined in the shooting preview area in combination with an area range of the coverage area; then, identifying a display object in the coverage area, converting the display object into a real object in the shooting scene by combining the shooting scene, and taking the real object as the second reference object.

Optionally, a coverage area corresponding to the visual focus is determined in the shooting preview area in combination with the area range of the coverage area, and similarly, as described in the above example, the area range is determined according to a corresponding proportional relationship, and the display object is converted into a real object in the shooting scene in combination with the shooting scene, where the display object is an object in a preview image in a preview state, and the real object in the shooting scene is an object corresponding to image information in image information acquired by a camera.

The method has the advantages that the coverage area corresponding to the visual focus is determined in the shooting preview area by combining the area range of the coverage area; then, identifying a display object in the coverage area, converting the display object into a real object in the shooting scene by combining the shooting scene, and taking the real object as the second reference object. The control scheme of focusing is realized more conveniently, the user can quickly and accurately control focusing without using extra hands, the operation efficiency is improved, and the user experience is enhanced.

EXAMPLE seven

Fig. 12 is a flowchart of a focus-following shooting method according to a seventh embodiment of the present invention, in which, based on the above embodiment, the determining a focus-following preview area of the wearable device according to the wearing state, and performing a real-time tracking instruction in the focus-following preview area in combination with the relative speeds of the shooting scene and the second reference object in the focus-following preview area include:

s41, in the wearing state, dividing the display area of the wearing equipment into two focus-following preview areas which are adjacent to the shooting preview area at the left and the right;

s42, a plurality of right and left adjacent focus tracking sub-regions are provided in each of the two focus tracking preview regions.

In this embodiment, first, in the worn state, two focus following preview areas adjacent to the shooting preview area on the left and right sides are obtained by dividing the display area of the wearable device; then, a plurality of right and left adjacent focus tracking sub-regions are provided in each of the two focus tracking preview regions.

Optionally, in this embodiment, in the worn state, two focus-following preview areas adjacent to the shooting preview area on the left and right sides are obtained by dividing in the display area of the wearable device, where the width of the focus-following preview area is determined according to the movement speed of the shooting object in the current preview image;

optionally, in this embodiment, in the worn state, two focus tracking preview areas adjacent to the shooting preview area on the left and right sides are obtained by dividing in the display area of the wearable device, where if the motion speed of the shooting object in the current preview image is higher, the width of the focus tracking preview area is correspondingly determined to be wider;

optionally, in this embodiment, in the worn state, two focus tracking preview areas adjacent to the shooting preview area on the left and right sides are obtained by dividing the display area of the wearable device, where the width of the focus tracking preview area is determined according to the movement speed of the second reference object in the current preview image, and if the movement speed of the second reference object in the current preview image is higher, the width of the focus tracking preview area is correspondingly determined to be wider.

The embodiment has the advantages that in the wearing state, two focus-following preview areas adjacent to the shooting preview area at the left and the right are obtained by dividing the display area of the wearing device; then, a plurality of right and left adjacent focus tracking sub-regions are provided in each of the two focus tracking preview regions. The control scheme of focusing is realized more conveniently, the user can quickly and accurately control focusing without using extra hands, the operation efficiency is improved, and the user experience is enhanced.

Example eight

Fig. 13 is a flowchart of an eighth embodiment of the focus-following shooting method according to the present invention, in which, based on the above embodiment, the determining a focus-following preview area of the wearable device according to the wearing state, and performing a real-time tracking instruction in the focus-following preview area in combination with relative speeds of the shooting scene and the second reference object in the focus-following preview area further includes:

s43, acquiring the rotation angular speed of the wearable device, and determining a corresponding reference speed according to the rotation angular speed;

and S44, determining the movement speed of the second reference object in the focus-following preview area by combining the shooting scene and the relative speed of the second reference object, comparing the reference speed and the movement speed in real time, and tracking and indicating the difference value of the reference speed and the movement speed through each focus-following sub-area in the focus-following preview area.

In this embodiment, first, a rotation angular velocity of the wearable device is obtained, and a corresponding reference velocity is determined according to the rotation angular velocity; and then, in the focus-following preview area, determining the movement speed of the second reference object by combining the shooting scene and the relative speed of the second reference object, comparing the reference speed and the movement speed in real time, and tracking and indicating the difference value of the reference speed and the movement speed through each focus-following sub-area in the focus-following preview area.

Optionally, a rotation angular velocity of the wearable device is obtained, and a corresponding reference velocity is determined according to the rotation angular velocity, where the rotation angular velocity is an angular velocity obtained by using the second camera module as a reference, and the reference velocity is a reference velocity of the second reference object estimated by combining the angular velocity and a distance of the second reference object;

optionally, in the focus-following preview area, determining a movement speed of the second reference object by combining the shooting scene and the relative speed of the second reference object, comparing the reference speed and the movement speed in real time, and tracking and indicating a difference value between the reference speed and the movement speed through each focus-following sub-area in the focus-following preview area. For example, when the reference speed is less than the moving speed, the user is prompted to increase the speed in the direction by the tracking instruction of the corresponding focus tracking sub-area in the focus tracking preview area, and when the reference speed is greater than the moving speed, the user is prompted to decrease the speed in the direction by the tracking instruction of the corresponding focus tracking sub-area in the focus tracking preview area, and when the speed direction of the reference speed is different from the moving direction of the moving speed, the user is prompted to adjust the current moving direction by the tracking instruction of the corresponding focus tracking sub-area in the focus tracking preview area.

The method has the advantages that the corresponding reference speed is determined according to the rotation angular speed of the wearable device by obtaining the rotation angular speed of the wearable device; and then, in the focus-following preview area, determining the movement speed of the second reference object by combining the shooting scene and the relative speed of the second reference object, comparing the reference speed and the movement speed in real time, and tracking and indicating the difference value of the reference speed and the movement speed through each focus-following sub-area in the focus-following preview area. The control scheme of focusing is realized more conveniently, the user can quickly and accurately control focusing without using extra hands, the operation efficiency is improved, and the user experience is enhanced.

Example nine

Based on the above embodiment, the present invention also provides a focus-following photographing apparatus, including:

Specifically, in this embodiment, first, a wearing state of the wearable device is obtained, and in the wearing state, a first reference object related to a photographer is obtained by a first camera, and a second reference object related to a shooting scene is obtained by a second camera; then, determining a shooting preview area of the wearable device according to the wearing state, and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object; then, determining a coverage area corresponding to the visual focus in the shooting preview area, and taking an object contained in the coverage area as the second reference object in combination with the shooting scene; and finally, determining a focus-following preview area of the wearable device according to the wearing state, and performing real-time tracking indication in the focus-following preview area by combining the shooting scene and the relative speed of the second reference object.

Example ten

Based on the foregoing embodiments, the present invention further provides a computer-readable storage medium, on which a bitmap processing program is stored, and when the bitmap processing program is executed by a processor, the bitmap processing program implements the steps of the bitmap processing method according to any one of the above.

By means of the bitmap processing method, the equipment and the computer readable storage medium, the wearing state of the wearing equipment is obtained, in the wearing state, the first reference object related to a photographer is obtained through the first camera, and the second reference object related to a shooting scene is obtained through the second camera; then, determining a shooting preview area of the wearable device according to the wearing state, and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object; then, determining a coverage area corresponding to the visual focus in the shooting preview area, and taking an object contained in the coverage area as the second reference object in combination with the shooting scene; and finally, determining a focus-following preview area of the wearable device according to the wearing state, and performing real-time tracking indication in the focus-following preview area by combining the shooting scene and the relative speed of the second reference object. The control scheme for quickly tracking the focus is realized, the focus tracking control can be quickly and accurately performed without the need of using extra hands by a user, the operation efficiency is improved, and the user experience is enhanced.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A focus-following photographing method, characterized by comprising:

determining a shooting preview area of the wearable device according to the wearing state, and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object; the first reference object is the center point of an eye, and the visual focus in the shooting preview area is determined according to the center point of the eye;

2. The focus-following shooting method according to claim 1, wherein the acquiring a wearing state of the wearing device, and in the wearing state, acquiring a first reference object related to the photographer by a first camera and acquiring a second reference object related to the shooting scene by a second camera, comprises:

acquiring the wearing state of the wearable equipment;

and determining the current enabled first camera shooting component and the second camera shooting component by combining the wearing state.

3. The focus-following photographing method according to claim 2, wherein the acquiring of the wearing state of the wearing apparatus, and in the wearing state, acquiring a first reference object related to the photographer by a first camera and acquiring a second reference object related to the photographing scene by a second camera, further comprises:

4. The focus-following shooting method according to claim 3, wherein the determining a shooting preview area of the wearable device according to the wearing state, and determining a visual focus of the photographer compared with the shooting preview area according to the shooting preview area and the first reference object, comprises:

5. The focus-following shooting method according to claim 4, wherein the determining of the coverage area corresponding to the visual focus in the shooting preview area and the setting of the object included in the coverage area as the second reference object in conjunction with the shooting scene comprise:

6. The focus-following shooting method according to claim 5, wherein the determining of the coverage area corresponding to the visual focus in the shooting preview area and the setting of the object included in the coverage area as the second reference object in conjunction with the shooting scene further include:

7. The focus-following shooting method according to claim 6, wherein the determining a focus-following preview area of the wearable device according to the wearing state, and performing a real-time tracking instruction in the focus-following preview area in combination with relative speeds of the shooting scene and the second reference object in the focus-following preview area includes:

8. The focus-following shooting method according to claim 7, wherein the determining a focus-following preview area of the wearable device according to the wearing state, and performing a real-time tracking instruction in the focus-following preview area in combination with relative speeds of the shooting scene and the second reference object in the focus-following preview area further includes:

9. A focus-following photographing apparatus, characterized in that the apparatus comprises:

the computer program, when executed by the processor, implementing the steps of the method of any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a focus-following photographing program that realizes the steps of the focus-following photographing method according to any one of claims 1 to 8 when executed by a processor.