CN114302063B

CN114302063B - Shooting method and equipment

Info

Publication number: CN114302063B
Application number: CN202210012722.3A
Authority: CN
Inventors: 王双; 胡洞民; 寇大贺
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2019-06-24
Filing date: 2020-04-22
Publication date: 2022-11-11
Anticipated expiration: 2040-04-22
Also published as: CN114302063A

Abstract

The embodiment of the application provides a shooting method and equipment, relates to the technical field of electronics, and responds to the operation of a user, a camera function of electronic equipment is started, a first preview interface is displayed, and the first preview interface comprises a first preview image acquired by a default camera; responding to an operation of increasing a first zoom ratio on a first preview interface by a user, and when the zoom ratio is greater than or equal to a preset value, displaying a second preview interface, wherein the second preview interface comprises an auxiliary view frame and a real-time view frame, the auxiliary view frame is used for displaying an auxiliary preview image acquired by an auxiliary camera, and the real-time view frame is used for displaying a second preview image acquired by a telephoto camera in real time; and changing the second zoom magnification of the second preview image in the live view frame in response to a pinch-in operation or an operation opposite to the pinch-in operation by the user in the live view frame.

Description

Shooting method and equipment

Technical Field

The embodiment of the application relates to the technical field of electronics, in particular to a shooting method and equipment.

Background

With the development of electronic technology, more and more cameras are integrated on electronic equipment. The plurality of cameras may include cameras of multiple focal segments, such as may include short-focus wide-angle cameras, medium-focus cameras, and long-focus cameras. The cameras of different focal lengths can correspond to different viewing ranges and zoom magnifications, so that shooting scenes of the electronic equipment can be enriched.

When a user switches the zoom ratio, a camera used by the electronic device for shooting may also be switched accordingly. For example, when the zoom ratio is switched to the large zoom ratio, the electronic device may switch from the wide camera or the medium-focus camera to the telephoto camera, so as to display a preview picture of the telephoto camera and perform shooting by using the telephoto camera.

After the wide-angle camera or the middle-focus camera is switched to the long-focus camera, the view finding range is reduced, and a target object to be photographed easily runs out of a preview picture of the long-focus camera. That is, the electronic apparatus easily loses the target object to be photographed. In the case of previewing using a telephoto camera, it is often difficult for a user to find a target object even taking a long time.

Disclosure of Invention

The embodiment of the application provides a shooting method and shooting equipment, which can guide a user to move electronic equipment according to a target object, so that the electronic equipment can adopt a long-focus camera to quickly lock the target object, the time for the user to search for the target object is saved, and the use experience of the user is improved.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

in one aspect, an embodiment of the present application provides a shooting method, including: the electronic device starts the camera. And then, the electronic equipment adopts the first camera and the second camera to respectively acquire the first preview image and the second preview image. The second camera is a long-focus camera, and the view range of the first camera is larger than that of the second camera. The electronic device displays a first preview interface. The first preview interface includes a first view frame, a second view frame, and a third view frame. The first viewfinder is used for displaying a first preview image. The image in the second viewing frame is a part of the first preview image; and the content in the second viewing frame is a target object to be shot by the second camera. The third viewing frame is used for displaying the second preview image. The electronic equipment displays first prompt information, and the first prompt information is used for guiding a user to move the electronic equipment so that the second camera can lock the target object after the electronic equipment moves.

Therefore, after the electronic equipment is switched from a first camera such as a wide-angle camera or a medium-focus camera to a long-focus camera such as a second camera, the electronic equipment can guide a user to move the electronic equipment through the prompt information. So that, after the electronic device moves, the tele camera can quickly lock on the target object. Further, the electronic device may capture an image of the target object using a tele camera.

In one possible design, after the electronic device displays the first preview interface, the method further includes: the electronic device detects a drag operation of the user for the second finder frame. The electronic device moves the second view frame on the first preview image in response to the drag operation, and the target object changes with a change in a position of the second view frame.

That is, the user can specify and change the target object by dragging the position of the second finder frame.

In another possible design, the method further includes: when the second view frame is close to the third view frame, the electronic equipment moves the third view frame away to avoid the second view frame.

Therefore, the second viewfinder frame and the third viewfinder frame do not overlap, and a user can intuitively and clearly see the contents in the two viewfinder frames.

In another possible implementation, the first prompt information is used for indicating the moving direction and the moving distance of the electronic equipment.

That is, the electronic device may prompt the user of the direction and the movement amplitude of the mobile electronic device through the first prompt message.

In another possible implementation, the first prompt message is an arrow, the pointing direction of the arrow is used for indicating the moving direction, and the length of the arrow indicates the moving distance. After the electronic device is moved in the direction indicated by the arrow, the length of the arrow becomes shorter.

That is, the arrow may serve as the first prompt message, and may dynamically indicate whether the user moves the electronic device, and the size of the movement distance, and whether the movement direction is correct, and so on.

In another possible design, the first prompt message may also indicate a flip direction of the electronic device, and a flip angle.

Therefore, the first prompt message can not only prompt the user of the direction and the amplitude of the mobile electronic equipment, but also prompt the user of the direction and the amplitude of the turnover electronic equipment.

In another possible design, the smaller the size of the second viewing frame, the greater the zoom magnification of the second preview image in the third viewing frame; the larger the size of the second finder frame is, the smaller the zoom magnification of the second preview image in the third finder frame is. After the electronic device displays the first preview interface, the method further includes: the electronic equipment detects the operation of adjusting the size of the second viewing frame by the user; the electronic equipment adjusts the size of the second viewing frame; the electronic equipment determines the zooming magnification according to the adjusted size of the second viewfinder; and the electronic equipment displays the second preview image in the third view frame according to the zoom magnification.

That is, the zoom magnification of the image in the third finder frame is inversely related to the size of the second finder frame, and the user can adjust the zoom magnification of the image in the third finder frame by adjusting the size of the second finder frame.

In another possible design, after the electronic device displays the first prompt message, the method further includes: and if the electronic equipment determines that the second camera locks the target object, the electronic equipment displays a second preview interface, and the second preview interface is used for displaying a second preview image acquired by the second camera.

That is to say, when the electronic device displays the first preview interface, if the electronic device determines that the telephoto camera locks the target object, the electronic device may switch to full-screen preview of the image acquired by the telephoto camera.

In another possible design, after the electronic device displays the second preview interface, the method further includes: the electronic device automatically captures an image.

And after the electronic equipment determines that the target object is locked by the long-focus camera, switching to display a second preview interface. Therefore, after the display of the second preview interface is switched, the electronic equipment can automatically shoot the image, so that the operation of shooting indicated by the user is saved.

In another possible design, the electronic device automatically captures an image, including: and if the electronic equipment determines that the second camera locks the target object, the electronic equipment automatically shoots an image. The method further comprises the following steps: and if the electronic equipment determines that the second camera does not lock the target object, the electronic equipment displays first prompt information.

That is, after the electronic device switches to display the second preview interface, whether the electronic device tele-camera locks the target object. If the target object is locked, automatically shooting an image; and if the target object is not locked, continuously prompting the user to move the electronic equipment so that the long-focus camera locks the target object again.

In another possible design, after the electronic device automatically captures the image, the method further includes: and if the electronic equipment determines that the second camera does not lock the target object, the electronic equipment displays first prompt information. The electronic device captures an image after detecting an operation of a user instructing to capture.

In the scheme, after the electronic equipment automatically shoots the image, the electronic equipment can also instruct the user to move the mobile phone through the prompt message, so that the user can continue to shoot the image manually.

In another possible design, after the electronic device displays the second preview interface, the method further includes: the electronic equipment shoots an image after detecting an operation of shooting instructed by a user.

That is, after switching to display the second preview interface, the electronic device may not automatically capture an image, but capture an image after receiving an instruction from the user.

In another possible design, after the electronic device displays the second preview interface, the method further includes: and if the electronic equipment determines that the second camera does not lock the target object, the electronic equipment displays first prompt information. The electronic device captures an image after detecting an operation of a user instructing to capture.

That is, the electronic device may continuously instruct the user to move the electronic device through the prompt message when the tele-camera is not locked with the target object.

In another possible design, the method further includes: and if the electronic equipment determines that the second camera locks the target object, the electronic equipment stops displaying the first prompt message.

In this way, after the tele camera locks the target object, the electronic device may stop prompting the user to move the electronic device.

In another possible design, if the electronic device determines that the second camera locks the target object, the electronic device displays a second prompt message, where the second prompt message is used to prompt the user that the second camera locks the target object.

Therefore, after the long-focus camera locks the target object, the electronic equipment can remind the user that the long-focus camera locks the target object through other prompt messages, and shooting can be carried out.

In another possible design, before the electronic device displays the first prompt message, the method further includes: and when the electronic equipment calculates that the second camera locks the target object, the target motion posture corresponding to the electronic equipment. The electronic equipment displays first prompt information, and the method comprises the following steps: and the electronic equipment determines the adjustment information according to the difference between the current motion attitude and the target motion attitude. And the electronic equipment displays the first prompt message according to the adjustment message. The electronic equipment determines that the second camera locks the target object, and the method comprises the following steps: and when the current motion posture is matched with the target motion posture, the electronic equipment determines that the second camera locks the target object.

In the scheme, the electronic equipment can display the first prompt information according to the current motion attitude and the target motion attitude, and determine whether the long-focus camera locks the target object.

In another possible design, the electronic device determining that the second camera locks the target object includes: and when the preview image acquired by the second camera is matched with the image in the second viewing frame, the electronic equipment determines that the second camera locks the target object.

In this scheme, the electronic device may determine whether the tele camera locks the target object according to whether the preview image acquired by the tele camera matches the image of the target object.

In another possible design, after the electronic device displays the second preview interface, the method further includes: and if the electronic equipment detects that the user indicates the operation of returning, the first preview interface can be displayed in a returning mode.

In another possible design, after the electronic device displays the first preview interface, the method further includes: if the electronic equipment detects that the target object is in the motion state, the electronic equipment moves the second view frame according to the motion state of the target object, so that the target object is in the second view frame.

That is, the position of the second finder frame may move as the target object moves, so that the second finder frame may include the target object in real time.

In particular, after the user designates the target object, for example, the user drags the second finder frame to designate the target object, the position of the second finder frame may move along with the movement of the target object.

In another possible design, if the electronic device detects that the target object is in a moving state, the method further includes: the electronic device displays a motion marker for indicating a motion direction and a contour of the target object.

In this scheme, in the case that the target object moves, the electronic device may further display a motion mark to allow the user to know information such as a motion direction and a contour size of the target object.

In another possible design, the electronic device displays a first prompt message, including: and when the electronic equipment calculates the target object locked by the second camera in real time, the real-time target motion attitude corresponding to the electronic equipment. The electronic equipment determines adjustment information according to a difference value between the current motion attitude and the real-time target motion attitude; and the electronic equipment displays the first prompt message according to the adjustment message. The electronic equipment determines that the second camera locks the target object, and the method comprises the following steps: and when the current motion attitude is matched with the real-time target motion attitude, the electronic equipment determines that the second camera locks the target object.

That is to say, under the condition that the target object moves, the electronic device may display the first prompt information according to the current real-time motion posture and the real-time target motion posture, and determine whether the long-focus camera locks the target object.

In another aspect, an embodiment of the present application provides an electronic device, including: one or more processors; a memory having code stored therein; the touch screen is used for detecting touch operation and displaying an interface; the code, when executed by the one or more processors, causes the electronic device to perform the steps of: starting a camera; the method comprises the steps of adopting a first camera and a second camera to collect a first preview image and a second preview image respectively, enabling the second camera to be a long-focus camera, and enabling the view range of the first camera to be larger than that of the second camera. Displaying a first preview interface, wherein the first preview interface comprises a first view frame, a second view frame and a third view frame; the first viewing frame is used for displaying a first preview image; the image in the second viewing frame is a part of the first preview image; the content in the second viewing frame is a target object to be shot by the second camera; the third viewing frame is used for displaying the second preview image. And displaying first prompt information, wherein the first prompt information is used for guiding a user to move the electronic equipment, so that the target object can be locked by the second camera after the electronic equipment moves.

In one possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: after the first preview interface is displayed, detecting the dragging operation of a user for the second view finding frame; in response to the drag operation, the second finder frame is moved on the first preview image, and the target object changes with a change in the position of the second finder frame.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: when the second viewing frame is close to the third viewing frame, the third viewing frame is moved away to avoid the second viewing frame.

In another possible design, the first prompt message is used to indicate a moving direction and a moving distance of the electronic device.

In another possible design, the first prompt message is an arrow, the direction of the arrow is used for indicating the moving direction, and the length of the arrow indicates the moving distance; after moving in the direction indicated by the arrow, the length of the arrow becomes shorter.

In another possible design, the smaller the size of the second viewing frame, the greater the zoom magnification of the second preview image in the third viewing frame; the larger the size of the second finder frame is, the smaller the zoom magnification of the second preview image in the third finder frame is. The code, when executed by the one or more processors, further causes the electronic device to perform the steps of: after the first preview interface is displayed, detecting the operation of adjusting the size of the second viewing frame by a user; adjusting the size of the second viewing frame; determining zoom magnification according to the adjusted size of the second viewing frame; and displaying the second preview image in the third viewing frame according to the zoom magnification.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: after the first prompt message is displayed, if it is determined that the second camera locks the target object, a second preview interface is displayed, and the second preview interface is used for displaying a second preview image acquired by the second camera.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: after the second preview interface is displayed, an image is automatically captured.

In another possible design, the image is automatically captured, including: and if the second camera is determined to lock the target object, automatically shooting the image. The code, when executed by the one or more processors, further causes the electronic device to perform the steps of: and if the second camera is determined not to lock the target object, displaying first prompt information.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: and after the image is automatically shot, if the second camera is determined not to lock the target object, displaying first prompt information. After an operation of a user instructing photographing is detected, an image is photographed.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: after the second preview interface is displayed, an image is photographed after an operation of a user instructing photographing is detected.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: and after the second preview interface is displayed, if the second camera is determined not to lock the target object, displaying first prompt information. After an operation of a user instructing photographing is detected, an image is photographed.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: and if the second camera is determined to lock the target object, stopping displaying the first prompt message.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: and if the second camera is determined to lock the target object, displaying second prompt information, wherein the second prompt information is used for prompting a user that the second camera locks the target object.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: and before the first prompt information is displayed, calculating the corresponding target motion attitude when the second camera locks the target object. Displaying first prompt information, including: determining adjustment information according to a difference value between the current motion attitude and the target motion attitude; and displaying the first prompt message according to the adjustment message. Determining a second camera locking target object, comprising: and when the current motion posture is matched with the target motion posture, determining that the second camera locks the target object.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: after the first preview interface is displayed, if the target object is detected to be in a motion state, the second view frame is moved according to the motion state of the target object, so that the target object is in the second view frame.

In another possible design, the code, when executed by the one or more processors, further causes the electronic device to perform the steps of: and if the target object is detected to be in a motion state, displaying a motion mark. The motion marker is used for representing the motion direction and the outline of the target object.

In another possible design, displaying the first prompt message includes: calculating the corresponding real-time target motion attitude when the second camera locks the target object in real time; determining adjustment information according to a difference value between the current motion attitude and the real-time target motion attitude; and displaying the first prompt message according to the adjustment message. Determining a second camera locking target object, comprising: and when the current motion posture is matched with the real-time target motion posture, determining that the second camera locks the target object.

In another aspect, the present disclosure provides a shooting device, which is included in an electronic device, and has a function of implementing the behavior of the electronic device in any one of the above aspects and possible designs. The function can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes at least one module or unit corresponding to the above-described functions. For example, a starting module or unit, an acquisition module or unit, a display module or unit, a processing module or unit, a moving module or unit, a shooting module or unit, etc.

In another aspect, an embodiment of the present application provides a computer storage medium, which includes computer instructions, when the computer instructions are executed on an electronic device, cause the electronic device to perform the shooting method in any one of the possible designs of the foregoing aspects.

In yet another aspect, the present application provides a computer program product, which when run on a computer, causes the computer to execute the shooting method in any one of the possible designs of the above aspect.

Drawings

Fig. 1A is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 1B is a schematic distribution diagram of cameras provided in the embodiment of the present application;

fig. 1C is a schematic view of a viewing range of a group of different cameras provided in the present application;

fig. 1D is a schematic view of a viewing range of another group of different cameras provided in the embodiment of the present application;

FIG. 2A is a schematic diagram of an interface for a set of cameras provided in an embodiment of the present application;

fig. 2B is a schematic diagram of a preview interface provided in the embodiment of the present application;

FIG. 3 is a schematic diagram of a set of tele assist mode entry provided by an embodiment of the present application;

FIGS. 4A-4C are schematic diagrams of another set of methods for entering tele assist mode according to embodiments of the present disclosure;

5A-5G are schematic diagrams of a set of tele-assisted preview interfaces provided by embodiments of the present application;

fig. 6 is a schematic diagram of correspondence between different cameras and different areas according to an embodiment of the present application;

FIGS. 7A-7D are schematic diagrams of a set of hint identifiers provided by an embodiment of the present application;

8A-8C are schematic diagrams of a set of tele preview interfaces provided by embodiments of the present application;

FIGS. 9A-9B are diagrammatic illustrations of another set of prompt identifiers provided in accordance with an embodiment of the present application;

FIGS. 10A-10B are schematic diagrams of a set of motion markers provided by embodiments of the present application;

11A-11C are schematic diagrams of interfaces for a set of tele auxiliary videos provided by an embodiment of the present application;

fig. 12 is a flowchart of a shooting method according to an embodiment of the present disclosure.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more than two.

The view finding range of the long-focus camera is small, the size of an object on an image shot by the long-focus camera is large, and the long-focus camera can be suitable for shooting a distant object, a close-up scene, object details or shooting a certain small object specially. The wide-angle camera and the middle-focus camera have larger viewing range and can shoot objects and pictures in a larger range.

When other cameras such as a wide-angle camera or a mid-focus camera are switched to a telephoto camera for shooting, the electronic device is prone to lose a target object to be shot. That is, it is difficult for the electronic device to lock the target object by the long focus camera. The user cannot see the target object on the preview interface of the tele-camera. In the prior art, after the target object is lost, the user does not know the specific position of the target object, so that the user usually searches heuristically around blindly in hope of finding the target object. Moreover, because the view range (or the range of view angle that can be shot) of the telephoto camera is small, and the target object is usually far away from the user, the user is likely to miss the target object during searching. Therefore, the user often takes much time and effort, and it is difficult to search for the target object.

The embodiment of the application provides a shooting method which can be applied to electronic equipment. For example, the electronic device may specifically be a mobile phone, a tablet computer, a wearable device, an in-vehicle device, an Augmented Reality (AR)/Virtual Reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), or a specialized camera (e.g., a single lens reflex camera, a card camera), and the like, and the specific type of the electronic device is not limited in this embodiment of the application.

In the embodiment of the application, the user can specify the target object in the shooting scene. After the electronic equipment is switched to the tele camera by other cameras such as the wide-angle camera or the mid-focus camera, the electronic equipment can guide the user to move the electronic equipment according to a target object specified by the user. The user can move the electronic device according to the guide, so that the long-focus camera behind the mobile electronic device can quickly lock the target object. Further, the electronic device may capture an image of the target object using a tele camera.

For example, fig. 1A shows a schematic structural diagram of the electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identity Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. Wherein, the different processing units may be independent devices or may be integrated in one or more processors.

The controller may be, among other things, a neural center and a command center of the electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the time sequence signal to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be called directly from memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus including a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, the processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, a charger, a flash, a camera 193, etc. through different I2C bus interfaces, respectively. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement a touch function of the electronic device 100.

The I2S interface may be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus, enabling communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface, so as to implement a function of answering a call through a bluetooth headset.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled by a PCM bus interface. In some embodiments, the audio module 170 may also transmit the audio signal to the wireless communication module 160 through the PCM interface, so as to implement the function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a bluetooth headset.

The MIPI interface may be used to connect the processor 110 with peripheral devices such as the display screen 194, the camera 193, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the capture functionality of electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, and the like.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transmit data between the electronic device 100 and a peripheral device. And the method can also be used for connecting a headset and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices and the like.

It should be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only an illustration, and does not limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication applied to the electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 and antenna 2 is coupled to wireless communication module 160 so that electronic device 100 can communicate with networks and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), general Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. GNSS may include Global Positioning System (GPS), global navigation satellite system (GLONASS), beidou satellite navigation system (BDS), quasi-zenith satellite system (QZSS), and/or Satellite Based Augmentation System (SBAS).

The electronic device 100 implements display functions via the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

In a shooting scene, the display screen 194 may display a preview image captured by the camera. In some embodiments, the display screen 194 may display an auxiliary view frame, a target view frame, and a live view frame. The auxiliary view frame is used for displaying an auxiliary preview image. The auxiliary preview image is a preview image collected by an auxiliary camera except the telephoto camera. For example, the auxiliary camera is a wide-angle camera or a mid-focus camera. The target view frame is used for displaying a target object to be shot by the telephoto camera, which is specified by the user on the auxiliary preview image. The real-time view finder is used for displaying a preview image acquired by the long-focus camera in real time.

In other embodiments, the display screen 194 may further display prompt information to guide the user to move the electronic device 100, so that the moved electronic device 100 may quickly lock the target object through the telephoto camera, thereby performing image capturing.

The electronic device 100 may implement a photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV and other formats. In some embodiments, electronic device 100 may include N cameras 193, N being a positive integer greater than 1.

Wherein, the N cameras may include a plurality of rear cameras. The N cameras may also include one or more front cameras. Alternatively, the camera may be a liftable camera.

The N cameras may include multiple types of cameras. For example, the N cameras may include a tele camera, and one or more of a wide camera, a mid-focus camera, or a time of flight (TOF) camera, among others. Wherein, wide-angle camera can include the very big super wide-angle camera of scope of finding a view.

The N cameras may include cameras of different focal lengths. The focal segment may include, but is not limited to: a first focal length (also referred to as a short focal length) having a focal length of less than a preset value of 1 (e.g., 35 mm), a second focal length (also referred to as a middle focal length) having a focal length of greater than or equal to a preset value of 1 and less than or equal to a preset value of 2 (e.g., 85 mm), and a third focal length (also referred to as a long focal length) having a focal length of greater than a preset value of 2. Wherein, the view finding scope that the camera of first focus section can be shot is great, and the camera of first focus section can be wide-angle camera. The view finding range that the camera of third focal length can shoot is less, and the camera of third focal length can be long focus camera. The size of the view finding range that the camera of the second burnt section can shoot is placed in the middle, and the camera of the second burnt section can be well burnt camera.

For example, when the electronic device 100 includes a wide camera, a mid camera, and a tele camera, the distribution diagram of the 3 cameras can be seen in fig. 1B. The view range that can be captured by the three cameras can be seen in fig. 1C.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor, which processes input information quickly by referring to a biological neural network structure, for example, by referring to a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the electronic device 100 can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, phone book, etc.) created during use of the electronic device 100, and the like. In addition, the internal memory 121 may include a high speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a Universal Flash Storage (UFS), and the like.

The electronic device 100 may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signals for output, and also used to convert analog audio inputs into digital audio signals. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into a sound signal. The electronic apparatus 100 can listen to music through the speaker 170A or listen to a hands-free call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the electronic apparatus 100 receives a call or voice information, it is possible to receive voice by placing the receiver 170B close to the human ear.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking near the microphone 170C through the mouth. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C to achieve a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and perform directional recording.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A can be of a wide variety, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic apparatus 100 may also calculate the touched position from the detection signal of the pressure sensor 180A. In some embodiments, the touch operations that are applied to the same touch position but have different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.

The gyro sensor 180B may be used to determine the current real-time motion attitude of the electronic device 100 (e.g., the tilt angle and the position of the electronic device 100, etc.). In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., the x, y, and z axes) may be determined by gyroscope sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects a shake angle of the electronic device 100, calculates a distance to be compensated for by the lens module according to the shake angle, and allows the lens to counteract the shake of the electronic device 100 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes.

The motion postures of the electronic apparatus 100 are different, and the contents shot by the camera on the electronic apparatus 100 are also different. Illustratively, as can be seen from a comparison between fig. 1C and fig. 1D, when the motion posture of the electronic device 100 changes, the contents that can be captured by the wide camera and the tele camera also change.

If the telephoto camera is to be used to capture the target object, the electronic device 100 may be moved to change the motion posture of the electronic device 100, so as to change the content that can be captured by the telephoto camera, and make the target object within the view range of the telephoto camera.

In some embodiments, the processor 110 may determine, according to a target object in the target view frame specified by the user, a target motion posture corresponding to the electronic device 100 when the target object is captured by using the telephoto camera. The processor 110 may also provide a prompt to the user based on the difference between the current real-time motion pose of the electronic device 100 and the target motion pose, to direct the user to move the electronic device 100 based on the prompt. So that the electronic apparatus 100 can quickly lock the target object through the telephoto camera after moving, thereby performing image photographing.

In other embodiments, when the target object moves, the processor 110 may further track the moving target object by using an image recognition technology, and determine a real-time target movement posture corresponding to the electronic device 100 when the moving target object is captured by using the telephoto camera. The processor 110 may also provide a prompt to the user based on the difference between the current real-time motion gesture and the real-time target motion gesture to direct the user to move the electronic device 100 based on the prompt. So that the electronic apparatus 100 can quickly lock the target object through the telephoto camera after moving, and perform image capturing.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, electronic device 100 calculates altitude, aiding in positioning and navigation, from barometric pressure values measured by barometric pressure sensor 180C.

The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip holster using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the opening and closing state of the leather sheath or the opening and closing state of the flip cover, the automatic unlocking of the flip cover is set.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 100 is stationary. The method can also be used for identifying the posture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and the like.

A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, taking a picture of a scene, the electronic device 100 may utilize the distance sensor 180F to range to achieve fast focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light to the outside through the light emitting diode. The electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there are no objects near the electronic device 100. The electronic device 100 can utilize the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear for talking, so as to automatically turn off the screen to achieve the purpose of saving power. The proximity light sensor 180G can also be used in a holster mode, a pocket mode automatically unlocks and locks the screen.

The ambient light sensor 180L is used to sense ambient light brightness. Electronic device 100 may adaptively adjust the brightness of display screen 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 can utilize the collected fingerprint characteristics to unlock the fingerprint, access the application lock, photograph the fingerprint, answer an incoming call with the fingerprint, and so on.

The temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 implements a temperature processing strategy using the temperature detected by temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 performs a reduction in performance of a processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, the electronic device 100 heats the battery 142 when the temperature is below another threshold to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than a further threshold, the electronic device 100 performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.

The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may be disposed on a surface of the electronic device 100, different from the position of the display screen 194.

The bone conduction sensor 180M can acquire a vibration signal. In some embodiments, the bone conduction sensor 180M may acquire a vibration signal of the human voice vibrating a bone mass. The bone conduction sensor 180M may also contact the human pulse to receive the blood pressure pulsation signal. In some embodiments, the bone conduction sensor 180M may also be disposed in a headset, integrated into a bone conduction headset. The audio module 170 may analyze a voice signal based on the vibration signal of the bone mass vibrated by the sound part acquired by the bone conduction sensor 180M, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure beating signals acquired by the bone conduction sensor 180M, and the heart rate detection function is achieved.

The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The electronic apparatus 100 may receive a key input, and generate a key signal input related to user setting and function control of the electronic apparatus 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be brought into and out of contact with the electronic apparatus 100 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. The same SIM card interface 195 can be inserted with multiple cards at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as communication and data communication. In some embodiments, the electronic device 100 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

In the embodiment of the application, a user can specify a target object to be shot by a long-focus camera. The sensors such as the gyro sensor 180B may determine the current real-time motion gesture of the electronic device 100 in real time. The processor 110 may determine a target motion posture corresponding to the electronic device 100 when the target object is shot by using the telephoto camera according to the target object specified by the user in the target view box. The processor 110 may also provide a prompt to the user based on the difference between the current real-time motion gesture and the target motion gesture to direct the user to move the electronic device 100 based on the prompt. So that the electronic apparatus 100 can quickly lock the target object through the telephoto camera after moving, thereby performing image photographing.

The shooting method provided by the embodiment of the present application will be explained below by taking the electronic device with the structure shown in fig. 1A as a mobile phone, and taking the mobile phone as an example, where the mobile phone includes a touch screen. As above, the touch screen may include a display panel and a touch panel. The display panel may display an interface. The touch panel can detect the touch operation of a user and report the touch operation to the mobile phone processor for corresponding processing.

In some embodiments, when the user uses the mobile phone to capture an image, the user may instruct the mobile phone to start the camera by a touch operation, a key operation, a gesture operation in the air, or a voice operation. Illustratively, as shown in fig. 2A (a), the mobile phone starts a camera function after detecting an operation of clicking a camera icon 201 by a user.

In some embodiments, after the camera is started, the mobile phone may automatically enter a shooting mode such as a shooting mode, a video recording mode, or a tele auxiliary mode, and display a preview interface.

For example, the mobile phone may automatically enter the photographing mode after detecting an operation of clicking the camera icon 201 shown in (a) of fig. 2A by the user. In one example, the handset may display a preview interface 202 as shown in (b) of fig. 2A. In another example, a preview interface is displayed as shown in FIG. 2B. The preview interface shown in fig. 2A or fig. 2B includes a view box. The preview image collected by the default camera can be displayed in the view-finding frame. For example, the default camera may be a wide-angle camera.

After the mobile phone starts the camera, if the mobile phone does not enter the tele auxiliary mode, the mobile phone can enter the tele auxiliary mode according to the instruction of the user; or, the mobile phone can automatically enter the tele auxiliary mode according to the zoom magnification.

For example, on the preview interface 202 shown in (b) in fig. 2A, if the mobile phone detects an operation of clicking the control 203 by the user, the tele-assist mode may be entered.

For further example, referring to (c) in fig. 2A, the mobile phone detects that the user is on the preview interface 202, and instructs an operation of increasing the zoom magnification. For example, the operation indicating to increase the zoom magnification may be an operation in which the user drags the zoom scale 204 on the preview interface 202, or an operation in which the user's finger performs the reverse of the pinch-in on the preview interface 202. If the increased zoom magnification is greater than or equal to the preset value 3 (for example, 5 times), the mobile phone may automatically enter the tele auxiliary mode.

As another example, on the preview interface in the photographing mode shown in (a) in fig. 3, if the mobile phone detects an operation of clicking the control 301 by the user, a setting interface shown in (c) in fig. 3 may be displayed. Alternatively, on the preview interface shown in (b) in fig. 3, if the mobile phone detects an operation of clicking the control 302 by the user, a setting interface as shown in (c) in fig. 3 may be displayed. Then, if the mobile phone detects that the user clicks the control 303, the tele-assist mode is entered.

For another example, in the photographing mode, a camera identifier may be included on a preview interface displayed by the mobile phone. After detecting the operation of selecting the identification of the long-focus camera by the user, the mobile phone determines that the user selects the long-focus camera to shoot the image, and then enters a long-focus auxiliary mode. For example, referring to fig. 4A, the preview interface of the mobile phone includes a rear wide-angle camera identifier 401, a rear middle-angle camera identifier 402, a rear tele-camera identifier 403, and the like. When the mobile phone detects that the user clicks the mark 403, the mobile phone enters a tele-assisted mode.

As another example, in the photographing mode, the mobile phone may prompt the user whether to enter the tele-assist mode. Or, in the photographing mode, after the mobile phone determines that the user selects the tele camera to photograph the image, the mobile phone may prompt the user whether to enter the tele auxiliary mode. For example, referring to fig. 4B, the cell phone may display information 405 to prompt the user; after detecting the operation of clicking the control 406 by the user, the mobile phone enters a tele-assisted mode.

For another example, in the photographing mode or the video recording mode, after detecting that the user draws a preset track 1 (for example, an "F" track) on the touch screen, the mobile phone enters the tele assist mode.

In other embodiments, when the mobile phone displays a desktop or displays an interface of another application, and the user wants to use the tele-assist mode of the mobile phone, the mobile phone may start the camera function and directly enter the tele-assist mode according to an instruction of the user, such as a touch operation, an air gesture operation, a voice operation, or a key operation.

For example, when the mobile phone displays a desktop or displays an interface of another application, if an instruction that the user indicates to enter the tele auxiliary mode is received, the camera is started and the tele auxiliary mode is entered. As another example, in the case of bright screen and displaying the desktop, or in the case of black screen as shown in fig. 4C, if the mobile phone detects that the user draws a preset track 2 (for example, a "CF" track) on the touch screen, the camera is started and the tele-assist mode is entered.

The above-described manner of entering the telephoto auxiliary mode is only an exemplary illustration, and the mobile phone may also enter the telephoto auxiliary mode through other manners, and this embodiment of the application does not limit this specific manner.

After entering the long-focus auxiliary mode, the mobile phone starts the auxiliary camera and the long-focus camera. The mobile phone can display a tele auxiliary preview interface. As shown in fig. 5A or 5B, the tele-assistant preview interface 501 may include an assistant view frame 502 and a target view frame 503. In some embodiments, as shown in fig. 5C or 5D, tele-assisted preview interface 501 may also include a live view box 504.

The auxiliary view frame 502 may be used to display a preview image captured by the auxiliary camera, where the preview image is also called an auxiliary preview image. The auxiliary camera may be a default camera or a camera designated by a user. The auxiliary camera can be a wide-angle camera or a middle-focus camera with a view range larger than that of the long-focus camera. In some embodiments, the assistant view box 502 may be spread over the entire display area, i.e., the cell phone may display the assistant preview image full screen.

Illustratively, the auxiliary camera is a wide-angle camera. The auxiliary preview image captured by the wide-angle camera is displayed in the auxiliary view frame 502 shown in fig. 5C. After detecting that the user clicks the control 505, the mobile phone may switch the auxiliary camera to a middle-focus camera, and an auxiliary preview image acquired by the middle-focus camera is displayed in the auxiliary view-finding frame 502.

The zoom magnification of the auxiliary preview image in the auxiliary view frame 502 may be changed accordingly according to the user's instruction. For example, referring to fig. 5E, after the mobile phone detects an operation of dragging the zoom scale 506 by the user, the zoom magnification of the auxiliary preview image in the auxiliary view frame 502 may be adjusted.

The target finder frame 503 may be used to display a target object to be photographed by the telephoto camera, which is specified by the user on the auxiliary preview image. That is, the content in the target finder frame 503 is a target object specified by the user. In some embodiments, a prompt message may be displayed near the target viewfinder 503, or the handset may play a voice message to prompt the user for the viewfinder to frame the target object.

The image in the target finder frame 503 is a portion selected on the auxiliary preview image. The image size displayed in the target finder frame 503 matches the image size on the auxiliary preview image. When the auxiliary preview image in the auxiliary view frame 502 changes after the user designates the target object, the target view frame 503 moves as the position of the target object on the auxiliary preview image moves. When the zoom magnification of the image in the auxiliary view frame 502 is changed, the size of the image displayed in the auxiliary view frame 502 is also changed accordingly, and the size of the image displayed in the target view frame 503 is also changed accordingly.

Illustratively, the zoom magnification of the auxiliary preview image corresponding to fig. 5E is larger than that of fig. 5C, and the image size of the target object in the target finder frame 503 is also larger.

In some embodiments, upon entering the tele-preview aided mode, the target viewing frame 503 may be located in the center area of the preview aided image by default, or in a position last designated by the user by default, or may be used to frame a person, building or some other object on the preview aided image by default. The user may drag the target view frame 503 so that the target object to be photographed by the telephoto camera is located within the target view frame 503, thereby selecting the target object to be photographed by the telephoto camera. Moreover, the user can also change the target object to be photographed by the telephoto camera by dragging the target view frame 503, changing the position of the target view frame 503, and changing the content in the target view frame 503.

In other embodiments, the target view box 503 is in a default position after entering tele aided preview mode. The content in the target finder frame 503 may not be a target object that the user wants to photograph by the long focus camera, and the user has not specified the target object. After detecting the operation of dragging the target view frame 503 by the user, the mobile phone determines that the user designates the target object, and the content in the target view frame 503 is the target object designated by the user.

In the process of moving the target finder frame 503, the live view frame 504 can also automatically move to avoid the target finder frame 503, so as to avoid the overlap between the live view frame 504 and the target finder frame 503, and facilitate the user to visually and clearly see the contents in the live view frame 504 and the target finder frame 503.

For example, in the case shown in fig. 5C, after the user drags the target view frame 503, the tele-assistant preview interface displayed by the mobile phone may be as shown in fig. 5F.

In some embodiments, the size of the target viewfinder 503 is fixed. In other embodiments, the size of the target viewing frame 503 may vary. The zoom magnification of the image displayed within the live view frame 504 may be inversely related to the size of the target view frame 503. That is, the larger the target finder frame 503 is, the smaller the zoom magnification of the image within the live view frame 504 is; the smaller the target finder frame 503 is, the larger the zoom magnification of the image within the live view frame 504 is. The user can adjust the size of the target finder frame 503 to thereby adjust the zoom magnification of the image within the live view frame 504.

Since the preview image captured by the tele camera in real time is displayed in the live view box 504, in some embodiments, the zoom ratio of the preview image captured by the tele camera in real time may also be inversely related to the size of the target view box 503.

Illustratively, referring to fig. 5G, a digital mark 507 and a zoom mark 508 are displayed on the target finder frame 503. When the user holds the zoom mark 508 to drag the edge of the target frame 503, the size of the target frame 503 is changed accordingly. The number in the number mark 507 corresponds to the size of the target finder frame 503 after the change. When the user directly drags the edge of the target frame 503 without holding the zoom mark 508, the position of the target frame 503 is moved and the size of the target frame 503 is not changed.

As another example, a zoom mark 508 is displayed on the target frame 503, and when the user drags an edge of the target frame 503 for the first time after clicking the target frame, the size of the target frame 503 is changed accordingly. When the user clicks the edge of the target view frame 503 n (n is an integer greater than 1) times after the target view frame, or when the user directly drags the edge of the target view frame 503 without clicking the zoom mark 508, the position of the target view frame 503 is moved and the size of the target view frame 503 is not changed.

When the zoom magnification of the image in the live view frame 504 is changed, the size of the target view frame 503 is also changed. For example, when the user changes the number in the numeric symbol 507 shown in fig. 5G, or when the user performs a pinch operation or an operation opposite to the pinch operation in the live view frame 504, the zoom magnification of the image in the live view frame 504 changes, and the size of the target frame 503 changes accordingly.

The preview image captured by the tele camera in real time may be displayed in the live view box 504. In some embodiments, a prompt message may be displayed near the live view box 504, or the mobile phone may play a voice message to prompt the user that the image displayed in the live view box is the image collected by the telephoto camera.

In some embodiments, the size of the image displayed in the live view box 504 may correspond to a default zoom magnification (e.g., 5) of the tele camera. In other embodiments, the zoom magnification of the image displayed within the live view frame 504 corresponds to the size of the target view frame 503. When the size of the target finder frame 503 is changed, the zoom magnification of the image displayed within the live view frame 504 is changed accordingly. Illustratively, the zoom magnification of the image displayed within the live view box 504 in fig. 5E is increased to 4 as compared with fig. 5C, and the size of the preview image displayed within the live view box 504 is large, matching the zoom magnification of 4. In other embodiments, the size of the image displayed in the live view frame 504 may correspond to the current zoom magnification of the auxiliary preview image.

In some embodiments, the size of the live view frame 504 is fixed. In other embodiments, the user may also modify the size of the live view box 504.

In some embodiments, the size ratio of the live view frame 504 (i.e., the ratio of two adjacent sides of the live view frame 504) and the size ratio of the target view frame 503 (i.e., the ratio of two adjacent sides of the target view frame 503) may be matched with the image ratio of the telephoto-camera photosensor (i.e., the ratio of images formed by the photosensor in the width direction and the height direction), so that the viewing ranges of the live view frame 504 and the target view frame 503 may be maximized as much as possible.

On the tele-assistant preview interface, a user can intuitively browse and compare the preview image acquired by the assistant camera, the target object and the preview image acquired by the tele camera in real time through the assistant view frame 502, the target view frame 503 and the live view frame 504.

In some embodiments, the mobile phone may determine the current real-time motion gesture through a gyroscope, an acceleration sensor, or other sensors. The movement posture can include information such as the inclination angle and the position of the mobile phone. The mobile phone calculates a target motion posture corresponding to the mobile phone when the telephoto camera locks (or is called to shoot) the target object according to the target object specified in the target view frame 503, that is, when the target object is within the view range of the telephoto camera. Then, the mobile phone can calculate the adjustment information of the mobile phone, such as the offset distance, the offset direction, the deflection angle and the like from the current real-time motion attitude to the target motion attitude according to the current real-time motion attitude and the target motion attitude. The mobile phone can prompt the user according to the adjustment information to guide the user to move the mobile phone (including translation, turnover and the like) to the target motion posture, so that the target object is placed in the view finding range of the telephoto camera, and the telephoto camera can lock the target object, thereby shooting images.

For example, the current real-time motion posture is the motion posture shown in fig. 1C, and the target object is the object 1 to be photographed. For example, the object 1 to be photographed may be a target object in the target finder frame 503 in fig. 5C.

As shown in fig. 1C, the subject 1 to be photographed is not within the framing range of the telephoto camera. Corresponding to the tele-assisted preview interface shown in fig. 5C, the preview image captured in the live view box 504 does not include the target object.

If the object 1 is to be captured by the telephoto camera, the object 1 needs to be placed within the viewing range of the telephoto camera as shown in fig. 1D. In this way, the preview image collected by the telephoto camera can include the object 1 to be photographed. That is, the mobile phone needs to be in the target motion posture as shown in fig. 1D, so that the object 1 to be photographed is placed in the view range of the telephoto camera, and the telephoto camera can lock the object 1 to be photographed.

In some technical solutions, the mobile phone may determine, according to the content of the preview image currently acquired by the telephoto camera, a relative relationship between a position on the auxiliary preview image (the position may be referred to as a reference position) and a position of the target object on the auxiliary preview image, and a current real-time motion posture of the mobile phone, a target motion posture corresponding to the mobile phone when the target object moves to the reference position, that is, when the telephoto camera can capture the target object.

In other technical solutions, the mobile phone may determine a relative relationship between a first position of the content in the preview image acquired by the telephoto camera in the live view frame in the actual space and a second position of the target object in the target view frame in the actual space. And determining the target motion attitude corresponding to the mobile phone when the telephoto camera locks the target object at the second position according to the relative relationship and the current real-time motion attitude of the mobile phone.

In other technical solutions, because the viewing ranges of different cameras are different, the preview images acquired by different cameras can correspond to different area ranges of the display area. For example, as shown in fig. 6, the view range of the auxiliary camera may correspond to the entire auxiliary view frame 601. The field of view of the tele camera may correspond to the region 602. In this way, the content of the preview image captured by the telephoto camera displayed in the live view frame 504 is located in the area 602 at a position on the auxiliary preview image. When the target object in the target finder frame 603 is not within the finder range of the telephoto camera, the target object on the auxiliary preview image is outside the region 602. When the target object in the target finder frame 603 is within the finder range of the telephoto camera, the target object on the subsidiary preview image is within the area 602. The mobile phone may determine a target motion posture corresponding to the mobile phone when the target object is located in the area 602 according to the relative position of the target object on the current auxiliary preview image and the area 602 and the current real-time motion posture.

In some embodiments, the field of view of the tele camera may overlap with a central region of the field of view of the auxiliary camera. Thus, region 602 may be a central region of the display area. That is, the region 602 may be a central region of the auxiliary view frame 601.

Therefore, the mobile phone can determine the adjustment information according to the difference value between the current real-time motion posture and the target motion posture and prompt the user to move the mobile phone according to the adjustment information. The method for prompting the user by the mobile phone according to the adjustment information can be various.

For example, in some embodiments, the handset may display a prompt identifier to direct the user to move the handset. For example, the prompt identification may direct the user in the direction of moving the handset. For example, the user is guided to move the mobile phone in the up, down, left, right, left up, or right down directions. Illustratively, referring to FIG. 7A, the prompt is identified as arrow 701. The direction indicated by the arrow 701 is the direction guiding the user to move the handset. The arrow 701 directs the user to move the handset to the left. By way of further example, referring to fig. 7B, the prompt is identified as arrow 702, and the arrow 702 directs the user to move the handset downward and to the left. For further example, referring to FIG. 7C, the prompt is identified as textual information 703. The text message 703 prompts the user to "please move the phone to the lower left".

It should be noted that the prompt information may give a user guidance in a general direction, so as to avoid a long-time search process caused by the user blindly searching for a target object all around, reduce the time for the telephoto camera to lock the target object, and improve the user experience.

It should be noted that in the actual shooting process, the user will usually flip the mobile phone naturally in the process of identifying the mobile phone according to the prompt. The user carries out subjective judgment according to the relative positions of the contents in the real-time view frame and the target view frame in the auxiliary view frame or according to the position of the target object in the actual three-dimensional space, so that the mobile phone is actively turned over in the process of moving the mobile phone, and the long-focus camera can lock the target object more quickly.

In other embodiments, the prompt identifier may also guide the user to move the mobile phone, so that the user knows the moving distance, and thus the user is guided more accurately, the user and the telephoto camera can lock the target object more quickly, and the time for the user to search for the target object is reduced.

For example, the prompt is identified as an arrow, the size of which indicates the distance the user is directed to move the handset. When the user moves the handset in the correct direction, the arrow becomes smaller (or shorter); when the user moves the handset in the wrong direction, the arrow becomes larger (or longer). For another example, the prompt identifier is text information, and the text information may be: please lean 30 ° down to the left and move 2 cm.

In other embodiments, the prompt identifier may also indicate whether the angle at which the user turns the mobile phone is correct, so as to give the user more precise guidance, so that the user and the telephoto camera can lock the target object more quickly. If the user moves the phone in the correct direction and flips the phone in the correct direction, the arrow becomes smaller (or shorter). If the direction of the user moving the mobile phone is correct, but the direction of the user turning the mobile phone is incorrect, the arrow is not reduced (or shortened). The arrow will be smaller (or shorter) after the user adjusts the flip direction of the handset.

In other embodiments, the handset may continuously guide the user through speech. For example, the cell phone may audibly instruct the user to "move up right," "move down," etc.

In other embodiments, the prompt identifier may prompt the user to adjust the motion posture of the mobile phone in a three-dimensional space, so as to give the user a more precise guidance, so that the user and the telephoto camera can lock the target object more quickly, and the time for the user to search for the target object is reduced. For example, the hint content may include the direction of movement and the direction of flipping of the cell phone. Illustratively, referring to fig. 7D, the prompt identification includes an arrow 704 and an arrow 705. The arrow 704 is used to prompt the user to move the handset to the left. The arrow 705 is used to prompt the user to flip the phone to the front of the touch screen (i.e., the side with the display function). As another example, the prompt is identified as a voice prompt message "please move the phone left and flip approximately 20 ° to the front of the touch screen".

If the user modifies the target object by dragging the target view-finding frame, the mobile phone can also determine adjustment information according to the modified target object, and prompt the user according to the adjustment information so as to guide the user to move the mobile phone.

And in the process that the user guides the mobile phone according to the prompt message, the target object is closer to the view finding range of the telephoto camera. The preview image acquired by the tele-camera displayed in the live view frame in real time is more and more similar to the image of the target object in the target view frame.

After the mobile phone moves, whether the target object is in the framing range of the telephoto camera or not can be determined, namely whether the telephoto camera locks the target object or not. For example, when the mobile phone determines that the current real-time motion gesture matches the target motion gesture, the target object is substantially within the view range of the telephoto camera, that is, the telephoto camera is determined to substantially lock the target object. For example, when it is determined that the similarity between the current real-time motion posture and the target motion posture is greater than a preset value 4 (e.g., 90%), the mobile phone may determine that the current real-time motion posture matches the target motion posture.

After the mobile phone determines that the target object is locked by the telephoto camera, the display of the telephoto preview interface can be switched.

It should be noted that the method for the mobile phone to determine the target object locked by the zoom camera may also be implemented in other ways. For example, when the mobile phone determines that the image in the live view frame 504 matches the content of the image in the target view frame 503 through an image recognition technique, it determines that the telephoto camera substantially locks the target object, and switches to displaying the telephoto preview interface. For example, the cellular phone can calculate the similarity of the image in the live view frame 504 and the image in the target view frame 503. If the similarity is greater than or equal to the preset value 5 (for example, 80%), the mobile phone can determine that the long-focus camera basically locks the target object.

For example, the image matching algorithm based on image recognition may include a grayscale-based template matching algorithm, a feature-based matching algorithm, an optical flow method, and the like. For example, the grayscale-based template matching algorithm may include a sum of absolute differences (MAD), a Sum of Absolute Differences (SAD), a Mean Square Differences (MSD), a Sequential Similarity Detection (SSDA), and so on.

Generally, the similarity between images is determined by an image recognition technology, and complicated calculation such as convolution is required, so that the consumed calculation resources are large, and the calculation speed is low. Compared with image recognition, the method has the advantages that the similarity between the real-time motion attitude and the target motion attitude is calculated through data acquired by a gyroscope and other sensors, the calculation amount is small, and the calculation speed is high.

After the mobile phone is switched to the tele preview display interface, the preview image collected by the tele camera can be displayed on the tele preview interface in a full screen mode. And the auxiliary preview image and the target view frame are not displayed on the tele preview interface.

The size ratio of the image on the tele preview interface and the size ratio of the image in the live view frame may or may not be the same. The target view frame and the live view frame are not displayed on the tele preview interface.

In one case, after switching to the scene preview interface, the zoom magnification of the preview image on the tele preview interface is the default zoom magnification. The user can modify the size of the default zoom magnification at the setting interface. In another case, after the zoom is switched to the tele preview interface, the zoom magnification of the preview image on the tele preview interface is the same as the zoom magnification corresponding to the size of the target finder frame before the zoom is switched.

In some embodiments, the tele preview interface includes a take control. For example, referring to fig. 8A, after the mobile phone detects that the user clicks the shooting control 801 on the tele preview interface, an image is shot.

In other embodiments, the tele preview interface can be as shown in fig. 8B or fig. 8C, and after the mobile phone switches to display the tele preview interface, one or more images are automatically captured, so that the operation of the user for instructing to capture can be saved.

After the zoom-in preview interface is switched to display, the target object may be deviated from the center of the screen or may not appear on the zoom-in preview interface (i.e., the target object is lost), so that the zoom-in camera cannot lock the target object. Illustratively, the tele preview interface may be as shown in FIG. 9A or FIG. 9B.

Thus, in other embodiments, the cell phone may continue to determine the current real-time motion pose after switching to displaying the tele-preview interface. If the current real-time motion posture is not matched with the target motion posture; or, if the preview image acquired by the tele-camera in real time does not match the image in the target view-finding frame, the user is continuously prompted to move the mobile phone by adopting the manner described in the above embodiment, so that the tele-camera can lock the target object again. Illustratively, the prompt identifier for prompting the user to move the handset may be arrow 901 in fig. 9A, or arrow 902 in fig. 9B.

After the long-focus preview interface is switched to be displayed, if the current real-time motion posture is matched with the target motion posture; or, if the preview image acquired by the tele-camera in real time is matched with the image in the target view frame. Or, if the user moves the mobile phone according to the guidance of the mobile phone, the current real-time motion posture is matched with the target motion posture; or, the preview image acquired by the long-focus camera in real time is matched with the image in the target view frame. Then, in one solution, the mobile phone automatically takes the image. In another technical scheme, the mobile phone can stop prompting the user, and shoot the image after detecting the operation of shooting instructed by the user. In another technical scheme, the mobile phone can prompt a user that a target object is locked through modes of displaying information, voice, vibration and the like, and an image is shot after the user indicates shooting operation is detected.

The automatic shooting is automatically performed when the current real-time motion posture is matched with the target motion posture or when the image in the live view frame 504 is matched with the image in the target view frame 503, so that the shot object is a target object specified by the user, the operation of the user can be saved, and the shooting efficiency and the user experience are improved.

After the mobile phone captures the image, if the target object is deviated (that is, the target object is not located in the center of the captured image) or lost (that is, the target object is not captured, and the target object does not appear on the captured image), so that the tele-camera does not lock the target object any longer, the mobile phone may further continue to guide the user by using the method described in the above embodiment, so that the tele-camera may lock the target object again. Particularly, after the mobile phone automatically shoots the image, the automatically shot image may not be ideal, and the user may continue to move the mobile phone according to the guidance of the mobile phone, so as to manually shoot one or more images with better effect after the target object is re-locked.

In some embodiments, after switching to displaying the tele preview interface, if the user wants to change the target object, the phone may exit the tele assist mode first. Illustratively, the handset may exit the tele-assist mode upon detecting that the user has clicked "x" in fig. 8B. After the mobile phone enters the tele-assist mode again, the user re-designates a new target object through the target finder frame.

In other embodiments, after switching to the tele preview interface, if the user wants to change the target object, the mobile phone may exit the tele preview interface, and return to display the tele auxiliary preview interface including the target view finder, so as to reselect and designate a new target object through the target view finder. For example, in the case that the mobile phone displays the tele preview interface, after detecting that the user clicks a back key, the mobile phone may return to display the tele auxiliary preview interface including the target view frame.

In some other scenarios, the target object is moving. For example, the target object is continuously moving. For another example, after the tele-assisted preview interface is displayed, the target object suddenly starts moving. For another example, after switching to displaying the tele preview interface, the target object suddenly starts moving.

In the case where the target object is in a moving state, the user and the telephoto camera more easily lose the target object. In some embodiments, the handset may track the target object in motion state in real time. The target view box on the tele-assisted preview interface can move in real time as the target object moves. And the mobile phone can calculate the real-time target motion attitude corresponding to the target object in the motion state. The mobile phone calculates real-time adjustment information according to the difference between the current real-time motion attitude and the real-time target motion attitude, so that prompt information for the user is adjusted in real time according to the real-time adjustment information, and the user is guided to move the mobile phone.

Similar to the process described in the above embodiment, in the case where the mobile phone displays the tele preview interface, when the current real-time motion posture matches the real-time target motion posture, or when the image in the real-time view frame 504 matches the content of the image in the target view frame 503, the mobile phone determines that the tele camera substantially locks the target object, thereby switching to displaying the tele preview interface.

Similar to the process described in the above embodiment, after switching to displaying the tele preview interface, the mobile phone may automatically capture an image.

Or, similar to the process described in the foregoing embodiment, after switching to displaying the tele preview interface, the mobile phone may continue to acquire the auxiliary preview image in the background and track the target object in real time. If the current real-time motion posture is matched with the real-time target motion posture or if the preview image currently acquired by the long-focus camera is matched with the image of the target object tracked in real time, the mobile phone can be triggered to automatically shoot the image. Thus, the user can be assisted in photographing a dynamic target object using the telephoto lens.

It should be noted that, when the target object is in a moving state, the mobile phone automatically shoots an image, and can shoot the target object in time, so as to prevent the user from having to click the shooting control and prevent the shooting target object from running out of the view finding range of the telephoto camera.

And when the target object is in a motion state, the mobile phone can also display a motion mark on the tele auxiliary preview interface. For example, the motion flag may be used to indicate a motion direction of the target object, an outline of the target object, and the like. The motion mark can facilitate a user to intuitively know information such as the size, the position, the motion direction and the like of the target object. Illustratively, FIG. 10A shows a schematic view of a motion marker 1001. The elliptical dotted lines in the motion marker 1001 are used to mark the outline and size of the moving target object. The arrow in the motion marker 1001 is used to mark the direction of motion of the target object. As yet another example, FIG. 10B shows a schematic view of a motion marker 1002. The "[ ] in the motion marker 1002 is used to mark the outline and size of the moving target object. The arrow in the motion flag 1002 is used to flag the direction of motion of the target object.

The above description mainly takes the example that the mobile phone guides the user to take a picture by using the telephoto camera. During the recording process, the user may also specify a target object. The mobile phone can also prompt the user by adopting the method described in the above embodiment to guide the user to move the mobile phone when the user adopts the tele-camera to record the video, so as to help the user to lock the target object as much as possible by using the tele-camera, and further track and record the video of the target object.

For example, referring to fig. 11A, upon entering the tele-assistance mode, a first control 1101 and a second control 1102 may be included on the tele-assistance preview interface. After detecting that the user clicks the first control 1101, the mobile phone enters the tele-assisted photographing sub-mode, and the mobile phone can guide the user to move, so that the tele-camera locks the target object and takes a picture.

After the mobile phone detects the operation of the user clicking the second control 1102, as shown in fig. 11B, the mobile phone may enter the tele-assisted recording sub-mode. Under the auxiliary long-focus video recording sub-mode, the mobile phone can guide the user to move so that the long-focus camera locks the target object as much as possible.

After detecting the operation of clicking the video recording control 1103 by the user, the mobile phone starts to record video. In the process of recording, especially in the process of recording the target object in the motion state, referring to fig. 11C, the mobile phone may guide the user to move the mobile phone, so that the user can lock the target object as much as possible by using the telephoto camera, thereby achieving the purpose of tracking the target object in real time and recording the target object.

In addition, the method for capturing the image by guiding the electronic equipment to move and assisting the telephoto camera of the electronic equipment to lock the target object can be applied to other various scenes. For example, in a multi-camera monitoring apparatus, a plurality of cameras for monitoring include a wide-angle camera and a telephoto camera. The monitoring area of the wide-angle camera is wide, and through an image recognition technology, a monitoring device can capture a suspicious or important monitored area, namely the suspicious or important monitored area is equivalent to the target object. The monitoring device can guide the tele camera to move, so that the picture of a suspicious or important monitoring area is locked and shot.

Another embodiment of the present application provides a photographing method, referring to fig. 12, the method may include:

1201. the electronic device activates the camera.

1202. The electronic equipment adopts a first camera and a second camera to respectively collect a first preview image and a second preview image, the second camera is a long-focus camera, and the viewing range of the first camera is larger than that of the second camera.

1203. The electronic equipment displays a first preview interface, wherein the first preview interface comprises a first view frame, a second view frame and a third view frame; the first viewing frame is used for displaying a first preview image; the image in the second viewing frame is a part of the first preview image; the content in the second view finding frame is a target object to be shot by the second camera; the third viewing frame is used for displaying the second preview image.

1204. The electronic equipment displays first prompt information, and the first prompt information is used for guiding a user to move the electronic equipment, so that the target object can be locked by the second camera after the electronic equipment moves.

Therefore, after the electronic equipment is switched from the first camera such as the wide-angle camera or the middle-focus camera to the second camera such as the long-focus camera, the electronic equipment can guide the user to move the electronic equipment through the prompt information. So that the tele camera can quickly lock onto the target object after the electronic device is moved. Further, the electronic device may capture an image of the target object using a tele camera.

In some embodiments, after the electronic device displays the first preview interface, the method may further include: the electronic device detects a dragging operation of the user for the second finder frame. The electronic device moves the second finder frame on the first preview image in response to the drag operation, the target object changing as the position of the second finder frame changes. That is, in the shooting scene, the user can specify a target object.

In this way, after the electronic device is switched from the wide-angle camera or the middle-focus camera to the long-focus camera, the electronic device can guide the user to move the electronic device according to the target object specified by the user. Therefore, the user can move the electronic equipment according to the guide, so that the long-focus camera can quickly lock the target object after the electronic equipment moves.

Moreover, the electronic device may further perform the steps and functions performed by the mobile phone in the above embodiments, so as to implement the shooting method provided by the above embodiments.

An embodiment of the present application further provides an electronic device, which may include: the device comprises a starting unit, a collecting unit, a display unit, a processing unit, a moving unit, a shooting unit and the like. These units may perform the respective steps in the above-described embodiments to realize the photographing method.

An embodiment of the present application further provides an electronic device, including one or more processors; a memory; and the touch screen is used for detecting touch operation and displaying an interface. The storage stores code, and when the code is executed by one or more processors, the electronic device is enabled to execute the steps in the above embodiments to implement the shooting method in the above embodiments.

Illustratively, when the electronic device is the device shown in fig. 1A, the processor in the electronic device may be the processor 110 shown in fig. 1A, the memory in the electronic device may be the internal memory 121 shown in fig. 1A, and the touch screen in the electronic device may be a combination of the display screen 194 and the touch sensor 180K shown in fig. 1A.

The embodiment of the present application further provides a computer storage medium, where a computer instruction is stored in the computer storage medium, and when the computer instruction runs on an electronic device, the electronic device is enabled to execute the relevant method steps to implement the shooting method in the foregoing embodiment.

The embodiment of the present application further provides a computer program product, and when the computer program product runs on a computer, the computer is caused to execute the relevant steps, so as to implement the shooting method in the embodiment.

In addition, an apparatus may be specifically a chip, and the chip may include a processor and a memory, where the memory stores instructions. When the instructions are executed by the processor, the chip executes the relevant steps to realize the shooting method in the above embodiment.

In addition, an apparatus, which may be specifically a component or a module, may include a processor and a memory connected to each other; the memory is used for storing computer execution instructions, and when the device runs, the processor can execute the computer execution instructions stored by the memory, so that the chip can execute the shooting method in the above method embodiments.

The electronic device, the chip, the computer storage medium, the computer program product, or the chip provided in the embodiments of the present application are all configured to execute the corresponding methods provided above, and therefore, the beneficial effects that can be achieved by the electronic device, the chip, the computer storage medium, the computer program product, or the chip may refer to the beneficial effects in the corresponding methods provided above, which are not described herein again.

Through the description of the foregoing embodiments, those skilled in the art will understand that, for convenience and simplicity of description, only the division of the functional modules is used for illustration, and in practical applications, the above function distribution may be completed by different functional modules as needed, that is, the internal structure of the device may be divided into different functional modules, so as to complete all or part of the functions described above.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical functional division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another device, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or multiple physical units, that is, may be located in one place, or may be distributed in multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a variety of media that can store program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A photographing method, characterized in that the method comprises:

responding to a first operation of a user, starting a camera function of the electronic equipment, and displaying a first interface, wherein the first interface comprises a first preview image acquired by a wide-angle camera;

responding to a second operation of increasing the zoom magnification of a user on the first interface, when the zoom magnification is larger than or equal to a preset value, the electronic equipment displays a second interface, wherein the second interface comprises a live view frame, an auxiliary view frame and a target view frame, the live view frame is used for displaying a second preview image acquired by a telephoto camera, the auxiliary view frame is used for displaying an auxiliary preview image acquired by a wide-angle camera or a middle-focus camera, the target view frame is located in the center of the auxiliary preview image, and an image in the target view frame is a part of the auxiliary preview image;

in response to a user's pinch-in operation in the live view frame, the zoom magnification of the second preview image in the live view frame becomes large, and the size of the target view frame becomes small;

in response to a reverse pinch-in operation by a user in the live view frame, the zoom magnification of the second preview image in the live view frame becomes smaller, and the size of the target view frame becomes larger.

2. The method of claim 1, wherein the live view frame is fixed in size.

3. The method of claim 1 or 2, wherein the field of view of the tele camera overlaps a central region of the field of view of the auxiliary camera.

4. The method of claim 1 or 2, wherein the live view frame is movable.

5. The method of any of claims 1 or 2, wherein the size of the target frame is adjustable.

6. The method according to claim 1 or 2, characterized in that the method further comprises:

the electronic equipment displays prompt information, and the prompt information is used for guiding a user to move the electronic equipment.

7. The method according to claim 1 or 2, wherein when the zoom magnification of the auxiliary preview image is changed, the size of the image displayed in the target finder frame is also changed.

8. The method according to claim 1 or 2, wherein the electronic device implements a shooting function through an ISP, a camera, a video codec, a GPU, a display screen, an application processor, and the like;

the first operation comprises touch operation, key operation, air gesture operation or voice operation;

the electronic equipment is a mobile phone;

and when the zoom magnification is greater than or equal to a preset value, the electronic equipment enters a tele auxiliary mode.

9. An electronic device, comprising:

one or more processors;

a memory having code stored therein;

the touch screen is used for detecting touch operation and displaying an interface;

the code, when executed by the one or more processors, causes the electronic device to perform the photography method of any of claims 1-8.