CN115484387B

CN115484387B - Prompting method and electronic equipment

Info

Publication number: CN115484387B
Application number: CN202111666858.8A
Authority: CN
Inventors: 黄雨菲; 易婕
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2021-06-16
Filing date: 2021-12-31
Publication date: 2023-11-07
Anticipated expiration: 2041-12-31
Also published as: CN115484387A

Abstract

The application provides a prompting method and electronic equipment, wherein the electronic equipment can display first prompting information when switching to a rear shooting mode, so that a user perceives that a front camera (a first camera) is collecting image data for identifying the user, and privacy of the user is prevented from being infringed. The method comprises the following steps: the electronic equipment displays a shooting preview interface, and responds to the fact that the first camera detects a first gesture, the electronic equipment displays a first mark on the shooting preview interface; in a first preset time after the first mark is displayed, responding to the fact that the first camera detects a second gesture, and continuously displaying a second image on a shooting preview interface by the electronic equipment, and stopping displaying the first image; the electronic device displays first prompt information on the shooting preview interface, wherein the first prompt information indicates that the electronic device is collecting image data for recognizing gestures of a user through the first camera.

Description

Prompting method and electronic equipment

The present application claims priority of chinese patent application filed at 16 months 2021 with the national intellectual property office, application number 202110676709.3, and application name "a video creation method for users based on story line mode and electronic device", and priority of chinese patent application filed at 29 months 2021 with the national intellectual property office, application number 202111436427.2, and application name "a prompting method and electronic device", which are all incorporated herein by reference.

Technical Field

The present application relates to the field of terminal technologies, and in particular, to a prompting method and an electronic device.

Background

With the development of electronic technology, electronic devices such as mobile phones and tablet computers are generally configured with multiple cameras, such as front cameras, rear cameras, and wide-angle cameras. In order to bring further shooting creation experience, more and more electronic devices can support simultaneous shooting of a plurality of cameras, so that attractive pictures such as wonderful moments, sensible scenes and the like are recorded.

Disclosure of Invention

The embodiment of the application provides a prompting method and electronic equipment, which can remind a user that the electronic equipment can acquire image data for recognizing a gesture of the user through a front camera when the shooting mode of the electronic equipment is switched to a rear shooting mode through the gesture.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical scheme:

in a first aspect, an embodiment of the present application provides a prompting method, where the method is applied to an electronic device including a display screen, a first camera and a second camera, where the first camera and the second camera are located on different sides of the display screen, and the first camera and the display screen are located on the same side of the electronic device, and the method includes: the electronic equipment displays a shooting preview interface, wherein a first area of the shooting preview interface displays a first image acquired in real time from a first camera, and a second area of the shooting preview interface displays a second image acquired in real time from a second camera; in response to the first camera detecting the first gesture, the electronic device displays a first identifier on the shooting preview interface; in a first preset time after the first mark is displayed, responding to the fact that the first camera detects a second gesture, and continuously displaying a second image on a shooting preview interface by the electronic equipment, and stopping displaying the first image; the electronic device displays first prompt information on the shooting preview interface, wherein the first prompt information indicates that the electronic device is collecting image data for recognizing gestures of a user through the first camera.

It can be seen that the electronic device can detect the gesture (such as the first gesture and the second gesture) of the user through the first camera, so that the user can switch the shooting mode of the electronic device from the front shooting mode to the rear shooting mode through the gesture, the whole process does not need the user to touch the display screen, and the user operation is more convenient. In addition, when the electronic equipment is switched to the rear shooting mode, the first prompt information can be displayed, so that a user perceives that the front camera (the first camera) is collecting image data for identifying the user, and privacy is prevented from being infringed when the user perceives.

In an alternative embodiment, the shooting preview interface further includes a first control, and the method further includes: responding to the operation of a user on the first control, displaying a setting interface by the electronic equipment, wherein the setting interface comprises a first option, the first option is used for starting or closing a first function, the first function is a function of the electronic equipment for acquiring image data for identifying the gesture of the user through a first camera, the first option comprises second prompt information, and the electronic equipment acquires the image data for identifying the gesture of the user through the first camera after the second prompt information indicates that the first function is started.

It can be seen that the electronic device can inform the user that the front camera (the first camera) can collect image data for identifying the user when the user starts the space-saving mirror changing function (the first function) through the setting interface.

In an alternative embodiment, the shooting preview interface further includes a second control, and the method further includes: responding to the operation of the user on the second control, and displaying a second popup window on the shooting preview interface by the electronic equipment; the electronic equipment circularly plays a plurality of guide videos on the second popup window according to a preset sequence, a first guide video in the plurality of guide videos indicates that the electronic equipment collects image data for recognizing gestures of a user through a first camera in a first shooting mode, and the first shooting mode is a mode that the electronic equipment shoots through a second camera. That is, the user can click the second control to view the guide video, and in a plurality of guide videos played by the electronic device, the electronic device collects a prompt for identifying image data of a gesture of the user through the first camera in the first shooting mode, so as to inform the user that the front camera can collect the image data for identifying the user.

In an alternative embodiment, the shooting preview interface further includes a third control, and the method further includes: responding to the operation of a user on a third control, and displaying a first popup window on a shooting preview interface by the electronic equipment, wherein the first popup window comprises an identifier of a first shooting mode, and the first shooting mode is a mode of shooting by the electronic equipment through a second camera; responding to the operation of the user on the identification of the first shooting mode, the electronic equipment continuously displays the second image on the shooting preview interface, and stops displaying the first image; the electronic equipment displays the first prompt information on the shooting preview interface.

It can be seen that the user can switch the shooting mode of the electronic device to the rear shooting mode not only through the blank gesture (i.e. the second gesture), but also by clicking the third control. After the electronic equipment is switched to the rear shooting mode, the electronic equipment can still display first prompt information to inform the user that the front camera can collect image data for identifying the user.

In an optional embodiment, the shooting preview interface further includes a fourth control, and if the electronic device does not start recording the video, the electronic device further includes, before displaying the first identifier on the shooting preview interface: in response to a user operation on the fourth control, the electronic device switches the fourth control from a first state to a second state on the shooting preview interface, second prompt information is displayed on the shooting preview interface, the first state indicates that the electronic device does not start the first function, the second state indicates that the electronic device has started the first function, and the second prompt information indicates that the electronic device collects image data for identifying gestures of the user through the first camera.

That is, when the electronic device does not start recording video, the user may turn on the blank-space mirror function (first function) of the electronic device through the fourth control, and when detecting the operation of the user on the fourth control (for example, clicking the fourth control), turn on the blank-space mirror function of the electronic device, and inform the user that the blank-space mirror function has been turned on, and the electronic device may collect image data for identifying the gesture of the user through the first camera.

In an alternative embodiment, the method further comprises: and hiding the second prompt information by the electronic equipment within a second preset time for displaying the second prompt information.

In an alternative embodiment, the electronic device continues to display the second image on the shooting preview interface, including: and the electronic equipment continuously displays the second image in a third area of the shooting preview interface, wherein the third area comprises a first area and a second area, and the first area and the second area are not overlapped.

Therefore, the prompting method provided by the embodiment of the application can be operated in a scene that the electronic equipment is switched from the front shooting mode to the rear shooting mode.

In an alternative embodiment, the electronic device continues to display the second image on the shooting preview interface, including: and the electronic equipment continuously displays a second image in a third area of the shooting preview interface, the first area is positioned on the second area, and the third area is identical to the second area. Therefore, the prompting method provided by the embodiment of the application can be operated in a scene that the electronic equipment is switched from the picture-in-picture shooting mode to the post shooting mode.

In an alternative embodiment, the method further comprises: if the first camera does not detect the preset gesture, the electronic device stops displaying the first mark after displaying the first preset time of the first mark, and the preset gesture comprises a first gesture and a second gesture. It can be seen that, if the electronic device does not detect the preset gesture (e.g., the first gesture, the second gesture) after the electronic device displays the first identifier, the electronic device may stop displaying the first identifier after the first preset time (e.g., 3 seconds).

In an alternative embodiment, the method further comprises: and in a first preset time after the first mark is displayed, if the first camera detects a preset gesture, the electronic equipment stops displaying the first mark, and the preset gesture comprises a first gesture and a second gesture. It can be seen that if the electronic device detects the preset gesture (the first gesture, the second gesture) within the preset time after the electronic device displays the first identifier, the electronic device may stop displaying the first identifier after the first preset time (for example, 3 seconds).

In an alternative embodiment, the electronic device displays a first identifier on a shooting preview interface, including: and when the electronic equipment displays the first mark on the shooting preview interface, detecting a preset gesture through the first camera. That is, the electronic device displays the first identifier while the first camera is also synchronously acquiring image data.

In an alternative embodiment, the method further comprises: in response to the first camera detecting the second gesture, the electronic device does not display the first identification on the capture preview interface and does not stop displaying the second image on the capture preview interface. That is, if the electronic device directly detects the second gesture without detecting the first gesture, the electronic device does not display the first identifier and does not switch the shooting mode. In other words, only if a plurality of gestures (e.g., first gesture, second gesture) are used in combination, the shooting mode of the electronic device can be switched.

In an alternative embodiment, the electronic device does not begin recording video or is recording video. That is, when the prompting method provided by the embodiment of the application is operated, the electronic device may not start recording video or is recording video.

In a second aspect, an embodiment of the present application provides an electronic device, including a display screen, a first camera, a second camera, and a processor, where the processor is coupled to a memory, and the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, cause the electronic device to implement a method according to any one of the possible design manners of the first aspect.

In a third aspect, a computer-readable storage medium includes computer instructions; when executed on an electronic device, the computer instructions cause the electronic device to perform the method of any one of the possible designs of the first aspect.

In a fourth aspect, the present application provides a chip system comprising one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected by a wire.

The chip system described above may be applied to an electronic device including a communication module and a memory. The interface circuit is for receiving signals from a memory of the electronic device and transmitting the received signals to the processor, the signals including computer instructions stored in the memory. When the processor executes the computer instructions, the electronic device may perform the method as described in any one of the possible designs of the first aspect.

In a fifth aspect, the application provides a computer program product which, when run on a computer, causes the computer to carry out the method according to any one of the possible designs of the first aspect.

Drawings

Fig. 1A is a schematic hardware structure of an electronic device according to an embodiment of the present application;

fig. 1B is a software architecture diagram of an electronic device according to an embodiment of the present application;

FIGS. 2A-2D are a set of interface diagrams according to an embodiment of the present application;

FIG. 3 is a schematic diagram of an interface according to an embodiment of the present application;

FIGS. 4A-4D are a set of interface diagrams according to an embodiment of the present application;

FIGS. 5A-5D are a set of interface diagrams according to an embodiment of the present application;

FIGS. 6A-6C are a set of interface diagrams according to an embodiment of the present application;

FIGS. 7A-7C are a set of interface diagrams according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a chip system according to an embodiment of the present application.

Detailed Description

The terms "first" and "second" are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present embodiment, unless otherwise specified, the meaning of "plurality" is two or more.

For clarity and conciseness in the description of the embodiments below and for ease of understanding to those skilled in the art, a brief introduction to related concepts or technologies is first presented.

The shooting preview interface refers to an interface displayed when the electronic equipment shoots and can be used for displaying images shot by the camera. In addition, the shooting preview interface may further display a plurality of controls, and the plurality of controls may include a flash control for turning on/off a flash, a beauty control for turning on/off a beauty function, a shutter control for shooting, and the like.

Single-lens shooting refers to a mode in which an electronic device shoots only through one camera. In the single-lens shooting mode, the electronic equipment only displays an image shot by one camera in a shooting preview interface. Wherein, the single-lens shooting can comprise a front shooting mode, a rear shooting mode and the like.

Specifically, front-end shooting refers to a mode in which electronic equipment shoots through a front-end camera. When the electronic equipment is in the front shooting mode, the image shot by the front camera can be displayed on the shooting preview interface in real time.

The rear shooting mode refers to a mode that the electronic equipment shoots through a rear camera. When the electronic equipment is in the rear shooting mode, the image shot by the rear camera can be displayed on the shooting preview interface in real time.

Multi-lens shooting refers to a mode that electronic equipment can shoot through a plurality of cameras. In the multi-mirror shooting mode, the display screen simultaneously displays images shot by the cameras in the shooting preview interface, and the images shot by the different cameras can be spliced or displayed in a picture-in-picture mode. The multi-lens shooting may include a front-back shooting mode, a back-back shooting mode, a picture-in-picture shooting mode, and the like, according to the type of the camera used by the electronic device and the display modes of the images shot by different cameras.

The front and back shooting mode refers to a mode that the electronic equipment can shoot through the front camera and the back camera at the same time. When the electronic device is in the front-back shooting mode, images (for example, a first image and a second image) shot by the front camera and the rear camera can be displayed in the shooting preview interface at the same time, and the first image and the second image are spliced and displayed. When the electronic equipment is vertically arranged, the first image and the second image can be spliced up and down; when the electronic equipment is horizontally arranged, the first image and the second image can be spliced left and right. By default, the display area of the first image is identical to the display area of the second image.

The rear shooting mode refers to a mode that the electronic device can shoot through two rear cameras (if a plurality of rear cameras exist) at the same time. When the electronic device is in the rear shooting mode, the electronic device can simultaneously display images (for example, a first image and a second image) shot by the two rear cameras in a shooting preview interface, and the first image and the second image are spliced and displayed. When the electronic equipment is vertically arranged, the first image and the second image can be spliced up and down; when the electronic equipment is horizontally arranged, the first image and the second image can be spliced left and right.

The picture-in-picture shooting mode refers to a mode in which the electronic device can shoot through two cameras at the same time. When the electronic device is in the picture-in-picture shooting mode, images (e.g., a first image, a second image) shot by two cameras can be displayed simultaneously in a shooting preview interface. The second image is displayed in the whole area of the shooting preview interface, the first image is overlapped on the second image, and the display area of the first image is smaller than that of the second image. By default, the first image may be located below and to the left of the second image. The two cameras can be freely combined, for example, two front cameras, two rear cameras or one front camera and one rear camera.

It should be noted that, the above-mentioned "single-lens shooting", "multi-lens shooting", "front shooting mode", "rear shooting mode", "front-rear shooting mode", "picture-in-picture shooting mode", and "rear shooting mode" are just some names used in the embodiments of the present application, and the meaning of the representative names are already described in the embodiments of the present application, and the names do not limit the embodiments.

The application provides a prompting method which is applied to electronic equipment comprising a display screen, a first camera and a second camera, wherein the first camera and the second camera are positioned on different sides of the display screen, and the first camera and the display screen are positioned on the same side of the electronic equipment. The electronic device displays a shooting preview interface, wherein a first area of the shooting preview interface displays a first image acquired in real time from a first camera, and a second area of the shooting preview interface displays a second image acquired in real time from a second camera. In response to the first camera detecting the first gesture, the electronic device displays a first identification on the capture preview interface. And in a first preset time after the first mark is displayed, responding to the fact that the first camera detects the second gesture, and continuously displaying the second image on the shooting preview interface by the electronic equipment, and stopping displaying the first image. The electronic device displays first prompt information on the shooting preview interface, wherein the first prompt information indicates that the electronic device is collecting image data for recognizing gestures of a user through the first camera.

Therefore, the electronic device can detect gestures (such as a first gesture and a second gesture) of the user through the first camera, so that the user can switch the shooting mode of the electronic device from the front shooting mode to the back shooting mode through the gestures, the whole process does not need the user to touch the display screen, and the user operation is more convenient. In addition, when the electronic equipment works in a rear shooting mode under the multi-mirror video recording, the front camera of the electronic equipment prompts the user that the front camera of the electronic equipment is collecting the blank gesture of the user, so that the user perceives that the front camera is collecting the image data for identifying the user, and the user is prevented from perceiving that privacy is infringed.

The electronic device may be an electronic device comprising a display screen or a folding screen device. When the electronic equipment is a single-screen mobile phone, the first camera and the second camera can be a front camera and a rear camera of the electronic equipment respectively. When the electronic equipment is a folding screen mobile phone, the display screen can comprise a first screen and a second screen, the first screen is rotationally connected with the second screen, the first camera and the second camera can be respectively positioned at two sides of the first screen, and the first camera and the first screen are positioned at the same side of the electronic equipment. Or, the first camera is located on the first screen, the second camera is located on the second screen, and the first camera, the second camera and the second camera are located on the same side of the electronic device. In the embodiment of the application, an electronic device is taken as an electronic device including a display screen as an example.

In the embodiment of the application, the electronic device can recognize the gesture of the user through the first camera (for example, the front camera) so as to switch the shooting mode of the electronic device. The above gesture is just a name used in the embodiment of the present application, and may also be referred to as a space gesture, a hover gesture, etc., specifically, a gesture input without contacting an electronic device, and the meaning of the representative gesture is already described in the embodiment of the present application, and the name is not limited in any way to the embodiment.

In order to more clearly and specifically describe the prompting method provided by the embodiment of the application, the following first describes an electronic device related to implementing the method.

The electronic device may be a cell phone, tablet, desktop, laptop, handheld, notebook, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), netbook, as well as a cellular telephone, personal digital assistant (personal digital assistant, PDA), augmented reality (augmented reality, AR) device, virtual Reality (VR) device, artificial intelligence (artificial intelligence, AI) device, wearable device, vehicle-mounted device, smart home device, and/or smart city device, with embodiments of the application not being particularly limited as to the particular type of electronic device.

Referring to fig. 1A, fig. 1A shows a schematic hardware structure of an electronic device according to an embodiment of the present application.

As shown in fig. 1A, the electronic device 200 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (universal serial bus, USB) interface 230, a charge management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, keys 290, a motor 291, an indicator 292, a plurality of cameras 293, a display 294, and a subscriber identity module (subscriber identification module, SIM) card interface 295.

The sensor module 280 may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, acceleration sensors, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, and the like.

It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic apparatus 200. In other embodiments, the electronic device 200 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 210 may include one or more processing units such as, for example: the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural hub and command center of the electronic device 200. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may hold instructions or data that the processor 210 has just used or recycled. If the processor 210 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided and the latency of the processor 210 is reduced, thereby improving the efficiency of the system.

In some embodiments, processor 210 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others. It should be understood that the connection relationship between the modules illustrated in this embodiment is only illustrative, and does not limit the structure of the electronic device 200. In other embodiments, the electronic device 200 may also employ different interfaces in the above embodiments, or a combination of interfaces.

In the embodiment of the present application, the processor 210 may receive a plurality of continuous images corresponding to a space gesture, such as a "palm", input by a user and captured by the camera 293, then the processor 210 may perform a comparative analysis on the plurality of continuous images, determine that the space gesture corresponding to the plurality of continuous images is a "palm", determine that an operation corresponding to the space gesture, such as starting recording, and then the processor 210 may control the camera application program to perform a corresponding operation. The corresponding operations may include, for example: the multiple cameras are moved to shoot images simultaneously, then the images shot by the multiple cameras are synthesized through a GPU (graphics processing unit) in a mode of splicing or picture-in-picture (local superposition) and the like, and the display screen 294 is called to display the synthesized images in a shooting preview interface of the electronic equipment.

The external memory interface 220 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 200. The external memory card communicates with the processor 210 through an external memory interface 220 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

Internal memory 221 may be used to store computer executable program code that includes instructions. The processor 210 executes various functional applications of the electronic device 200 and data processing by executing instructions stored in the internal memory 221. For example, in an embodiment of the present application, the processor 210 may include a memory program area and a memory data area by executing instructions stored in the internal memory 221. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 200 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 221 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.

In an embodiment of the present application, the internal memory 221 may store a picture file or a recorded video file or the like that is photographed by the electronic device in different photographing modes.

The charge management module 240 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. The charging management module 240 may also supply power to the terminal device through the power management module 241 while charging the battery 242.

The power management module 241 is used for connecting the battery 242, and the charge management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and/or the charge management module 240 and provides power to the processor 210, the internal memory 221, the external memory, the display 294, the camera 293, the wireless communication module 260, and the like. In some embodiments, the power management module 241 and the charge management module 240 may also be provided in the same device.

The wireless communication function of the electronic device 200 can be implemented by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, a modem processor, a baseband processor, and the like. In some embodiments, antenna 1 and mobile communication module 250 of electronic device 200 are coupled, and antenna 2 and wireless communication module 260 are coupled, such that electronic device 200 may communicate with a network and other devices via wireless communication techniques.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 200 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 250 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied on the electronic device 200. The mobile communication module 250 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 250 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation.

The mobile communication module 250 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 250 may be disposed in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 250 may be provided in the same device as at least some of the modules of the processor 210.

The wireless communication module 260 may provide solutions for wireless communication including WLAN (e.g., (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied on the electronic device 200.

The wireless communication module 260 may be one or more devices that integrate at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 210. The wireless communication module 260 may also receive a signal to be transmitted from the processor 210, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

The electronic device 200 implements display functions through a GPU, a display screen 294, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or change display information.

The display 294 is used to display images, videos, and the like. The display 294 includes a display panel.

The electronic device 200 may implement a photographing function through an ISP, a camera 293, a video codec, a GPU, a display 294, an application processor, and the like. The ISP is used to process the data fed back by the camera 293. The camera 293 is used to capture still images or video. In some embodiments, the electronic device 200 may include N cameras 293, N being a positive integer greater than 2.

The electronic device 200 may implement audio functions through an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an ear-headphone interface 270D, an application processor, and the like. Such as music playing, recording, etc.

Keys 290 include a power on key, a volume key, etc. The keys 290 may be mechanical keys. Or may be a touch key. The motor 291 may generate a vibration alert. The motor 291 may be used for incoming call vibration alerting or for touch vibration feedback. The indicator 292 may be an indicator light, which may be used to indicate a state of charge, a change in power, a message indicating a missed call, a notification, etc.

The plurality of cameras 293 are used to capture images. In the embodiment of the application, the number of cameras 293 can be M, M is more than or equal to 2, and M is a positive integer. The number of cameras started in multi-lens shooting of the electronic equipment can be N, N is more than or equal to 2 and less than or equal to M, and N is a positive integer.

In the embodiment of the present application, the type of the camera 293 may be differentiated according to the hardware configuration and the physical location. For example, the plurality of cameras included in the camera 293 may be disposed on the front and back sides of the electronic device, the camera disposed on the display screen 294 of the electronic device may be referred to as a front camera, and the camera disposed on the rear cover of the electronic device may be referred to as a rear camera; for example, cameras having different focal lengths and different viewing angles, which are included in the camera 293, may be referred to as wide-angle cameras, and cameras having a long focal length and a small viewing angle may be referred to as normal cameras. The content of the images shot by different cameras is different in that: the front camera is used for shooting scenes facing the front surface of the electronic equipment, and the rear camera is used for shooting scenes facing the back surface of the electronic equipment; the wide-angle camera can shoot scenes with larger area in a shorter shooting distance range, and the scenes shot at the same shooting distance are smaller than the images of the scenes shot by using the common lens in the picture. The focal length and the visual angle are relative concepts, and are not limited by specific parameters, so that the wide-angle camera and the common camera are also relative concepts, and can be distinguished according to physical parameters such as the focal length, the visual angle and the like.

Particularly, in the embodiment of the present application, the camera 293 at least includes a camera with a time of flight (TOF) 3D sensing module or a structured light (structured light) 3D sensing module, and the camera acquires 3D data of an object in a captured image, so that the processor 210 can identify an operation instruction corresponding to a space gesture of a user according to the 3D data of the object.

The camera for acquiring the 3D data of the object can be an independent low-power-consumption camera, and can also be other common front-mounted cameras or rear-mounted cameras, wherein the common front-mounted cameras or rear-mounted cameras support a low-power-consumption mode, when the low-power-consumption camera works or the common front-mounted cameras or rear-mounted cameras work in the low-power-consumption mode, the frame rate of the camera is lower than that of the common camera working in a non-low-power-consumption mode, and the output image is in a black-and-white format. A typical camera may output 30 frames of images, 60 frames of images, 90 frames of images, 240 frames of images for 1 second, but the low power consumption camera may output, for example, 2.5 frames of images for 1 second when the typical front camera or the rear camera operates in a low power consumption mode, and may switch to output 10 frames of images for 1 second when the camera captures the first image representing the same space gesture, so as to accurately recognize an operation instruction corresponding to the space gesture through continuous multiple image recognition. Meanwhile, compared with the common camera, the power consumption is reduced when the camera works in a low power consumption mode.

The display 294 is used to display images, videos, and the like. In some embodiments, the electronic device may include 1 or N displays 294, N being a positive integer greater than 1. In an embodiment of the present application, the display 294 may be used to display images taken by any one or more cameras 293, for example, to display multiple frames of images taken by one camera in a capture preview interface, or to display multiple frames of images from one camera 293 in a saved video file, or to display a photograph from one camera 293 in a saved picture file.

The SIM card interface 295 is for interfacing with a SIM card. The SIM card may be inserted into the SIM card interface 295 or removed from the SIM card interface 295 to enable contact and separation from the electronic device 200. The electronic device 200 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 295 may support Nano SIM cards, micro SIM cards, and the like.

Fig. 1B is a software structural block diagram of an electronic device according to an embodiment of the present application.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 1B, the application package may include applications for cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 1B, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is for providing communication functions of the electronic device. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The workflow of the electronic device in software and hardware during shooting is illustrated in connection with capturing a photo scene.

When the touch sensor receives a touch operation, the corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the touch operation into the original input event (including information such as touch coordinates, time stamp of touch operation, etc.). The original input event is stored at the kernel layer. The application framework layer acquires an original input event from the kernel layer, and identifies a control corresponding to the input event. Taking the touch operation as a touch click operation, taking a control corresponding to the click operation as an example of a control of a camera application icon, the camera application calls an interface of an application framework layer, starts the camera application, further starts a camera driver by calling a kernel layer, and captures a still image or video through a camera 293. In the embodiment of the present application, the touch operation received by the touch sensor may be replaced by an operation in which the camera 293 captures a blank gesture input by the user. Specifically, when the camera 293 shoots the operation of the air-stop gesture, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the space gesture operation into the original input event (including the image of the space gesture, the timestamp of the space gesture operation, etc.). The original input event is stored at the kernel layer. The application framework layer acquires an original input event from the kernel layer, and identifies an operation corresponding to the input event. Taking the operation of switching the shooting mode as an example, the camera application calls the interface of the application framework layer, and further starts other camera drivers by calling the kernel layer, so that the camera application switches to the other cameras 293 to capture still images or videos.

Next, the specific contents of the prompting method provided by the present application will be described with reference to the drawings.

In the embodiment of the application, the electronic equipment can have a function of changing the mirror at intervals. The function of spacing and changing the mirror can be as follows: under the multi-mirror video recording, the electronic equipment can recognize the air-separation gesture through the front-mounted camera so as to switch the shooting mode.

When the electronic equipment is in a front-back shooting mode, a front shooting mode or a picture-in-picture shooting mode, the electronic equipment can simultaneously acquire images through the front camera and the rear camera, and simultaneously display the images shot by the front camera and the images shot by the rear camera on a shooting preview interface. It can be seen that in the above three photographing modes, the operation of photographing an image by the front camera is visible to the user.

When the electronic equipment is in the rear shooting mode, the electronic equipment can shoot images through the rear camera and display the images shot by the rear camera on a shooting preview interface. However, since the electronic device requires the front-facing camera to recognize the blank gesture of the user, the front-facing camera is actually operating at the same time. In other words, when the electronic device is in the rear-end photographing mode, although the front-end camera and the rear-end camera are simultaneously operated, the electronic device displays only the image photographed by the rear-end camera on the photographing preview interface, and the operation of photographing the image by the front-end camera is invisible to the user. In this case, the electronic device may alert the user that the electronic device is using the front-facing camera to identify the spaced-apart gesture to avoid the user from feeling privacy violated.

Referring to fig. 2A-2B, a process for an electronic device to enter a multi-mirror video is shown.

As shown in fig. 2A, the handset may display a main interface 301. The main interface 301 may include an icon 302 of a camera application. The handset may receive an operation of clicking on the icon 302 by the user, and in response to the operation, as shown in fig. 2B, the handset may open the camera application and display a shooting preview interface 303 of the camera application. It can be understood that the camera application is an application for capturing an image on an electronic device such as a smart phone, a tablet computer, etc., and may be a system application or a third party application, and the name of the application is not limited by the present application. That is, the user may click on the icon 302 of the camera application to open the photographing preview interface 303 of the camera application. Without being limited thereto, the user may also invoke the camera application to open the shooting preview interface 303 in other applications, such as the user clicking on a shooting control in a social class application to open the shooting preview interface 303. The social application can support the user to share the shot pictures or videos with other people.

It should be noted that, the shooting preview interface 303 may be a user interface of a default shooting mode of the camera application, for example, may be a user interface provided when the camera application is in a front shooting mode. It will be appreciated that the default shooting mode may be other, such as a rear shooting mode, a front-rear shooting mode, and the like. Still alternatively, the shooting preview interface 303 may be a user interface of a shooting mode in which the camera application is in when the camera application exits last time.

Fig. 2B illustrates an example of the shooting preview interface 303 as a shooting preview interface corresponding to when the camera application is in the front shooting mode. As shown in fig. 2B, the shot preview interface 303 may include a preview image 304, a shot mode option 305, a flash control, a shutter control, and the like. The preview image 304 is an image captured by a front camera among the plurality of cameras 293. It should be noted that, the electronic device may refresh the image displayed in the shooting preview interface 303 (i.e., the preview image 304) in real time, so that the user previews the image currently shot by the camera 293. The shooting mode option 305 is used to provide a plurality of shooting modes for selection by the user. The plurality of photographing modes may include: photograph 305a, video 305b, multi-mirror video 305c, real-time blurring, panoramic, etc. The electronic device may receive an operation of the user's left/right slide the photographing mode option 305, and in response to the operation, the electronic device may turn on the photographing mode selected by the user. Note that, not limited to the one shown in fig. 2B, more or fewer options than those shown in fig. 2B may be displayed in the shooting mode option 305.

The photographing mode corresponding to the photographing 305a, i.e. the commonly used single-lens photographing, may include a front photographing mode, a rear photographing mode, and the like. That is, when the photograph 305a is selected, the electronic device may take a photograph through the front camera or the rear camera. For specific description of the front shooting mode and the rear shooting mode, please refer to the foregoing, and the description is omitted herein.

The shooting modes corresponding to the multi-mirror video 305c may include multi-mirror shooting and single-mirror shooting. That is, when the multi-lens video 305c is selected, the electronic apparatus can perform single-lens shooting through one camera or multi-lens shooting through a plurality of cameras. For a specific description of the multi-shot image, reference may be made to the foregoing detailed description, which is not repeated herein.

As shown in fig. 2B, the photo 305a is in a selected state. That is, the electronic device is currently in a photographing mode. If the user wishes to turn on the multi-mirror recording mode, he/she can slide left through the capture mode option 305 and select the multi-mirror recording 305c. When detecting the user's left-hand slide of the photographing mode option 305 and selecting the operation of the multi-mirror video 305C, the electronic device may turn on the multi-mirror video mode and display the photographing preview interface 303 as shown in fig. 2C.

As shown in fig. 2C, after entering the multi-mirror video recording mode, the electronic device displays the shooting preview interface 303. The shooting preview interface 303 includes an image 306a (may also be referred to as a second image), an image 306b (may also be referred to as a first image), a blank mirror control 307, a setup control 308, a shooting mode switch control 309, a teaching guide control 310, and the like. The image 306a is an image acquired by the rear camera in real time, the image 306b is an image acquired by the front camera in real time, and the image 306a and the image 306b are spliced up and down due to the fact that the electronic equipment is arranged vertically.

In the application, the front camera and the rear camera can be started by default when the electronic equipment is in the first multi-mirror video recording mode, and the display mode of the image is a splicing mode by default. However, in other embodiments, the default on camera may be two rear cameras, a front camera, or a rear camera. The display method of the image is not limited to the stitching method, and may be a picture-in-picture method or the like, and is not particularly limited herein.

Wherein, the space-apart mirror-changing control 307 can be used for a user to quickly start/stop the space-apart mirror-changing function. After the function of changing the mirror at intervals is started, a user can control the electronic equipment through a specific interval gesture. It should be noted that, after the electronic device enters the multi-mirror video recording mode, the function of changing the mirror with a space can be started by default. Thus, the blank mirror control 307 is in an on state for indicating that the blank mirror function has been turned on. Of course, the space-saving mirror changing function can also be turned off. For example, in response to detecting a touch operation by a user on the blank mirror control 307, the electronic device may turn off the blank mirror function. At this time, the blank mirror control 307 is in an off state for indicating that the blank mirror function has been turned off.

The setup control 308 (also referred to as a first control) may be used to adjust parameters of taking a photograph (e.g., resolution, picture scale, etc.), turn on or off some of the ways to take a photograph (e.g., alternate mirror, timed photograph, smile snap, voice control photograph, etc.), and so on. Specifically, the electronic device can receive a user click on the setting control 308, and in response to the operation, the electronic device can display a setting interface 308a as shown in fig. 2D. The setup interface 308a may include options such as a space-apart mirror 308b (which may also be referred to as a first option), a photo scale, voice-controlled photographing, and the like. The blank-out mirror 308b may turn on or off a blank-out mirror function (may also be referred to as a first function), which refers to a function of the electronic device for capturing image data for recognizing a gesture of a user through the front camera and switching a shooting mode. Note that, the on-off state of the blank mirror 308b in the setting interface 308a is linked with the on-off state of the blank mirror control 307 in the shooting preview interface 303, and the on-off state of the blank mirror 308b is consistent with the on-off state of the blank mirror control 307. That is, if the blank mirror 308b is switched from the on state/off state to the off state/on state, the blank mirror control 307 is also switched from the on state/off state to the off state/on state, and vice versa.

In addition, the space-saving and changing mirror 308b can prompt a user, and the electronic device can recognize the space-saving gesture by utilizing the front camera during multi-mirror video recording. For example, the alternate mirror 308b may include text information of "switch multi-mirror mode by front camera recognition gesture during multi-mirror video recording". That is, the electronic device may inform the user that the electronic device may recognize the blank gesture using the front camera when the user opens the blank mirror change function by setting the control 308, avoiding the user from feeling that the privacy is violated.

The shooting mode switch control 309 (which may also be referred to as a third control) may be used to provide a plurality of shooting modes for selection by a user, such as a front-back shooting mode, a back-back shooting mode, a picture-in-picture shooting mode, a front shooting mode, a back shooting mode, and so on. Notably, the capture mode switch control 309 can also indicate the capture mode in which the electronic device is located and the manner in which the image is displayed. For example, the "smiling face" in the shooting mode switching control 309 in fig. 2C is used to refer to an image shot by a front camera, and "blank" is identical to an image shot by a rear camera, and is spliced up and down with the "smiling face" to indicate that the image 306a is spliced up and down with the image 306 b.

The teaching guidance control 310 (also referred to as a second control) may be used to guide the user to learn a blank gesture of blank changing, such as a blank gesture to open a recording, a gesture to switch a double mirror and a single mirror, a gesture to open/close a picture-in-picture, a gesture to exchange front and rear lenses, a gesture to end a recording, etc. Note that the teaching guidance control 310 is associated with a space-apart mirror change function: when the blank mirror change function is turned on (or the blank mirror change control 307 is in an on state), the shooting preview interface 303 may display the teaching guide control 310; when the alternate mirror function is turned off (or the alternate mirror control 307 is in an off state), the capture preview interface 303 may hide (and may be understood as not displaying) the teaching guide control 310. It should be noted that, when the electronic device starts recording, the teaching guide control 310 may also be hidden.

In the embodiment of the application, the electronic equipment can remind the user that the electronic equipment can use the front-facing camera to recognize the air-separation gesture of the user when the user views the teaching guide about the air-separation gesture.

If the user wishes to view the tutorial guidance for the blank gesture, the tutorial guidance control 310 may be clicked. As shown in fig. 3, the electronic device may receive an operation of clicking on the tutorial guidance control 310 by the user, and in response to the operation, the electronic device may display a guidance window 311 (also may be referred to as a second popup window) as shown in fig. 4A. The guided missile window 311 can be used to show the manner of use of the air-stop gesture and related ancillary interpretations. Specifically, the guided pop-up window 311 may include an animation display area 311a, a text prompt area 311b, and a confirmation option 311c. The animation display area 311a is used for displaying the use method and effect of the space gesture. In one design, the animation display 311a may be presented in an animated manner, which is more vivid and easy to understand, and helps the user to quickly understand and learn the space gesture. The content displayed by the text prompt area 311b matches the content displayed by the dynamic display 311a, and can be used for assisting in explaining the function of the blank gesture being displayed by the animation display area 311a and the using method of the blank gesture.

As shown in fig. 4A to 4C, the animation display region 311a may display a guide animation that turns on/off the pip at intervals.

As shown in fig. 4A, the electronic device is in the rear-end shooting mode, and an image 313a shot by the rear-end camera is displayed in the shooting preview interface 312. As also shown in fig. 4A, the electronic device may display a blank mirror icon 314 upon recognition of the "hand up" gesture. As shown in fig. 4B, the electronic device may, after recognizing the gesture of "lift hand and make a fist," turn on the picture-in-picture mode and display the shooting preview interface 312 as shown in fig. 4C. The photographing preview interface 312 shown in fig. 4C displays an image 313a and an image 313b at the same time. The image 313a is still displayed in the whole display area of the shooting preview interface 312, and the image 313b is superimposed on the image 313a.

In addition, the animation display region 311a may also display the inverse process of fig. 4A to 4C. That is, the electronic device may display the photographing preview interface 312 as shown in fig. 4B after detecting a gesture of "lift hand" in the photographing preview interface 312 as shown in fig. 4C. Then, after a gesture of "lift hand and make a fist" is detected in the photographing preview interface 312 shown in fig. 4B, the photographing preview interface 312 shown in fig. 4A is displayed. In other words, the user can turn on or off the picture-in-picture by this "lift hand and make a fist" gesture.

Correspondingly, in fig. 4A-7C, the text prompting area 311b can display "open/close picture-in-picture at intervals", and the user can grasp a fist after the hand is lifted to have the open gesture icon 312, so as to assist the user in understanding how to open/close picture-in-picture using the open gesture.

In one possible design, before the electronic device displays the shooting preview interface 312 shown in fig. 4A, the electronic device may also display the shooting preview interface 312 shown in fig. 4D, where the shooting preview interface 312 is an interface displayed by the electronic device before the gesture of "lift hand" is recognized. The capture preview interface 312 may display a prompt 315, where the prompt 315 is used to prompt the user, and the electronic device may use the front camera to recognize the blank gesture when in the rear capture mode, so as to avoid the user from feeling that the privacy is violated. In an embodiment of the present application, the prompt 315 may be an icon. In other embodiments, however, the prompt 315 may be in the form of text or a combination of text and icons. It should be noted that, the scene shown in fig. 4D may be displayed as a single guide animation in the animation display area 311a, instead of being combined with the animation of switching the double mirror and the single mirror at intervals.

It should be noted that, the above-mentioned guiding animation with the double mirrors and the single mirrors being switched at intervals is taken as an example, and the guiding pop-up window 311 may also display other guiding animations, such as a record of opening at intervals, a picture-in-picture of opening/closing at intervals, a shot before and after switching at intervals, and a record of ending at intervals. In the embodiment of the application, the electronic device can display the content shown in fig. 4D in the guide animation of playing the shot before and after the space switching and the space opening/closing picture-in-picture to remind the user that the electronic device can use the front camera to recognize the space gesture.

In the embodiment of the application, the electronic equipment can remind the user that the electronic equipment can recognize the blank gesture through the front camera when switching from any shooting mode to the rear shooting mode. Specifically, any one of the shooting modes may be a front-back shooting mode, a front shooting mode, a picture-in-picture shooting mode, and a back-back shooting mode.

It should be noted that, the user may switch the shooting mode of the electronic device from the front-back shooting mode/the front shooting mode/the picture-in-picture shooting mode to the rear shooting mode through the space gesture, or may switch the shooting mode of the electronic device from any one of the shooting modes to the rear shooting mode by touching a specific control (e.g., the shooting mode switching control 309) on the display screen 294.

The following describes a process of switching from the front-back shooting mode to the rear shooting mode after the electronic device recognizes the space gesture.

When the electronic device is in the front-rear photographing mode, a photographing preview interface 401 as shown in fig. 5A may be displayed. The shooting preview interface 401 includes an image 401a (may also be referred to as a second image), an image 401b (may also be referred to as a first image), a blank mirror change control 402, a shooting mode switching control 403, and the like. The image 401a is an image acquired by the rear camera in real time, and the image 401b is an image acquired by the front camera in real time. In addition, the image 401a is stitched from side to side with the image 401b because the electronic device is placed sideways. In the shooting scenario shown in fig. 5A, the blank mirror change control 402 is in an on state. The area where the first image is located may be referred to as a first area, and the area where the second image is located may be referred to as a second area, where the first area and the second area do not overlap due to the electronic device being in the front-back shooting mode.

As shown in fig. 5A, if the user wishes to switch the shooting mode of the electronic device, a blank gesture, for example, a blank gesture of "lift" may be input to the electronic device (it may be understood that the user keeps facing the display screen and keeps holding "lift" and may also be referred to as a first gesture). The front camera of the electronic device may capture a blank gesture (i.e., image 401 b) entered by the user and display it in the capture preview interface 401. In addition, the electronic device may further analyze the captured image 401B, and when the "lift hand" blank gesture is recognized, display the capture preview interface 401 as shown in fig. 5B. The shooting preview interface 401 shown in fig. 5B is similar to the shooting preview interface 401 shown in fig. 5A, except that: the shot preview interface 401 shown in fig. 5B includes a prompt 404 (which may also be referred to as a first identifier) for prompting the user that the electronic device has entered a "ready" state (which may be understood to be a state in which a user's blank gesture is ready to be further recognized), and the user may enter the blank gesture as desired. For example, as shown in fig. 5B, the prompt 404 may be an icon of a blank gesture. In one possible design, the prompt 404 may also include text information prompting the user for a gesture operation to be completed within a first predetermined time, such as "gesture operation to be completed within 3 seconds".

Meanwhile, the reminder information 404 may also include a timeline bar that may be used to indicate when the electronic device is entering a "ready" state. Wherein the electronic device starts timing from a time (e.g., a first time) when the electronic device enters a "ready" state, at which time the timeline is blank; the electronic device stops timing after a first preset time at a first moment, and the time progress bar is filled up at the moment. After the electronic device enters the "ready" state, the user needs to input a space-apart gesture before the timeline is filled (which can be understood as being within a first preset time) to achieve control over the electronic device.

As shown in fig. 5C, if the user desires the electronic device to switch from the front-back photographing mode to the rear photographing mode, a blank gesture (which may also be referred to as a second gesture) of "slide left-to-right" may be input in opposition to the display screen when the electronic device displays the photographing preview interface 401 shown in fig. 5B. In response to detecting a "slide left to right" blank gesture of the user, the electronic device may switch the capture mode from a picture-in-picture capture mode to a post capture mode and display a capture preview interface 401 as shown in fig. 5D.

As shown in fig. 5D, after the electronic device switches to the rear-end shooting mode, an image 401a shot by the rear-end camera may be displayed in the shooting preview interface 401. It should be noted that the front camera working at this time may be a default rear main camera of the electronic device. In addition, the shooting preview interface 401 further includes a prompt 405 (may also be referred to as a first prompt), where the prompt 405 is used to remind the user that the electronic device is using the front camera to recognize the blank gesture of the user. In the embodiment of the present application, the prompt 405 may be a flag. In other embodiments, the prompt 405 may include text or a combination of text and icons. In fig. 5D, the region where the image 401a is located may be referred to as a third region, and the third region may include the first region and the second region.

Note that, when the electronic device switches from the picture-in-picture photographing mode/the front photographing mode to the rear photographing mode through the blank gesture, the prompt message 405 may also be displayed. The principle of the electronic device switching from the picture-in-picture photographing mode/the front photographing mode to the rear photographing mode is similar to the principle of the electronic device switching from the front photographing mode to the rear photographing mode, and is not repeated herein.

In addition, when the electronic device is in the picture-in-picture photographing mode, the front-back photographing mode, the front photographing mode, and the back photographing mode, the user may also switch the photographing mode of the electronic device to the back-up mode by touching a specific control (e.g., the photographing mode switch control 309) on the display screen 294. The following description will take, as an example, a procedure in which the electronic apparatus switches from the post-shooting mode to the post-shooting mode.

When the electronic device is in the rear photographing mode, a photographing preview interface 401 as shown in fig. 6A may be displayed. The photographing preview interface 401 includes an image 401a and an image 401c photographed by two rear cameras. The image 401a is an image captured by a normal camera in the rear camera, and the image 401c is an image captured by a wide-angle camera in the rear camera. It can be seen that image 401c has a larger viewing range than image 401 a. In addition, the shooting preview interface 401 further includes a shooting mode switching control 403.

As shown in fig. 6A, the electronic device may receive an operation in which the user clicks the photographing mode switching control 403 (may also be referred to as a third control), and in response to the operation, the electronic device may display a first popup window 406 as shown in fig. 6B on the photographing preview interface 401. The first popup window 406 may display preview interfaces of multiple shooting modes, such as a preview interface 406a of a front shooting mode, a preview interface 406b of a rear shooting mode (also referred to as a first shooting mode identifier), a preview interface 406c of a picture-in-picture shooting mode, a preview interface 406d of a rear shooting mode, and a preview interface 406e of a front and rear shooting mode. The preview interface of any shooting mode is used for previewing the shooting preview interface after the electronic equipment is switched to the shooting mode.

As shown in fig. 6B, the electronic device may receive an operation in which the user clicks the preview interface 406B, and in response to the operation, the electronic device switches the photographing mode from the post-photographing mode to the post-photographing mode, and displays the photographing preview interface 401 as shown in fig. 6C. The shooting preview interface 401 is similar to the shooting preview interface 401 shown in fig. 5D, and will not be described again.

Therefore, when the electronic device switches to the rear shooting mode in any mode, the prompt information 405 can be displayed to remind the user that the electronic device can use the front camera to recognize the blank gesture of the user.

The electronic equipment can remind the user that the electronic equipment can use the front-facing camera to recognize the air-separating gesture of the user when the user starts the air-separating mirror changing function. For example, as shown in fig. 7A, the electronic device may display a shooting preview interface 701 when in a rear shooting mode. The shooting preview interface 701 includes a preview image 701a shot by a rear camera, a blank mirror change control 702 (also referred to as a fourth control), and a setting control 703. Wherein the blank mirror control 702 is in an off state (may also be referred to as a first state) for indicating that the electronic device does not turn on the blank mirror function.

As shown in fig. 7A, if the user wishes the electronic device to turn on the alternate mirror function, the alternate mirror control 702 may be clicked. In response to detecting a user clicking on the alternate mirror control 702, the electronic device may turn on the alternate mirror function and display a capture preview interface 701 as shown in fig. 7A. In contrast to fig. 7A, the blank mirror control 702 in fig. 7B is in an on state (which may also be referred to as a second state) for indicating that the electronic device has turned on the blank mirror function. In addition, the shooting preview interface 701 further includes a prompt message 704 (may also be referred to as a second prompt message), where the prompt message 704 is used to remind the user that the electronic device can use the front camera to recognize the gesture after opening the function of changing the lens. For example, the prompt message 704 may be "the space-apart mirror-changing function is turned on, and the multi-mirror mode may be switched by the gesture recognition of the front camera during the multi-mirror video recording.

In one possible design, the electronic device may hide the reminder 704 after a second preset time to avoid the reminder 704 from affecting the user's preview of the captured content.

In one possible design, the electronic device may hide the prompt 704 after a second preset time and display the capture preview interface 701 as shown in fig. 7C. The capture preview interface 701 in fig. 7C hides (or can be understood as not displaying) the cue information 704 and displays the cue information 705. The prompt 705 is used to alert the user that the electronic device is using the front-facing camera to recognize a gesture. The hint information 705 can be an identification that characterizes the gesture being captured, or related text, such as "gesture being recognized," or a combination of identification and text.

It should be noted that, the user may also click the setting control 703 to open the space-saving mirror changing function. After the opening, the prompt message 704 shown in fig. 7B and the prompt message 705 shown in fig. 7C may be displayed, which are not described herein.

In summary, the electronic device may remind the user that the electronic device may use the front camera to identify the space gesture of the user in various scenarios, so as to avoid misunderstanding of the user.

The present application also provides a chip system 800, as shown in FIG. 8, comprising at least one processor 801 and at least one interface circuit 802. The processor 801 and the interface circuit 802 may be interconnected by wires. For example, interface circuit 802 may be used to receive signals from other devices (e.g., a memory of an electronic apparatus). For another example, interface circuit 802 may be used to send signals to other devices (e.g., processor 801).

For example, the interface circuit 802 may read instructions stored in a memory in the electronic device and send the instructions to the processor 801. The instructions, when executed by the processor 801, may cause the electronic device to perform the various steps described in the various embodiments above.

From the foregoing description of the embodiments, it will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of functional modules is illustrated, and in practical application, the above-described functional allocation may be implemented by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to implement all or part of the functions described above. The specific working processes of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which are not described herein.

The functional units in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in the embodiments of the present application. And the aforementioned storage medium includes: flash memory, removable hard disk, read-only memory, random access memory, magnetic or optical disk, and the like.

The foregoing is merely a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited to this, and any changes or substitutions within the technical scope disclosed in the embodiment of the present application should be covered in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiments of the present application shall be subject to the protection scope of the claims.

Claims

1. A prompting method, characterized in that the method is applied to an electronic device including a display screen, a first camera and a second camera, the first camera and the second camera are located on different sides of the display screen, and the first camera and the display screen are located on the same side of the electronic device, the method comprising:

the electronic equipment displays a shooting preview interface, wherein a first area of the shooting preview interface displays a first image acquired in real time from the first camera, and a second area of the shooting preview interface displays a second image acquired in real time from the second camera;

in response to the first camera detecting a first gesture, the electronic device displays a first identification on the shooting preview interface;

in a first preset time after the first mark is displayed, responding to the fact that the first camera detects a second gesture, and continuing to display the second image on the shooting preview interface by the electronic equipment, and stopping displaying the first image;

the electronic equipment displays first prompt information on the shooting preview interface, and the first prompt information indicates that the electronic equipment is collecting image data for recognizing gestures of a user through the first camera.

2. The prompting method according to claim 1, wherein the shooting preview interface further comprises a first control, the method further comprising:

responding to the operation of a user on the first control, displaying a setting interface on the electronic equipment, wherein the setting interface comprises a first option, the first option is used for starting or closing a first function, the first function is a function that the electronic equipment acquires image data for identifying user gestures through the first camera, the first option comprises second prompt information, and after the second prompt information indicates that the first function is started, the electronic equipment acquires the image data for identifying the user gestures through the first camera.

3. The prompting method according to claim 1, wherein the shooting preview interface further comprises a second control, the method further comprising:

responding to the operation of the user on the second control, and displaying a second popup window on the shooting preview interface by the electronic equipment;

the electronic equipment circularly plays a plurality of guide videos on the second popup window according to a preset sequence, a first guide video in the plurality of guide videos indicates that in a first shooting mode, the electronic equipment collects image data for recognizing gestures of a user through the first camera, and the first shooting mode is a mode in which the electronic equipment shoots through the second camera.

4. A prompting method according to any one of claims 1-3 wherein the shooting preview interface further comprises a third control, the method further comprising:

responding to the operation of a user on the third control, displaying a first popup window on the shooting preview interface by the electronic equipment, wherein the first popup window comprises an identification of a first shooting mode, and the first shooting mode is a mode that the electronic equipment shoots through the second camera;

responding to the operation of the user on the identification of the first shooting mode, the electronic equipment continues to display the second image on the shooting preview interface, and the display of the first image is stopped;

and the electronic equipment displays the first prompt information on the shooting preview interface.

5. A prompting method according to any one of claims 1-3 wherein said shooting preview interface further comprises a fourth control, said method further comprising, if said electronic device does not begin recording video, before said electronic device displays a first identifier on said shooting preview interface:

responding to the operation of a user on the fourth control, switching the fourth control from a first state to a second state on the shooting preview interface by the electronic device, and displaying second prompt information on the shooting preview interface, wherein the first state indicates that the electronic device does not start a first function, the first function is a function of acquiring image data for identifying user gestures by the electronic device through the first camera, the second state indicates that the first function is started by the electronic device, and the second prompt information indicates that the image data for identifying user gestures are acquired by the electronic device through the first camera.

6. The prompting method according to claim 5, further comprising:

and hiding the second prompt information by the electronic equipment within a second preset time for displaying the second prompt information.

7. A prompting method according to any one of claims 1-3 wherein said electronic device continues to display said second image at said capture preview interface, comprising:

and the electronic equipment continues to display the second image in a third area of the shooting preview interface, wherein the third area comprises the first area and the second area, and the first area and the second area are not overlapped.

8. A prompting method according to any one of claims 1-3 wherein said electronic device continues to display said second image at said capture preview interface, comprising:

and the electronic equipment continues to display the second image in a third area of the shooting preview interface, wherein the first area is positioned on the second area, and the third area is the same as the second area.

9. A prompting method according to any one of claims 1-3, characterized in that the method further comprises:

And if the first camera does not detect the preset gesture, the electronic device stops displaying the first mark after displaying the first preset time of the first mark, wherein the preset gesture comprises the first gesture and the second gesture.

10. A prompting method according to any one of claims 1-3, characterized in that the method further comprises:

and in a first preset time after the first mark is displayed, if the first camera detects a preset gesture, the electronic equipment stops displaying the first mark, and the preset gesture comprises the first gesture and the second gesture.

11. A prompting method according to any one of claims 1-3, wherein the electronic device displays a first identifier on the shooting preview interface, comprising:

and when the electronic equipment displays the first mark on the shooting preview interface, detecting a preset gesture through the first camera.

12. A prompting method according to any one of claims 1-3, characterized in that the method further comprises:

in response to the first camera detecting a second gesture, the electronic device does not display the first identification on the capture preview interface and does not stop displaying the second image on the capture preview interface.

13. A method of prompting according to any one of claims 1-3, wherein the electronic device does not begin recording video or is recording video.

14. An electronic device comprising a display screen, a front-facing camera, a rear-facing camera, and a processor, the processor and memory coupled, the memory storing program instructions that, when executed by the processor, cause the electronic device to implement the method of any of claims 1-13.

15. A computer-readable storage medium comprising computer instructions;

the computer instructions, when run on an electronic device, cause the electronic device to perform the method of any one of claims 1-13.