CN117939287A - Abnormality prompting method and electronic equipment - Google Patents

Abnormality prompting method and electronic equipment Download PDF

Info

Publication number
CN117939287A
CN117939287A CN202311865325.1A CN202311865325A CN117939287A CN 117939287 A CN117939287 A CN 117939287A CN 202311865325 A CN202311865325 A CN 202311865325A CN 117939287 A CN117939287 A CN 117939287A
Authority
CN
China
Prior art keywords
image
camera
electronic device
preview interface
shooting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311865325.1A
Other languages
Chinese (zh)
Inventor
黄雨菲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Publication of CN117939287A publication Critical patent/CN117939287A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/667Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)

Abstract

The application provides an abnormality prompting method and electronic equipment, which can prompt a user that the electronic equipment cannot start a first function (a space-apart mirror changing function) in a post shooting mode in time, and improve the man-machine interaction efficiency. The method comprises the following steps: and displaying a shooting preview interface, and in response to detection of user operation, displaying a second image, a third image and first prompt information on the shooting preview interface by the electronic equipment, wherein the first prompt information is used for indicating that the electronic equipment cannot enable a first function in a current shooting mode.

Description

Abnormality prompting method and electronic equipment
The present application is a divisional application, the application number of which is 202111679475.4, the date of which is 2021, 12, 31, and the entire contents of which are incorporated herein by reference.
The present application claims priority of chinese patent application filed in 2021, 16 months, and 2021, application number 202110676709.3, entitled "a video creation method for user based on story line mode and electronic device", and priority of chinese patent application filed in 2021, 11 months, 29 days, application number 202111473686.2, entitled "an abnormality prompting method and electronic device", the entire contents of which are incorporated herein by reference.
Technical Field
The present application relates to the field of terminal technologies, and in particular, to an anomaly prompting method and an electronic device.
Background
With the development of electronic technology, electronic devices such as mobile phones and tablet computers are generally configured with multiple cameras, such as front cameras, rear cameras, and wide-angle cameras. In order to bring further shooting creation experience, more and more electronic devices can support simultaneous shooting of a plurality of cameras, so that attractive pictures such as wonderful moments, sensible scenes and the like are recorded.
However, some scenes currently exist, which cannot support simultaneous shooting of a plurality of cameras, and a user needs to be reminded.
Disclosure of Invention
The embodiment of the application provides an abnormality prompting method and electronic equipment, which can prompt a user in time when abnormality exists.
In a first aspect, an embodiment of the present application provides an anomaly prompting method, where the method is applied to an electronic device including a display screen, a first camera, a second camera, and a third camera, where the first camera and the second camera are located on different sides of the display screen, the first camera and the display screen are located on the same side of the electronic device, and the third camera and the second camera are located on the same side of the display screen, and the method includes: the electronic equipment displays a shooting preview interface, the shooting preview interface displays at least one of a first image and a second image, the first image is an image acquired by a first camera in real time, the second image is an image acquired by a second camera in real time, the electronic equipment starts a first function, and the first function is a function of acquiring image data for identifying gestures of a user through the first camera by the electronic equipment; in response to detection of user operation, the electronic device displays a second image, a third image and first prompt information on a shooting preview interface, wherein the third image is an image acquired by a third camera in real time, and the first prompt information is used for indicating that the electronic device cannot enable a first function in a current shooting mode.
It can be appreciated that the electronic device may switch from any one of a front shooting mode, a rear shooting mode, a front-rear shooting mode, and a picture-in-picture shooting mode to a rear shooting mode, and after switching to the rear shooting mode, the electronic device may remind a user that the space-apart mirror-changing function cannot be used in the rear shooting mode.
In a possible implementation manner, the shooting preview interface further includes a second control, and in response to detecting the user operation, the electronic device continues to display the second image on the shooting preview interface, and displays a third image and a first prompt message acquired in real time from a third camera, including: responding to the operation of a user on the second control, displaying a first popup window on a shooting preview interface by the electronic equipment, wherein the first popup window comprises an identifier of a first shooting mode, and the first shooting mode is a mode that the electronic equipment shoots through a second camera and a third camera at the same time; and responding to the operation of the user on the identification of the first shooting mode, the electronic equipment displays a second image on a shooting preview interface and displays a third image and first prompt information. That is, the user may switch from the other shooting mode to the post-shooting mode through a control (e.g., a second control) on the interface.
In one possible implementation, in response to detecting the user operation, the electronic device continues to display the second image on the shooting preview interface, and displays a third image and the first prompt information acquired in real time from the third camera, including: in response to the first camera detecting the first gesture, the electronic device displays a first identifier on the shooting preview interface; and in the preset time after the first mark is displayed, responding to the fact that the first camera detects the second gesture, and continuously displaying the second image on the shooting preview interface by the electronic equipment to display the third image and the first prompt information. That is, the user may switch from the other shooting mode to the post-shooting mode through a blank gesture (e.g., a second gesture).
In one possible implementation, before detecting the user operation, the method further includes: detecting the temperature of equipment in real time; if the temperature of the equipment is not in the preset temperature range, the electronic equipment displays second prompt information on the shooting preview interface, and the second prompt information indicates that the electronic equipment has closed the first function.
It can be seen that, according to the guiding usage method of the blank gesture provided by the embodiment of the application, when the electronic device is in any one shooting mode (including a front shooting mode, a rear shooting mode, a front-back shooting mode and a picture-in-picture shooting mode), the device temperature is detected in real time, and when the device temperature is detected not to be within the preset temperature range, the blank mirror changing function (namely the first function) is closed and the second prompt information is displayed. Therefore, when the temperature of the equipment is abnormal, the user can be timely reminded that the electronic equipment is closed for changing the mirror at intervals, and the man-machine interaction efficiency is improved.
In a possible implementation manner, in a case where the electronic device does not start recording video, the shooting preview interface further includes a first control, where the first control is used to turn on or off the first function, and the method further includes: if the temperature of the equipment is not in the preset temperature range, the electronic equipment switches the first control from the first state to the second state on the shooting preview interface, the first state indicates that the electronic equipment has started the first function, and the second state indicates that the electronic equipment has closed the first function.
It can be appreciated that if the electronic device does not begin recording video, the shooting preview interface may include a first control that may be used to turn on or off the alternate mirror function. When the electronic equipment detects that the equipment temperature is not in the preset range, the function of switching off the empty mirror can be automatically closed, and the state of the first control can be switched on the shooting preview interface, and the first state is switched into the second state so as to indicate that the electronic equipment has closed the function of switching off the empty mirror.
In one possible implementation, in a case where the electronic device is recording video, the method further includes: if the temperature of the equipment is not in the preset temperature range, the electronic equipment stops recording the video in response to detection of the user operation, and a first control is displayed on a shooting preview interface, wherein the first control is in a second state, and the second state indicates that the electronic equipment has closed a first function.
That is, if the device temperature is not within the preset temperature range, the electronic device may automatically close the space-saving mirror-changing function. During this time, if the electronic device receives the operation of stopping recording the video by the user, the electronic device may stop recording the video, and display the first control on the shooting preview interface after stopping recording the video, where the first control is in the second state.
In one possible implementation, the first control is in an non-clickable state during a period when the device temperature is not within a preset temperature range. That is, the user cannot turn on the air-blocking mirror-changing function through the first control during the period when the device temperature is not within the preset temperature range.
In one possible implementation, the method further includes: if the temperature of the equipment is not in the preset temperature range, responding to the detection of the operation of the user on the first control, and displaying third prompt information on a shooting preview interface by the electronic equipment, wherein the third prompt information indicates that the first function of the electronic equipment cannot be started due to abnormal temperature. That is, in the case where the device temperature is not within the preset temperature range, the user cannot turn on the air-separation mirror-changing function.
In one possible implementation, if the device temperature is greater than or equal to a first preset temperature, or the device temperature is less than or equal to a second preset temperature, the device temperature is not within a preset temperature range, wherein the first preset temperature is greater than the second preset temperature. That is, the device temperature is either too high or too low, and the device temperature may be considered to be outside the preset temperature range.
In one possible implementation, the shooting preview interface includes a first image and a second image, and the electronic device displays the shooting preview interface, including: the electronic device displays a first image in a first area of the shooting preview interface and displays a second image in a second area of the shooting preview interface. That is, the electronic device may be in a front-back shooting mode or a picture-in-picture shooting mode, where if the electronic device is in the front-back shooting mode, the first area and the second area do not overlap; if the electronic device is in the picture-in-picture shooting mode, the first area and the second area are overlapped.
In a possible implementation manner, the electronic device displays the second image and the third image on the shooting preview interface, including: the electronic device displays the second image in a third area of the shooting preview interface, displays the third image in a fourth area of the shooting preview interface, wherein the third area is identical to the second area, and the fourth area is identical to the first area.
It will be appreciated that the third region is identical to the second region and the fourth region is identical to the first region, i.e. no switching of the size of the display region is involved during switching of the shooting mode. The electronic device may perform any of the foregoing methods during the switching of the front-rear shooting mode to the rear-rear shooting mode.
In a possible implementation manner, the electronic device displays the second image and the third image on the shooting preview interface, including: the electronic device displays a second image in a third area of the shooting preview interface, displays the third image in a fourth area of the shooting preview interface, the third area is different from the second area, the fourth area is different from the first area, and the first area and the second area are overlapped. It will be appreciated that the electronic device may perform any of the methods described above during the switching of the picture-in-picture photographing mode to the post-photographing mode.
In one possible implementation, the capture preview interface includes a first image or a second image. That is, the electronic apparatus may perform any one of the foregoing methods in the front-end shooting mode or the rear-end shooting mode.
In one possible implementation, the electronic device does not begin recording video or is recording video.
In a second aspect, an embodiment of the present application provides an electronic device, including a display screen, a first camera, a second camera, and a processor, where the processor is coupled to a memory, and the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, cause the electronic device to implement a method according to any one of the possible design manners of the first aspect.
In a third aspect, a computer-readable storage medium includes computer instructions; when executed on an electronic device, the computer instructions cause the electronic device to perform the method of any one of the possible designs of the first aspect.
In a fourth aspect, the present application provides a chip system comprising one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected by a wire.
The chip system described above may be applied to an electronic device including a communication module and a memory. The interface circuit is for receiving signals from a memory of the electronic device and transmitting the received signals to the processor, the signals including computer instructions stored in the memory. When the processor executes the computer instructions, the electronic device may perform the method as described in any one of the possible designs of the first aspect.
In a fifth aspect, the application provides a computer program product which, when run on a computer, causes the computer to carry out the method according to any one of the possible designs of the first aspect.
Drawings
Fig. 1A is a schematic hardware structure of an electronic device according to an embodiment of the present application;
fig. 1B is a software architecture diagram of an electronic device according to an embodiment of the present application;
FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application;
FIG. 3 is a schematic diagram of an interface according to an embodiment of the present application;
FIGS. 4A-4B are a set of interface diagrams according to an embodiment of the present application;
FIGS. 5A-5D are a set of interface diagrams according to an embodiment of the present application;
FIGS. 6A-6C are a set of interface diagrams according to an embodiment of the present application;
FIGS. 7A-7G are a set of interface diagrams according to an embodiment of the present application;
Fig. 8 is a schematic structural diagram of a chip system according to an embodiment of the present application.
Detailed Description
The terms "first" and "second" are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present embodiment, unless otherwise specified, the meaning of "plurality" is two or more.
For clarity and conciseness in the description of the embodiments below and for ease of understanding to those skilled in the art, a brief introduction to related concepts or technologies is first presented.
The shooting preview interface refers to an interface displayed before or during shooting of the electronic equipment, and can be used for displaying images acquired by the camera in real time. In addition, the shooting preview interface may further display a plurality of controls, and the plurality of controls may include a flash control for turning on/off a flash, a beauty control for turning on/off a beauty function, a shutter control for shooting, and the like.
Single-lens shooting refers to a mode in which an electronic device shoots only through one camera. In the single-lens shooting mode, the electronic equipment only displays an image shot by one camera in a shooting preview interface. Wherein, the single-lens shooting can comprise a front shooting mode, a rear shooting mode and the like.
Specifically, front-end shooting refers to a mode in which electronic equipment shoots through a front-end camera. When the electronic equipment is in the front shooting mode, the image acquired by the front camera in real time can be displayed on a shooting preview interface.
The rear shooting mode refers to a mode that the electronic equipment shoots through a rear camera. When the electronic equipment is in the rear shooting mode, the image acquired by the rear camera in real time can be displayed on a shooting preview interface.
Multi-lens shooting refers to a mode that electronic equipment can shoot through a plurality of cameras. In the multi-mirror shooting mode, the display screen simultaneously displays images shot by the cameras in the shooting preview interface, and the images shot by the different cameras can be spliced or displayed in a picture-in-picture mode. The multi-lens shooting may include a front-back shooting mode, a back-back shooting mode, a picture-in-picture shooting mode, and the like, according to the type of the camera used by the electronic device and the display modes of the images shot by different cameras. In the embodiment of the application, the multi-mirror shooting can also be called multi-mirror video recording.
The front and back shooting mode refers to a mode that the electronic equipment can shoot through the front camera and the back camera at the same time. When the electronic device is in the front-back shooting mode, images (for example, a first image and a second image) shot by the front camera and the rear camera can be displayed in the shooting preview interface at the same time, and the first image and the second image are spliced and displayed. When the electronic equipment is vertically arranged, the first image and the second image can be spliced up and down; when the electronic equipment is horizontally arranged, the first image and the second image can be spliced left and right. By default, the display area of the first image is identical to the display area of the second image.
The rear shooting mode refers to a mode that the electronic device can shoot through two rear cameras (if a plurality of rear cameras exist) at the same time. When the electronic device is in the rear shooting mode, the electronic device can simultaneously display images (for example, a first image and a second image) shot by the two rear cameras in a shooting preview interface, and the first image and the second image are spliced and displayed. When the electronic equipment is vertically arranged, the first image and the second image can be spliced up and down; when the electronic equipment is horizontally arranged, the first image and the second image can be spliced left and right.
The picture-in-picture shooting mode refers to a mode in which the electronic device can shoot through two cameras at the same time. When the electronic device is in the picture-in-picture shooting mode, images (e.g., a first image, a second image) shot by two cameras can be displayed simultaneously in a shooting preview interface. The second image is displayed in the whole area of the shooting preview interface, the first image is overlapped on the second image, and the display area of the first image is smaller than that of the second image. By default, the first image may be located below and to the left of the second image. The two cameras can be freely combined, for example, two front cameras, two rear cameras or one front camera and one rear camera.
It should be noted that, the above-mentioned "single-lens shooting", "multi-lens shooting", "front shooting mode", "rear shooting mode", "front-rear shooting mode", "picture-in-picture shooting mode", and "rear shooting mode" are just some names used in the embodiments of the present application, and the meaning of the representative names are already described in the embodiments of the present application, and the names do not limit the embodiments.
The application provides an abnormality prompting method which is applied to electronic equipment comprising a display screen, a first camera, a second camera and a third camera, wherein when the electronic equipment is switched from a mode of shooting by the first camera and/or the second camera to a mode of shooting by the second camera and the third camera, first prompting information can be displayed on a shooting preview interface, and the first prompting information indicates that the electronic equipment cannot enable a space-apart mirror changing function (also can be called as a first function) in a current shooting mode. The function of separating and changing the mirror refers to a function that the electronic equipment collects image data for recognizing gestures of a user through the front-facing camera and switches shooting modes. By the method, the user can be timely prompted that the user cannot use the space-apart gesture, and the man-machine interaction efficiency is improved.
The electronic device may be a single-screen mobile phone or a folding-screen mobile phone. When the electronic equipment is a single-screen mobile phone, the first camera and the second camera can be a front camera and a rear camera of the electronic equipment respectively. When the electronic equipment is a folding screen mobile phone, the display screen can comprise a first screen and a second screen, the first screen is rotationally connected with the second screen, the first camera and the second camera can be respectively positioned at two sides of the first screen, and the first camera and the first screen are positioned at the same side of the electronic equipment. Or the first camera is located on the first screen, the second camera is located on the second screen, and the first camera, the second camera and the second camera are located on the same side of the electronic device. In the embodiment of the application, the electronic equipment is taken as a single-screen mobile phone for illustration.
In the embodiment of the application, the electronic equipment can recognize the air-separation gesture of the user through any one of the front cameras. The embodiment of the application does not limit the blank gestures for switching the shooting modes. The above-mentioned space gesture is just a name used in the embodiment of the present application, and may also be referred to as a hover gesture, etc., specifically, a gesture input without touching the electronic device, and the meaning of the representation of the gesture is already described in the embodiment of the present application, and the name of the gesture is not limited in any way to the embodiment of the present application.
In order to more clearly and specifically describe the prompting method provided by the embodiment of the application, the following first describes an electronic device related to implementing the method.
The electronic device may be a cell phone, tablet, desktop, laptop, handheld, notebook, ultra-mobile personal computer (UMPC), netbook, and cellular telephone, personal Digital Assistant (PDA), augmented reality (augmented reality, AR) device, virtual Reality (VR) device, artificial intelligence (ARTIFICIAL INTELLIGENCE, AI) device, wearable device, vehicle-mounted device, smart home device, and/or smart city device, and the specific type of the electronic device is not particularly limited by the embodiments of the present application.
Referring to fig. 1A, fig. 1A shows a schematic hardware structure of an electronic device according to an embodiment of the present application.
As shown in fig. 1A, the electronic device 200 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (universal serial bus, USB) interface 230, a charge management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, keys 290, a motor 291, an indicator 292, a plurality of cameras 293, a display 294, a subscriber identity module (subscriber identification module, SIM) card interface 295, and the like.
The sensor module 280 may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, acceleration sensors, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, and the like.
It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic apparatus 200. In other embodiments, the electronic device 200 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Processor 210 may include one or more processing units such as, for example: processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (IMAGE SIGNAL processor, ISP), a controller, a memory, a video codec, a digital signal processor (DIGITAL SIGNAL processor, DSP), a baseband processor, and/or a neural Network Processor (NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.
The controller may be a neural hub and command center of the electronic device 200. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may hold instructions or data that the processor 210 has just used or recycled. If the processor 210 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided and the latency of the processor 210 is reduced, thereby improving the efficiency of the system.
In some embodiments, processor 210 may include one or more interfaces. The interfaces may include an integrated circuit (inter-INTEGRATED CIRCUIT, I2C) interface, an integrated circuit built-in audio (inter-INTEGRATED CIRCUIT SOUND, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others. It should be understood that the connection relationship between the modules illustrated in this embodiment is only illustrative, and does not limit the structure of the electronic device 200. In other embodiments, the electronic device 200 may also employ different interfaces in the above embodiments, or a combination of interfaces.
In the embodiment of the present application, the processor 210 may receive a plurality of continuous images corresponding to a space gesture, such as a "palm", input by a user and captured by the camera 293, then the processor 210 may perform a comparative analysis on the plurality of continuous images, determine that the space gesture corresponding to the plurality of continuous images is a "palm", determine that an operation corresponding to the space gesture, such as starting recording, and then the processor 210 may control the camera application program to perform a corresponding operation. The corresponding operations may include, for example: the multiple cameras are moved to shoot images simultaneously, then the images shot by the multiple cameras are synthesized through a GPU (graphics processing unit) in a mode of splicing or picture-in-picture (local superposition) and the like, and the display screen 294 is called to display the synthesized images in a shooting preview interface of the electronic equipment.
The external memory interface 220 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 200. The external memory card communicates with the processor 210 through an external memory interface 220 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.
Internal memory 221 may be used to store computer executable program code that includes instructions. The processor 210 executes various functional applications of the electronic device 200 and data processing by executing instructions stored in the internal memory 221. For example, in an embodiment of the present application, the processor 210 may include a memory program area and a memory data area by executing instructions stored in the internal memory 221. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 200 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 221 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.
In an embodiment of the present application, the internal memory 221 may store a picture file or a recorded video file or the like that is photographed by the electronic device in different photographing modes.
The charge management module 240 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. The charging management module 240 may also supply power to the terminal device through the power management module 241 while charging the battery 242.
The power management module 241 is used for connecting the battery 242, and the charge management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and/or the charge management module 240 and provides power to the processor 210, the internal memory 221, the external memory, the display 294, the camera 293, the wireless communication module 260, and the like. In some embodiments, the power management module 241 and the charge management module 240 may also be provided in the same device.
The wireless communication function of the electronic device 200 can be implemented by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, a modem processor, a baseband processor, and the like. In some embodiments, antenna 1 and mobile communication module 250 of electronic device 200 are coupled, and antenna 2 and wireless communication module 260 are coupled, such that electronic device 200 may communicate with a network and other devices via wireless communication techniques.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 200 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 250 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied on the electronic device 200. The mobile communication module 250 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), or the like. The mobile communication module 250 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation.
The mobile communication module 250 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 250 may be disposed in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 250 may be provided in the same device as at least some of the modules of the processor 210.
The wireless communication module 260 may provide solutions for wireless communication including WLAN (e.g., (WIRELESS FIDELITY, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation SATELLITE SYSTEM, GNSS), frequency modulation (frequency modulation, FM), near Field Communication (NFC), infrared (IR), etc., applied on the electronic device 200.
The wireless communication module 260 may be one or more devices that integrate at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 210. The wireless communication module 260 may also receive a signal to be transmitted from the processor 210, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.
The electronic device 200 implements display functions through a GPU, a display screen 294, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or change display information.
The display 294 is used to display images, videos, and the like. The display 294 includes a display panel.
The electronic device 200 may implement a photographing function through an ISP, a camera 293, a video codec, a GPU, a display 294, an application processor, and the like. The ISP is used to process the data fed back by the camera 293. The camera 293 is used to capture still images or video. In some embodiments, the electronic device 200 may include N cameras 293, N being a positive integer greater than 2.
The electronic device 200 may implement audio functions through an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an ear-headphone interface 270D, an application processor, and the like. Such as music playing, recording, etc.
Keys 290 include a power on key, a volume key, etc. The keys 290 may be mechanical keys. Or may be a touch key. The motor 291 may generate a vibration alert. The motor 291 may be used for incoming call vibration alerting or for touch vibration feedback. The indicator 292 may be an indicator light, which may be used to indicate a state of charge, a change in power, a message indicating a missed call, a notification, etc.
The plurality of cameras 293 are used to capture images. In the embodiment of the application, the number of cameras 293 can be M, M is more than or equal to 2, and M is a positive integer. The number of cameras started in multi-lens shooting of the electronic equipment can be N, N is more than or equal to 2 and less than or equal to M, and N is a positive integer.
In the embodiment of the present application, the type of the camera 293 may be differentiated according to the hardware configuration and the physical location. For example, the plurality of cameras included in the camera 293 may be disposed on the front and back sides of the electronic device, the camera disposed on the display screen 294 of the electronic device may be referred to as a front camera, and the camera disposed on the rear cover of the electronic device may be referred to as a rear camera; for example, cameras having different focal lengths and different viewing angles, which are included in the camera 293, may be referred to as wide-angle cameras, and cameras having a long focal length and a small viewing angle may be referred to as normal cameras. The content of the images shot by different cameras is different in that: the front camera is used for shooting scenes facing the front surface of the electronic equipment, and the rear camera is used for shooting scenes facing the back surface of the electronic equipment; the wide-angle camera can shoot scenes with larger area in a shorter shooting distance range, and the scenes shot at the same shooting distance are smaller than the images of the scenes shot by using the common lens in the picture. The focal length and the visual angle are relative concepts, and are not limited by specific parameters, so that the wide-angle camera and the common camera are also relative concepts, and can be distinguished according to physical parameters such as the focal length, the visual angle and the like.
Particularly, in the embodiment of the present application, the camera 293 at least includes a camera with a time of flight (TOF) 3D sensing module or a structured light (structured light) 3D sensing module, and the camera acquires 3D data of an object in a captured image, so that the processor 210 can identify an operation instruction corresponding to a space gesture of a user according to the 3D data of the object.
The camera for acquiring the 3D data of the object can be an independent low-power-consumption camera, and can also be other common front-mounted cameras or rear-mounted cameras, wherein the common front-mounted cameras or rear-mounted cameras support a low-power-consumption mode, when the low-power-consumption camera works or the common front-mounted cameras or rear-mounted cameras work in the low-power-consumption mode, the frame rate of the camera is lower than that of the common camera working in a non-low-power-consumption mode, and the output image is in a black-and-white format. A typical camera may output 30 frames of images, 60 frames of images, 90 frames of images, 240 frames of images for 1 second, but the low power consumption camera may output, for example, 2.5 frames of images for 1 second when the typical front camera or the rear camera operates in a low power consumption mode, and may switch to output 10 frames of images for 1 second when the camera captures the first image representing the same space gesture, so as to accurately recognize an operation instruction corresponding to the space gesture through continuous multiple image recognition. Meanwhile, compared with the common camera, the power consumption is reduced when the camera works in a low power consumption mode.
The display 294 is used to display images, videos, and the like. In some embodiments, the electronic device may include 1 or N displays 294, N being a positive integer greater than 1. In an embodiment of the present application, the display 294 may be used to display images taken by any one or more cameras 293, for example, to display multiple frames of images taken by one camera in a capture preview interface, or to display multiple frames of images from one camera 293 in a saved video file, or to display a photograph from one camera 293 in a saved picture file.
The SIM card interface 295 is for interfacing with a SIM card. The SIM card may be inserted into the SIM card interface 295 or removed from the SIM card interface 295 to enable contact and separation from the electronic device 200. The electronic device 200 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 295 may support Nano SIM cards, micro SIM cards, and the like.
Fig. 1B is a software structural block diagram of an electronic device according to an embodiment of the present invention.
The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun rows (Android runtime) and system libraries, and a kernel layer, respectively.
The application layer may include a series of application packages.
As shown in fig. 1B, the application package may include applications for cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, etc.
The application framework layer provides an application programming interface (application programming interface, API) and programming framework for the application of the application layer. The application framework layer includes a number of predefined functions.
As shown in FIG. 1B, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.
The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.
The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.
The telephony manager is for providing communication functions of the electronic device. Such as the management of call status (including on, hung-up, etc.).
The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.
The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.
Android run time includes a core library and virtual machines. Android runtime is responsible for scheduling and management of the android system.
The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.
The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.
The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.
The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.
The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.
The 2D graphics engine is a drawing engine for 2D drawing.
The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.
The workflow of the electronic device in software and hardware during shooting is illustrated in connection with capturing a photo scene.
When the touch sensor receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into the original input event (including information such as touch coordinates, time stamp of touch operation, etc.). The original input event is stored at the kernel layer. The application framework layer acquires an original input event from the kernel layer, and identifies a control corresponding to the input event. Taking the touch operation as a touch click operation, taking a control corresponding to the click operation as an example of a control of a camera application icon, the camera application calls an interface of an application framework layer, starts the camera application, further starts a camera driver by calling a kernel layer, and captures a still image or video through a camera 293. In the embodiment of the present application, the touch operation received by the touch sensor may be replaced by an operation in which the camera 293 captures a blank gesture input by the user. Specifically, when the camera 293 shoots the operation of the air-stop gesture, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the space gesture operation into the original input event (including the image of the space gesture, the timestamp of the space gesture operation, etc.). The original input event is stored at the kernel layer. The application framework layer acquires an original input event from the kernel layer, and identifies an operation corresponding to the input event. Taking the operation of switching the shooting mode as an example, the camera application calls the interface of the application framework layer, and further starts other camera drivers by calling the kernel layer, so that the camera application switches to the other cameras 293 to capture still images or videos.
Next, a method provided by the present application will be described with reference to the drawings.
As shown in fig. 2, the handset may display a main interface 301. The main interface 301 may include an icon 302 of a camera application. The mobile phone may receive an operation of clicking on the icon 302 by the user, and in response to the operation, as shown in fig. 3, the mobile phone may open the camera application and display a photographing preview interface 303 of the camera application. It can be understood that the camera application is an application for capturing an image on an electronic device such as a smart phone, a tablet computer, etc., and may be a system application or a third party application, and the name of the application is not limited by the present application. That is, the user may click on the icon 302 of the camera application to open the photographing preview interface 303 of the camera application. Without being limited thereto, the user may also invoke the camera application to open the shooting preview interface 303 in other applications, such as the user clicking on a shooting control in a social class application to open the shooting preview interface 303. The social application can support the user to share the shot pictures or videos with other people.
It should be noted that, the shooting preview interface 303 may be a user interface of a default shooting mode of the camera application, for example, may be a user interface provided when the camera application is in a front shooting mode. It will be appreciated that the default shooting mode may be other, such as a rear shooting mode, a front-rear shooting mode, and the like. Alternatively, the camera application may have a memory function, and the shooting preview interface 303 may be a user interface of a shooting mode in which the camera application is in when the camera application exits last time.
Fig. 3 illustrates an example of the shooting preview interface 303 as a shooting preview interface corresponding to when the camera application is in the front shooting mode. As shown in fig. 3, the shot preview interface 303 may include a preview image 304, a shot mode option 305, a flash control, a shutter control, and the like. The preview image 304 is an image captured by a front camera among the plurality of cameras 293. It should be noted that, the electronic device may refresh the image displayed in the shooting preview interface 303 (i.e., the preview image 304) in real time, so that the user previews the image currently shot by the camera 293. The shooting mode option 305 is used to provide a plurality of shooting modes for selection by the user. The plurality of photographing modes may include: photograph 305a, video 305b, multi-mirror video 305c, real-time blurring, panoramic, etc. The electronic device may receive an operation of the user's left/right slide the photographing mode option 305, and in response to the operation, the electronic device may turn on the photographing mode selected by the user. Note that, not limited to the one shown in fig. 3, more or fewer options than those shown in fig. 3 may be displayed in the shooting mode option 305.
The photographing mode corresponding to the photographing 305a, i.e. the commonly used single-lens photographing, may include a front photographing mode, a rear photographing mode, and the like. That is, when the photograph 305a is selected, the electronic device may take a photograph through the front camera or the rear camera. For specific description of the front shooting mode and the rear shooting mode, please refer to the foregoing, and the description is omitted herein.
The shooting modes corresponding to the multi-mirror video 305c may include multi-mirror shooting and single-mirror shooting. That is, when the multi-lens video 305c is selected, the electronic apparatus can perform single-lens shooting through one camera or multi-lens shooting through a plurality of cameras. For a specific description of the multi-shot image, reference may be made to the foregoing detailed description, which is not repeated herein.
As shown in fig. 3, the photo 305a is in a selected state. That is, the electronic device is currently in a photographing mode. If the user wishes to turn on the multi-mirror recording mode, he/she can slide left through the capture mode option 305 and select the multi-mirror recording 305c. When detecting the user's left-hand slide of the photographing mode option 305 and selecting the operation of the multi-mirror video 305c, the electronic device may turn on the multi-mirror video mode and display the photographing preview interface 303 as shown in fig. 4A.
As shown in fig. 4A, after entering the multi-mirror video recording mode, the electronic device displays a shooting preview interface 303. The shooting preview interface 303 includes an image 306a, an image 306b, a blank mirror control 307, a setup control 308, a shooting mode switch control 309, a teaching guide control 310, and the like. The image 306a is an image photographed by a rear camera, the image 306b is an image photographed by a front camera, and the image 306a and the image 306b are spliced up and down due to the vertical arrangement of the electronic device.
In the application, the front camera and the rear camera can be started by default when the electronic equipment is in the first multi-mirror video recording mode, and the display mode of the image is a splicing mode by default. However, in other embodiments, the default on camera may be two rear cameras, a front camera, or a rear camera. The display method of the image is not limited to the stitching method, and may be a picture-in-picture method or the like, and is not particularly limited herein. Or the camera application can have a memory function, after the electronic equipment enters the multi-mirror video mode, the electronic equipment can start a camera which is working when the camera application exits from the multi-mirror video mode last time, and display the camera in the last display mode.
Wherein, the space-apart mirror-changing control 307 can be used for a user to quickly start/stop the space-apart mirror-changing function. After the function of changing the mirror at intervals is started, a user can control the electronic equipment through a specific interval gesture. It should be noted that, after the electronic device enters the multi-mirror video recording mode, the function of changing the mirror with a space can be started by default. Thus, the blank mirror control 307 is in an on state (which may also be referred to as a first state) for indicating that the blank mirror function has been turned on. Of course, the space-saving mirror changing function can also be turned off. For example, in response to detecting a touch operation by a user on the blank mirror control 307, the electronic device may turn off the blank mirror function. At this time, the blank mirror control 307 is in an off state (may also be referred to as a second state) for indicating that the blank mirror function has been turned off.
The setup controls 308 may be used to adjust parameters of the photograph taken (e.g., resolution, picture scale, etc.), to turn on or off some of the ways used for taking the photograph (e.g., alternate mirror, timed photograph, smile snapshot, voice-activated photograph, etc.), etc. Specifically, the electronic device can receive a user click on the setting control 308, and in response to the operation, the electronic device can display a setting interface 308a as shown in fig. 4B. The setup interface 308a may include options for a space-apart mirror 308b, a photo scale, voice-controlled photographing, and the like. The alternate mirror 308b may turn on or off the alternate mirror function. Note that, the on-off state of the blank mirror 308b in the setting interface 308a is linked with the on-off state of the blank mirror control 307 in the shooting preview interface 303, and the on-off state of the blank mirror 308b is consistent with the on-off state of the blank mirror control 307. That is, if the blank mirror 308b is switched from the on state/off state to the off state/on state, the blank mirror control 307 is also switched from the on state/off state to the off state/on state, and vice versa.
In addition, the space-saving and changing mirror 308b can prompt a user, and the electronic device can recognize the space-saving gesture by utilizing the front camera during multi-mirror video recording. For example, the alternate mirror 308b may include text information of "switch multi-mirror mode by front camera recognition gesture during multi-mirror video recording". That is, the electronic device may inform the user that the electronic device may recognize the blank gesture using the front camera when the user opens the blank mirror change function by setting the control 308, avoiding the user from feeling that the privacy is violated.
The shooting mode switch control 309 can be used to provide a variety of shooting modes for selection by the user, such as a front-back shooting mode, a back-back shooting mode, a picture-in-picture shooting mode, a front shooting mode, a back shooting mode, and so on.
In the embodiment of the application, the electronic equipment can have a function of changing the mirror at intervals. The function of spacing and changing the mirror can be as follows: under the multi-mirror video recording, the electronic equipment can recognize the air-separation gesture through the front-mounted camera so as to switch the shooting mode. The function of changing the mirror with a space of the electronic device will be described with reference to the accompanying drawings.
As shown in fig. 5A, the electronic device may display a shooting preview interface 401. The shooting preview interface 401 includes an image 401a (may also be referred to as a second image), an image 401b (may also be referred to as a first image), a shooting mode switching control 402, and the like. The image 401a is an image acquired by the rear camera in real time, and the image 401b is an image acquired by the front camera in real time. In addition, the image 401a and the image 401b are stitched from side to side because the electronic device is laid horizontally. Specifically, the first image is located in a first area of the shooting preview interface, the second image is located in a second area of the shooting preview interface, and the first area and the second area are not overlapped. For example, the first region may be the region of the image 401b in fig. 5A, and the second region may be the region of the image 401a in fig. 5A.
As shown in fig. 5A, if the user wishes to switch the shooting mode of the electronic device, a blank gesture, for example, a blank gesture of "lift" may be input to the electronic device (it may be understood that the user keeps facing the display screen and keeps holding "lift" and may also be referred to as a first gesture). The front camera of the electronic device may capture a blank gesture (i.e., image 401 b) entered by the user and display it in the capture preview interface 401. In addition, the electronic device may further analyze the captured image 401B, and when the "lift hand" blank gesture is recognized, display the capture preview interface 401 as shown in fig. 5B. The shooting preview interface 401 shown in fig. 5B is similar to the shooting preview interface 401 shown in fig. 5A, except that: the shot preview interface 401 shown in fig. 5B includes prompt information 403 for prompting the user that the electronic device has entered a "ready" state (which may be understood as a state in which the user's hold gesture is ready to be further recognized), and the user may enter the hold gesture as desired. For example, as shown in fig. 5B, the prompt 403 may be an icon of a blank gesture. In one possible design, the prompt 403 may further include text information prompting the user for a gesture operation to be completed within a first predetermined time, such as "gesture operation is required to be completed within 3 seconds".
Meanwhile, the hint information 403 may also include a timeline that may be used to indicate when the electronic device entered the "ready" state. Wherein the electronic device starts timing from a time (e.g., a first time) when the electronic device enters a "ready" state, at which time the timeline is blank; the electronic device stops timing after a first preset time at a first moment, and the time progress bar is filled up at the moment. After the electronic device enters the "ready" state, the user needs to input a space-apart gesture before the timeline is filled (which can be understood as being within a first preset time) to achieve control over the electronic device.
For example, the electronic device may switch from the front-rear shooting mode to the front-shooting mode or the rear-shooting mode when a blank gesture input by a user is detected. The interface involved in switching the electronic apparatus from the front-rear photographing mode to the front-photographing mode will be described below based on the photographing scene shown in fig. 5A to 5B.
As shown in fig. 5C, if the user desires the electronic device to switch from the front-back shooting mode to the front shooting mode, when the electronic device displays the shooting preview interface 401 shown in fig. 5B, a blank gesture (a gesture that can be understood simply as a left-hand gesture of the palm, and also referred to as a third gesture) of "moving the palm from right to left" may be input to the display screen. In response to detecting a blank gesture of "palm moving from right to left" input by the user, the electronic device may switch the photographing mode from the front-rear photographing mode to the front photographing mode, and display a photographing preview interface 401 as shown in fig. 5D. As shown in fig. 5D, after the electronic device switches to the front-end shooting mode, an image 401b shot by the front-end camera may be displayed in the shooting preview interface 401. It should be noted that, when there are a plurality of front cameras, the front camera working at this time may be the default front main camera of the electronic device.
It should be noted that, the electronic device may also switch the shooting mode from the front-back shooting mode to the other shooting mode in response to detecting other blank gestures of the user. For example, in the shooting scene shown in fig. 5B, in response to detecting a blank gesture of "stretch palm and then make a fist" input by the user, the electronic device may switch the shooting mode from the front-back shooting mode to the picture-in-picture shooting mode. Or in response to detecting a "reverse palm" blank gesture entered by the user, the electronic device may swap the positions of image 401a and image 401b, i.e., change the position of image 401a from the original left of the screen to the right of the screen, and change the position of image 401b from the original right of the screen to the left of the screen. Or in response to detecting a "winning" blank gesture entered by the user, the electronic device may switch the shooting mode from a front-to-back shooting mode to a back-to-back shooting mode. Specifically, the electronic device may switch the image 401b to the image 401c (may also be referred to as a third image), where the image 401c is an image acquired by another rear camera (may be referred to as a third camera) in real time.
When the space-apart mirror-changing function is started, the electronic device needs to recognize a space-apart gesture of the user through at least one front-facing camera, and further execute an operation corresponding to the space-apart gesture. That is, when the electronic device recognizes the blank gesture, the blank mirror function cannot be enabled.
In the embodiment of the application, the electronic equipment can simultaneously utilize two cameras to shoot images. When the electronic equipment is in a rear shooting mode, the two rear cameras are in a working state, so that the electronic equipment cannot recognize a space gesture of a user through the front cameras. Therefore, when the electronic device is in the rear shooting mode, the space-apart mirror-changing function cannot be started.
The electronic device can remind a user that the function of changing the mirror by spacing cannot be used when the shooting mode is switched to the post shooting mode. As shown in fig. 6A, the electronic device may display a shooting preview interface 401. The shooting preview interface 401 is similar to the shooting preview interface 401 shown in fig. 5A, and will not be described again.
As shown in fig. 6A, the electronic device may also receive an operation in which the user clicks the photographing mode switching control 402 (may also be referred to as a second control), and in response to the operation, the electronic device may display the photographing preview interface 401 shown in fig. 6B on the photographing preview interface 401. The shooting preview interface 401 may include a shooting mode selection area 404 (which may also be referred to as a first popup). The shooting mode selection area 404 may display preview interfaces of multiple shooting modes, such as a preview interface 404a of a front shooting mode, a preview interface 404b of a rear shooting mode (may also be referred to as a first shooting mode), a preview interface 404c of a picture-in-picture shooting mode, a preview interface 404d of a rear shooting mode, and a preview interface 404e of a front and rear shooting mode.
As shown in fig. 6B, the electronic apparatus may receive an operation in which the user clicks the preview interface 404B of the rear photographing mode, switch the photographing mode from the front-rear photographing mode to the rear-rear photographing mode in response to the operation, and display the photographing preview interface 401 as shown in fig. 6C.
As shown in fig. 6C, the image displayed in the photographing preview interface 401 is switched from the images 401a and 401b shown in fig. 6A to an image 401a and an image 401C (may also be referred to as a third image). The image 401a is an image captured by a common camera in the rear camera, and the image 401c is an image acquired by a wide-angle camera in the rear camera in real time. It can be seen that image 401c has a larger viewing range than image 401 a. In addition, the shooting preview interface 401 further includes an abnormality notification 405 (may also be referred to as a first notification). The abnormality notification 405 is used to alert the user that the space-saving lens changing function cannot be used in the rear-rear shooting mode, for example, "space-saving lens changing cannot be used at rear/rear".
Or the user may also use the space-saving gesture to switch from the other shooting mode to the post-shooting mode. The specific switching process is described in the foregoing description about the space-apart mirror-changing functional portion, and is not repeated herein.
In the above description, the electronic device is merely described by taking an example of switching from the front-rear shooting mode to the rear-rear shooting mode, and in fact, the abnormality indication information 405 (may also be referred to as the first abnormality indication information) may be displayed when the electronic device is switched from any of the other shooting modes (for example, the picture-in-picture shooting mode, the front shooting mode, and the rear shooting mode) to the rear-rear shooting mode. The mode of switching the electronic device from any other shooting mode to the back shooting mode is the same as the mode of switching the electronic device from the front shooting mode to the back shooting mode, and is not described herein.
The electronic device may display the abnormality notification 405 when it first switches to the post-shooting mode after entering the multi-mirror video recording. The method can avoid frequent reminding of the user by the electronic equipment and reduce redundant information.
It should be noted that the above description only takes the abnormality reminding process of the electronic device in the recording process as an example. When the electronic device is in an unrecorded state, the electronic device can also be switched from any shooting mode to a post shooting mode, and abnormal prompt information 405 is displayed.
If the electronic equipment has started the space-apart mirror-changing function, the electronic equipment can also close the space-apart mirror-changing function and remind a user when the equipment temperature is too high or too low. The following description will take an example in which the electronic apparatus is in the front-rear shooting mode.
Referring to fig. 7A, a capture preview interface 401 is shown when the electronic device is at a normal temperature. The shooting preview interface 401 shown in fig. 7A is similar to the shooting preview interface 401 shown in fig. 6A, except that: the shooting preview interface 401 shown in fig. 6A is in a recorded state, and the shooting preview interface 401 shown in fig. 7A is in an unrecorded state, but this does not affect the abnormality alert.
Referring to fig. 7B, a capture preview interface 401 is shown when the electronic device is too hot. In comparison with the photographing preview interface 401 shown in fig. 7A, abnormality notification 407 (which may also be referred to as second notification) is displayed in the photographing preview interface 401 shown in fig. 7B. The abnormality notification 407 is used to notify the user that the electronic device has turned off the function of changing the mirror at a distance due to an excessive device temperature, for example, "the device temperature is too high" the mirror is changed at a distance "off". In addition, the state in which the blank mirror control 406 (which may also be referred to as a first control) is in changes from the on state shown in fig. 7A to the off state shown in fig. 7B (which may also be referred to as a second state).
Specifically, the temperature sensor of the electronic device may detect the device temperature of the electronic device in real time and transmit it to the processor 210. The processor 210 may consider that the device temperature of the electronic device is too high when the device temperature is greater than a preset first temperature (may also be referred to as a first preset temperature), and control the display 294 to display the abnormality notification 407 on the shooting preview interface 401.
Referring to fig. 7C, a capture preview interface 401 is shown when the electronic device temperature is too low. In comparison with the photographing preview interface 401 shown in fig. 7A, abnormality notification 408 (which may also be referred to as second notification) is displayed in the photographing preview interface 401 shown in fig. 7C. The anomaly prompt 408 is used to prompt the user that the electronic device has turned off the alternate mirror function due to too low a device temperature, e.g., "too low a device temperature" alternate mirror "off. In addition, the state in which the blank mirror control 406 is in changes from the on state shown in fig. 7A to the off state (which may also be referred to as a second state) shown in fig. 7C.
Specifically, the temperature sensor of the electronic device may detect the device temperature of the electronic device in real time and transmit it to the processor 210. The processor 210 may consider that the device temperature of the electronic device is too low when the device temperature is less than a preset second temperature (may also be referred to as a second preset temperature), and control the display 294 to display the abnormality notification 408 on the photographing preview interface 401.
It can be appreciated that when the temperature of the device of the electronic device is too high, the user continues to use the space-saving mirror-changing function, which may aggravate the heating condition of the electronic device, so that the space-saving mirror-changing function needs to be turned off. When the equipment temperature of the electronic equipment is too low, the internal resistance of the battery of the electronic equipment is increased, and at the moment, if a user continues to use the function of changing the mirror by spacing, the current of the battery can be increased instantaneously, so that the voltage of the battery is pulled down instantaneously, and the electronic equipment is powered off, so that the function of changing the mirror by spacing is required to be closed.
The electronic device may also not display (or hide) the anomaly prompt 407 or the anomaly prompt 408 after a predetermined time. For example, the electronic device may display the photographing preview interface 401 shown in fig. 7D after a preset time. Compared to the photographing preview interface 401 shown in fig. 7A, the state in which the blank mirror change control 406 is in is changed from the on state shown in fig. 7A to the off state shown in fig. 7D.
As shown in fig. 7D, if the user wishes to turn on the alternate mirror function, the alternate mirror control 406 may be clicked. The electronic device may receive an operation of clicking the space-apart mirror control 406 by a user, and in response to the operation, the electronic device may determine a temperature interval in which a device temperature is located, and perform a corresponding operation.
Specifically, if the electronic device determines that the device temperature is greater than the preset first temperature (i.e., the device temperature is too high), an abnormal prompt message 410 (may be referred to as a third prompt message) as shown in fig. 7E may be displayed, and the abnormal prompt message 410 is used to remind the user that the device temperature is too high to open the function of changing the lens while keeping the lens apart. If the electronic device determines that the device temperature is less than the preset second temperature (i.e., the device temperature is too low), a shooting preview interface 401 as shown in fig. 7F may be displayed, and the user may be reminded of the too low device temperature to turn on the function of changing the lens by using the abnormal prompt information 411 (which may be referred to as a third prompt information). If the electronic device determines that the device temperature is between the preset first temperature and the preset second temperature, the air-separation mirror-changing function may be turned on and a prompt message 412 shown in fig. 7G may be displayed to indicate that the air-separation mirror-changing function is turned on.
In an alternative embodiment, the blank mirror change control 406 may be grayed out (not shown) when the device temperature is greater than a preset first temperature or less than a preset second temperature. In other words, the blank mirror control 406 cannot be clicked during the period when the device temperature is greater than the preset first temperature or less than the preset second temperature until the device temperature returns to normal (less than the preset first temperature and greater than the preset second temperature), the blank mirror control 406 can change to the second state for the user to turn on the blank mirror function.
If the user wishes to turn on the alternate mirror function, the setup control 308 may also be clicked. The electronic device may receive an operation of clicking the space changing mirror 308b by the user, and in response to the operation, the electronic device may determine a temperature interval in which the device temperature is located, and perform a corresponding operation.
In summary, the abnormality prompting method provided by the application can prompt the user that the function of changing the mirror with a space can not be used in time when the electronic equipment is in the post-shooting mode or the equipment temperature is abnormal (the equipment temperature is higher than the preset first temperature or lower than the preset second temperature), thereby being beneficial to prompting the user to control the electronic equipment in an available mode and improving the man-machine interaction efficiency.
The present application also provides a chip system 800, as shown in FIG. 8, comprising at least one processor 801 and at least one interface circuit 802. The processor 801 and the interface circuit 802 may be interconnected by wires. For example, interface circuit 802 may be used to receive signals from other devices (e.g., a memory of an electronic apparatus). For another example, interface circuit 802 may be used to send signals to other devices (e.g., processor 801).
For example, the interface circuit 802 may read instructions stored in a memory in the electronic device and send the instructions to the processor 801. The instructions, when executed by the processor 801, may cause the electronic device to perform the various steps described in the various embodiments above.
From the foregoing description of the embodiments, it will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of functional modules is illustrated, and in practical application, the above-described functional allocation may be implemented by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to implement all or part of the functions described above. The specific working processes of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which are not described herein.
The functional units in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in the embodiments of the present application. And the aforementioned storage medium includes: flash memory, removable hard disk, read-only memory, random access memory, magnetic or optical disk, and the like.
The foregoing is merely a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited to this, and any changes or substitutions within the technical scope disclosed in the embodiment of the present application should be covered in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiments of the present application shall be subject to the protection scope of the claims.

Claims (16)

1. The method is applied to electronic equipment comprising a display screen, a first camera, a second camera and a third camera, wherein the first camera and the second camera are positioned on different sides of the display screen, the first camera and the display screen are positioned on the same side of the electronic equipment, and the third camera and the second camera are positioned on the same side of the display screen, and the method comprises the following steps:
The electronic equipment displays a shooting preview interface, the shooting preview interface displays at least one of a first image and a second image, the first image is an image acquired by the first camera in real time, the second image is an image acquired by the second camera in real time, the electronic equipment has started a first function, and the first function is a function that the electronic equipment acquires image data for identifying gestures of a user through the first camera;
In response to detection of user operation, the electronic device displays the second image, a third image and first prompt information on the shooting preview interface, wherein the third image is an image acquired by the third camera in real time, and the first prompt information is used for indicating that the electronic device cannot enable the first function in the current shooting mode.
2. The method of claim 1, wherein the capture preview interface further comprises a second control, the electronic device displaying the second image, the third image, and the first prompt at the capture preview interface in response to detecting a user operation, comprising:
Responding to the operation of a user on the second control, displaying a first popup window on the shooting preview interface by the electronic equipment, wherein the first popup window comprises an identifier of a first shooting mode, and the first shooting mode is a mode that the electronic equipment shoots through the second camera and the third camera at the same time;
and responding to the operation of the user on the identification of the first shooting mode, and displaying the second image, the third image and the first prompt information on the shooting preview interface by the electronic equipment.
3. The method of claim 2, wherein the electronic device displaying the second image, the third image, and the first prompt information on the capture preview interface in response to detecting a user operation comprises:
In response to the first camera detecting a first gesture, the electronic device displays a first identification on the shooting preview interface;
and in the preset time after the first mark is displayed, responding to the fact that the first camera detects the second gesture, and displaying the second image, the third image and the first prompt information on the shooting preview interface by the electronic equipment.
4. A method according to any one of claims 1-3, characterized in that before detecting a user operation, the method further comprises:
detecting the temperature of equipment in real time;
And if the equipment temperature is not in the preset temperature range, the electronic equipment displays second prompt information on the shooting preview interface, wherein the second prompt information indicates that the electronic equipment has closed the first function.
5. The method of claim 4, wherein in the event that the electronic device does not begin recording video, the capture preview interface further comprises a first control for turning on or off the first function, the method further comprising:
If the equipment temperature is not in the preset temperature range, the electronic equipment switches the first control from a first state to a second state on the shooting preview interface, the first state indicates that the electronic equipment has started the first function, and the second state indicates that the electronic equipment has closed the first function.
6. The method of claim 4, wherein, in the event that the electronic device is recording video, the method further comprises:
If the equipment temperature is not in the preset temperature range, responding to detection of user operation, stopping recording video by the electronic equipment, and displaying a first control on the shooting preview interface, wherein the first control is in a second state, and the second state indicates that the first function of the electronic equipment is closed.
7. The method of claim 5 or 6, wherein the first control is in an non-clickable state during a period when the device temperature is not within a preset temperature range.
8. The method according to claim 5 or 6, characterized in that the method further comprises:
If the equipment temperature is not in the preset temperature range, responding to detection of operation of a user on the first control, and displaying third prompt information on the shooting preview interface by the electronic equipment, wherein the third prompt information indicates that the first function of the electronic equipment cannot be started due to abnormal temperature.
9. The method of any of claims 4-8, wherein the device temperature is not within a predetermined temperature range if the device temperature is greater than or equal to a first predetermined temperature or the device temperature is less than or equal to a second predetermined temperature, wherein the first predetermined temperature is greater than the second predetermined temperature.
10. The method of any of claims 1-9, wherein the capture preview interface includes the first image and the second image, and wherein the electronic device displays the capture preview interface comprising:
And the electronic equipment displays the first image in a first area of the shooting preview interface and displays the second image in a second area of the shooting preview interface.
11. The method of claim 10, wherein the electronic device displaying the second image, the third image at the capture preview interface, comprises:
the electronic device displays the second image in a third area of the shooting preview interface, displays the third image in a fourth area of the shooting preview interface, wherein the third area is identical to the second area, and the fourth area is identical to the first area.
12. The method of claim 10, wherein the electronic device displaying the second image, the third image at the capture preview interface, comprises:
The electronic device displays the second image in a third area of the shooting preview interface, displays the third image in a fourth area of the shooting preview interface, wherein the third area is different from the second area, the fourth area is different from the first area, and the first area and the second area are overlapped.
13. The method of any of claims 1-9, wherein the capture preview interface includes the first image or the second image.
14. The method of any of claims 1-13, wherein the electronic device does not begin recording video or is recording video.
15. An electronic device comprising a display screen, a first camera, a second camera, and a processor, the processor and memory coupled, the memory storing program instructions that, when executed by the processor, cause the electronic device to implement the method of any one of claims 1-14.
16. A computer-readable storage medium comprising computer instructions;
the computer instructions, when run on an electronic device, cause the electronic device to perform the method of any one of claims 1-14.
CN202311865325.1A 2021-06-16 2021-12-31 Abnormality prompting method and electronic equipment Pending CN117939287A (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
CN202110676709 2021-06-16
CN2021106767093 2021-06-16
CN2021114736862 2021-11-29
CN202111473686 2021-11-29
CN202111679475.4A CN115484393B (en) 2021-06-16 2021-12-31 Abnormality prompting method and electronic equipment

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN202111679475.4A Division CN115484393B (en) 2021-06-16 2021-12-31 Abnormality prompting method and electronic equipment

Publications (1)

Publication Number Publication Date
CN117939287A true CN117939287A (en) 2024-04-26

Family

ID=84420818

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202311865325.1A Pending CN117939287A (en) 2021-06-16 2021-12-31 Abnormality prompting method and electronic equipment
CN202111679475.4A Active CN115484393B (en) 2021-06-16 2021-12-31 Abnormality prompting method and electronic equipment

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202111679475.4A Active CN115484393B (en) 2021-06-16 2021-12-31 Abnormality prompting method and electronic equipment

Country Status (2)

Country Link
CN (2) CN117939287A (en)
WO (1) WO2022262453A1 (en)

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102055166A (en) * 2009-10-27 2011-05-11 深圳长城开发科技股份有限公司 Power equipment and high-temperature self-protection method thereof
JP6316540B2 (en) * 2012-04-13 2018-04-25 三星電子株式会社Samsung Electronics Co.,Ltd. Camera device and control method thereof
CN104427124B (en) * 2013-09-09 2019-05-21 中兴通讯股份有限公司 A kind of method, apparatus and terminal of controlling terminal temperature
CN106793894A (en) * 2014-05-01 2017-05-31 艾肯制造公司 For distribute can consumable liquid system and method
CN105554412B (en) * 2016-02-15 2018-03-16 广东欧珀移动通信有限公司 A kind of photographic method based on screen light filling, device and mobile terminal
CN105807873B (en) * 2016-03-08 2019-03-08 北京小米移动软件有限公司 Temprature control method and device
CN109194813A (en) * 2018-07-12 2019-01-11 北京小米移动软件有限公司 Intelligent wearable device and its temperature control method, device and storage medium
CN109142398B (en) * 2018-07-16 2021-02-02 北京林业大学 Method for improving imaging quality of arabidopsis seeds
CN111327814A (en) * 2018-12-17 2020-06-23 华为技术有限公司 Image processing method and electronic equipment
CN110113479B (en) * 2019-04-15 2020-10-30 珠海格力电器股份有限公司 Intelligent terminal cooling strategy making method, cooling method, system and terminal
CN114679538A (en) * 2019-05-22 2022-06-28 华为技术有限公司 Shooting method and terminal
CN114915726A (en) * 2019-11-15 2022-08-16 华为技术有限公司 Shooting method and electronic equipment
CN112860169B (en) * 2021-02-18 2024-01-12 Oppo广东移动通信有限公司 Interaction method and device, computer readable medium and electronic equipment

Also Published As

Publication number Publication date
WO2022262453A1 (en) 2022-12-22
CN115484393A (en) 2022-12-16
CN115484393B (en) 2023-11-17

Similar Documents

Publication Publication Date Title
WO2021000881A1 (en) Screen splitting method and electronic device
CN111466112A (en) Image shooting method and electronic equipment
WO2022262475A1 (en) Image capture method, graphical user interface, and electronic device
US20240077987A1 (en) Widget display method and electronic device
CN110830645B (en) Operation method, electronic equipment and computer storage medium
CN112068907A (en) Interface display method and electronic equipment
CN113010076A (en) Display element display method and electronic equipment
WO2022262550A1 (en) Video photographing method and electronic device
CN115442509B (en) Shooting method, user interface and electronic equipment
CN115484387B (en) Prompting method and electronic equipment
CN115484391B (en) Shooting method and electronic equipment
CN115484393B (en) Abnormality prompting method and electronic equipment
CN115268731B (en) Method for processing service card and electronic equipment
CN115484394B (en) Guide use method of air separation gesture and electronic equipment
CN115808997A (en) Preview method, electronic equipment and system
CN115484390B (en) Video shooting method and electronic equipment
CN115484392B (en) Video shooting method and electronic equipment
CN115811656A (en) Video shooting method and electronic equipment
WO2023160455A1 (en) Object deletion method and electronic device
CN116820288A (en) Window control method, electronic device and computer readable storage medium
CN116798418A (en) Control method and device based on voice assistant
CN117632323A (en) Display method and electronic equipment
CN115904164A (en) Split-screen display method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination