WO2022262453A1 - 一种异常提示方法及电子设备 - Google Patents

一种异常提示方法及电子设备 Download PDF

Info

Publication number
WO2022262453A1
WO2022262453A1 PCT/CN2022/091049 CN2022091049W WO2022262453A1 WO 2022262453 A1 WO2022262453 A1 WO 2022262453A1 CN 2022091049 W CN2022091049 W CN 2022091049W WO 2022262453 A1 WO2022262453 A1 WO 2022262453A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
image
camera
preview interface
shooting
Prior art date
Application number
PCT/CN2022/091049
Other languages
English (en)
French (fr)
Inventor
黄雨菲
Original Assignee
荣耀终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 荣耀终端有限公司 filed Critical 荣耀终端有限公司
Publication of WO2022262453A1 publication Critical patent/WO2022262453A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor

Definitions

  • the present application relates to the technical field of terminals, and in particular to an abnormality prompting method and electronic equipment.
  • electronic devices such as mobile phones and tablet computers are generally equipped with multiple cameras, such as front cameras, rear cameras, wide-angle cameras, and the like.
  • multiple cameras such as front cameras, rear cameras, wide-angle cameras, and the like.
  • more and more electronic devices can support multiple cameras to shoot at the same time, so as to record wonderful moments, touching scenes and other beautiful pictures.
  • Embodiments of the present application provide an abnormality prompting method and an electronic device, which can promptly remind a user when an abnormality exists.
  • an embodiment of the present application provides a method for prompting an abnormality.
  • the method is applied to an electronic device including a display screen, a first camera, and a second camera.
  • the first camera and the second camera are located on different sides of the display screen.
  • the first camera The display screen is located on the same side of the electronic device, and the method includes: the electronic device displays a shooting preview interface, and the shooting preview interface displays at least one of a first image and a second image, the first image is an image collected by the first camera in real time, and the second The image is an image captured by the second camera in real time, and the electronic device has turned on the first function.
  • the first function is the function of the electronic device to collect image data for recognizing user gestures through the first camera; the electronic device detects the temperature of the device in real time; if the temperature of the device If the temperature is not within the preset temperature range, the electronic device displays a first prompt message on the shooting preview interface, and the first prompt message indicates that the electronic device has turned off the first function.
  • the method for guiding the use of space gestures can be used when the electronic device is in any shooting mode (including front shooting mode, rear shooting mode, front and rear shooting mode, and picture-in-picture shooting mode).
  • the temperature of the device is detected in real time, and when it is detected that the temperature of the device is not within the preset temperature range, the air-to-air mirror function (that is, the first function) is turned off and the first prompt message is displayed.
  • the air-to-air mirror function that is, the first function
  • the user can be reminded in time that the electronic device has turned off the function of changing the mirror through the air, and the efficiency of human-computer interaction can be improved.
  • the shooting preview interface further includes a first control
  • the first control is used to enable or disable the first function
  • the method further includes: if the temperature of the device is not within the preset temperature range
  • the electronic device switches the first control from the first state to the second state, the first state indicates that the electronic device has turned on the first function, and the second state indicates that the electronic device has turned off the first function.
  • the shooting preview interface may include a first control, which can be used to enable or disable the function of changing the mirror through space.
  • a first control which can be used to enable or disable the function of changing the mirror through space.
  • the method further includes: if the temperature of the device is not within the preset temperature range, in response to detecting a user operation, the electronic device stops recording the video, and displays the first video on the shooting preview interface.
  • a control wherein the first control is in a second state, and the second state indicates that the electronic device has turned off the first function.
  • the electronic device can automatically turn off the function of changing the mirror through the air. During this period, if the electronic device receives the user's operation to stop recording video, the electronic device may stop recording video, and display the first control on the shooting preview interface after stopping video recording, and the first control is in the second state.
  • the first control when the temperature of the device is not within the preset temperature range, the first control is in an unclickable state. That is to say, when the temperature of the device is not within the preset temperature range, the user cannot enable the function of changing the mirror through the first control.
  • the method further includes: if the temperature of the device is not within the preset temperature range, in response to detecting the user's operation on the first control, the electronic device displays a second prompt message on the shooting preview interface, and the second The prompt information indicates that the electronic device cannot start the first function due to abnormal temperature. That is to say, when the temperature of the device is not within the preset temperature range, the user cannot enable the function of changing the mirror through the air.
  • the device temperature is greater than or equal to the first preset temperature, or the device temperature is less than or equal to the second preset temperature, the device temperature is not within the preset temperature range, wherein the first preset temperature is greater than Second preset temperature. That is to say, if the temperature of the device is too high or too low, it can be considered that the temperature of the device is not within the preset temperature range.
  • the electronic device further includes a third camera, and the third camera is located on the same side of the display screen as the second camera, and the method further includes: in response to detecting a user operation, the electronic device continues to display the The second image displays a third image captured in real time by the third camera and third prompt information, the third prompt information is used to indicate that the electronic device cannot enable the first function in the current shooting mode.
  • the electronic device can switch from any one of the front shooting mode, rear shooting mode, front and rear shooting mode, and picture-in-picture shooting mode to the rear and rear shooting mode. After switching to the rear and rear shooting mode, The electronic device can remind the user that the mirror change function cannot be used in the rear-rear shooting mode.
  • the shooting preview interface further includes a second control, and in response to detecting a user operation, the electronic device continues to display the second image on the shooting preview interface, displaying the third image and the second control captured in real time by the third camera.
  • Prompt information including: in response to the user's operation on the second control, the electronic device displays a first pop-up window on the shooting preview interface, the first pop-up window includes the logo of the first shooting mode, and the first shooting mode is the A mode in which the two cameras and the third camera shoot at the same time; in response to the user's operation on the sign of the first shooting mode, the electronic device displays the second image on the shooting preview interface, and displays the third image and the third prompt information. That is, the user can switch from other shooting modes to the rear-to-back shooting mode through the controls on the interface (for example, the second control).
  • the electronic device in response to detecting the user operation, continues to display the second image on the shooting preview interface, and displays the third image and the third prompt information collected in real time from the third camera, including: responding to the first A camera detects the first gesture, and the electronic device displays the first logo on the shooting preview interface; within a preset time after the first logo is displayed, in response to the first camera detecting the second gesture, the electronic device displays the first logo on the shooting preview interface Continue to display the second image, and display information from the third image and the third prompt. That is, the user can switch from other shooting modes to the rear-to-back shooting mode through an air gesture (for example, a second gesture).
  • an air gesture for example, a second gesture
  • the shooting preview interface includes a first image and a second image
  • the electronic device displays the shooting preview interface, including: the electronic device displays the first image in the first area of the shooting preview interface, and displays the first image in the shooting preview interface.
  • the second area displays a second image. That is, the electronic device may be in the front-back shooting mode or the picture-in-picture shooting mode, wherein, if the electronic device is in the front-back shooting mode, the first area and the second area do not overlap; if the electronic device is in the picture-in-picture shooting mode, the first area A region overlaps with a second region.
  • the electronic device displaying the second image and the third image on the shooting preview interface includes: displaying the second image on the electronic device in the third area of the shooting preview interface, and displaying the second image on the shooting preview interface
  • the fourth area of the interface displays the third image, the third area is the same as the second area, and the fourth area is the same as the first area.
  • the third area is the same as the second area and the fourth area is the same as the first area, that is, the switching of the size of the display area is not involved in the process of switching the shooting mode.
  • the electronic device may execute any one of the foregoing methods while switching from the front-to-back shooting mode to the back-to-back shooting mode.
  • the electronic device displaying the second image and the third image on the shooting preview interface includes: displaying the second image on the electronic device in the third area of the shooting preview interface, and displaying the second image on the shooting preview interface
  • the fourth area of the interface displays the third image, the third area is different from the second area, the fourth area is different from the first area, and the first area overlaps with the second area. It can be understood that the electronic device may execute any one of the above-mentioned methods during the period when the picture-in-picture shooting mode is switched to the back-to-back shooting mode.
  • the shooting preview interface includes the first image or the second image. That is, the electronic device may execute any one of the foregoing methods in a front-facing shooting mode or a rear-facing shooting mode.
  • the electronic device has not started recording video or is recording video.
  • the embodiment of the present application provides an electronic device, including a display screen, a first camera, a second camera, and a processor, the processor is coupled to a memory, and the memory stores program instructions.
  • the program instructions stored in the memory are processed
  • the electronic device implements the method described in any possible design manner in the first aspect.
  • a computer-readable storage medium includes computer instructions; when the computer instructions are run on an electronic device, the electronic device is made to execute the method described in any possible design mode in the first aspect.
  • the present application provides a chip system, which includes one or more interface circuits and one or more processors.
  • the interface circuit and the processor are interconnected by wires.
  • the system-on-a-chip described above can be applied to an electronic device including a communication module and a memory.
  • the interface circuit is for receiving signals from the memory of the electronic device and sending the received signals to the processor, the signals including computer instructions stored in the memory.
  • the processor executes the computer instruction
  • the electronic device may execute the method described in any possible design manner in the first aspect.
  • the present application provides a computer program product.
  • the computer program product runs on a computer, the computer executes the method described in any possible design manner in the first aspect.
  • FIG. 1A is a schematic diagram of a hardware structure of an electronic device provided in an embodiment of the present application.
  • FIG. 1B is a software architecture diagram of an electronic device provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of an interface provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of an interface provided by an embodiment of the present application.
  • 4A-4B are schematic diagrams of a set of interfaces provided by the embodiment of the present application.
  • 5A-5D are schematic diagrams of a set of interfaces provided by the embodiment of the present application.
  • Figure 6A- Figure 6C are a set of schematic diagrams of the interface provided by the embodiment of the present application.
  • FIGS. 7A-7G are schematic diagrams of a set of interfaces provided by the embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of a chip system provided by an embodiment of the present application.
  • first and second are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as “first” and “second” may explicitly or implicitly include one or more of these features. In the description of this embodiment, unless otherwise specified, “plurality” means two or more.
  • the shooting preview interface refers to the interface displayed by the electronic device before or during shooting, which can be used to display the images collected by the camera in real time.
  • the shooting preview interface can also display multiple controls, and the multiple controls can include a flashlight control for turning on/off the flashlight, a beauty control for turning on/off the beauty function, and a shutter control for shooting, etc.
  • Single-lens shooting refers to the mode in which an electronic device only uses one camera to shoot.
  • the single-lens shooting mode of the electronic device only images captured by one camera are displayed in the shooting preview interface.
  • the single-lens shooting may include a front shooting mode, a rear shooting mode, and the like.
  • front-facing shooting refers to a mode in which an electronic device shoots through a front-facing camera.
  • the images captured by the front-facing camera in real time can be displayed on the shooting preview interface.
  • the rear shooting mode refers to a mode in which an electronic device shoots through a rear camera.
  • the images captured by the rear-facing camera in real time can be displayed on the shooting preview interface.
  • Multi-camera shooting refers to a mode in which an electronic device can shoot through multiple cameras.
  • the display screen simultaneously displays images captured by multiple cameras in the shooting preview interface, and the images captured by different cameras can be spliced and displayed, or displayed in a picture-in-picture manner.
  • the multi-lens shooting may include a front-to-back shooting mode, a rear-to-back shooting mode, a picture-in-picture shooting mode, and the like.
  • multi-lens shooting may also be referred to as multi-lens video recording.
  • the front and rear shooting mode refers to the mode in which the electronic device can simultaneously shoot through the front camera and the rear camera.
  • the images for example, the first image and the second image
  • the first image and the second image can be simultaneously displayed in the shooting preview interface, and the first image and the second image are spliced and displayed.
  • the first image and the second image can be spliced up and down; when the electronic device is placed horizontally, the first image and the second image can be spliced left and right.
  • the display area of the first image is the same as the display area of the second image.
  • the rear-rear shooting mode refers to a mode in which an electronic device can simultaneously shoot through two rear-facing cameras (if there are multiple rear-facing cameras).
  • the electronic device can simultaneously display the images captured by the two rear cameras (for example, the first image and the second image) in the shooting preview interface, and the first image and the second image are spliced and displayed.
  • the first image and the second image can be spliced up and down; when the electronic device is placed horizontally, the first image and the second image can be spliced left and right.
  • the picture-in-picture shooting mode refers to a mode in which an electronic device can simultaneously shoot through two cameras.
  • the images captured by the two cameras for example, the first image and the second image
  • the shooting preview interface the images captured by the two cameras
  • the second image is displayed in the entire area of the shooting preview interface
  • the first image is superimposed on the second image
  • the display area of the first image is smaller than that of the second image.
  • the first image can be positioned to the lower left of the second image.
  • the above two cameras can be combined freely, for example, they can be two front cameras, two rear cameras, or one front camera and one rear camera.
  • the present application provides a method for prompting an abnormality, which is applied to an electronic device including a display screen, a first camera, and a second camera, the first camera and the second camera are located on different sides of the display screen, and the first camera A camera is located on the same side of the electronic device as the display screen.
  • the electronic device can display a shooting preview interface, and the electronic device can also detect the temperature of the device in real time. If the temperature of the device is not within the preset temperature range, the electronic device will display a first prompt message on the shooting preview interface.
  • the information indicates that the electronic device has turned off the function of the air-to-air mirror change (also referred to as the first function).
  • the function of changing mirrors through the air refers to the function that the electronic device collects image data for recognizing gestures of the user through the front camera, and switches the shooting mode.
  • the user can be prompted in time that the scene where the gesture cannot be used can be used, and the efficiency of human-computer interaction can be improved.
  • the electronic device may be a single-screen mobile phone or a folding-screen mobile phone.
  • the first camera and the second camera may be a front camera and a rear camera of the electronic device respectively.
  • the display screen may include a first screen and a second screen, the first screen and the second screen are rotatably connected, the first camera and the second camera may be respectively located on both sides of the first screen, The first camera is located on the same side of the electronic device as the first screen.
  • the first camera is located on the first screen
  • the second camera is located on the second screen, and is located on the same side of the electronic device as the first screen, the second screen, the first camera, and the second camera.
  • the electronic device is a single-screen mobile phone as an example for description.
  • the electronic device may recognize the air gesture of the user through any one of the front cameras.
  • the embodiment of the present application does not limit the air gesture used to switch the shooting mode.
  • the above-mentioned air gestures are only the names used in the embodiments of this application. They can also be called air gestures, hover gestures, etc., and specifically refer to gestures input without touching electronic devices. Record, its name can not constitute any limitation to this embodiment.
  • Electronic devices can be cell phones, tablet computers, desktop computers, laptop computers, handheld computers, notebook computers, ultra-mobile personal computers (UMPC), netbooks, as well as cellular phones, personal digital assistants (personal digital assistants) assistant, PDA), augmented reality (augmented reality, AR) device, virtual reality (virtual reality, VR) device, artificial intelligence (artificial intelligence, AI) device, wearable device, vehicle-mounted device, smart home device and/or smart For urban equipment, the embodiment of the present application does not specifically limit the specific type of the electronic equipment.
  • FIG. 1A shows a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application.
  • the electronic device 200 can be a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (universal serial bus, USB) interface 230, a charging management module 240, a power management module 241, and a battery 242 , antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, audio module 270, speaker 270A, receiver 270B, microphone 270C, earphone jack 270D, sensor module 280, button 290, motor 291, indicator 292, multiple A camera 293, a display screen 294, and a subscriber identification module (subscriber identification module, SIM) card interface 295, etc.
  • SIM subscriber identification module
  • the sensor module 280 may include sensors such as a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and a bone conduction sensor.
  • sensors such as a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and a bone conduction sensor.
  • the structure shown in this embodiment does not constitute a specific limitation on the electronic device 200 .
  • the electronic device 200 may include more or fewer components than shown, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 210 may include one or more processing units, for example: the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • graphics processing unit graphics processing unit
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit, NPU
  • the controller may be the nerve center and command center of the electronic device 200 .
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 210 for storing instructions and data.
  • the memory in processor 210 is a cache memory.
  • the memory may hold instructions or data that the processor 210 has just used or recycled. If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 210 is reduced, thereby improving the efficiency of the system.
  • processor 210 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input and output
  • subscriber identity module subscriber identity module
  • SIM subscriber identity module
  • USB universal serial bus
  • the interface connection relationship among the modules shown in this embodiment is only a schematic illustration, and does not constitute a structural limitation of the electronic device 200 .
  • the electronic device 200 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
  • the processor 210 may receive a plurality of consecutive images corresponding to the air gesture input by the user, such as "palm", captured by the camera 293, and then the processor 210 may process the multiple consecutive images After comparative analysis, it is determined that the air gesture corresponding to the multiple consecutive images is "palm", and the operation corresponding to the air gesture is determined to be, for example, start recording, and then the processor 210 may control the camera application to perform the corresponding operation.
  • the corresponding operation may include, for example: mobilizing multiple cameras to capture images at the same time, then using the GPU to synthesize the images captured by the multiple cameras by splicing or picture-in-picture (partial superimposition), and calling the display screen 294 to The synthesized image is displayed on the shooting preview interface of the electronic device.
  • the external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200.
  • the external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. Such as saving music, video and other files in the external memory card.
  • the internal memory 221 may be used to store computer-executable program codes including instructions.
  • the processor 210 executes various functional applications and data processing of the electronic device 200 by executing instructions stored in the internal memory 221.
  • the processor 210 may execute instructions stored in the internal memory 221, and the internal memory 221 may include a program storage area and a data storage area.
  • the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
  • the storage data area can store data created during the use of the electronic device 200 (such as audio data, phonebook, etc.) and the like.
  • the internal memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
  • the internal memory 221 may store picture files or recorded video files taken by the electronic device in different shooting modes.
  • the charging management module 240 is configured to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger. While the charging management module 240 is charging the battery 242 , it can also supply power to the terminal device through the power management module 241 .
  • the power management module 241 is used for connecting the battery 242 , the charging management module 240 and the processor 210 .
  • the power management module 241 receives the input from the battery 242 and/or the charging management module 240 to provide power for the processor 210 , internal memory 221 , external memory, display screen 294 , camera 293 , and wireless communication module 260 .
  • the power management module 241 and the charging management module 240 can also be set in the same device.
  • the wireless communication function of the electronic device 200 can be realized by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor and the baseband processor.
  • the antenna 1 of the electronic device 200 is coupled to the mobile communication module 250, and the antenna 2 is coupled to the wireless communication module 260, so that the electronic device 200 can communicate with the network and other devices through wireless communication technology.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 200 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 250 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 200 .
  • the mobile communication module 250 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 250 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 250 can also amplify the signal modulated by the modem processor, convert it into electromagnetic wave and radiate it through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 250 may be set in the processor 210 .
  • at least part of the functional modules of the mobile communication module 250 and at least part of the modules of the processor 210 may be set in the same device.
  • the wireless communication module 260 can provide applications on the electronic device 200 including WLAN (such as (wireless fidelity, Wi-Fi) network), Bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation ( frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN such as (wireless fidelity, Wi-Fi) network
  • Bluetooth bluetooth, BT
  • global navigation satellite system global navigation satellite system, GNSS
  • frequency modulation frequency modulation, FM
  • near field communication technology near field communication, NFC
  • infrared technology infrared, IR
  • the wireless communication module 260 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 260 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 210 .
  • the wireless communication module 260 can also receive the signal to be sent from the processor 210 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 to radiate out.
  • the electronic device 200 realizes the display function through the GPU, the display screen 294 , and the application processor.
  • GPU is a microprocessor for image processing, connected to display screen 294 and application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 210 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 294 is used to display images, videos and the like.
  • the display screen 294 includes a display panel.
  • the electronic device 200 can realize the shooting function through the ISP, the camera 293 , the video codec, the GPU, the display screen 294 and the application processor.
  • the ISP is used for processing the data fed back by the camera 293 .
  • Camera 293 is used to capture still images or video.
  • the electronic device 200 may include N cameras 293 , where N is a positive integer greater than 2.
  • the electronic device 200 can realize the audio function through the audio module 270 , the speaker 270A, the receiver 270B, the microphone 270C, the earphone interface 270D, and the application processor. Such as music playback, recording, etc.
  • the keys 290 include a power key, a volume key and the like.
  • the key 290 may be a mechanical key. It can also be a touch button.
  • the motor 291 can generate a vibrating reminder.
  • the motor 291 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
  • the indicator 292 can be an indicator light, which can be used to indicate the charging status, the change of the battery capacity, and also can be used to indicate messages, missed calls, notifications and so on.
  • the number of cameras 293 may be M, where M ⁇ 2, and M is a positive integer.
  • the number of cameras enabled by the electronic device in the multi-camera shooting may be N, where 2 ⁇ N ⁇ M, and N is a positive integer.
  • the types of cameras 293 may be distinguished according to hardware configurations and physical locations.
  • the multiple cameras included in the camera 293 can be respectively placed on the front and back sides of the electronic device, the camera set on the side of the display screen 294 of the electronic device can be called a front camera, and the camera set on the side of the back cover of the electronic device can be called a front camera.
  • the camera can be called a rear camera; for another example, the multiple cameras included in the camera 293 have different focal lengths and viewing angles, a camera with a short focal length and a larger viewing angle can be called a wide-angle camera, and a camera with a long focal length and a small viewing angle can be called an ordinary camera. Camera.
  • the content of the images captured by different cameras is different in that: the front camera is used to capture the scene facing the front of the electronic device, while the rear camera is used to capture the scene facing the back of the electronic device; the wide-angle camera is used at a shorter shooting distance Within the range, a larger area of the scene can be photographed, and the scene shot at the same shooting distance has a smaller image in the screen than the scene shot with a normal lens.
  • the length of the focal length and the size of the viewing angle are relative concepts, and there are no specific parameter limitations. Therefore, wide-angle cameras and ordinary cameras are also a relative concept, which can be distinguished according to physical parameters such as focal length and viewing angle.
  • the camera 293 includes at least one camera with a (time of flight, TOF) 3D sensing module or a structured light (structured light) 3D sensing module, and the camera acquires objects in the captured image The 3D data of the object, so that the processor 210 can recognize the operation instruction corresponding to the user's space gesture according to the 3D data of the object.
  • TOF time of flight
  • structured light structured light
  • the camera used to obtain object 3D data can be an independent low-power camera, or other common front-facing cameras or rear-facing cameras.
  • the common front-facing camera or rear-facing camera supports low-power consumption mode.
  • the frame rate of the camera is lower than that of the normal camera in non-low-power mode, and the output image is in black and white format .
  • an ordinary camera can output 30 frames of images, 60 frames of images, 90 frames of images, and 240 frames of images in 1 second, but when the low-power camera, or the ordinary front camera or rear camera is running in low power consumption mode, the camera output in 1 second
  • the camera output in 1 second
  • 2.5 frames of images can be output, and when the camera captures the first image representing the same space gesture, the above-mentioned camera can be switched to output 10 frames of images in 1 second, so as to accurately identify the space through continuous multiple image recognition
  • the gesture corresponds to an operation command.
  • the pixel of the image captured by the low-power camera is lower than that of the image captured by the common camera. At the same time, it reduces power consumption compared to ordinary cameras working in low power consumption mode.
  • the display screen 294 is used to display images, videos and the like.
  • the electronic device may include 1 or N display screens 294, where N is a positive integer greater than 1.
  • the display screen 294 can be used to display images captured by any one or more cameras 293, for example, displaying multiple frames of images captured by a camera in the shooting preview interface, or displaying images in saved video files. Multi-frame images from a camera 293, or display a photo from a camera 293 in a saved picture file.
  • the SIM card interface 295 is used for connecting a SIM card.
  • the SIM card can be connected and separated from the electronic device 200 by inserting it into the SIM card interface 295 or pulling it out from the SIM card interface 295 .
  • the electronic device 200 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • SIM card interface 295 can support Nano SIM card, Micro SIM card, SIM card etc.
  • FIG. 1B is a block diagram of a software structure of an electronic device provided by an embodiment of the present invention.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
  • the Android system is divided into four layers, which are respectively the application program layer, the application program framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer from top to bottom.
  • the application layer can consist of a series of application packages.
  • the application package may include application programs such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
  • application programs such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make it accessible to applications.
  • Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.
  • the view system can be used to build applications.
  • a display interface can consist of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide communication functions of electronic devices. For example, the management of call status (including connected, hung up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify the download completion, message reminder, etc.
  • the notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window.
  • prompting text information in the status bar issuing a prompt sound, vibrating the electronic device, and flashing the indicator light, etc.
  • the Android Runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application program layer and the application program framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • a system library can include multiple function modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.
  • the corresponding hardware interrupt is sent to the kernel layer.
  • the kernel layer processes touch operations into original input events (including touch coordinates, time stamps of touch operations, and other information). Raw input events are stored at the kernel level.
  • the application framework layer obtains the original input event from the kernel layer, and identifies the control corresponding to the input event. Take the touch operation as a touch click operation, and the control corresponding to the click operation is the control of the camera application icon as an example.
  • the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer.
  • Camera 293 captures still images or video.
  • the touch operation received by the touch sensor may be replaced by the camera 293 photographing the gesture input by the user.
  • the corresponding hardware interrupt is sent to the kernel layer.
  • the kernel layer processes the air gesture operation into the original input event (including the image of the air gesture, the time stamp of the air gesture operation and other information).
  • Raw input events are stored at the kernel level.
  • the application framework layer obtains the original input event from the kernel layer, and identifies the operation corresponding to the input event.
  • the camera application calls the interface of the application framework layer, and then starts other camera drivers by calling the kernel layer, so as to switch to other cameras 293 to capture still images or videos.
  • the mobile phone may display a main interface 301 .
  • the main interface 301 may include an icon 302 of the camera application.
  • the mobile phone may receive an operation of clicking the icon 302 by the user, and in response to the operation, as shown in FIG. 3 , the mobile phone may start the camera application and display a shooting preview interface 303 of the camera application.
  • the camera application is an image capturing application on electronic devices such as smartphones and tablet computers, which may be a system application or a third-party application, and this application does not limit the name of the application. That is to say, the user can click the icon 302 of the camera application to open the shooting preview interface 303 of the camera application.
  • the user can also invoke the camera application in other applications to open the shooting preview interface 303 , for example, the user clicks on a shooting control in a social application to open the shooting preview interface 303 .
  • This social application can support users to share captured pictures or videos with others.
  • the shooting preview interface 303 may be a user interface of the default shooting mode of the camera application, for example, it may be a user interface provided when the camera application is in the front shooting mode. It can be understood that the default shooting mode can also be other, such as a rear shooting mode, a front and rear shooting mode, and the like. Alternatively, the camera application may have a memory function, and the shooting preview interface 303 may be a user interface of the shooting mode that the camera application was in when the camera application was exited last time.
  • FIG. 3 is illustrated by taking the shooting preview interface 303 as an example corresponding to the shooting preview interface when the camera application is in the front-facing shooting mode.
  • the shooting preview interface 303 may include a preview image 304 , shooting mode options 305 , flash control, shutter control, and the like.
  • the preview image 304 is an image captured by a front camera in the plurality of cameras 293 .
  • the electronic device can refresh the image displayed on the shooting preview interface 303 (ie, the preview image 304 ) in real time, so that the user can preview the image currently captured by the camera 293 .
  • the shooting mode option 305 is used to provide multiple shooting modes for the user to choose.
  • the various shooting modes may include: photo taking 305a, video recording 305b, multi-lens video recording 305c, real-time blurring, panorama and so on.
  • the electronic device may receive an operation of the user sliding left/right on the shooting mode option 305, and in response to the operation, the electronic device may enable the shooting mode selected by the user. It should be noted that, not limited to what is shown in FIG. 3 , more or fewer options than those shown in FIG. 3 may be displayed in the shooting mode option 305 .
  • the shooting mode corresponding to the photographing 305a is commonly used single-lens shooting, which may include a front shooting mode, a rear shooting mode, and the like. That is, when the camera 305a is selected, the electronic device can take a photo through a front camera or a rear camera.
  • the front shooting mode and the rear shooting mode please refer to the previous article, and I will not repeat them here.
  • the shooting mode corresponding to the multi-camera video recording 305c may include multi-camera shooting and single-camera shooting. That is, when the multi-camera recording 305c is selected, the electronic device can perform single-lens shooting through one camera, or perform multi-lens shooting through multiple cameras. Among them, for the specific introduction of multi-camera shooting, please refer to the specific description above, and will not repeat it here.
  • the photograph 305a is in a selected state. That is, the electronic device is currently in a photographing mode. If the user wishes to enable the multi-camera recording mode, he can slide the shooting mode option 305 to the left, and select the multi-camera video recording 305c. When it is detected that the user slides the shooting mode option 305 to the left and selects the operation of the multi-camera recording 305c, the electronic device can start the multi-camera recording mode and display the shooting preview interface 303 as shown in FIG. 4A .
  • the shooting preview interface 303 includes an image 306a, an image 306b, a mirror change control 307, a setting control 308, a shooting mode switching control 309, a teaching guide control 310, and the like.
  • the image 306a is an image taken by the rear camera
  • the image 306b is an image taken by the front camera, and since the electronic device is vertical, the image 306a and the image 306b are spliced up and down.
  • the front camera and the rear camera can be turned on by default when the electronic device is in the multi-mirror recording mode for the first time, and the image display mode is the splicing mode by default.
  • the cameras enabled by default may also be two rear cameras, one front camera, or one rear camera.
  • the image display mode is not limited to the splicing mode, but may also be a picture-in-picture mode, etc., which is not specifically limited here.
  • the camera application may have a memory function. After the electronic device enters the multi-camera recording mode, the electronic device may turn on the camera that was working when the camera application exited the multi-camera recording mode last time, and display it in the previous display mode.
  • the air-to-air mirror change control 307 can be used by the user to quickly turn on/off the air-to-air mirror change function. After the air mirror change function is turned on, users can control electronic devices through specific air gestures. It should be noted that after the electronic device enters the multi-mirror recording mode, the function of changing the mirror through the air can be enabled by default. Therefore, the air-to-air mirror change control 307 is in an on state (also referred to as a first state), which is used to indicate that the air-to-air mirror change function has been turned on. Of course, the mirror change function can also be turned off. For example, in response to detecting a user's touch operation on the air mirror control 307 , the electronic device may turn off the air mirror function. At this time, the air-to-air mirror change control 307 is in a closed state (also referred to as a second state), which is used to indicate that the air-to-air mirror change function has been turned off.
  • a closed state also referred to as a second state
  • the setting control 308 can be used to adjust the parameters of taking photos (such as resolution, picture ratio, etc.) and to turn on or off some ways for taking pictures (such as changing mirrors in space, timing shooting, smiling capture, voice-activated taking pictures, etc.).
  • the electronic device may receive the user's operation of clicking the setting control 308, and in response to the operation, the electronic device may display the setting interface 308a as shown in FIG. 4B.
  • the setting interface 308a may include options such as space change mirror 308b, photo ratio, and voice-activated photo taking.
  • the space change mirror 308b can enable or disable the space change mirror function.
  • the switch state of the space changer 308b in the setting interface 308a is linked with the switch state of the space changer control 307 in the shooting preview interface 303, and the switch state of the space changer 308b is linked with the switch state of the space changer control 307.
  • the switching state of the air-changing mirror control 307 remains consistent. That is, if the air-swap mirror 308b is switched from the on/off state to the off/on state, the air-swap mirror control 307 is also switched from the on/off state to the off/on state, and vice versa.
  • the air-to-air mirror change 308b can also prompt the user that the electronic device can use the front camera to recognize an air-to-air gesture during multi-mirror video recording.
  • the air-to-air mirror change 308b may include the text information of "during multi-mirror video recording, switch the multi-mirror mode by recognizing gestures with the front camera". That is, the electronic device can notify the user that the electronic device can use the front camera to recognize air gestures when the user enables the function of changing the mirror through the setting control 308, so as to prevent the user from feeling that the privacy is violated.
  • the shooting mode switching control 309 can be used to provide multiple shooting modes for users to choose, such as front and rear shooting modes, rear and rear shooting modes, picture-in-picture shooting modes, front shooting modes, and rear shooting modes.
  • the electronic device may have the function of changing mirrors through air.
  • the function of changing mirrors in the air can refer to the function that electronic devices can recognize gestures in the air through the front camera to switch shooting modes under multi-lens video recording.
  • the air-to-air mirror changing function of the electronic device will be described below with reference to the accompanying drawings.
  • the electronic device may display a shooting preview interface 401 .
  • the shooting preview interface 401 includes an image 401a (also called a second image), an image 401b (also called a first image), a shooting mode switching control 402 and the like.
  • the image 401a is an image collected by the rear camera in real time
  • the image 401b is an image collected by the front camera in real time.
  • the image 401a and the image 401b are stitched left and right, because the electronic device is placed horizontally.
  • the first image is located in the first area of the shooting preview interface
  • the second image is located in the second area of the shooting preview interface
  • the first area and the second area do not overlap.
  • the first area may be the area where the image 401b in FIG. 5A is located
  • the second area may be the area where the image 401a in FIG. 5A is located.
  • the user wants to switch the shooting mode of the electronic device, he can first input an air gesture facing the electronic device, such as inputting the air gesture of "raise hand” (it can be understood that the user keeps facing the display screen and keeps “raise hand”) ", which can also be called the first gesture).
  • the front camera of the electronic device can capture the air gesture input by the user (that is, the image 401 b ), and display it in the shooting preview interface 401 .
  • the electronic device can also analyze and process the captured image 401b, and display the shooting preview interface 401 as shown in FIG. 5B when the air gesture of "raising hand" is recognized.
  • the shooting preview interface 401 shown in FIG. 5B is similar to the shooting preview interface 401 shown in FIG.
  • the shooting preview interface 401 shown in FIG. 5B includes prompt information 403, which is used to remind the user that the electronic device has entered the "ready" state (It can be understood as a state of being ready to further recognize the user's air gesture), and the user can input the air gesture as required.
  • the prompt information 403 may be an icon of an air gesture.
  • the prompt information 403 may also include text information prompting the user to complete the gesture operation within the first preset time, for example, "the gesture operation needs to be completed within 3 seconds".
  • the prompt information 403 may also include a time progress bar, which may be used to indicate the time when the electronic device enters the "ready” state.
  • a time progress bar which may be used to indicate the time when the electronic device enters the "ready” state.
  • the electronic device starts counting from the moment when it enters the "preparation” state (for example, the first moment), and the time progress bar is blank at this time; the electronic device stops counting after the first preset time at the first moment, and at this time The time progress bar is filled.
  • the user needs to input an air gesture before the time progress bar is filled (which can be understood as within the first preset time), so as to control the electronic device.
  • the electronic device can switch from the front and rear shooting modes to the front shooting mode or the rear shooting mode when detecting the air gesture input by the user. Based on the shooting scenes shown in FIGS. 5A-5B , the interfaces involved in the process of switching the electronic device from the front-rear shooting mode to the front-facing shooting mode will be introduced below.
  • the electronic device displays the shooting preview interface 401 shown in FIG. "Move" air gesture (it can be understood simply as the gesture of sliding the palm to the left, and can also be called the third gesture).
  • the electronic device can switch the shooting mode from the front and rear shooting mode to the front shooting mode, and display the shooting preview interface 401 as shown in FIG. 5D .
  • FIG. 5D after the electronic device switches to the front-facing shooting mode, an image 401b captured by the front-facing camera may be displayed on the shooting preview interface 401 .
  • the working front-facing camera at this time may be a default front-facing main camera of the electronic device.
  • the electronic device may also switch the shooting mode from the front and rear shooting modes to other shooting modes in response to detecting other air gestures of the user. For example, in the shooting scene shown in FIG. 5B , in response to detecting the air gesture of "extend your palm and then make a fist" input by the user, the electronic device may switch the shooting mode from the front and back shooting mode to the picture-in-picture shooting mode.
  • the electronic device in response to detecting the air gesture of "flip the palm” input by the user, can exchange the positions of the image 401a and the image 401b, that is, the position of the image 401a is changed from the original left side of the screen to the right side of the screen, and the position of the image 401b The position is changed from the original right side of the screen to the left side of the screen.
  • the electronic device may switch the shooting mode from the front-to-back shooting mode to the rear-to-back shooting mode. Specifically, the electronic device may switch the image 401b to an image 401c (which may also be called a third image), and the image 401c is an image captured by another rear camera (which may be called a third camera) in real time.
  • the electronic device needs to recognize the user's air-to-air gesture through at least one front camera, and further execute the operation corresponding to the air-to-air gesture. That is, when the electronic device recognizes an air gesture, the air mirror change function cannot be enabled.
  • the electronic device may simultaneously use two cameras to capture images.
  • the two rear cameras are in working state, so that the electronic device cannot recognize the user's air gesture through the front camera. Therefore, when the electronic device is in the rear-rear shooting mode, the air-to-air mirror function cannot be activated.
  • the electronic device can remind the user that the air mirror change function cannot be used when the shooting mode is switched to the rear-to-back shooting mode.
  • the electronic device may display a shooting preview interface 401 .
  • the shooting preview interface 401 is similar to the shooting preview interface 401 shown in FIG. 5A , so details will not be described here.
  • the electronic device may also receive an operation in which the user clicks on the shooting mode switch control 402 (also referred to as the second control), and in response to the operation, the electronic device may display on the shooting preview interface 401 the The shooting preview interface 401 shown.
  • the shooting preview interface 401 may include a shooting mode selection area 404 (also called a first pop-up window).
  • the shooting mode selection area 404 can display preview interfaces of multiple shooting modes, such as the preview interface 404a of the front shooting mode, the preview interface 404b of the rear shooting mode (also called the first shooting mode), and the picture-in-picture shooting mode.
  • the electronic device can receive the user’s operation of clicking the preview interface 404b of the rear shooting mode.
  • the electronic device switches the shooting mode from the front and rear shooting mode to the rear and rear shooting mode, and displays the display shown in FIG. 6C
  • the shooting preview interface 401 is shown.
  • the images displayed in the shooting preview interface 401 are switched from the images 401 a and 401 b shown in FIG. 6A to an image 401 a and an image 401 c (also referred to as a third image).
  • image 401a is an image taken by a common camera in the rear camera
  • image 401c is an image collected in real time by a wide-angle camera in the rear camera. It can be seen that the viewing range of the image 401c is larger than that of the image 401a.
  • the shooting preview interface 401 also includes abnormal prompt information 405 (also referred to as third prompt information).
  • the abnormal prompt information 405 is used to remind the user that the air-to-air mirror function cannot be used in the rear-to-rear shooting mode, for example, "rear/rear cannot use the air-to-air mirror".
  • users can also use air gestures to switch from other shooting modes to rear-to-back shooting mode.
  • air gestures please refer to the previous description of the function of mirror change through space, so I won’t go into details here.
  • the above is only an example of switching the electronic device from the front-to-back shooting mode to the rear-to-back shooting mode.
  • the electronic device switches from any other shooting mode (for example, picture-in-picture shooting mode, front shooting mode, rear shooting mode) is switched to the rear shooting mode, the abnormal prompt information 405 (also referred to as the first abnormal prompt information) can be displayed.
  • the manner of switching the electronic device from any other shooting mode to the rear-rear shooting mode is the same as the method of switching the electronic device from the front-rear shooting mode to the rear-rear shooting mode, and details will not be described here.
  • the electronic device may display the abnormal prompt information 405 when switching to the rear-rear shooting mode for the first time after entering the multi-camera video recording. This approach can prevent the electronic device from frequently reminding the user and reduce redundant information.
  • the above content is only described by taking the abnormality reminder process when the electronic device is in the recording process as an example.
  • the electronic device When the electronic device is in the non-recording state, it can also switch from any shooting mode to the back-to-back shooting mode, and an abnormal prompt message 405 is displayed.
  • the electronic device can also turn off the function of changing mirrors through space and remind the user when the temperature of the device is too high or too low.
  • the following takes the electronic device in the front and rear shooting modes as an example for introduction.
  • FIG. 7A it shows a shooting preview interface 401 when the temperature of the electronic device is normal.
  • the shooting preview interface 401 shown in FIG. 7A is similar to the shooting preview interface 401 shown in FIG. 6A, the difference is that the shooting preview interface 401 shown in FIG. Recording status, but this does not affect exception reminders.
  • FIG. 7B it shows a shooting preview interface 401 when the temperature of the electronic device is too high.
  • the shooting preview interface 401 shown in FIG. 7B displays abnormal prompt information 407 (also referred to as first prompt information).
  • the abnormality prompt information 407 is used to remind the user that the electronic device has turned off the function of the air mirror change due to the high temperature of the device, for example, "the device temperature is too high and the "air mirror change" has been turned off”.
  • the state of the air mirror change control 402 (also called the first control) is changed from the open state shown in FIG. 7A to the closed state shown in FIG. 7B (also called the second state).
  • the temperature sensor of the electronic device can detect the device temperature of the electronic device in real time and transmit it to the processor 210 .
  • the processor 210 may consider that the temperature of the electronic device is too high when the temperature of the device is greater than the preset first temperature (also referred to as the first preset temperature), and control the display screen 294 to display an abnormal prompt message on the shooting preview interface 401 407.
  • FIG. 7C it shows a shooting preview interface 401 when the temperature of the electronic device is too low.
  • the shooting preview interface 401 shown in FIG. 7C displays abnormal prompt information 408 (also referred to as first prompt information).
  • the abnormal prompt information 408 is used to remind the user that the air mirror function of the electronic device is turned off because the temperature of the device is too low, for example, "device temperature is too low "air mirror change" has been turned off”.
  • the state of the air mirror changer control 402 is changed from the open state shown in FIG. 7A to the closed state shown in FIG. 7C (also referred to as the second state).
  • the temperature sensor of the electronic device can detect the device temperature of the electronic device in real time and transmit it to the processor 210 .
  • the processor 210 may consider that the temperature of the electronic device is too low when the temperature of the device is lower than the preset second temperature (also referred to as the second preset temperature), and control the display screen 294 to display an abnormal prompt message on the shooting preview interface 401 408.
  • the electronic device may also no longer display (or hide) the abnormality prompt information 407 or the abnormality prompt information 408 after a preset time.
  • the electronic device may display a shooting preview interface 401 as shown in FIG. 7D after a preset time. Compared with the shooting preview interface 401 shown in FIG. 7A , the state of the mirror changer control 402 is changed from the open state shown in FIG. 7A to the closed state shown in FIG. 7D .
  • the user may click the mirror changing through the air control 402 .
  • the electronic device may receive the user's operation of clicking the air-to-mirror control 402 , and in response to the operation, the electronic device may determine the temperature range in which the temperature of the device is located, and perform corresponding operations.
  • the electronic device may display an abnormal prompt message 410 (which may be called the second prompt message) as shown in FIG.
  • the message 410 reminds the user that the device temperature is too high and the air-to-air mirror change function cannot be enabled.
  • the electronic device judges that the temperature of the device is lower than the preset second temperature (that is, the temperature of the device is too low), it can display the shooting preview interface 401 as shown in FIG. The temperature of the user's device is too low to enable the Air Mirror function. If the electronic device judges that the temperature of the device is between the preset first temperature and the preset second temperature, it can enable the function of changing mirrors by air and display a prompt message 412 as shown in FIG. feature is turned on.
  • the space changer control 402 when the temperature of the device is greater than the preset first temperature or lower than the preset second temperature, the space changer control 402 may be grayed out (not shown in the figure). In other words, during the period when the device temperature is greater than the preset first temperature or lower than the preset second temperature, the space changer control 402 cannot be clicked until the device temperature returns to normal (less than the preset first temperature and greater than the preset second temperature), the air-to-air mirror changer control 402 can be changed to a second state for the user to enable the air-to-air mirror changer function.
  • the electronic device may receive the user's operation of clicking the space changer 409 , and in response to the operation, the electronic device may determine the temperature range in which the temperature of the device is located, and perform corresponding operations.
  • the abnormality prompt method provided by this application can timely remind the user that the electronic device cannot be used when the electronic device is in the back-to-back shooting mode or the temperature of the device is abnormal (the temperature of the device is higher than the preset first temperature or lower than the preset second temperature).
  • the function of changing mirrors in space is helpful to remind users to use available methods to control electronic devices and improve the efficiency of human-computer interaction.
  • the present application also provides a chip system 800 , as shown in FIG. 8 , the chip system includes at least one processor 801 and at least one interface circuit 802 .
  • the processor 801 and the interface circuit 802 may be interconnected through wires.
  • interface circuit 802 may be used to receive signals from other devices (eg, memory of an electronic device).
  • the interface circuit 802 may be used to send signals to other devices (such as the processor 801).
  • the interface circuit 802 can read instructions stored in the memory of the electronic device, and send the instructions to the processor 801 .
  • the electronic device may be made to execute various steps in the foregoing embodiments.
  • Each functional unit in each embodiment of the embodiment of the present application may be integrated into one processing unit, or each unit may physically exist separately, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage
  • the medium includes several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk, and other various media capable of storing program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)

Abstract

本申请提供一种异常提示方法及电子设备,可及时提醒用户电子设备由于温度异常而关闭第一功能(隔空换镜功能),避免用户继续使用第一功能,提高人机交互效率。该方法包括:显示拍摄预览界面,电子设备实时检测设备温度,若所述设备温度不在预设温度范围内,所述电子设备在所述拍摄预览界面上显示第一提示信息,第一提示信息指示所述电子设备已关闭第一功能。

Description

一种异常提示方法及电子设备
本申请要求于2021年6月16日提交国家知识产权局、申请号为202110676709.3、发明名称为“一种基于故事线模式的用户视频创作方法及电子设备”的中国专利申请的优先权,以及于2021年11月29日提交国家知识产权局、申请号为202111473686.2、发明名称为“一种异常提示方法及电子设备”的中国专利申请的优先权,以及于2021年12月31日提交国家知识产权局、申请号为202111679475.4、发明名称为“一种异常提示方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域,尤其涉及一种异常提示方法及电子设备。
背景技术
随着电子技术的发展,手机、平板电脑等电子设备一般都配置有多个摄像头,如前置摄像头、后置摄像头、广角摄像头等等。为了带来进一步的拍摄创作体验,越来越多的电子设备可以支持多个摄像头同时拍摄,从而记录精彩时刻、感人场景等美好画面。
但是,目前存在一些场景无法支持多个摄像头同时拍摄,需要对用户进行提醒。
发明内容
本申请实施例提供一种异常提示方法及电子设备,可以在存在异常时及时提醒用户。
第一方面,本申请实施例提供一种异常提示方法,方法应用于包括显示屏、第一摄像头和第二摄像头的电子设备,第一摄像头和第二摄像头位于显示屏的不同侧,第一摄像头与显示屏位于电子设备的同一侧,方法包括:电子设备显示拍摄预览界面,拍摄预览界面显示第一图像、第二图像中的至少一个,第一图像为第一摄像头实时采集的图像,第二图像为第二摄像头实时采集的图像,电子设备已开启第一功能,第一功能为电子设备通过第一摄像头采集用于识别用户手势的图像数据的功能;电子设备实时检测设备温度;若设备温度不在预设温度范围内,电子设备在拍摄预览界面上显示第一提示信息,第一提示信息指示电子设备已关闭第一功能。
可以看出,本申请实施例提供的隔空手势的引导使用方法,在电子设备处于任何一种拍摄模式(包括前置拍摄模式、后置拍摄模式、前后拍摄模式、画中画拍摄模式)时实时检测设备温度,并在检测到设备温度不在预设温度范围内时关闭隔空换镜功能(即第一功能)并显示第一提示信息。这样可以在设备温度存在异常时及时提醒用户电子设备已关闭隔空换镜功能,提升人机交互效率。
在一种可能的实现方式中,若电子设备未开始录制视频,拍摄预览界面还包括第一控件,第一控件用于开启或关闭第一功能,方法还包括:若设备温度不在预设温度范围内,电子设备在拍摄预览界面上将第一控件由第一状态切换为第二状态,第一状态指示电子设备已开启第一功能,第二状态指示电子设备已关闭第一功能。
可以理解地,若电子设备未开始录制视频,该拍摄预览界面上可以包括第一控件,可用于开启或者关闭隔空换镜功能。当电子设备检测到设备温度不在预设范围内时,不仅可以自动关闭隔空换镜功能,还可以在拍摄预览界面上切换第一控件的状态,由第一状态切 换为第二状态,以指示电子设备已关闭隔空换镜功能。
在一种可能的实现方式中,若电子设备正在录制视频,方法还包括:若设备温度不在预设温度范围内,响应于检测到用户操作,电子设备停止录制视频,在拍摄预览界面上显示第一控件,其中,第一控件处于第二状态,第二状态指示电子设备已关闭第一功能。
也就是说,若设备温度不在预设温度范围内,电子设备可以自动关闭隔空换镜功能。在此期间,若电子设备接收到用户停止录制视频的操作,电子设备可以停止录制视频,并在停止录制视频后的拍摄预览界面上显示第一控件,且第一控件处于第二状态。
在一种可能的实现方式中,在设备温度不在预设温度范围内期间,第一控件处于不可被点击状态。也就是说,在设备温度不在预设温度范围期间,用户无法通过第一控件开启隔空换镜功能。
在一种可能的实现方式中,方法还包括:若设备温度不在预设温度范围内,响应于检测到用户对第一控件的操作,电子设备在拍摄预览界面上显示第二提示信息,第二提示信息指示电子设备由于温度异常而无法开启第一功能。也就是说,在设备温度不在预设温度范围内的情况下,用户无法开启隔空换镜功能。
在一种可能的实现方式中,若设备温度大于或等于第一预设温度,或设备温度小于或等于第二预设温度,设备温度不在预设温度范围内,其中,第一预设温度大于第二预设温度。也就是说,设备温度过高或者过低,都可认为设备温度不在预设温度范围内。
在一种可能的实现方式中,电子设备还包括第三摄像头,第三摄像头与第二摄像头位于显示屏的同一侧,方法还包括:响应于检测到用户操作,电子设备在拍摄预览界面继续显示第二图像,显示来自第三摄像头实时采集的第三图像及第三提示信息,第三提示信息用于指示电子设备在当前拍摄模式下无法启用第一功能。
可以理解地,电子设备可以从前置拍摄模式、后置拍摄模式、前后拍摄模式、画中画拍摄模式中的任意一种拍摄模式切换至后后拍摄模式,在切换到后后拍摄模式后,电子设备可提醒用户在后后拍摄模式下无法使用隔空换镜功能。
在一种可能的实现方式中,拍摄预览界面还包括第二控件,响应于检测到用户操作,电子设备在拍摄预览界面继续显示第二图像,显示来自第三摄像头实时采集的第三图像及第三提示信息,包括:响应于用户对第二控件的操作,电子设备在拍摄预览界面上显示第一弹窗,第一弹窗包括第一拍摄模式的标识,第一拍摄模式为电子设备通过第二摄像头、第三摄像头同时进行拍摄的模式;响应于用户对第一拍摄模式的标识的操作,电子设备在拍摄预览界面显示第二图像,显示来自第三图像及第三提示信息。也即,用户可以通过界面上的控件(例如,第二控件)从其他拍摄模式切换为后后拍摄模式。
在一种可能的实现方式中,响应于检测到用户操作,电子设备在拍摄预览界面继续显示第二图像,显示来自第三摄像头实时采集的第三图像及第三提示信息,包括:响应于第一摄像头检测到第一手势,电子设备在拍摄预览界面上显示第一标识;在显示第一标识后的预设时间内,响应于第一摄像头检测到第二手势,电子设备在拍摄预览界面继续显示第二图像,显示来自第三图像及第三提示信息。也即,用户可以通过隔空手势(例如,第二手势)从其他拍摄模式切换为后后拍摄模式。
在一种可能的实现方式中,拍摄预览界面包括第一图像和第二图像,电子设备显示拍摄预览界面,包括:电子设备在拍摄预览界面的第一区域显示第一图像,在拍摄预览界面 的第二区域显示第二图像。也即,电子设备可处于前后拍摄模式或者画中画拍摄模式,其中,若电子设备处于前后拍摄模式,则第一区域与第二区域不重叠;若电子设备处于画中画拍摄模式,则第一区域与第二区域重叠。
在一种可能的实现方式中,所述电子设备在所述拍摄预览界面显示所述第二图像、第三图像,包括:电子设备在拍摄预览界面的第三区域显示第二图像,在拍摄预览界面的第四区域显示第三图像,第三区域与第二区域相同,第四区域与第一区域相同。
可以理解地,第三区域与第二区域相同且第四区域与第一区域相同,也即在切换拍摄模式过程中不涉及显示区域大小的切换。电子设备可以前后拍摄模式切换为后后拍摄模式期间,执行前述任意一种方法。
在一种可能的实现方式中,所述电子设备在所述拍摄预览界面显示所述第二图像、第三图像,包括:电子设备在拍摄预览界面的第三区域显示第二图像,在拍摄预览界面的第四区域显示第三图像,第三区域与第二区域不同,第四区域与第一区域不同,第一区域与第二区域重叠。可以理解地,电子设备可以画中画拍摄模式切换为后后拍摄模式期间,执行前述任意一种方法。
在一种可能的实现方式中,拍摄预览界面包括第一图像或第二图像。也即,电子设备可以在前置拍摄模式或者后置拍摄模式下,执行前述任意一种方法。
在一种可能的实现方式中,电子设备未开始录制视频或者正在录制视频。
第二方面,本申请实施例提供了一种电子设备,包括显示屏、第一摄像头、第二摄像头及处理器,处理器和存储器耦合,存储器存储有程序指令,当存储器存储的程序指令被处理器执行时使得电子设备实现第一方面中任一种可能的设计方式所述的方法。
第三方面,一种计算机可读存储介质,包括计算机指令;当计算机指令在电子设备上运行时,使得电子设备执行第一方面中任一种可能的设计方式所述的方法。
第四方面,本申请提供一种芯片系统,该芯片系统包括一个或多个接口电路和一个或多个处理器。该接口电路和处理器通过线路互联。
上述芯片系统可以应用于包括通信模块和存储器的电子设备。该接口电路用于从电子设备的存储器接收信号,并向处理器发送接收到的信号,该信号包括存储器中存储的计算机指令。当处理器执行该计算机指令时,电子设备可以执行如第一方面中任一种可能的设计方式所述的方法。
第五方面,本申请提供一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如第一方面中任一种可能的设计方式所述的方法。
附图说明
图1A为本申请实施例提供的一种电子设备的硬件结构示意图;
图1B为本申请实施例提供的一种电子设备的软件架构图;
图2为本申请实施例提供的一种界面示意图;
图3为本申请实施例提供的一种界面示意图;
图4A-图4B为本申请实施例提供的一组界面示意图;
图5A-图5D为本申请实施例提供的一组界面示意图;
图6A-图6C为本申请实施例提供的一组界面示意图;
图7A-图7G为本申请实施例提供的一组界面示意图;
图8为本申请实施例提供的一种芯片系统的结构示意图。
具体实施方式
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
为了下述各实施例的描述清楚简洁及便于本领域技术人员容易理解,首先给出相关概念或技术的简要介绍。
拍摄预览界面,指电子设备拍摄前或者拍摄时所显示的界面,可用于显示摄像头实时采集的图像。此外,拍摄预览界面还可显示多个控件,多个控件可包括用于开启/关闭闪光灯的闪光灯控件,用于开启/关闭美颜功能的美颜控件,可用于拍摄的快门控件等。
单镜拍摄,指电子设备仅通过一个摄像头进行拍摄的模式。电子设备在单镜拍摄模式下,在拍摄预览界面中仅显示一个摄像头拍摄的图像。其中,单镜拍摄可包括前置拍摄模式、后置拍摄模式等。
具体的,前置拍摄,指电子设备通过前置摄像头进行拍摄的模式。电子设备处于前置拍摄模式时,可在拍摄预览界面显示该前置摄像头实时采集的图像。
后置拍摄模式,指电子设备通过后置摄像头进行拍摄的模式。电子设备处于后置拍摄模式时,可在拍摄预览界面显示该后置摄像头实时采集的图像。
多镜拍摄,指电子设备可通过多个摄像头进行拍摄的模式。电子设备在多镜拍摄模式下,显示屏在拍摄预览界面中同时显示多个摄像头分别拍摄的图像,不同摄像头拍摄的图像可以拼接显示,或者以画中画的方式显示。其中,根据电子设备所用摄像头的类型,及不同摄像头拍摄的图像的显示方式,多镜拍摄可包括前后拍摄模式、后后拍摄模式、画中画拍摄模式等。在本申请实施例中,多镜拍摄也可称为多镜录像。
前后拍摄模式,指电子设备可通过前置摄像头和后置摄像头同时进行拍摄的模式。电子设备处于前后拍摄模式时,可在拍摄预览界面中同时显示前置摄像头和后置摄像头所拍摄的图像(例如,第一图像、第二图像),第一图像与第二图像拼接显示。其中,当电子设备竖置时,第一图像与第二图像可上下拼接;当电子设备横置时,第一图像与第二图像可左右拼接。默认情况下,第一图像的显示面积与第二图像的显示面积一致。
后后拍摄模式,指电子设备可通过两个后置摄像头(如果存在多个后置摄像头)同时进行拍摄的模式。电子设备处于后后拍摄模式时,电子设备可在拍摄预览界面中同时显示两个后置摄像头所拍摄的图像(例如,第一图像、第二图像),第一图像与第二图像拼接显示。其中,当电子设备竖置时,第一图像与第二图像可上下拼接;当电子设备横置时,第一图像与第二图像可左右拼接。
画中画拍摄模式,指电子设备可通过两个摄像头同时进行拍摄的模式。电子设备处于画中画拍摄模式时,可在拍摄预览界面中同时显示两个摄像头所拍摄的图像(例如,第一图像、第二图像)。其中,第二图像显示于拍摄预览界面的整个区域,第一图像叠放于第二图像上,且第一图像的显示面积小于第二图像的显示面积。默认情况下,第一图像可位于第二图像的左下方。上述两个摄像头可自由组合,例如可以为两个前置摄像头、两个后置摄像头或者一个前置摄像头和一个后置摄像头。
需要说明的是,上述“单镜拍摄”、“多镜拍摄”、“前置拍摄模式”、“后置拍摄模式”、“前后拍摄模式”、“画中画拍摄模式”、“后后拍摄模式”只是本申请实施例所使用的一些名称,其代表的含义在本申请实施例中已经记载,其名称并不能对本实施例构成任何限制。
本申请提供了一种异常提示方法,应用于包括显示屏、第一摄像头和第二摄像头的电子设备,所述第一摄像头和所述第二摄像头位于所述显示屏的不同侧,所述第一摄像头与所述显示屏位于所述电子设备的同一侧。该电子设备可显示拍摄预览界面,电子设备还可以实时检测设备温度,若所述设备温度不在预设温度范围内,所述电子设备在所述拍摄预览界面上显示第一提示信息,第一提示信息指示所述电子设备已关闭隔空换镜功能(也可以称为第一功能)。其中,隔空换镜功能是指电子设备通过前置摄像头采集用于识别用户手势的图像数据,并切换拍摄模式的功能。通过该方法可以及时提示用户无法使用隔空手势的场景,提高人机交互效率。
其中,该电子设备可以为单屏手机或者折叠屏手机。在电子设备为单屏手机时,该第一摄像头和第二摄像头可分别为电子设备的前置摄像头和后置摄像头。在电子设备为折叠屏手机时,该显示屏可包括第一屏和第二屏,第一屏与第二屏转动连接,该第一摄像头、第二摄像头可分别位于第一屏的两侧,第一摄像头与第一屏位于该电子设备的同一侧。或者,第一摄像头位于第一屏,第二摄像头位于第二屏,且与第一屏、第二屏、第一摄像头和第二摄像头位于该电子设备的同一侧。在本申请实施例中,以电子设备为单屏手机为例进行说明。
在本申请实施例中,电子设备可以通过前置摄像头中的任意一个摄像头识别用户的隔空手势。本申请实施例对用于切换拍摄模式的隔空手势不作限定。上述隔空手势只是本申请实施例所使用的名称,其还可以被称为悬空手势、悬浮手势等,具体是指不接触电子设备而输入的手势,其代表的含义在本申请实施例中已经记载,其名称并不能对本实施例构成任何限制。
为了更加清楚、详细地介绍本申请实施例提供的提示方法,下面先介绍本申请实施例提供实施该方法所涉及的电子设备。
电子设备可以是手机、平板电脑、桌面型计算机、膝上型计算机、手持计算机、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本,以及蜂窝电话、个人数字助理(personal digital assistant,PDA)、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、人工智能(artificial intelligence,AI)设备、可穿戴式设备、车载设备、智能家居设备和/或智慧城市设备,本申请实施例对该电子设备的具体类型不作特殊限制。
参阅图1A,图1A示出了本申请实施例所提供的电子设备的硬件结构示意图。
如图1A所示,该电子设备200可以处理器210,外部存储器接口220,内部存储器221,通用串行总线(universal serial bus,USB)接口230,充电管理模块240,电源管理模块241,电池242,天线1,天线2,移动通信模块250,无线通信模块260,音频模块270,扬声器270A,受话器270B,麦克风270C,耳机接口270D,传感器模块280,按键290,马达291,指示器292,多个摄像头293,显示屏294,以及用户标识模块(subscriber identification module,SIM)卡接口295等。
其中,上述传感器模块280可以包括压力传感器,陀螺仪传感器,气压传感器,磁传 感器,加速度传感器,距离传感器,接近光传感器,指纹传感器,温度传感器,触摸传感器,环境光传感器和骨传导传感器等传感器。
可以理解的是,本实施例示意的结构并不构成对电子设备200的具体限定。在另一些实施例中,电子设备200可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器210可以包括一个或多个处理单元,例如:处理器210可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以是电子设备200的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器210中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器210中的存储器为高速缓冲存储器。该存储器可以保存处理器210刚用过或循环使用的指令或数据。如果处理器210需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器210的等待时间,因而提高了系统的效率。
在一些实施例中,处理器210可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。可以理解的是,本实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备200的结构限定。在另一些实施例中,电子设备200也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
在本申请实施例中,处理器210可以接收到摄像头293拍摄的用户输入的隔空手势例如为“手掌”所对应的多个连续的图像,然后处理器210可以对该多个连续的图像进行对比分析,确定该多个连续的图像对应的隔空手势为“手掌”,并确定该隔空手势对应的操作例如是开始录制,之后处理器210可以控制相机应用程序执行对应的操作。该对应的操作例如可以包括:去调动多个摄像头同时拍摄图像,然后通过GPU将多个摄像头分别拍摄到的图像,通过拼接或画中画(局部叠加)等方式合成,并调用显示屏294将合成后的图像显示于电子设备的拍摄预览界面中。
外部存储器接口220可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备200的存储能力。外部存储卡通过外部存储器接口220与处理器210通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器221可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器210通过运行存储在内部存储器221的指令,从而执行电子设备200的各种功能应 用以及数据处理。例如,在本申请实施例中,处理器210可以通过执行存储在内部存储器221中的指令,内部存储器221可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备200使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器221可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。
在本申请实施例中,内部存储器221可以存储有电子设备在不同拍摄模式下拍摄的图片文件或录制的视频文件等。
充电管理模块240用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。充电管理模块240为电池242充电的同时,还可以通过电源管理模块241为终端设备供电。
电源管理模块241用于连接电池242,充电管理模块240与处理器210。电源管理模块241接收电池242和/或充电管理模块240的输入,为处理器210,内部存储器221,外部存储器,显示屏294,摄像头293,和无线通信模块260等供电。在一些实施例中,电源管理模块241和充电管理模块240也可以设置于同一个器件中。
电子设备200的无线通信功能可以通过天线1,天线2,移动通信模块250,无线通信模块260,调制解调处理器以及基带处理器等实现。在一些实施例中,电子设备200的天线1和移动通信模块250耦合,天线2和无线通信模块260耦合,使得电子设备200可以通过无线通信技术与网络以及其他设备通信。
天线1和天线2用于发射和接收电磁波信号。电子设备200中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块250可以提供应用在电子设备200上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块250可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块250可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。
移动通信模块250还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块250的至少部分功能模块可以被设置于处理器210中。在一些实施例中,移动通信模块250的至少部分功能模块可以与处理器210的至少部分模块被设置在同一个器件中。
无线通信模块260可以提供应用在电子设备200上的包括WLAN(如(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。
无线通信模块260可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块260经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器210。无线通信模块260还可以从处理器210接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
电子设备200通过GPU,显示屏294,以及应用处理器等实现显示功能。GPU为图像 处理的微处理器,连接显示屏294和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器210可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏294用于显示图像,视频等。该显示屏294包括显示面板。
电子设备200可以通过ISP,摄像头293,视频编解码器,GPU,显示屏294以及应用处理器等实现拍摄功能。ISP用于处理摄像头293反馈的数据。摄像头293用于捕获静态图像或视频。在一些实施例中,电子设备200可以包括N个摄像头293,N为大于2的正整数。
电子设备200可以通过音频模块270,扬声器270A,受话器270B,麦克风270C,耳机接口270D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
按键290包括开机键,音量键等。按键290可以是机械按键。也可以是触摸式按键。马达291可以产生振动提示。马达291可以用于来电振动提示,也可以用于触摸振动反馈。指示器292可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
多个摄像头293用于拍摄图像。在本申请实施例中,摄像头293的数量可以为M个,M≥2,M为正整数。电子设备在多镜拍摄中开启的摄像头的数量可以为N,2≤N≤M,N为正整数。
在本申请实施例中,摄像头293的类型可以根据硬件配置以及物理位置进行区分。例如,摄像头293所包含的多个摄像头可以分别置于电子设备的正反两面,设置在电子设备的显示屏294那一面的摄像头可以称为前置摄像头,设置在电子设备的后盖那一面的摄像头可以称为后置摄像头;又例如,摄像头293所包含的多个摄像头的焦距、视角不同,焦距短、视角越大的摄像头可以称为广角摄像头,焦距长、视角小的摄像头可以称为普通摄像头。不同摄像头拍摄到的图像的内容的不同之处在于:前置摄像头用于拍摄电子设备正面面对的景物,而后置摄像头用于拍摄电子设备背面面对的景物;广角摄像头在较短的拍摄距离范围内,能拍摄到较大面积的景物,在相同的拍摄距离处所拍摄的景物,比使用普通镜头所拍摄的景物在画面中的影像小。其中,焦距的长短、视角的大小为相对概念,并无具体的参数限定,因此广角摄像头和普通摄像头也是一个相对概念,具体可以根据焦距、视角等物理参数进行区分。
特别的,在本申请实施例中,摄像头293中至少包含一个具有(time of flight,TOF)3D感测模块或结构光(structured light)3D感测模块的摄像头,该摄像头获取拍摄图像中的物体的3D数据,以便处理器210可以根据物体的3D数据,识别用户的隔空手势对应的操作指令。
该用于获取物体3D数据的摄像头可以是独立的一个低功耗摄像头,也可以是其他普通的前置摄像头或后置摄像头,该普通的前置摄像头或后置摄像头支持低功耗模式,当低功耗摄像头工作时,或者普通前置摄像头或后置摄像头工作在低功耗模式时,摄像头的帧率比普通摄像头在非低功耗模式下工作的帧率低且输出的图像为黑白格式。通常普通的摄像头1秒可以输出30帧图像、60帧图像、90帧图像、240帧图像,但是该低功耗摄像头,或者普通前置摄像头或后置摄像头运行低功耗模式时,摄像头1秒可以输出例如2.5帧图像,而当摄像头拍摄到表示同一个隔空手势的第一张图像时,上述摄像头可以切换为1秒输出10帧图像,以通过连续的多张图像识别准确识别该隔空手势对应的操作指令,此外, 该低功耗摄像头的拍摄的图像的像素低于普通摄像头拍摄的图像的像素。同时相比普通摄像头在给低功耗模式下工作降低了功耗。
显示屏294用于显示图像,视频等。在一些实施例中,电子设备可以包括1个或N个显示屏294,N为大于1的正整数。在本申请实施例中,显示屏294可用于显示来自任意一个或多个摄像头293拍摄的图像,例如在拍摄预览界面中显示来自一个摄像头拍摄的多帧图像,或者在已保存的视频文件中显示来自一个摄像头293的多帧图像,或者在已保存的图片文件中显示来自一个摄像头293的一张照片。
SIM卡接口295用于连接SIM卡。SIM卡可以通过插入SIM卡接口295,或从SIM卡接口295拔出,实现和电子设备200的接触和分离。电子设备200可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口295可以支持Nano SIM卡,Micro SIM卡,SIM卡等。
图1B是本发明实施例提供的电子设备的软件结构框图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android系统分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和系统库,以及内核层。
应用程序层可以包括一系列应用程序包。
如图1B所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图1B所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
视图系统包括可视控件,例如显示文字的控件,显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供电子设备的通信功能。例如通话状态的管理(包括接通,挂断等)。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备振动,指示灯闪烁等。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心 库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。
表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。
下面结合捕获拍照场景,示例性说明电子设备在拍摄过程中软件以及硬件的工作流程。
当触摸传感器接收到触摸操作,相应的硬件中断被发给内核层。内核层将触摸操作加工成原始输入事件(包括触摸坐标,触摸操作的时间戳等信息)。原始输入事件被存储在内核层。应用程序框架层从内核层获取原始输入事件,识别该输入事件所对应的控件。以该触摸操作是触摸单击操作,该单击操作所对应的控件为相机应用图标的控件为例,相机应用调用应用框架层的接口,启动相机应用,进而通过调用内核层启动摄像头驱动,通过摄像头293捕获静态图像或视频。在本申请实施例中,上述触摸传感器接收到触摸操作可以由摄像头293拍摄到用户输入的隔空手势的操作来代替。具体的,当摄像头293拍摄到隔空手势的操作,相应的硬件中断被发给内核层。内核层将隔空手势操作加工成原始输入事件(包括隔空手势的图像,隔空手势操作的时间戳等信息)。原始输入事件被存储在内核层。应用程序框架层从内核层获取原始输入事件,识别该输入事件所对应的操作。以该隔空手势操作是切换拍摄模式的操作为例,相机应用调用应用框架层的接口,进而通过调用内核层启动其他摄像头驱动,从而切换为其他摄像头293来捕获静态图像或视频。
接下来,将结合附图对本申请提供的方法进行说明。
如图2所示,手机可显示主界面301。主界面301可包括相机应用的图标302。手机可接收用户点击该图标302的操作,响应于该操作,如图3所示,手机可开启相机应用并显示相机应用的拍摄预览界面303。可以理解的是,相机应用是智能手机、平板电脑等电子设备上的一款图像拍摄的应用,其可以是系统应用也可以是第三方应用,本申请对该应用的名称不做限制。也即是说,用户可以点击相机应用的图标302来打开相机应用的拍摄预览界面303。不限于此,用户还可以在其他应用中调用相机应用以打开拍摄预览界面303,例如用户在社交类应用中点击拍摄控件来打开拍摄预览界面303。该社交类应用,可支持用户向他人分享所拍摄的图片或视频等。
需要说明的是,拍摄预览界面303可以是相机应用的默认拍摄模式的用户界面,例如可以是相机应用处于前置拍摄模式时提供的用户界面。可以理解的是,该默认拍摄模式也可以为其他,例如后置拍摄模式、前后拍摄模式等。又或者,相机应用可以具备记忆功能, 该拍摄预览界面303可以为相机应用上一次退出时,相机应用所处的拍摄模式的用户界面。
图3以拍摄预览界面303为相机应用处于前置拍摄模式时对应的拍摄预览界面为例进行说明。如图3所示,拍摄预览界面303可包括预览图像304、拍摄模式选项305、闪光灯控件、快门控件等。其中,预览图像304即为多个摄像头293中的前置摄像头拍摄的图像。需要说明的是,电子设备可实时刷新拍摄预览界面303所显示的图像(即预览图像304),以便于用户预览摄像头293当前拍摄到的图像。拍摄模式选项305用于提供多种拍摄模式供用户选择。多种拍摄模式可包括:拍照305a、录像305b、多镜录像305c、实时虚化、全景等。电子设备可接收用户左滑/右滑该拍摄模式选项305的操作,响应于该操作,电子设备可开启用户选择的拍摄模式。需要说明的是,不限于图3所示,拍摄模式选项305中可以显示比图3所示更多或者更少的选项。
其中,拍照305a所对应的拍摄模式即常用的单镜拍摄,可包括前置拍摄模式、后置拍摄模式等。也即,当拍照305a被选中时,电子设备可通过前置摄像头或后置摄像头进行拍照。其中关于前置拍摄模式、后置拍摄模式的具体介绍请参照前文,在此暂不赘述。
多镜录像305c所对应的拍摄模式可包括多镜拍摄及单镜拍摄。也即,当多镜录像305c被选中时,电子设备既可以通过一个摄像头进行单镜拍摄,也可以通过多个摄像头进行多镜拍摄。其中,关于多镜拍摄下的具体介绍可以参考前文的具体描述,在此暂不赘述。
如图3所示,拍照305a处于被选中状态。也即,电子设备当前处于拍照模式。若用户希望开启多镜录像模式,则可左滑拍摄模式选项305,并选择多镜录像305c。当检测到用户左滑拍摄模式选项305并选中多镜录像305c的操作时,电子设备可开启多镜录像模式并显示如图4A所示的拍摄预览界面303。
如图4A所示,进入多镜录像模式后,电子设备显示拍摄预览界面303。该拍摄预览界面303包括图像306a、图像306b、隔空换镜控件307、设置控件308、拍摄模式切换控件309、教学引导控件310等。图像306a为后置摄像头所拍摄的图像,图像306b为前置摄像头所拍摄的图像,且由于电子设备竖置,该图像306a与图像306b上下拼接。
需要说明的是,在本申请中,电子设备第一次多镜录像模式时可默认开启前置摄像头和后置摄像头,图像的显示方式默认为拼接方式。但在其他实施方式中,默认开启的摄像头也可以为两个后置摄像头、一个前置摄像头或者一个后置摄像头等。此外,图像的显示方式不仅限于拼接方式,还可以为画中画方式等,在此不做具体限制。又或者,相机应用可具备记忆功能,在电子设备进入多镜录像模式后,电子设备可开启相机应用上一次从多镜录像模式退出时正在工作的摄像头,并以上一次的显示方式进行显示。
其中,隔空换镜控件307可供用户快速开启/关闭隔空换镜功能。隔空换镜功能开启后,用户可通过特定的隔空手势控制电子设备。需要说明的是,电子设备进入多镜录像模式后,可默认开启隔空换镜功能。因此,该隔空换镜控件307处于开启状态(又可以称为第一状态),用于指示隔空换镜功能已开启。当然,隔空换镜功能也可关闭。例如,响应于检测到用户作用于该隔空换镜控件307的触摸操作,电子设备可关闭隔空换镜功能。此时,隔空换镜控件307处于关闭状态(又可称为第二状态),用于指示隔空换镜功能已关闭。
设置控件308可用于调整拍摄照片的参数(如分辨率、图片比例等)以及开启或关闭一些用于拍照的方式(如隔空换镜、定时拍摄、微笑抓拍、声控拍照等)等。具体的,电子设备可接收用户点击设置控件308的操作,响应于该操作,电子设备可显示如图4B所 示的设置界面308a。设置界面308a可包括隔空换镜308b、照片比例、声控拍照等选项。该隔空换镜308b可开启或关闭隔空换镜功能。需要说明的是,该设置界面308a中的隔空换镜308b的开关状态与拍摄预览界面303中的隔空换镜控件307的开关状态是联动的,且隔空换镜308b的开关状态与隔空换镜控件307的开关状态保持一致。也即,若隔空换镜308b由开启状态/关闭状态切换为关闭状态/开启状态,隔空换镜控件307也由开启状态/关闭状态切换为关闭状态/开启状态,反之亦然。
此外,隔空换镜308b还可提示用户,电子设备可在多镜录像时利用前置摄像头识别隔空手势。例如,该隔空换镜308b可包括“多镜录像时,通过前置摄像头识别手势切换多镜模式”的文字信息。也即,电子设备可在用户通过设置控件308开启隔空换镜功能时,告知用户电子设备可利用前置摄像头识别隔空手势,避免用户感觉隐私被侵犯。
拍摄模式切换控件309可用于提供多种拍摄模式给用户进行选择,如前后拍摄模式、后后拍摄模式、画中画拍摄模式、前置拍摄模式、后置拍摄模式等。
在本申请实施例中,电子设备可具备隔空换镜功能。隔空换镜功能可指:电子设备在多镜录像下,可通过前置摄像头识别隔空手势,以切换拍摄模式的功能。下面将结合附图对电子设备的隔空换镜功能进行说明。
如图5A所示,电子设备可显示拍摄预览界面401。其中,拍摄预览界面401包括图像401a(也可称为第二图像)、图像401b(也可称为第一图像)、拍摄模式切换控件402等。其中,图像401a为后置摄像头实时采集的图像,图像401b为前置摄像头实时采集的图像。此外,图像401a及图像401b左右拼接,这是因为电子设备被横置。具体的,第一图像位于拍摄预览界面的第一区域,第二图像位于拍摄预览界面的第二区域,第一区域与第二区域不重叠。示例性的,第一区域可以为图5A中图像401b所在区域,第二区域可以为图5A中图像401a所在区域。
如图5A所示,若用户希望切换电子设备的拍摄模式,可先面对电子设备输入隔空手势,例如输入“举手”的隔空手势(可以理解为用户保持面向显示屏保持“举手”的状态,又可以称为第一手势)。电子设备的前置摄像头可拍摄用户输入的隔空手势(即图像401b),并在拍摄预览界面401中显示。此外,电子设备还可对拍摄到的图像401b进行分析处理,并在识别到该“举手”的隔空手势时,显示如图5B所示的拍摄预览界面401。图5B所示的拍摄预览界面401与图5A所示的拍摄预览界面401类似,区别在于:图5B所示的拍摄预览界面401包括提示信息403,用于提示用户电子设备已进入“预备”状态(可以理解为准备好进一步识别用户的隔空手势的状态),用户可按需输入隔空手势。示例性的,如图5B所示,该提示信息403可以为隔空手势的图标。在一种可能的设计中,该提示信息403还可包括提示用户需要在第一预设时间内完成手势操作的文字信息,例如“需要在3秒内完成手势操作”。
同时,提示信息403还可包括时间进度条,该时间进度条可用于指示电子设备进入“预备”状态的时间。其中,电子设备从进入“预备”状态的时刻(例如,第一时刻)开始计时,此时该时间进度条为空白;电子设备在第一时刻的第一预设时间后停止计时,此时该时间进度条被填满。电子设备进入“预备”状态后,用户需要在该时间进度条被填满前(可以理解为在第一预设时间内)输入隔空手势,以实现对电子设备的控制。
示例性的,电子设备可在检测到用户输入的隔空手势时,由前后拍摄模式切换为前置 拍摄模式或后置拍摄模式。下面将基于图5A-图5B所示的拍摄场景,介绍电子设备由前后拍摄模式切换为前置拍摄模式过程中涉及到的界面。
如图5C所示,若用户希望电子设备由前后拍摄模式切换为前置拍摄模式,则可在电子设备显示图5B所示的拍摄预览界面401时,面对显示屏输入“手掌从右向左移动”的隔空手势(可以理解简单理解为手掌左滑的手势,也可称为第三手势)。响应于检测到用户输入的“手掌从右向左移动”的隔空手势,电子设备可将拍摄模式由前后拍摄模式切换为前置拍摄模式,并显示如图5D所示的拍摄预览界面401。如图5D所示,电子设备切换为前置拍摄模式后,可在拍摄预览界面401中显示前置摄像头所拍摄的图像401b。需要说明的是,当前置摄像头有多个时,此时工作的前置摄像头可为电子设备默认的前置主摄像头。
需要说明的是,电子设备还可响应于检测到用户的其他隔空手势,将拍摄模式由前后拍摄模式切换为其他拍摄模式。例如,在图5B所示的拍摄场景下,响应于检测到用户输入的“伸出手掌然后握拳”的隔空手势,电子设备可将拍摄模式由前后拍摄模式切换为画中画拍摄模式。或者,响应于检测到用户输入的“翻转手掌”的隔空手势,电子设备可将图像401a与图像401b的位置互换,即将图像401a的位置由原来的屏幕左边更换为屏幕右边,图像401b的位置由原来的屏幕右边更换为屏幕左边。或者,响应于检测用户输入的“胜利”的隔空手势,电子设备可将拍摄模式由前后拍摄模式切换为后后拍摄模式。具体的,电子设备可将图像401b切换为图像401c(也可以称为第三图像),图像401c为另一个后置摄像头(可以称为第三摄像头)实时采集的图像。
可见,在隔空换镜功能开启时,电子设备需要通过至少一个前置摄像头识别用户的隔空手势,并进一步执行该隔空手势对应的操作。也即,在电子设备识别隔空手势时,隔空换镜功能无法启用。
在本申请实施例中,电子设备可同时利用两个摄像头拍摄图像。当电子设备处于后后拍摄模式时,两个后置摄像头处于工作状态,导致电子设备无法通过前置摄像头识别用户的隔空手势。因此,在电子设备处于后后拍摄模式时,隔空换镜功能无法启用。
电子设备可在将拍摄模式切换至后后拍摄模式时,提醒用户无法使用隔空换镜功能。如图6A所示,电子设备可显示拍摄预览界面401。该拍摄预览界面401与图5A所示的拍摄预览界面401类似,在此暂不赘述。
如图6A所示,电子设备还可接收用户点击该拍摄模式切换控件402(也可以称为第二控件)的操作,响应于该操作,电子设备可在拍摄预览界面401上显示如图6B所示的拍摄预览界面401。该拍摄预览界面401可包括拍摄模式选择区404(也可以称为第一弹窗)。该拍摄模式选择区404可展示多种拍摄模式的预览界面,例如前置拍摄模式的预览界面404a、后置拍摄模式(也可以称为第一拍摄模式)的预览界面404b、画中画拍摄模式的预览界面404c、后后拍摄模式的预览界面404d及前后拍摄模式的预览界面404e。
如图6B所示,电子设备可接收用户点击该后置拍摄模式的预览界面404b的操作,响应于该操作,电子设备将拍摄模式由前后拍摄模式切换为后后拍摄模式,并显示如图6C所示的拍摄预览界面401。
如图6C所示,拍摄预览界面401中显示的图像由图6A所示的图像401a和401b切换为图像401a和图像401c(也可以称为第三图像)。其中,图像401a为后置摄像头中的普 通摄像头所拍摄的图像,图像401c为后置摄像头中的广角摄像头实时采集的图像。可以看出,图像401c相对于图像401a来说其取景范围更大。此外,拍摄预览界面401还包括异常提示信息405(也可以称为第三提示信息)。该异常提示信息405用于提醒用户,在后后拍摄模式下无法使用隔空换镜功能,例如为“后/后无法使用隔空换镜”。
或者,用户还可以使用隔空手势从其他拍摄模式切换为后后拍摄模式。其具体切换过程见前文关于隔空换镜功能部分的描述,在此暂不赘述。
需要说明的是,上述仅仅是以电子设备由前后拍摄模式切换为后后拍摄模式为例进行说明,事实上,电子设备从其他任意一种拍摄模式(例如,画中画拍摄模式、前置拍摄模式、后置拍摄模式)切换为后后拍摄模式时,均可显示该异常提示信息405(也可称为第一异常提示信息)。其中,电子设备从其他任意一种拍摄模式切换为后后拍摄模式的方式与电子设备由前后拍摄模式切换为后后拍摄模式的方式相同,在此暂不赘述。
电子设备可在进入多镜录像后首次切换至后后拍摄模式时,显示该异常提示信息405。这种做法可避免电子设备频繁提醒用户,减少冗余信息。
还需要说明的是,上述内容仅以电子设备处于录制过程中的异常提醒流程为例进行说明。电子设备处于未录制状态时,也可从任意一种拍摄模式切换至后后拍摄模式,并显示异常提示信息405。
若电子设备已开启隔空换镜功能,电子设备还可在设备温度过高或过低时,关闭隔空换镜功能并提醒用户。下面以电子设备处于前后拍摄模式为例进行介绍。
参阅图7A,示出了电子设备温度正常时的拍摄预览界面401。其中,图7A所示的拍摄预览界面401与图6A所示的拍摄预览界面401类似,区别在于:图6A所示的拍摄预览界面401处于录制状态,图7A所示的拍摄预览界面401处于未录制状态,但这并不影响异常提醒。
参阅图7B,示出了电子设备温度过高时的拍摄预览界面401。与图7A所示的拍摄预览界面401相比,图7B所示的拍摄预览界面401中显示有异常提示信息407(也可以称为第一提示信息)。该异常提示信息407用于提示用户电子设备由于设备温度过高而关闭了隔空换镜功能,例如“设备温度过高“隔空换镜”已关闭”。此外,隔空换镜控件402(也可以称为第一控件)所处的状态由图7A所示的开启状态变为图7B所示的关闭状态(又可称为第二状态)。
具体的,电子设备的温度传感器可实时检测电子设备的设备温度,并将其传输给处理器210。处理器210可在设备温度大于预设的第一温度(也可以称为第一预设温度)时,认为电子设备的设备温度过高,控制显示屏294在拍摄预览界面401上显示异常提示信息407。
参阅图7C,示出了电子设备温度过低时的拍摄预览界面401。与图7A所示的拍摄预览界面401相比,图7C所示的拍摄预览界面401中显示有异常提示信息408(也可以称为第一提示信息)。该异常提示信息408用于提示用户电子设备由于设备温度过低而关闭了隔空换镜功能,例如“设备温度过低“隔空换镜”已关闭”。此外,隔空换镜控件402所处的状态由图7A所示的开启状态变为图7C所示的关闭状态(又可称为第二状态)。
具体的,电子设备的温度传感器可实时检测电子设备的设备温度,并将其传输给处理器210。处理器210可在设备温度小于预设的第二温度(也可以称为第二预设温度)时, 认为电子设备的设备温度过低,控制显示屏294在拍摄预览界面401上显示异常提示信息408。
可以理解地,电子设备的设备温度过高时,用户继续使用隔空换镜功能,可能会加重电子设备的发热情况,因此需关闭隔空换镜功能。而电子设备的设备温度过低时,电子设备的电池内阻会增大,此时若用户继续使用隔空换镜功能可能会使电池的电流瞬时增大,导致电池电压被瞬间拉低,进而使得电子设备关机,因此需关闭隔空换镜功能。
电子设备还可在预设时间后不再显示(或者说隐藏)上述异常提示信息407或异常提示信息408。示例性的,电子设备可在预设时间后显示如图7D所示的拍摄预览界面401。与图7A所示的拍摄预览界面401相比,隔空换镜控件402所处的状态由图7A所示的开启状态变为图7D所示的关闭状态。
如图7D所示,若用户希望开启隔空换镜功能,可点击隔空换镜控件402。电子设备可接收用户点击隔空换镜控件402的操作,响应于该操作,电子设备可判断设备温度所处的温度区间,并执行对应的操作。
具体的,若电子设备判断设备温度大于预设的第一温度(即设备温度过高),则可显示如图7E所示的异常提示信息410(可以称为第二提示信息),通过异常提示信息410提醒用户设备温度过高无法开启隔空换镜功能。若电子设备判断设备温度小于预设的第二温度(即设备温度过低),则可显示如图7F所示的拍摄预览界面401,通过异常提示信息411(可以称为第二提示信息)提醒用户设备温度过低无法开启隔空换镜功能。若电子设备判断设备温度在预设的第一温度与预设的第二温度之间,则可开启隔空换镜功能并显示如图7G所示的提示信息412,用于指示隔空换镜功能已开启。
在一种可选的实施方式中,在设备温度大于预设的第一温度或者小于预设的第二温度时,该隔空换镜控件402可被置灰(图未示)。换句话说,在在设备温度大于预设的第一温度或者小于预设的第二温度期间,该隔空换镜控件402不可被点击,直至设备温度恢复正常(小于预设的第一温度且大于预设的第二温度)时,该隔空换镜控件402可变为第二状态,供用户开启隔空换镜功能。
若用户希望开启隔空换镜功能,还可点击设置控件403。电子设备可接收用户点击该隔空换镜409的操作,响应于该操作,电子设备可判断设备温度所处的温度区间,并执行对应的操作。
综上,本申请提供的异常提示方法,可在电子设备处于后后拍摄模式或者设备温度异常(设备温度大于预设的第一温度或者小于预设的第二温度)时,及时提醒用户无法使用隔空换镜功能,有利于提醒用户使用可用的方式控制电子设备,提高人机交互效率。
本申请还提供一种芯片系统800,如图8所示,该芯片系统包括至少一个处理器801和至少一个接口电路802。处理器801和接口电路802可通过线路互联。例如,接口电路802可用于从其它装置(例如,电子设备的存储器)接收信号。又例如,接口电路802可用于向其它装置(例如处理器801)发送信号。
例如,接口电路802可读取电子设备中存储器中存储的指令,并将该指令发送给处理器801。当所述指令被处理器801执行时,可使得电子设备执行上述各实施例中的各个步骤。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便 和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请实施例的具体实施方式,但本申请实施例的保护范围并不局限于此,任何在本申请实施例揭露的技术范围内的变化或替换,都应涵盖在本申请实施例的保护范围之内。因此,本申请实施例的保护范围应以所述权利要求的保护范围为准。

Claims (16)

  1. 一种异常提示方法,其特征在于,所述方法应用于包括显示屏、第一摄像头和第二摄像头的电子设备,所述第一摄像头和所述第二摄像头位于所述显示屏的不同侧,所述第一摄像头与所述显示屏位于所述电子设备的同一侧,所述方法包括:
    所述电子设备显示拍摄预览界面,所述拍摄预览界面显示第一图像、第二图像中的至少一个,所述第一图像为所述第一摄像头实时采集的图像,所述第二图像为所述第二摄像头实时采集的图像,所述电子设备已开启第一功能,所述第一功能为所述电子设备通过所述第一摄像头采集用于识别用户手势的图像数据的功能;
    所述电子设备实时检测设备温度;
    若所述设备温度不在预设温度范围内,所述电子设备在所述拍摄预览界面上显示第一提示信息,所述第一提示信息指示所述电子设备已关闭所述第一功能。
  2. 根据权利要求1所述的方法,其特征在于,若所述电子设备未开始录制视频,所述拍摄预览界面还包括第一控件,所述第一控件用于开启或关闭所述第一功能,所述方法还包括:
    若所述设备温度不在预设温度范围内,所述电子设备在所述拍摄预览界面上将所述第一控件由第一状态切换为第二状态,所述第一状态指示所述电子设备已开启所述第一功能,所述第二状态指示所述电子设备已关闭所述第一功能。
  3. 根据权利要求1所述的方法,其特征在于,若所述电子设备正在录制视频,所述方法还包括:
    若所述设备温度不在预设温度范围内,响应于检测到用户操作,所述电子设备停止录制视频,在所述拍摄预览界面上显示第一控件,其中,所述第一控件处于第二状态,所述第二状态指示所述电子设备已关闭所述第一功能。
  4. 根据权利要求2或3所述的方法,其特征在于,在所述设备温度不在预设温度范围内期间,所述第一控件处于不可被点击状态。
  5. 根据权利要求2或3所述的方法,其特征在于,所述方法还包括:
    若所述设备温度不在预设温度范围内,响应于检测到用户对所述第一控件的操作,所述电子设备在所述拍摄预览界面上显示第二提示信息,所述第二提示信息指示所述电子设备由于温度异常而无法开启所述第一功能。
  6. 根据权利要求1-5中任意一项所述的方法,其特征在于,若所述设备温度大于或等于第一预设温度,或所述设备温度小于或等于第二预设温度,所述设备温度不在预设温度范围内,其中,所述第一预设温度大于所述第二预设温度。
  7. 根据权利要求1-6中任意一项所述的方法,其特征在于,所述电子设备还包括第三摄像头,所述第三摄像头与所述第二摄像头位于所述显示屏的同一侧,所述方法还包括:
    响应于检测到用户操作,所述电子设备在所述拍摄预览界面显示所述第二图像、第三图像及第三提示信息,所述第三图像为所述第三摄像头实时采集的图像,所述第三提示信息用于指示所述电子设备在当前拍摄模式下无法启用所述第一功能。
  8. 根据权利要求7所述的方法,其特征在于,所述拍摄预览界面还包括第二控件,所述响应于检测到用户操作,所述电子设备在所述拍摄预览界面显示所述第二图像、第三图像及第三提示信息,包括:
    响应于用户对所述第二控件的操作,所述电子设备在所述拍摄预览界面上显示第一弹窗,所述第一弹窗包括第一拍摄模式的标识,所述第一拍摄模式为所述电子设备通过所述第二摄像头、所述第三摄像头同时进行拍摄的模式;
    响应于用户对所述第一拍摄模式的标识的操作,所述电子设备在所述拍摄预览界面显示所述第二图像、第三图像及第三提示信息。
  9. 根据权利要求7所述的方法,其特征在于,所述响应于检测到用户操作,所述电子设备在所述拍摄预览界面显示所述第二图像、第三图像及第三提示信息,包括:
    响应于所述第一摄像头检测到第一手势,所述电子设备在所述拍摄预览界面上显示第一标识;
    在显示所述第一标识后的预设时间内,响应于所述第一摄像头检测到第二手势,所述电子设备在所述拍摄预览界面显示所述第二图像、第三图像及第三提示信息。
  10. 根据权利要求1-9中任意一项所述的方法,其特征在于,所述拍摄预览界面包括所述第一图像和所述第二图像,所述电子设备显示拍摄预览界面,包括:
    所述电子设备在所述拍摄预览界面的第一区域显示所述第一图像,在所述拍摄预览界面的第二区域显示所述第二图像。
  11. 根据权利要求10所述的方法,其特征在于,所述电子设备在所述拍摄预览界面显示所述第二图像、第三图像,包括:
    所述电子设备在所述拍摄预览界面的第三区域显示所述第二图像,在所述拍摄预览界面的第四区域显示所述第三图像,所述第三区域与所述第二区域相同,所述第四区域与所述第一区域相同。
  12. 根据权利要求10所述的方法,其特征在于,所述电子设备在所述拍摄预览界面显示所述第二图像、第三图像,包括:
    所述电子设备在所述拍摄预览界面的第三区域显示所述第二图像,在所述拍摄预览界面的第四区域显示所述第三图像,所述第三区域与所述第二区域不同,所述第四区域与所述第一区域不同,所述第一区域与所述第二区域重叠。
  13. 根据权利要求1-9中任意一项所述的方法,其特征在于,所述拍摄预览界面包括所述第一图像或所述第二图像。
  14. 根据权利要求1-13中任意一项所述的方法,其特征在于,所述电子设备未开始录制视频或者正在录制视频。
  15. 一种电子设备,其特征在于,包括显示屏、第一摄像头、第二摄像头及处理器,所述处理器和存储器耦合,所述存储器存储有程序指令,当所述存储器存储的程序指令被所述处理器执行时使得所述电子设备实现权利要求1-14中任一项所述的方法。
  16. 一种计算机可读存储介质,其特征在于,包括计算机指令;
    当所述计算机指令在电子设备上运行时,使得所述电子设备执行如权利要求1-14中任一项所述的方法。
PCT/CN2022/091049 2021-06-16 2022-05-05 一种异常提示方法及电子设备 WO2022262453A1 (zh)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN202110676709 2021-06-16
CN202110676709.3 2021-06-16
CN202111473686.2 2021-11-29
CN202111473686 2021-11-29
CN202111679475.4A CN115484393B (zh) 2021-06-16 2021-12-31 一种异常提示方法及电子设备
CN202111679475.4 2021-12-31

Publications (1)

Publication Number Publication Date
WO2022262453A1 true WO2022262453A1 (zh) 2022-12-22

Family

ID=84420818

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/091049 WO2022262453A1 (zh) 2021-06-16 2022-05-05 一种异常提示方法及电子设备

Country Status (2)

Country Link
CN (2) CN115484393B (zh)
WO (1) WO2022262453A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130271618A1 (en) * 2012-04-13 2013-10-17 Samsung Electronics Co., Ltd. Camera apparatus and control method thereof
CN110113479A (zh) * 2019-04-15 2019-08-09 珠海格力电器股份有限公司 智能终端降温策略的制定方法、降温方法、系统、终端
CN112860169A (zh) * 2021-02-18 2021-05-28 Oppo广东移动通信有限公司 交互方法及装置、计算机可读介质和电子设备

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102055166A (zh) * 2009-10-27 2011-05-11 深圳长城开发科技股份有限公司 电力设备及其高温自我保护方法
CN104427124B (zh) * 2013-09-09 2019-05-21 中兴通讯股份有限公司 一种控制终端温度的方法、装置及终端
CN106793894A (zh) * 2014-05-01 2017-05-31 艾肯制造公司 用于分配可消耗液体的系统和方法
CN108111773B (zh) * 2016-02-15 2020-06-23 Oppo广东移动通信有限公司 基于屏幕补光的拍照方法、装置、移动终端及存储介质
CN105807873B (zh) * 2016-03-08 2019-03-08 北京小米移动软件有限公司 温度控制方法及装置
CN109194813A (zh) * 2018-07-12 2019-01-11 北京小米移动软件有限公司 智能穿戴设备及其温控方法、装置和存储介质
CN109142398B (zh) * 2018-07-16 2021-02-02 北京林业大学 一种提高拟南芥种子成像质量的方法
CN111327814A (zh) * 2018-12-17 2020-06-23 华为技术有限公司 一种图像处理的方法及电子设备
CN114679538A (zh) * 2019-05-22 2022-06-28 华为技术有限公司 一种拍摄方法及终端
CN111010506A (zh) * 2019-11-15 2020-04-14 华为技术有限公司 一种拍摄方法及电子设备

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130271618A1 (en) * 2012-04-13 2013-10-17 Samsung Electronics Co., Ltd. Camera apparatus and control method thereof
CN110113479A (zh) * 2019-04-15 2019-08-09 珠海格力电器股份有限公司 智能终端降温策略的制定方法、降温方法、系统、终端
CN112860169A (zh) * 2021-02-18 2021-05-28 Oppo广东移动通信有限公司 交互方法及装置、计算机可读介质和电子设备

Also Published As

Publication number Publication date
CN115484393B (zh) 2023-11-17
CN115484393A (zh) 2022-12-16
CN117939287A (zh) 2024-04-26

Similar Documents

Publication Publication Date Title
WO2021000881A1 (zh) 一种分屏方法及电子设备
WO2022262475A1 (zh) 拍摄方法、图形用户界面及电子设备
CN110830645B (zh) 一种操作方法和电子设备及计算机存储介质
WO2022262550A1 (zh) 一种拍摄视频的方法及电子设备
CN112068907A (zh) 一种界面显示方法和电子设备
WO2024040990A1 (zh) 拍照方法及电子设备
WO2021042878A1 (zh) 一种拍摄方法及电子设备
CN115442509B (zh) 拍摄方法、用户界面及电子设备
CN115904160A (zh) 一种图标移动方法、相关图形界面及电子设备
CN115484387B (zh) 一种提示方法及电子设备
WO2022262453A1 (zh) 一种异常提示方法及电子设备
WO2022262540A1 (zh) 一种拍摄方法及电子设备
CN115484390B (zh) 一种拍摄视频的方法及电子设备
WO2022262547A1 (zh) 一种拍摄视频的方法及电子设备
CN115484394B (zh) 一种隔空手势的引导使用方法及电子设备
EP4361805A1 (en) Method for generating theme wallpaper, and electronic device
WO2024125301A1 (zh) 显示方法和电子设备
WO2023051354A1 (zh) 一种分屏显示方法及电子设备
WO2024027504A1 (zh) 一种应用显示方法及电子设备
US20240193842A1 (en) Display Method and Electronic Device
WO2023160455A1 (zh) 删除对象的方法及电子设备
CN115811656A (zh) 一种拍摄视频的方法及电子设备
CN116820288A (zh) 窗口控制方法、电子设备及计算机可读存储介质
CN115484397A (zh) 一种多媒体资源分享方法和电子设备
CN115808997A (zh) 一种预览方法、电子设备及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22823936

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22823936

Country of ref document: EP

Kind code of ref document: A1