RU2809660C1 - Frame method for recording multichannel video, graphic user interface and electronic device - Google Patents

Abstract

FIELD: image capture.

SUBSTANCE: invention relates to a framing method used for recording multi-channel video. The technical result is to provide separate adjustment of the framing of each working camera in the preview during multi-channel shooting without changing the framing of other working cameras in the preview frame. The result is achieved in that the image from one camera is displayed in one area, and the user's operation, such as the left slide operation or the right slide operation of the user in the area, can be detected to change the crop presented by the corresponding camera in the area without changing the crop of the other camera in the relevant area.

EFFECT: separate adjustment of the framing of each working camera in the preview during multi-channel shooting without changing the framing of other working cameras in the preview frame.

20 cl, 45 dwg

Description

[0001] The present application claims priority based on Chinese Patent Application No. 202010324919.1, filed with the National Intellectual Property Administration of China on April 22, 2020, entitled “FRAMING METHOD FOR MULTICHANNEL VIDEO RECORDING, GRAPHICAL USER INTERFACE AND ELECTRONIC DEVICE,” which is incorporated herein by reference in its entirety.

TECHNICAL FIELD

[0002] The present invention relates to the field of electronic technology and, in particular, to a framing method used for recording multi-channel video, a graphical user interface and an electronic device.

BACKGROUND OF THE ART

[0003] Nowadays, a portable electronic device (such as a mobile phone or a tablet computer) is usually equipped with a plurality of cameras, such as a front camera, a wide-angle camera, and a long-angle camera. To provide an enhanced imaging experience, an increasing number of electronic devices can support the simultaneous capture of images by multiple cameras.

SUMMARY OF THE INVENTION

[0004] The object of this application is to provide a framing method for recording multi-channel video, a graphical user interface (GUI) and an electronic device so that the user can separately adjust the framing of each camera in the multi-channel recording preview, and the framing of each camera in the preview frame do not affect each other to avoid the problem that changing the framing of the working camera in the preview frame causes the framing of another working camera in the preview frame to change.

[0005] The above purpose and other purposes are achieved by using features in independent claims. Further implementations are embodied in the dependent claims, description and accompanying drawings.

[0006] According to a first aspect, a framing method for recording multi-channel video is provided. The method is applied to an electronic device having a display and M cameras, where M ≥ 2 and M is a positive integer. The method includes: An electronic device includes N cameras, where N ≤ M and N is a positive integer. An electronic device captures images using N cameras. The electronic device displays a preview interface and part or all of the image captured by each of the N cameras. The preview interface includes N regions, and part or all of the image captured by each of the N cameras is displayed in one of the N regions. The electronic device detects the user's first operation in the first area. The first region is one of N regions, the first preview image is displayed in the first region, and the first preview image is obtained by cropping the entire image captured by the first camera. The electronic device displays a second preview image in the first area. The second preview image is also obtained by cropping the entire image captured by the first camera, and in the entire image captured by the first camera, the position of the second preview image is different from the position of the first preview image. The electronic device detects the user's second operation. The electronic device starts recording video and displays the image capture interface. The image capture interface includes N areas.

[0007] According to the method presented in the first aspect, in the process of previewing a multi-channel video recording, the user can adjust the framing of each working camera in the preview frame by performing a user operation, so that the framing of each working camera in the preview frame does not affect each other.

[0008] With reference to the first aspect, in a possible implementation, the first camera may be a rear camera, or may be a front camera. In particular, the center position of the first preview image may coincide with the center position of the entire image captured by the first camera. In this case, the first preview image is obtained by cropping it to the center.

[0009] With reference to the first aspect, in a possible implementation at 1x speed of the first camera, the size of the first preview image may be the same as the size of the first region.

[0010] With reference to the first aspect, in an exemplary implementation, the first user operation includes a sliding operation, for example, a sliding left operation or a sliding right operation. In the entire image captured by the first camera, the direction in which the center position of the first preview image points to the center position of the second preview image is opposite to the sliding direction of the sliding operation. Thus, the user can change, using a sliding operation, the crop range represented by the first camera in the first area.

[0011] Specifically, if the user's first operation is a left-slide operation, the second preview image is closer to the right edge of the entire image captured by the first camera than the first preview image.

[0012] Specifically, if the user's first operation is a right-slide operation, the second preview image is closer to the left edge of the entire image captured by the first camera than the first preview image.

[0013] With reference to the first aspect, in an exemplary implementation, the center position of the first preview image coincides with the center position of the entire image captured by the first camera. In other words, the electronic device may crop by center cropping the entire image captured by the first camera to obtain a first preview image.

[0014] With reference to the first aspect, in a possible implementation, the second preview image may have the same size as the first preview image. In other words, before and after the user adjusts the crop of the camera using a sliding operation, the electronic device does not change the size of the crop area in the entire image captured by the first camera.

[0015] With reference to the first aspect, in a possible implementation, the electronic device further detects a third user operation before detecting the first user operation. The electronic device enlarges the first preview image and displays the enlarged first preview image in a first area. Here, the first user operation may be a sliding operation, and the third user operation may be a two-finger zoom operation. Thus, an electronic device can separately adjust in a zoom scenario the crop range presented by a camera in the preview interface without affecting the crop range presented by another camera in the preview interface.

[0016] With reference to the first aspect, in an exemplary implementation, the second user operation is a user operation indicating the start of video recording, for example, an operation of clicking on an image capture control.

[0017] With reference to the first aspect, in a possible implementation, the electronic device may further detect a fourth user operation in the first area of the image capture interface. The electronic device displays a third preview image of the first camera in a first area of the image capturing interface. The third preview image is obtained by cropping the entire image captured by the first camera, and in the entire image captured by the first camera, the position of the third preview image is different from the position of the second preview image.

[0018] Thus, after adjusting the cropping of the camera in the preview interface, the user can further adjust, by user operation, the cropping range presented by the camera in the image capture interface.

[0019] In particular, the fourth user operation may be a sliding operation.

[0020] With reference to the first aspect, in a possible implementation, when the electronic device detects the first operation of the user, if the position of the electronic device does not change, the electronic device displays a second preview image from the first camera in the first area. When the electronic device detects the first operation of the user, if the position of the electronic device changes, the electronic device displays a fourth preview image of the first camera in the first area. The fourth preview image is obtained by cropping the entire image captured by the first camera, and the center position of the fourth preview image is the same as the center position of the entire cropped image of the first camera.

[0021] In other words, the electronic device adjusts the cropping range of the camera in the preview interface based on the user's first operation only when the position of the electronic device does not change. When the first user operation is detected, if the position of the electronic device is changed, the electronic device may not adjust the camera framing range in the preview interface based on the first user operation detected at that time, so that the user changes the optical framing by adjusting the position of the electronic device.

[0022] With reference to the first aspect, in a possible implementation, the electronic device may detect that the entire image captured by the first camera includes an image of the first person. The electronic device displays a fifth preview image in the first area. The fifth preview image is obtained by cropping the entire image captured by the first camera, and the fifth preview image includes the first person image. The electronic device detects that the position of the first person image in the entire image captured by the first camera is changing. The electronic device displays a sixth preview image in the first area. The sixth preview image is obtained by cropping the entire image captured by the first camera, and the sixth preview image includes the first person image. In other words, the cropping method for recording multi-channel video provided in this embodiment of this application can further provide a face tracking function so that a preview image including a face is always displayed in the preview interface area.

[0023] In some embodiments, the position of the first person image in the sixth preview image is the same as the position of the first person image in the fifth preview image.

[0024] In some embodiments, the first person image is in the central region of the fifth preview image.

[0025] With reference to the first aspect, in a possible implementation, the electronic device may further detect that the entire image captured by the first camera includes an image of the first person; and turns on the second camera. The second camera's framing range is greater than the first camera's framing range, and the first person is within the second camera's framing range. The electronic device displays a seventh preview image in the first area. The seventh preview image is obtained by cropping the entire image captured by the second camera, and the seventh preview image includes the first person image. The electronic device detects that the position of the first person's image in the entire image captured by the second camera changes. The electronic device displays the eighth preview image in the first area. The eighth preview image is obtained by cropping the entire image captured by the second camera, and the eighth preview image includes the first person image. In this way, the crop range corresponding to the preview area can be expanded during face tracking.

[0026] In some embodiments, the position of the first person image in the seventh preview image is the same as the position of the first person image in the eighth preview image.

[0027] In some embodiments, the first person image is in the central region of the seventh preview image.

[0028] With reference to the first aspect, in a possible implementation, the first camera is a front camera or a rear camera. In other words, functions such as the face tracking function and camera crop range adjustment by sliding provided in this embodiment of the present application are applicable to a forward-facing image shooting scenario or applicable to a rearward-facing image shooting scenario.

[0029] With reference to the first aspect, in a possible implementation, the electronic device may further detect a fifth operation of the user. The electronic device stops recording video and creates a video file. The electronic device detects the user's sixth operation on the video file. The electronic device displays the playback interface. The playback interface includes N areas. In this way, after adjusting the preview image of each area according to the user's requirements, the user can save the desired preview image, so that the user can have a more flexible and convenient video recording experience.

[0030] The fifth user operation is a user operation indicating to stop video recording, for example, it may be a pressing operation performed on the image capture control.

[0031] According to a second aspect, an embodiment of the present application provides a framing method for recording multi-channel video. The method is applied to an electronic device having a display and M cameras, where M ≥ 2 and M is a positive integer. The method includes: An electronic device includes N cameras, where N ≤ M and N is a positive integer. An electronic device captures images using N cameras. The electronic device displays a preview interface and part or all of the image captured by each of the N cameras. The preview interface includes N regions, and part or all of the image captured by each of the N cameras is displayed in one of the N regions. The electronic device detects the user's seventh operation in the first area. The electronic device detects a change in the position of the electronic device. The electronic device displays a ninth preview image in the first area. The crop range of the ninth preview image is the same as the crop range of the tenth preview image, the tenth preview image is the image displayed in the first area before changing the position of the electronic device, the ninth preview image is obtained by cropping the entire image captured by the first camera after the change position of the electronic device, and a tenth preview image is obtained by cropping the entire image captured by the first camera before changing the position of the electronic device. The electronic device detects the user's eighth operation. The electronic device starts recording video and displays the image capture interface. The image capture interface includes N areas.

[0032] The seventh user operation may be a user operation to select the first area, for example, a double-click operation or a touch-and-hold operation performed in the first area.

[0033] According to the method presented in the second aspect, when the position of the electronic device is changed, the crop range of the selected preview area does not change.

[0034] According to a third aspect, an embodiment of this application provides a framing method for multi-channel photography. The method is applied to an electronic device having a display and M cameras, where M ≥ 2 and M is a positive integer. The method includes: An electronic device includes N cameras, where N ≤ M and N is a positive integer. An electronic device captures images using N cameras. The electronic device displays a preview interface and part or all of the image captured by each of the N cameras. The preview interface includes N regions, and part or all of the image captured by each of the N cameras is displayed in one of the N regions. The electronic device detects the user's first operation in the first area. The first region is one of N regions, the first preview image is displayed in the first region, and the first preview image is obtained by cropping the entire image captured by the first camera. The electronic device displays a second preview image in the first area. The second preview image is also obtained by cropping the entire image captured by the first camera, and in the entire image captured by the first camera, the position of the second preview image is different from the position of the first preview image.

[0035] According to the method presented in the second aspect, in the process of previewing a multi-channel photograph, the user can adjust the framing of each working camera in the preview frame by performing the user's operation, so that the framing of each working camera in the preview frame does not affect each other.

[0036] In accordance with the third aspect, an electronic device is further provided. The electronic device may include M cameras, a display, a touch sensor, a wireless communication module, a memory, and one or more processors. One or more processors are configured to execute one or more computer programs stored in memory. M ≥ 2, and M is a positive integer.

[0037] The N cameras are configured to capture images.

[0038] The display may be configured to display a preview interface and part or all of the image captured by each of the N cameras. The preview interface includes N regions, and part or all of the image captured by each of the N cameras is displayed in one of the N regions.

[0039] The touch sensor may be configured to detect a first user operation in the first area. The first region is one of N regions, the first preview image is displayed in the first region, and the first preview image is obtained by cropping the entire image captured by the first camera.

[0040] The display may be configured to display a second preview image in the first area in response to a first user operation. The second preview image is also obtained by cropping the entire image captured by the first camera, and in the entire image captured by the first camera, the position of the second preview image is different from the position of the first preview image.

[0041] The touch sensor may be further configured to detect a second operation by the user.

[0042] The N cameras may be configured to begin recording video in response to a second user operation. The display may be configured to display an image capturing interface in response to a second operation by the user. The image capture interface includes N areas.

[0043] For a specific implementation of each component included in the electronic device in the third aspect, refer to the method described in the first aspect. The details are not repeated here.

[0044] In accordance with the fourth aspect, an electronic device is further provided. The electronic device may include an apparatus, wherein the apparatus may implement any possible implementation of the first aspect or any possible implementation of the second aspect.

[0045] According to the fifth aspect, a video recording apparatus is further provided. The apparatus has the function of realizing the behavior of an electronic device in the above-described implementation method. The function may be implemented using hardware or may be implemented using hardware executing associated software. The hardware or software includes one or more modules corresponding to the above functions.

[0046] According to a sixth aspect, there is provided a computer device including a memory, a processor, and a computer program that is stored in the memory and executable on the processor. When the processor executes a computer program, the computer device is given the opportunity to implement any possible implementation of the first aspect or any possible implementation of the second aspect.

[0047] In accordance with the seventh aspect, a computer program product is provided including instructions. When a computer program product runs on an electronic device, the electronic device may implement any possible implementation of the first aspect or any possible implementation of the second aspect.

[0048] In accordance with the eighth aspect, a computer-readable storage medium containing instructions is provided. When the instructions are executed on an electronic device, the electronic device allows any possible implementation of the first aspect or any possible implementation of the second aspect to be carried out.

BRIEF DESCRIPTION OF THE DRAWINGS

[0049] To more clearly describe the technical solutions in the embodiments of this application, the accompanying drawings used in the embodiments of this application are described below.

[0050] FIG. 1 is a schematic diagram of the structure of an electronic device according to an embodiment;

[0051] FIG. 2A is a schematic diagram of a user interface that is located on an electronic device and that is used for an application menu according to an embodiment;

[0052] FIG. 2B is a schematic diagram of a rear camera on an electronic device according to an embodiment;

[0053] FIG. 3A - fig. 3D - schematic representations of a two-channel video recording scenario according to this application;

[0054] FIG. 4A is a schematic diagram of the operating principle of two-channel video recording;

[0055] FIG. 4B is a schematic representation of a cropped image of an existing two-channel video;

[0056] FIG. 5 is a schematic diagram of a multi-channel video recording scenario;

[0057] FIG. 6A, FIG. 6B, FIG. 6D and FIG. 6E are schematic diagrams of a UI in which a preview image displayed in each area is adjusted during the preview process of a multi-channel video recording according to an embodiment;

[0058] FIG. 6C and FIG. 6F are schematic diagrams of image cropping when a preview image displayed in each area is adjusted during the preview process of a multi-channel video recording according to an embodiment;

[0059] FIG. 7A, FIG. 7B, FIG. 7D and FIG. 7E are schematic diagrams of a UI in which a preview image displayed in each area is adjusted during the preview process of a multi-channel video recording according to another embodiment;

[0060] FIG. 7C and FIG. 7F are schematic diagrams of image cropping when a preview image displayed in each area is adjusted during the preview process of a multi-channel video recording according to another embodiment;

[0061] FIG. 8A and FIG. 8B are schematic diagrams of image cropping when a preview image displayed in each area is adjusted during the preview process of a multi-channel video recording according to another embodiment;

[0062] FIG. 9A - fig. 9C are schematic diagrams of a UI in which a preview image displayed in each area is adjusted during the preview process of a multi-channel video recording according to another embodiment;

[0063] FIG. 9D and FIG. 9E are schematic diagrams of image cropping when a preview image displayed in each area is adjusted during the preview process of a multi-channel video recording according to another embodiment;

[0064] FIG. 10A-1 - fig. 10B-2 are schematic diagrams of a UI that prompts a user to position a preview image displayed in each area during the preview process of a multi-channel video recording, according to an embodiment;

[0065] FIG. 11A - fig. 11F are schematic diagrams of a UI in which a preview image displayed in each area is adjusted during the multi-channel video recording process according to the embodiment;

[0066] FIG. 12A and FIG. 12B are schematic diagrams of a UI in which a preview image displayed in each area is adjusted by moving the electronic device while previewing a multi-channel video recording according to an embodiment;

[0067] FIG. 13A and FIG. 13B are schematic diagrams of a UI in which a preview image displayed in each area is adjusted in the multi-channel photograph preview process according to the embodiment;

[0068] FIG. 14 is a schematic diagram of the interaction between some software and hardware of an electronic device according to an embodiment; And

[0069] FIG. 15 is a flowchart of a framing method for recording multi-channel video according to an embodiment.

Description of Embodiments

[0070] The terms used in the following embodiments of this application are intended to describe specific embodiments only and are not intended to limit this application. The terms “one”, “that”, “the above”, “this” and the like in the singular forms used in this specification and in the appended claims of this application are also intended to include plural forms unless otherwise expressly stated in context. In addition, it should be understood that the term “and/or” as used in this application indicates and includes any one or all possible combinations of one or more of the listed elements.

[0071] The present application provides a framing method for recording multi-channel video that can be applied to an electronic device including multiple cameras. An electronic device can simultaneously use multiple cameras to record photos or videos to obtain multiple image channels and more complete image information. In addition, the electronic device may further support the user to separately adjust the framing of each working camera in the preview area corresponding to the working camera during multi-channel photo or video recording, so that the framing of each working camera in the preview area corresponding to the working camera does not affect each other to each other to avoid the problem that changing the framing of a working camera in the corresponding preview area causes the framing of another working camera in the corresponding preview area to change.

[0072] The framing range (also called field of view, FOV) of a camera is determined by the design of the camera's optical system. For example, a wide-angle camera has a large cropping range. The user can adjust the camera's framing by moving the electronic device. In embodiments of the present application, the framing of a camera in a corresponding camera preview area can be adjusted by a user operation (eg, a sliding left or right operation) performed on the preview area. The camera crop in the corresponding camera preview area is the content displayed in the corresponding preview area.

[0073] The camera is used to display part or all of the camera image in the corresponding preview area. The preview image displayed by the camera in the corresponding preview area is, in particular, the image in the cropping area in the image captured by the camera, that is, the preview image displayed in the preview area is obtained by cropping the image captured by the camera.

[0074] In embodiments of the present application, multi-channel imaging may include multi-channel video recording and multi-channel still photography. The electronic device can provide two modes of multi-channel image capture: multi-channel video mode and multi-channel photo mode.

[0075] Multi-channel video mode may mean that multiple cameras in an electronic device, such as a front camera and a rear camera, can simultaneously record multi-channel videos. In multi-channel video mode, while previewing a video or video recording or while playing back recorded video, the display can simultaneously display multiple images from multiple cameras on the same interface. Multiple images can be stitched and displayed on the same interface or displayed in picture-in-picture mode. The display method is described in detail in the following embodiments. Additionally, in multi-channel video mode, multiple images can be stored as multiple videos in a gallery (which may also be called an album) or as a synthesized video formed by combining multiple videos.

[0076] "Video recording" may also be referred to as "video recording". In the following embodiments of this application, “video recording” and “video recording” have the same meaning.

[0077] Multi-photo mode may mean that multiple cameras in an electronic device, such as a front camera and a rear camera, can capture multiple images simultaneously. In multi-photo mode, while previewing a photo, the display can simultaneously display multiple frames of images from multiple cameras within the viewfinder frame (which may also be called a preview frame). Multiple frames of images can be stitched together and displayed in a viewfinder frame or displayed in picture-in-picture mode. In addition, in multi-channel photo mode, multiple image frames can be saved as multiple images in a gallery (which may also be called an album) or a composite image formed by stitching together multiple image frames.

[0078] In embodiments of the present application, the image displayed in the preview frame from the camera is obtained by cropping the image captured by the camera. For the cutting method, see the descriptions of the following embodiments.

[0079] “Multi-channel photo mode” and “multi-channel video mode” are just some names used in the embodiments of the present application, the meanings represented by the names have been written in the embodiments of the present application, and the names should not represent any restrictions embodiments.

[0080] First, an electronic device provided in embodiments of this application is described.

[0081] The electronic device may be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR)/virtual reality (VR) device, a laptop, an ultra-mobile personal computer ( ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), or dedicated camera (such as a single-lens reflex camera or compact camera). The specific type of electronic device is not limited in this application.

[0082] FIG. Figure 1 shows an example of the structure of an electronic device. As shown in FIG. 1, the electronic device 100 may have a plurality of cameras 193, such as a front camera, a wide-angle camera, an ultra-wide-angle camera, and a telephoto camera. In addition, the electronic device 100 may further include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging control module 140, a power management module 141, a battery 142, and an antenna. 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headset jack 170D, sensor module 180, button 190, electric motor 191, indicator 192, display 194, interface 195 subscriber identification module (SIM) cards, etc.

[0083] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an atmospheric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, an optical proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a sensor 180K touch, 180L ambient light sensor, 180M bone conduction sensor, etc.

[0084] It will be understood that the structure shown in this embodiment of this application does not place particular limitations on the electronic device 100. In some other embodiments of this application, the electronic device 100 may include more or fewer components than shown in the figure, or some components may be combined, or some components may be separated, or a different arrangement of components may be used. The components shown in the figure may be implemented using hardware, software, or a combination of software and hardware.

[0085] Processor 110 may include one or more processing units. For example, processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital digital signal processor (DSP), baseband processor, neural-network processing unit (NPU), and/or the like. The various processing units may be independent components or may be integrated into one or more processors.

[0086] In some embodiments, the processor 110, such as a controller or GPU, may be configured to: - in a multi-image capture scenario - synthesize, by stitching, partial overlay, etc., multiple frames of images simultaneously captured by multiple cameras 193 , into a preview image displayed in the viewfinder frame, so that the electronic device 100 can simultaneously display images captured by a plurality of cameras 193.

[0087] In some other embodiments, the processor 110, such as a controller or GPU, may be further configured to: in a multi-image capture scenario, perform image stabilization processing on the image captured by each camera 193, and then synthesize the images captured after image stabilization processing and corresponding to multiple cameras 193.

[0088] The controller may be the "nerve center" and command center of the electronic device 100. The controller may generate an operation control signal based on the instruction operation code and the timing signal to complete control of instruction reading and instruction execution.

[0089] Memory may be further located in processor 110 and configured to store instructions and data. In some embodiments, the memory in processor 110 is a cache. The memory may store instructions or data just used or cyclically used by the processor 110. If the processor 110 needs to use the instructions or data again, the processor 110 may directly recall the instructions or data from the memory. This avoids re-accesses, reduces processor 110 latency, and improves system efficiency.

[0090] In some embodiments, processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter interface (universal asynchronous receiver/transmitter, UART), mobile industry processor interface (MIPI), general-purpose input/output (GPIO), subscriber identity module (SIM) interface ), universal serial bus (USB) interface and/or the like. It can be understood that the interface connection relationship between the modules shown in this embodiment of this application is merely an example for description and does not impose restrictions on the structure of the electronic device 100. In some other embodiments of the present application, the electronic device 100 may alternatively use an interface connection method, different from the connection method in the previous embodiment, or use a combination of multiple interface connection methods.

[0091] The charging control module 140 is configured to receive charging input from charging. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging control module 140 may receive charging input from a wired charger via a USB interface 130. In some wireless charging embodiments, the charging control module 140 may receive charging input from a wireless charging device through the wireless charging coil of the electronic device 100. The charging control 140 supplies power to the electronic device through the power control module 141 while charging the battery 142.

[0092] Power management module 141 is configured to connect to battery 142, charging management module 140, and processor 110. Power management module 141 receives input from battery 142 and/or charging management module 140 to supply power to processor 110, internal memory 121, external memory, display 194, camera 193, wireless communication module. 160 and the like. The power management module 141 may be further configured to monitor parameters such as battery capacity, number of battery cycles, and battery health status (current leakage or impedance).

[0093] In some other embodiments, the power management module 141 may alternatively be located in the processor 110. In some other embodiments, the power management module 141 and the charging control module 140 may alternatively be located in the same device.

[0094] The wireless communication function of the electronic device 100 may be implemented by an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a modem processor, a baseband processor, and the like.

[0095] Antenna 1 and antenna 2 are configured to transmit and receive an electromagnetic wave signal. Each antenna in electronic device 100 may be configured to cover one or more communication frequency bands. Different antennas can be further multiplexed to improve antenna utilization. For example, antenna 1 may be multiplexed as a wireless LAN diversity antenna. In some other embodiments, the antenna may be used in combination with a tuning switch.

[0096] Mobile communication module 150 may provide a solution applied to electronic device 100 for wireless communications, including 2G, 3G, 4G, 5G, and the like. Mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like. The mobile communication unit 150 may receive the electromagnetic wave through the antenna 1, perform processing such as filtering or amplifying the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may further amplify the signal modulated by the modem processor and convert the signal into an electromagnetic wave for radiation through the antenna 1.

[0097] Wireless communication module 160 may provide a wireless communication solution that is applied to electronic device 100 and that includes wireless local area network (WLAN) (eg, wireless fidelity, Wi-Fi), Bluetooth (BT) ), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, or the like. Wireless communication module 160 may be one or more components integrating at least one communication processor module. The wireless communication module 160 receives the electromagnetic wave through the antenna 2, performs frequency modulation and filtering of the electromagnetic wave signal, and sends the processed signal to the processor 110. The wireless communication module 160 may further receive the signal to be sent from the processor 110, perform frequency modulation and amplification of the signal, and convert the signal. into an electromagnetic wave for radiation through antenna 2.

[0098] In some embodiments, in the electronic device 100, the antenna 1 and the mobile communication module 150 are connected, and the antenna 2 and the wireless communication module 160 are connected, so that the electronic device 100 can communicate with a network and another device via wireless communication technology. Wireless technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, IR technologies and/or the like. GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system system, QZSS) and/or satellite based augmentation system (SBAS).

[0099] The external memory interface 120 may be configured to connect to an external memory card, such as a micro SD card, to enhance the storage capabilities of the electronic device 100. The external memory card interfaces with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored on an external memory card.

[00100] The internal memory 121 may be configured to store computer-executable program code, where the executable program code includes instructions. The processor 110 executes instructions stored in the internal memory 121 to perform various functional applications of the electronic device 100 and process data. The internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required by at least one function (eg, a voice playback function or an image playback function), and the like. The data storage area may store data (such as audio data and address book) created during use of the electronic device 100, and the like. In addition, internal memory 121 may include high-speed random access memory, and may include non-volatile memory, such as at least one magnetic disk storage device, flash memory, or universal flash storage (UFS).

[00101] The electronic device 100 may implement an audio function, such as playing and recording music, through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, an application processor, and the like. The audio module 170 is configured to convert digital audio information into an analog audio signal for output, and is also configured to convert an analog audio input to a digital audio signal. Audio module 170 may be further configured to encode and decode an audio signal. In some embodiments, the audio module 170 may be located in the processor 110, or some of the functional modules in the audio module 170 are located in the processor 110.

[00102] The pressure sensor 180A is configured to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, pressure sensor 180A may be located on display 194. There are many types of pressure sensors 180A, such as resistive pressure sensor, inductive pressure sensor, and capacitive pressure sensor. The capacitive pressure sensor may include at least two parallel plates of conductive materials. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is performed on the display 194, the electronic device 100 detects the intensity of the touch operation using the pressure sensor 180A. The electronic device 100 may also calculate the location of the touch based on the detection signal of the pressure sensor 180A.

[00103] The gyroscope sensor 180B may be configured to determine the position of movement of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 about three axes (namely, the x, y, and z axes) may be determined using the gyroscope sensor 180B. The gyroscope sensor 180B may be configured to implement image stabilization during image capture. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle at which the electronic device 100 shakes, calculates based on the angle the distance that the lens module needs to compensate, and allows the lens to compensate for the shake of the electronic device 100 through reverse motion to realize image stabilization. The gyroscope sensor 180B can also be used in a navigation scenario and a somatic game scenario.

[00104] The atmospheric pressure sensor 180C is configured to measure atmospheric pressure. In some embodiments, electronic device 100 calculates altitude from barometric pressure measured by barometric pressure sensor 180C to aid in positioning and navigation.

[00105] Magnetic sensor 180D includes a Hall effect sensor. The electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 may detect the opening and closing of the flip cover based on the magnetic sensor 180D. In addition, a function such as automatic unlocking of the flip cover is set based on the detected state of opening or closing the leather case or the detected state of opening or closing the flip cover.

[00106] Acceleration sensor 180E can detect accelerations in various directions (typically three axes) of the electronic device 100. When the electronic device 100 is stationary, the magnitude and direction of gravity can be determined. Acceleration sensor 180E may further be configured to detect the position of an electronic device and be used in an application such as switching between landscape mode and portrait mode or a pedometer.

[00107] The distance sensor 180F is configured to measure distance. Electronic device 100 may measure distance using infrared or laser methods. In some embodiments, in an image capture scenario, the electronic device 100 may measure a distance using the distance sensor 180F to achieve rapid focusing.

[00108] The optical proximity sensor 180G may include, for example, a light-emitting diode (LED) and an optical sensor, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light using a light-emitting diode. Electronic device 100 detects infrared light reflected from a nearby object through a photodiode. When sufficient reflected light is detected, it can be determined that there is an object in the vicinity of the electronic device 100. When detecting insufficiently reflected light, the electronic device 100 may determine that there is no object near the electronic device 100. The electronic device 100 can detect, through the optical proximity sensor 180G, that the user is holding the electronic device 100 close to the ear during a call to automatically turn off the screen to save power. The 180G optical proximity sensor can also be used in smart cover mode or pocket mode to automatically unlock or lock the screen.

[00109] The ambient light sensor 180L is configured to detect the brightness of the ambient light. The electronic device 100 may adaptively adjust the brightness of the display 194 based on the perceived brightness of ambient light. The ambient light sensor 180L may also be configured to automatically adjust the white balance during photography. The ambient light sensor 180L may also cooperate with the optical proximity sensor 180G to determine whether the electronic device 100 is in a pocket to avoid accidental touching.

[00110] The fingerprint sensor 180H is configured to collect fingerprints. The electronic device 100 may use the collected fingerprint characteristic to perform fingerprint-based unlocking, application lock access, fingerprint-based photo taking, fingerprint-based call answering, and the like.

[00111] The temperature sensor 180J is configured to detect temperature. In some embodiments, electronic device 100 implements a temperature processing policy by means of a temperature detected by temperature sensor 180J. For example, when the temperature reported by temperature sensor 180J exceeds a threshold value, electronic device 100 reduces the performance of a processor adjacent to temperature sensor 180J to reduce power consumption for thermal protection. In some other embodiments, when the temperature is less than another threshold value, the electronic device 100 heats the battery 142 to prevent the electronic device 100 from shutting down due to low temperature. In some other embodiments, when the temperature is below another threshold value, the electronic device 100 increases the output voltage of the battery 142 to avoid a low temperature shutdown.

[00112] The 180K touch sensor is also called a "touch pad". The touch sensor 180K may be located on the display 194, and the touch sensor 180K and the display 194 constitute a touch screen, which is also referred to as a “touch screen.” The touch sensor 180K is configured to detect a touch operation performed on or adjacent to the touch sensor. The touch sensor may communicate the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation may be provided through the display 194. In some other embodiments, the touch sensor 180K may also be located on the surface of the electronic device 100 at a location different from the position of the display 194.

[00113] The bone conduction sensor 180M may receive a vibration signal. In some embodiments, the bone conduction sensor 180M may receive a vibration signal from the vibration of the human vocal cord bone. The 180M bone conduction sensor can also be in contact with the body's pulse to receive the blood pressure pulsation signal. In some embodiments, the bone conduction sensor 180M may also be located in the headset to provide the bone conduction headset may alternatively be located in the headset. The audio module 170 may obtain a speech signal by parsing based on a vibration signal that originates from the vocal cord vibration bone and that is received by the bone conduction sensor 180M, for. The application processor can analyze the heart rate information based on the blood pressure pulsation signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[00114] Button 190 includes a power button, a volume button, and the like. The button 190 may be a mechanical button or a touch button. Electronic device 100 may receive button input and generate button signal input associated with user configuration and control of functions of electronic device 100.

[00115] The electric motor 191 may generate a vibration prompt. The electric motor 191 may be configured to provide a vibration prompt of an incoming call and touch vibration feedback. For example, touch operations performed in different applications (such as taking photos and playing audio) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects for touch operations performed on different areas of the display 194. Different application scenarios (eg, time reminder, information retrieval, alarm, game) may also correspond to different vibration feedback effects. The touch vibration feedback effect can be further customized.

[00116] The indicator 192 may be an indicator light and may be configured to indicate charging status and power changes, or may be configured to indicate a message, missed call, notification, or the like.

[00117] The SIM card interface 195 is configured to connect to a SIM card. A SIM card may be inserted into or removed from the SIM card interface 195 to allow contact with or separation from the electronic device 100 . Electronic device 100 may support one or more SIM card interfaces. The SIM card interface 195 may support a nano SIM card, a micro SIM card, a SIM card, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The plurality of cards may be of the same type or of different types. The SIM card interface 195 may be compatible with various types of SIM cards. The SIM card interface 195 is also compatible with an external memory card. The electronic device 100 communicates with the network via a SIM card to perform functions such as talking and data transfer. In some embodiments, electronic device 100 uses an eSIM, that is, an embedded SIM card. The eSIM card may be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[00118] The electronic device 100 may implement an image capture function through an ISP, camera 193, video codec, GPU, display 194, application processor, or the like.

[00119] The ISP is configured to process data returned by the camera 193. For example, when taking a photograph, the shutter is pressed and light is transmitted to the camera's photosensitive element through the lens. The optical signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing to convert the electrical signal into a visible image. The ISP can further optimize the algorithm for noise, brightness and color of the image. The ISP can further optimize parameters such as exposure and color temperature of the image shooting scenario. Not limited to integration into processor 110, the ISP may also be located within chamber 193.

[00120] In this embodiment of the present application, there may be M cameras 193, M ≥ 2, and M is a positive integer. The electronic device 100 may include N cameras during multi-channel image capture, N ≤ M, and N is a positive integer. The camera turned on by the electronic device 100 during multi-channel image capture may also be called a working camera.

[00121] Camera 193 includes a lens and a photosensitive element (which may also be referred to as an image sensor) and is configured to capture a still image or video. An optical image of an object is formed through a lens and projected onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a phototransistor based on a complementary metal-oxide-semiconductor (CMOS) structure. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert the electrical signal into a digital image signal, such as an image signal in standard RGB or YUV format.

[00122] The hardware configurations and physical positions of the cameras 193 may vary. Therefore, sizes, ranges, content, clarity, etc. Images captured by different cameras may vary.

[00123] The sizes of the output images of the cameras 193 may be different or may be the same. The camera output image size refers to the length and width of the image captured by the camera. Both the length and width of an image can be measured using the number of pixels. The camera output image size may also be called image size, image size, pixel size, or image resolution. Typical camera output ratios may include 4:3, 16:9, 3:2, and the like. Output image size ratio refers to the approximate ratio of the number of pixels along the length to the number of pixels across the width of the image captured by the camera.

[00124] The camera 193 may correspond to the same focal length or may correspond to different focal lengths. The focal length may include, but is not limited to: a first focal length less than a predetermined value 1 (e.g., 20 mm), a second focal length greater than or equal to a predetermined value 1 and less than or equal to a predetermined value 2 (e.g., 50 mm), and a third focal length distance is greater than the specified value 2. The camera corresponding to the first focal length may be called an ultra-wide-angle camera, the camera corresponding to the second focal length may be called a wide-angle camera, and the camera corresponding to the third focal length may be called a long-angle camera. A larger focal length corresponding to a camera indicates a smaller field of view (FOV) of the camera. Field of view refers to the range of angles over which an optical system can perform imaging.

[00125] Camera 193 may be located on both sides of the electronic device. A camera located in the same plane as the display 194 of the electronic device may be referred to as a front camera, and a camera located in the plane on which the rear cover of the electronic device is located may be referred to as a rear camera. The front camera may be configured to capture an image of a photographer facing the display 194, and the rear camera may be configured to capture an image of the subject being photographed (e.g., a person or landscape) facing the photographer.

[00126] In some embodiments, camera 193 may be configured to collect depth data. For example, camera 193 may have a 3D time-of-flight (TOF) sensing module or a 3D structured light sensing module configured to obtain depth information. The camera configured to collect depth data may be a front camera or a rear camera.

[00127] The video codec is configured to compress or decompress a digital image. Electronic device 100 may support one or more image codecs. Thus, the electronic device 100 can access or store images or videos in a variety of encoding formats.

[00128] The electronic device 100 may implement a display function using a GPU, display 194, application processor, or the like. The GPU is an image processing microprocessor and interfaces with the display 194 and application processor. The GPU is configured to: perform mathematical and geometric calculations and image rendering. Processor 110 may include one or more GPUs that execute software instructions to create or modify display information.

[00129] The display 194 is configured to display an image, video, or the like. Display 194 includes a display panel. The display panel can be a liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode (AMOLED), flexible light -emitting diode, FLED), mini-LED, micro-LED, micro-OLED, quantum dot LED (quantum dot light-emitting diode, QLED) and the like. In some embodiments, electronic device 100 may include one or more displays 194.

[00130] In some embodiments, in a multi-channel imaging scenario, the display 194 may display multi-channel images from multiple cameras 193 in a stitched or picture-in-picture manner such that multi-channel images from multiple cameras 193 can be simultaneously presented to the user.

[00131] In some embodiments, in multi-channel imaging mode, processor 110 (e.g., a controller or GPU) may synthesize multiple image frames from multiple cameras 193. For example, multi-channel video streams from multiple cameras 193 are combined into a single video stream, and a video encoder in processor 110 may encode synthesized video stream data to create a video file. Thus, each image frame in a video file may include multiple images from multiple cameras 193. When an image frame of the video file is played, display 194 may display multi-channel images from multiple cameras 193 to present the user with multiple images with different ranges, different resolutions, or different details. information at the same moment or in the same scenario.

[00132] In some embodiments, in multi-imaging mode, processor 110 may separately link image frames from different cameras 193 so that when the captured image or video is played back, display 194 may simultaneously display the associated image frame in the viewfinder frame. In this case, videos simultaneously recorded by different cameras 193 can be stored separately as different videos, and images simultaneously captured by different cameras 193 can be stored separately as different images.

[00133] In some embodiments, in multi-channel video mode, multiple cameras 193 may individually capture images at the same frame rate. In other words, multiple cameras 193 capture the same number of image frames at the same time. Videos from different cameras 193 can be stored separately as different video files, and different video files are linked to each other. In video files, image frames are stored in an image frame capture sequence, and different video files include the same number of image frames. When the recorded videos are played back, the display 194 can perform display based on a preset position method or a user-specified position method, and in sequences of image frames included in related video files, to display on the same interface multiple image frames corresponding to the same sequence and located in different video files.

[00134] In some embodiments, in multi-channel video mode, multiple cameras 193 may individually capture images at the same frame rate. In other words, multiple cameras 193 capture the same number of image frames at the same time. The processor 110 may separately add a timestamp to each image frame from different cameras 193, so that when playing back recorded video, the display 194 can simultaneously display multiple image frames from multiple cameras 193 on the same interface according to the time stamp.

[00135] The image displayed by the electronic device in the preview frame from the camera is obtained by cropping the image captured by the camera. For a method in which an electronic device crops an image captured by a camera, see the descriptions of the following embodiments.

[00136] For ease of use, the electronic device typically performs image capture in the user's manual mode. However, the image captured in manual mode tends to be shaky for the user. In some embodiments, in multi-image mode, processor 110 may separately perform image stabilization processing for image frames captured by different cameras 193. The display 194 then displays the image obtained after the image stabilization processing.

[00137] An example of a user interface that is located on the electronic device 100 and that is used for an application menu is described below.

[00138] FIG. 2A shows an example of a user interface 21 that is located on the electronic device 100 and that is used for an application menu. As shown in FIG. 2A, the electronic device 100 may be provided with a plurality of cameras 193, and the plurality of cameras 193 may include a front camera and a rear camera. There may be a plurality of front cameras, for example, a front camera 193-1 and a front camera 193-2. As shown in FIG. 2A, the front camera 193-1 and the front camera 193-2 may be located on top of the electronic device 100, for example, in a “notch” position of the electronic device 100 (ie, area AA shown in FIG. 2A). It can be learned that in addition to the camera 193, area AA may further include an illuminator 197 (not shown in FIG. 1), a speaker 170A, an optical proximity sensor 180G, an ambient light sensor 180L, and the like. In some embodiments, as shown in FIG. 2B, a rear camera 193 and an illuminator 197 may also be located on the rear side of the electronic device 100. There may be a plurality of rear cameras 193, such as a wide-angle rear camera 193-3, an ultra-wide-angle rear camera 193-4, and a long-angle rear camera 193-5.

[00139] As shown in FIG. 2A, the user interface 21 may include a status bar 201, a general application icon bar 223, a calendar indicator 203, a weather indicator 205, a navigation bar 225, and another application icon.

[00140] Status line 201 may include one or more mobile signal strength indicators 201-1 (which may also be referred to as cellular signal), mobile signal carrier indicator 201-2, time indicator 201. 3, battery status indicator 201-4, etc.

[00141] The calendar indicator 203 may be used to indicate the current time, such as the date, day of the week, and hour and minute information.

[00142] Weather indicator 205 may be used to indicate the type of weather, such as cloudy to clear or light rain, and may further be used to indicate information such as temperature.

[00143] Tray 223 having a general application icon may display a Phone icon 223-1, a Messages icon 223-2, a Contacts icon 221-4, and the like.

[00144] The navigation bar 225 may include system navigation buttons such as a back button 225-1, a Home screen button 225-3, and a callout history button 225-5. When detecting that the user touches the back button 225-1, the electronic device 100 may display the previous page of the current page. When detecting that the user touches the home screen button 225-3, the electronic device 100 may display the home screen. When detecting that the user touches the callout history button 225-5, the electronic device 100 may display a task recently opened by the user. Alternatively, the names of the navigation buttons may be different. This is definitely not limited in this application. Not limited to a virtual button, each navigation button on the navigation bar 225 may alternatively be implemented as a physical button.

[00145] Other application icons may be, for example, a WeChat icon 211, a QQ icon 212, a Twitter icon 213, a Facebook icon 214, an email icon 215, a Cloud Storage icon 216, a Memo icon 217, a Settings icon 218 , a Gallery icon 219 , and a Camera icon 220 . The user interface 21 may further include a page indicator 221 . Other application icons may be distributed across multiple pages, and the page indicator 221 may be used to indicate the specific page on which the user is currently viewing the application. The user can swipe left or right in an area that includes other application icons to view the application icon on another page. When detecting that the user touches these application icons, the electronic device 100 may display the user interface of the application.

[00146] In some embodiments, the user interface 21 shown in FIG. 2A can be the Home screen.

[00147] In some other embodiments, the electronic device 100 may further include a home screen button. The home screen button may be a physical button or may be a virtual button (eg, button 225-3). The home screen button can be used to receive instructions from the user and return the currently displayed UI to the home screen so that the user can view the home screen at any time.

[00148] It can be understood that FIG. 2A merely shows an example of a user interface on electronic device 100 and is not intended to be limiting to this embodiment of the present application.

[00149] The following describes separately a typical photography scenario in this application: a two-channel video recording scenario.

[00150] As shown in FIG. 3A, the electronic device may detect a touch operation performed on the camera icon 220 (eg, a press operation of the icon 220). In response to the operation, the electronic device may display a user interface 31 shown in FIG. 3B. The user interface 31 may be a user interface of the default photo shooting mode "Camera" and can be used by the user to take photos using the default rear camera. Camera is an application for taking pictures on an electronic device such as a smartphone or tablet. The application name is not limited in this application. In other words, the user can touch the icon 220 to open the Camera user interface 31 . It doesn't stop there. The user may optionally open the user interface 31 in another application. For example, the user touches the image capture control in WeChat to open the user interface 31 WeChat is a social application that allows the user to share the captured image with others.

[00151] FIG. 3B shows an example of a Camera user interface 31 on an electronic device such as a smartphone. As shown in FIG. 3B, the user interface 31 may include an area 301, an image capture mode list 302, a control 303, a control 304, and a control 305.

[00152] The area 301 may be referred to as a preview frame 301 or a viewfinder frame 301. The preview frame 301 may be used to display the image captured by the camera 193 in real time. The electronic device may update the displayed content in the area 301 in real time so that the user previews the image currently captured by the camera 193.

[00153] One or more image capture mode options may be displayed in the image capture mode list 302. The one or more image capturing options may include: photo mode option 302A, video mode option 302B, multi-channel photo mode option 302C, multi-channel video mode option 302D, and an additional option 302E. One or more image capture options may be presented as text information on the interface, such as “photo,” “video,” “multi-channel photo,” “multi-channel video,” and “more.” It doesn't stop there. Alternatively, one or more image capture options may be presented as icons or other forms of interactive elements (IEs) on the interface.

[00154] The control 303 may be configured to listen to (monitor) user operations that trigger image capture (photographing or video recording). The electronic device may detect a user operation on the control 303 (eg, a click operation on the control 303), and in response to the operation, the electronic device 100 may store the image in the preview frame 301 as a “Gallery” image. When the user switches to video mode, control 303 may be changed to control 901. The electronic device may detect a user operation on the control element 901 (eg, a pressing operation on the control element 901). In response to the operation, the electronic device 100 may store the image in the preview frame 301 as a video in the “Gallery”. Here, "Gallery" is an application for managing images in an electronic device such as a smartphone or tablet computer and may also be referred to as "Album". In this embodiment, the application name is not limited. The gallery may support a user to perform various operations on an image stored in an electronic device, such as viewing, editing, deleting, and selecting. In addition, the electronic device 100 may further display a thumbnail of the stored image in the control 304. In other words, the user can touch the control 303 or the control 901 to initiate capturing an image. Control 303 or control 901 may be a button or other form of control. In this application, control 303 may be referred to as a photograph control and control 901 may be referred to as a video recording control. The control 303 and the control 901 may be collectively referred to as an image capture control.

[00155] Control 305 may be configured to listen to user operations that trigger camera switching. The electronic device 100 may detect a user operation on the control 305 (eg, a press operation on the control 305), and in response to the operation, the electronic device 100 may flip the camera, such as switching the rear camera to the front camera. In this case, as shown in FIG. 3C, an image captured by the front camera is displayed in a preview frame 301.

[00156] The electronic device 100 may detect a user operation performed on an image capture mode option, and the user operation may be used to select an image capture mode. In response to the operation, the electronic device 100 may enable an image capture mode selected by the user. In particular, when the user operation is performed with the additional image shooting mode option 302E, the electronic device 100 may further display more other image shooting mode options, such as the slow image shooting mode option, to present more extensive image shooting functions to the user. Without being limited to what is shown in FIG. 3B, the additional image capture mode option 302E may not be displayed in the image capture mode list 302, and the user can view other image capture mode options by swiping left/right in the image capture mode list 302.

[00157] It can be learned that the user interface 31 can display to the user a variety of image capturing functions (modes) provided by the Camera, and the user can select to enable the image capturing mode by touching the corresponding image capturing mode option.

[00158] For example, when a user operation (eg, a click operation) to select the multi-channel video mode 302D is detected, the electronic device 100 may display the user interface shown in FIG. 3D. The preview frame 301 displays images from both the front camera and the rear camera. In some embodiments, electronic device 100 may enable multi-channel video mode by default upon launching Camera. It doesn't stop there. The electronic device 100 may further enable a multi-channel video mode in another manner. For example, the electronic device 100 may further enable a multi-channel video mode in accordance with voice instructions from the user. This is not limited in this embodiment of the present application.

[00159] It can be learned that, compared with the photo mode or video mode, images from multiple cameras are simultaneously displayed in the preview frame 301 in the multi-channel video mode. The preview frame 301 includes two preview areas 301A and 301B. The rear camera image is displayed at step 301A, and the front camera image is displayed at step 301B.

[00160] Two-channel video recording is used as an example. Next, the principle of two-channel video recording will be described with reference to FIG. 4A. As shown in FIG. 4A assumes that both the front camera and the rear camera involved in dual-channel video recording output frames in an aspect ratio of 16:9 (the frame output specification is the same as in normal photo shooting mode). The ISP converts the image frame output by the camera into a standard format image (eg, YUV), crops the image frame output by the front camera to the ratio (eg, 10.5:9) required for the given area 301A, and crops the image frame output by the rear camera to the ratio (eg, 9:9) required by area 301B. The ISP then passes the output image to the HAL layer. After the HAL performs electronic image stabilization (EIS) processing on the image, the image processing module stitches the two image channels. The display can then display the stitched image. The image processing module may include an image processor, a video codec, a digital signal processor, and the like. in an electronic device 100.

[00161] In this process, the display may additionally listen for the zoom event and transmit the zoom factor to the ISP and the corresponding camera. The display can optionally listen for a camera switch event and transmit the event to the appropriate camera.

[00162] FIG. 4B is a schematic diagram of ISP processing by a method of center cropping an image output from a camera. As shown in FIG. 4B, the rear camera of the electronic device captures an image of a. The electronic device crops image a to obtain image a1 in the cropping area. The cropping area uses the center point O of image a as the center and has the same ratio and size as the area 301A. In other words, the crop area is the area where the dotted frame is located on the image. Image a is displayed in area 301A, that is, image a is a preview image in area 301A.

[00163] Similarly, the front camera of the electronic device captures image b. The electronic device crops image b to obtain image b1 in the cropping area. The cropping area uses the center point O of image b as the center and has the same ratio and size as the area 301B. In other words, the crop area is the area where the dotted frame is located on the image. Image b is displayed in the area 301B, that is, image b is a preview image in the area 301B.

[00164] When performing multi-channel image capture using an electronic device, the user can change, by moving the electronic device, the framing of one of the cameras in the preview area corresponding to the camera. However, in this case, moving the electronic device, that is, changing the position of the electronic device, causes the framing of the remaining camera in the corresponding preview area to change. This change may be unnecessary or unexpected to the user. When an electronic device is moved to change the framing of one of the cameras in the preview area corresponding to the camera, it cannot be guaranteed that the framing of the other camera in the corresponding preview area will remain unchanged. In other words, when capturing a multi-channel image, the user cannot take into account the cropping of each camera in the corresponding preview area.

[00165] This is not limited to the dual-channel image capture shown in the above UI embodiments as an example, and the electronic device may alternatively enter the multi-channel image capture mode.

[00166] FIG. 5 shows an example of a user interface displayed during four-channel video recording after the electronic device 100 turns on the “multi-channel video mode.” As shown in FIG. 5, the user interface preview frame may be divided into four areas, from area 301A to area 301D. Each area can be used to display images from different cameras. For example, area 301A may be used to display an image from a wide-angle rear camera 193-3, area 301B may be used to display an image from an ultra-wide-angle rear camera 193-4, area 301C may be used to display an image from a long-angle rear camera 193-5, and area 301D can be used to display the image from the front camera 193-1.

[00167] Based on the above image capture scenario, some embodiments of a user interface (user interface) implemented on the electronic device 100 are now described, using dual-channel image capture as an example.

[00168] First, the user interface of the “multi-channel video mode” is described.

[00169] In some embodiments, electronic device 100 may automatically enter "multi-channel video mode" by default upon startup of "Camera". In some other embodiments, after starting "Camera", if the electronic device 100 does not enter "multi-channel video mode", the electronic device 100 may enter "multi-channel video mode" in response to a detected user operation. For example, the electronic device 100 may detect a touch operation (eg, a press operation) performed on the multi-channel video mode option 302D on the user interface 31 shown in FIG. 3B or FIG. 3C, and enter “multi-channel video mode” in response to the operation. It doesn't stop there. The electronic device 100 may further enter a “multi-channel video mode” in another manner. For example, the electronic device 100 may optionally enter a “multi-channel video mode” in accordance with voice instruction from the user. This is not limited in this embodiment of the present application.

[00170] FIG. 6A shows an example of a preview interface 41 displayed after the electronic device 100 enters the “multi-channel video mode”. As shown in FIG. 6A, the preview interface 41 includes a preview frame 301, an image capture mode list 302, a control 901, a control 304, and a control 305. For a list of image capture modes 302, control 304, and control 305, refer to the corresponding descriptions of the user interface 31. The details are not repeated here. As shown in FIG. 6A, multi-channel video mode option 302C is selected. The control 901 may be configured to listen to user operations that trigger video recording.

[00171] After entering the "multi-channel video mode", the electronic device 100 can capture images using N (eg, 2) cameras and display a preview interface on the display. Part or all of the image from each of the N cameras is displayed in the preview interface.

[00172] After the electronic device 100 enters the “multi-channel video mode,” the preview frame 301 may include N regions, and one region corresponds to one of the N cameras. Each of the different areas is used to display part or all of the image from the corresponding camera.

[00173] The position in the preview frame 301 of each area included in the preview frame 301, the size/size occupied by each area in the preview frame 301, and the camera corresponding to each area may be collectively referred to as a composition method during multi-channel video recording. In some embodiments, the areas included in the preview frame 301 do not overlap each other and are stitched together into the preview frame 301. In other words, the electronic device 100 can display images from N cameras by stitching. In some other embodiments, the areas included in the preview frame 301 may overlap. In other words, the electronic device 100 may display images from the N cameras in a floating or overlay manner.

[00174] For example, when N is 2, see FIG. 6A. The arrangement method during multi-channel video recording shown in FIG. 6A may be as follows: The preview frame 301 is equally divided into left and right areas 301A and 301B, area 301A respectively displays an image from the wide-angle rear camera 193-3, and area 301B respectively displays an image from the front camera 193-1. For example, if we assume that the size (i.e., screen resolution) of an electronic device display is 2340×1080 and the ratio is 19.5:9, the size of the area 301A may be 1248×1080 and the ratio is 10.5:9, where 1248 and 1080 are respectively the number of pixels in the length and width area 301A. The size of the area 301B may be 1088*1080, and the ratio is 10.5:9, where 1088 and 1080 are respectively the number of pixels of the area 301A in terms of length and width. It can be learned that the ratio of the total area obtained after stitching the area 301A and the area 302A is 19.5:9, which is the same as the ratio of the preview frame 301. That is, the area formed by stitching the area 301A and the area 302A fills the display display area. As shown in FIG. 6A, the image in area 301A is an image of the photographed subject (e.g., a person or landscape) facing the photographer, and the image in area 301B is an image of the photographer facing the display 194.

[00175] In another example, when N is 2, the arrangement method during multi-channel video recording may be as follows: The preview frame 301 includes an area 1 and an area 2, area 1 occupies the entire preview frame 301, area 2 is located at the bottom right corner of the preview frame 301 and occupying a quarter of the preview frame 301, area 1 respectively displays an image from the ultra-wide-angle rear camera 193-4, and area 2 respectively displays an image from the wide-angle rear camera 193-3.

[00176] In another example, when N is 3, the arrangement method during multi-channel video recording may be as follows: The preview frame 301 is equally divided into three areas on the left, middle and right. One area respectively displays an image from the long-angle rear camera 193-5, one area respectively displays an image from the ultra-wide-angle rear camera 193-4, and one area respectively displays an image from the front camera 193-1.

[00177] It can be understood that combining is performed based on various situations such as the shape, size and position of each area in the preview frame 301, and there may be many arrangement methods for recording multi-channel video that are not listed here one by one.

[00178] After the electronic device 100 enters the "multi-channel video mode", the number N of cameras and the arrangement method that are used by default for recording multi-channel video may be preset by the electronic device 100 or may be set offline by the user. or it could be the number of cameras and layout method that the user has recently used in "multi-channel video mode".

[00179] In some embodiments, upon entering “multi-channel video mode,” the electronic device 100 may further display in the preview interface a control used by the user to change the number of cameras and layout method. The electronic device 100 may display, in response to a touch operation (eg, a press operation) performed on the control, a setting interface used to set or change the number of cameras, and a layout method used in the “multi-channel video mode.” The user can set or change the number of cameras and the layout method used in the “multi-channel video mode” in the setting interface. The specific implementation of the configuration interface is not limited in this embodiment of this application.

[00180] In some other embodiments, after entering "multi-channel video mode", the electronic device 100 may further change in response to a touch operation (e.g., a press operation) of a control that is in the preview interface and that is used to switch cameras, camera corresponds to an area in the layout. For example, the user may touch control 304 in FIG. 6A to change the camera corresponding to the area 301A from the wide-angle rear camera 193-3 to the ultra-wide-angle rear camera 193-4. In some embodiments, each area in the preview interface may include a corresponding control used to switch a camera, and the electronic device 100 may change, in response to a touch operation of the control used to switch a camera in the preview area, the camera corresponding preview area.

[00181] In some embodiments, upon entering “multi-channel video mode,” the electronic device 100 may further display in each area of the preview interface the camera ID of the corresponding area to prompt the user about the source of the image displayed in each area. The camera ID may be implemented as text, an icon, or other form.

[00182] After the electronic device 100 enters the “multi-channel video mode,” the preview image displayed in each area of the preview frame 301 is part or all of the image of each of the N cameras.

[00183] In some embodiments, after the electronic device 100 turns on the "multi-channel video mode", a preview image displayed in each area of the preview frame 301 may be obtained after the electronic device 100 crops the image captured by the corresponding camera . That is, a portion of the preview image of the corresponding camera is displayed in the preview area. The cutting method may be, for example, center cutting or other cutting method. This is definitely not limited in this application. An electronic device may crop images captured by different cameras differently. The method in which the electronic device crops images captured by the N cameras may be preset by the electronic device, or may be set offline by the user, or may be a cropping method recently used by the user in "multi-channel video mode".

[00184] Center crop means that the electronic device 100 crops from the image, using as the center the center of the image captured by the camera, a portion of the image that is the same size as the corresponding area.

[00185] For example, refer to FIG. 4B. The image captured by the wide-angle rear camera 193-3 is a, and the preview image displayed in the area 301A is a portion that is cropped by the electronic device 100 using the center of the image a as the center and which has the same size as area 301A. Likewise, refer to FIG. 6F. The image captured by the front camera 193-1 is b, and the image displayed in the area 301B is a portion that is cropped by the electronic device 100 using the center of the image b as the center and has the same size as the area 301B.

[00186] In some other embodiments, if the size of the image captured by the camera is the same as the size of the preview area corresponding to the camera, the electronic device 100 may display the image directly in the area without cropping. That is, the preview area displays the image captured by the camera.

[00187] In the following embodiments of the present application, it is assumed that after the electronic device 100 turns on the "multi-channel video mode", the preview image in the area 301A is an image obtained by the electronic device by cropping, in the cropping area centered at point O and having a first size of an image captured by a camera corresponding to the area 301A. That is, after the electronic device 100 turns on the “multi-channel video mode,” the cropping area in the image captured by the camera corresponding to the area 301A uses point O as the center and has a first size.

[00188] FIG. 6A - fig. 6F, fig. 7A - fig. 7F, fig. 8A and FIG. 8B and FIG. 9A - fig. 9E shows exemplary embodiments of adjusting the preview image displayed in each area of the preview interface after the electronic device 100 enters the “multi-channel video mode”.

[00189] It should be noted that in the embodiments shown in FIGS. 6A - fig. 6F, fig. 7A - fig. 7F, fig. 8A and FIG. 8B and FIG. 9A - fig. 9E, the position of the electronic device 100 does not change. In other words, when adjusting the preview image displayed in each area of the electronic device preview interface, the user does not move the electronic device 100. Thus, when the user adjusts the framing of one camera in the preview area corresponding to the camera, it can be ensured that the framing of the other camera in the corresponding preview area will remain unchanged. In other words, the user can view the cropping of each camera in the corresponding preview area when capturing a multi-channel image.

[00190] In addition, although the position of the electronic device 100 does not change, the external environment may change. In other words, the camera of the electronic device 100 can collect an image that is updated in real time.

[00191] In some embodiments, after entering “multi-channel video mode,” the electronic device 100 may adjust the framing of the production camera in the preview area in a non-zooming scenario.

[00192] FIG. 6A - fig. 6F shows an example of the way in which the electronic device 100 adjusts the framing of the production camera in the preview area in a non-zooming scenario.

[00193] See FIG. 6A. The electronic device 100 may detect a sliding operation (eg, a horizontal sliding operation to the left) performed in the area 301A. See fig. 6B. The electronic device 100 may update the cropping area in the image a in response to the sliding operation to update the preview image displayed in the area 301A. Image a is an image captured by the camera corresponding to the area 301A.

[00194] The center of the cropping area in the updated image a is point O1 of image a, and the size of the cropping area is the second dimension. The second size is equal to the first size.

[00195] If the area using O1' as the center and having a second size does not exceed the edge of the image a, then O1 is at the point O1'. If the region using O1' as the center and having the second dimension exceeds the edge of image a, then O1 is at the center of the region coinciding with the edge of image a and having the second dimension.

[00196] O1' is determined by the image point O a and the sliding path corresponding to the sliding operation. Specifically, O1 is located in the first direction O, and the first direction is the reverse direction of the slide path. The distance between O1' and point O is positively correlated with the length of the slip track. In some embodiments, the distance between O1' and point O is equal to the length of the slide track. O is the center of the crop area before the update, and the first size is the size of the crop area before the update.

[00197] FIG. 6C shows an example of an updated cropping area of the electronic device 100. The updated cropping area is an area in which a dotted frame is located. The preview image displayed in the update area 301A is image a1.

[00198] In some embodiments, if the speed at which the user enters the sliding operation exceeds a threshold, the distance between O1 and point O may be the default distance. In other words, when the user slides quickly, the electronic device determines O1 based on the default distance.

[00199] Likewise, refer to FIG. 6D. The electronic device 100 may further detect a sliding operation (eg, a horizontal sliding operation to the right) performed in the area 301B. The user interfaces shown in FIGS. 6D and FIG. 6B are the same. See related descriptions. See fig. 6E. The electronic device 100 may update the cropping area in image b in response to the sliding operation to update the preview image displayed in the area 301B. To see how the electronic device updates the crop area in image b, see the way the electronic device updates the crop area in image a. Fig. 6F shows an example of the updated cropping area in image b of the electronic device 100. The updated cropping area is the area in which the dotted frame is located. The preview image displayed in the update area 301B is image b1.

[00200] According to the embodiments shown in FIG. 6A - fig. 6F, after the electronic device 100 enters the “multi-channel video mode,” the user may be supported to separately adjust the framing of each working camera in the preview area corresponding to the working camera during multi-channel video recording, so that the framing of each working camera is The preview areas corresponding to the working camera do not influence each other, so as to avoid the problem that changing the framing of the working camera in the corresponding preview area causes the framing of another working camera in the corresponding preview area to change. This method of framing during multi-channel video recording is more flexible and convenient, and the user experience can be improved.

[00201] According to the embodiments shown in FIG. 6A - fig. 6F, the electronic device may display a preview interface and part or all of the image captured by each of the N (eg, 2) cameras. The preview interface includes N regions, and part or all of the image captured by each of the N cameras is displayed in one of the N regions.

[00202] Here, the preview area typically displays a portion of the image captured by the corresponding camera. However, when the user reduces the zoom factor (eg 0.7X), the preview area can display the entire image captured by the corresponding camera.

[00203] The first region (eg, region 301A) may be one of N regions, and the camera corresponding to the first region may be referred to as the first camera (eg, camera corresponding to region 301A). The first area may display an image captured by the electronic device by cropping the entire image captured by the first camera before the cropping method is changed based on the user's operation. Until the cropping method is changed, the method in which the electronic device crops the entire image captured by the first camera is not limited in embodiments of this application. In a specific embodiment, before changing the cropping method, in this embodiment of the present application, the electronic device crops the entire image captured by the first camera using the center cropping method.

[00204] If the electronic device detects a sliding operation in the first area, the electronic device may change, based on the sliding operation, a method of cropping the entire image captured by the first camera to update the preview image displayed in the first area. Before and after the update, the electronic device crops the entire image captured by the first camera differently. In the entire image captured by the first camera, the position of the preview images before and after updating is different in the entire image captured by the first camera.

[00205] For example, the position of the preview image displayed in the first area before updating may be, for example, the position of the cropping area before updating in FIG. 6A - fig. 6F, or the position of the preview image displayed in the first area before updating may be, for example, the position of the cropping area after updating in FIG. 6A - fig. 6F.

[00206] For the relationship between the position of the second preview image and the position of the first preview image, refer to the previous descriptions.

[00207] In some embodiments, in the entire image captured by the first camera, the direction in which the center position of the preview image displayed in the first area before updating indicates the center position of the preview image displayed in the first area after updating is opposite to the sliding direction sliding operations.

[00208] If the user's sliding operation is a left sliding operation, the preview image displayed in the first area after updating is closer to the right edge of the entire image captured by the first camera than the preview image displayed in the first area before updating.

[00209] If the user's sliding operation is a right sliding operation, the preview image displayed in the first area after updating is closer to the left edge of the entire image captured by the first camera than the preview image displayed in the first area before updating.

[00210] In some embodiments, the center position of the preview image displayed in the first area before updating is the same as the center position of the entire image captured by the first camera.

[00211] In some embodiments, the preview images displayed in the first area before and after the update are the same size.

[00212] In some embodiments, after entering “multi-channel video mode,” the electronic device 100 may adjust the framing of the production camera in the preview area in a zoom scenario. Scaling means that the preview image displayed in each area of the preview interface is enlarged or reduced.

[00213] FIG. 7A - fig. 7F shows an example of the way in which the electronic device 100 adjusts the framing of the production camera in the preview area in a zoom scenario.

[00214] See FIG. 7A. The user interface 51 shown in FIG. 7A is a preview interface displayed after the electronic device 100 enters the “multi-channel video mode”. The user interface 51 includes a preview frame 301, an image capture mode list 302, a control 901, a control 304, and a control 305. The preview frame 301 includes an area 301A and an area 301B. For information about the function of each control and the preview image displayed in each area of the user interface 51, see the corresponding descriptions of the user interface 41 shown in FIG. 6A. The details are not repeated here.

[00215] As shown in FIG. 7A and FIG. 7B, the electronic device 100 may detect a two-finger zoom gesture (e.g., the two-finger outward slide gesture shown in the figure) in the area 301A, display in response to the two-finger zoom gesture a control 306 is used to indicate the zoom factor of the corresponding camera in the area 301A, and updating the cropping area in image a to update the preview image displayed in area 301A. Image a is an image captured by the camera corresponding to the area 301A.

[00216] The control 306 may be implemented as an icon or text, and the zoom factor of the corresponding camera indicated by the control 306 is changed using a two-finger zoom gesture. When a two-finger zoom gesture is a two-finger zoom gesture, a larger amplitude of the gesture indicates a larger zoom factor of the corresponding camera. When a two-finger zoom gesture is a two-finger zoom out gesture, a larger gesture amplitude indicates a smaller zoom factor of the corresponding camera. For example, the text "1x" in FIG. 7A indicates that the camera zoom factor is 1 and the text "2x" in control 306 in FIG. 7B indicates that the camera zoom factor is 2.

[00217] An example in which before detecting the two-finger zoom gesture, the zoom factor of the camera corresponding to the area 301A is 1, and after receiving the two-finger zoom gesture, the camera zoom factor is x1 is used for description. The center of the cropping area in the updated image a is the point O of image a, and the size of the cropping area is the third dimension.

[00218] The length of the third size is 1/x1 the length of the first size, and the width of the third size is 1/x1 the width of the first size. That is, the first size is 1/x12 of the first size. O is the center of the crop area before the update, and the first dimension is the size of the crop area before the update.

[00219] FIG. 7C shows an example of an updated cropping area of the electronic device 100. The updated cropping area is an area in which a dotted frame is located. The preview image displayed in the update area 301A is image a2.

[00220] As shown in FIG. 7B, since the dimensions of the image a2 and the area 301A are different, the electronic device 100 can enlarge the pixels of the image a2 through "interpolation" processing to enlarge the image a2 to the entire display area 301A.

[00221] In some embodiments, when the two-finger zoom gesture is a two-finger zoom gesture, if the amplitude of the two-finger zoom gesture exceeds the first predetermined value, the camera corresponding to the area 301A may automatically switch to a camera with a larger focal length, for example, switched from wide-angle camera to long-angle camera. When the two-finger zoom-out gesture is a two-finger zoom-out gesture, if the amplitude of the two-finger zoom-out gesture exceeds a second predetermined value, the camera corresponding to the area 301A can automatically switch to a camera with a smaller focal length, for example, switched from a wide-angle camera to an ultra-wide-angle camera.

[00222] FIG. 7D - fig. 7F shows an example of the way in which the electronic device 100 adjusts the framing of the production camera in the preview area in a zoom scenario.

[00223] The user interface 51 shown in FIG. 7D is the same as the user interface 51 shown in FIG. 7B. See related descriptions.

[00224] See FIG. 7D. The electronic device 100 may detect a sliding operation (eg, a horizontal sliding operation to the left) performed in the area 301A. The direction and track of the sliding operation are not limited in this embodiment of the present application.

[00225] See FIG. 7E. The electronic device 100 may again update the cropping area in the image a in response to the sliding operation to update the preview image displayed in the area 301A. Image a is an image captured by the camera corresponding to the area 301A.

[00226] The method in which the electronic device again updates the cropping area in image a in response to the sliding operation is similar to the way in which the electronic device updates the cropping area in image a in response to the sliding operation shown in FIG. 6A - fig. 6F. See related descriptions.

[00227] For example, the center of the re-updated crop region in image a is O2, and the size of the crop region is the third size.

[00228] If the area using O2' as the center and having a third dimension does not exceed the edge of the image a, then O2 is at point O2'. If the region using O2' as the center and having the third dimension exceeds the edge of image a, then O2 is at the center of the region coinciding with the edge of image a and having the third dimension.

[00229] O2' is determined by the point O of image a and the sliding path corresponding to the sliding operation. Specifically, O2' is located in the first direction O, and the first direction is the reverse direction of the slide path. The distance between O2' and the O point is positively correlated with the length of the slip track. In some embodiments, the distance between O2' and point O is equal to the length of the slide track.

[00230] FIG. 7F shows an example of a re-updated cropping area of the electronic device 100. The re-updated cropping area is an area in which a dotted frame is located. The preview image displayed in the update area 301A is image a3.

[00231] In some embodiments, if the area that uses O2' as the center and has a third dimension exceeds the edge of the image a, the electronic device 100 may automatically switch the camera corresponding to the area 301A. The electronic device 100 may switch the camera corresponding to the area 301A to a camera with a larger field of view. For example, if the source camera belonging to the electronic device 100 and corresponding to the area 301A is a long-angle camera, the electronic device 100 may switch the long-angle camera to a wide-angle camera. This can fully satisfy the user's need to adjust the framing of each area within a larger field of view.

[00232] According to the embodiments shown in FIG. 7A - fig. 7F, after the electronic device 100 enters the “multi-channel video mode,” the user can be supported to separately adjust the framing of each working camera in the preview area corresponding to the working camera during multi-channel video recording, so that the framing of each working camera in the area The previews corresponding to the working camera do not influence each other, so as to avoid the problem that changing the framing of the working camera in the corresponding preview area causes the framing of another working camera in the corresponding preview area to change. This method of framing during multi-channel video recording is more flexible and convenient, and the user experience can be improved.

[00233] After adjusting the preview image of each area in the preview interface in the zoom scenario, the electronic device 100 may zoom in again to increase or decrease the zoom factor of the camera corresponding to the area. The following will be described using an example in which, after adjusting the framing of the working camera in the preview area in the zoom scenario shown in FIG. 7A - fig. 7F, the electronic device 100 again zooms for the camera corresponding to the area 301A.

[00234] In some embodiments, after adjusting the preview image of each region in the preview interface in a zoom scenario, the electronic device 100 may detect a two-finger zoom gesture (e.g., a two-finger outward slide gesture) affecting the area 301A and update the cropping area in image a in response to a two-finger zoom gesture to update the preview image displayed in the area 301A. Image a is an image captured by the camera corresponding to the area 301A. Here, the manner in which the electronic device 100 updates the cropping area on image a in response to the two-finger zoom gesture is similar to the manner in which the electronic device updates the cropping area in image a in response to the two-finger zooming gesture shown in FIG. 7A - fig. 7C. See related descriptions.

[00235] For example, refer to FIG. 8A. Fig. 8A shows a possible updated crop area in image a. As shown in FIG. 8A, the preview image displayed in the updated area 301A is image a4.

[00236] For example, refer to FIG. 8B. Fig. 8B shows another possible updated crop region in image a. As shown in FIG. 8B, the preview image displayed in the updated area 301A is image a4.

[00237] From the above, it can be learned how the electronic device 100 adjusts the framing of the production camera in the preview area in the zoom scenario shown in FIG. 7A - fig. 7F what,

Before detecting a sliding operation (for example, the sliding operation in Fig. 7A to Fig. 7F), the electronic device may further detect an operation (for example, a two-finger zoom operation in Fig. 7A to Fig. 7F) used to change the zoom factor of the camera corresponding to the first areas. Then, in response to the operation, the electronic device may enlarge the preview image displayed in the first area before receiving the operation and display the enlarged preview image in the first area. It should be noted that after changing the zoom factor of the camera corresponding to the first area, the first area displays an enlarged partial image. For details, see the corresponding descriptions in FIGS. 7A - fig. 7F.

[00238] In some embodiments, after entering “multi-channel video mode,” the electronic device 100 may track a target object and autonomously adjust the framing of the production camera in the preview area based on the position of the target object. This can reduce the number of user operations and improve convenience.

[00239] FIG. 9A - fig. 9E shows an example of the way in which an electronic device tracks a target object and autonomously adjusts the framing of the production camera in the preview area.

[00240] See FIG. 9A. The user interface 71 shown in FIG. 9A is a preview interface displayed after the electronic device 100 enters the “multi-channel video mode”. The user interface 71 includes a preview frame 301, an image capture mode list 302, a control 901, a control 304, and a control 305. The preview frame 301 includes an area 301A and an area 301B. For information about the function of each control and preview image displayed in each area of the user interface 71, see the corresponding descriptions of the user interface 41 shown in FIG. 6A. The details are not repeated here.

[00241] In some embodiments, upon entering “multi-channel video mode,” the electronic device 100 may automatically identify an object in the preview image displayed in each area in the preview frame 301 and prompt the user when it detects an object of a given type. An object of a given type may include a face, animal, human body, sun, moon, etc. A preset type object may be installed by default by the electronic device 100 or may be selected autonomously by the user.

[00242] In some other embodiments, upon entering "multi-channel video mode", the electronic device 100 may begin to identify, in response to a received user operation, an object in the preview image displayed in each area in the preview frame 301, and prompt the user when the object is detected. of a given type. The user's operation may be a touch-and-hold operation, or a double-tap operation on an area, a voice instruction input, or the like. This is not limited in this embodiment of the present application.

[00243] For example, as shown in FIG. 9A, the electronic device 100 may detect that a face is displayed in the area 301B and display the hint information 307 in the area 301B. Prompt information 307 is used to inform the user that a face has been detected, and the prompt information 307 may be the text “face detected.”

[00244] See FIG. 9B. In some embodiments, the electronic device 100 may detect a touch operation (eg, a press operation) performed on an object (eg, a face in FIG. 9B) in the area 301B, and select the object on which the touch operation is performed as a tracked target object. In some embodiments, after selecting a target object to be tracked, the electronic device 100 may display hint information in an area for displaying the target object in the area 301B, such as the dotted frame shown in FIG. 9B to prompt the user that an object is currently selected as a target object to be tracked.

[00245] In some other embodiments, upon detecting an object of a given type, the electronic device 100 may further directly select the object as a tracked target without user intervention.

[00246] After selecting a target object to be tracked, the electronic device 100 updates the cropping area in image b using the target object as the center to update the preview image displayed in the area 301B. Image b is an image captured by the camera corresponding to the area 301B.

[00247] After the electronic device 100 selects a target object to be tracked, hint information 307 in area 301B may be used to prompt the user that the target object is currently being tracked. For example, refer to FIG. 9B and FIG. 9C. The prompt information 307 may be changed to read “Face tracking in progress.”

[00248] See FIG. 9C and FIG. 9E. If the image b captured by the front camera 193-1 corresponding to the area 301B still includes the target object, the center of the updated cropping area in image b is O4 in image b, and the size of the cropping area is the fourth size. O4 is the center of the crop area in image b before the update, and the fourth size is the size of the crop area in image b before the update.

[00249] If the area using O4' as the center and having a fourth dimension does not exceed the edge of image b, then O4 is at point O4'. If the region using O4' as the center and having a fourth dimension exceeds the edge of image b, then O4 is located at the center of the region coinciding with the edge of image b and having a fourth dimension. O4' is the center of image b where the target object is located.

[00250] FIG. 9D and FIG. 9E shows an example of an updated cropping area of the electronic device 100. The updated cropping area is an area in which a dotted frame is located. The preview image displayed in the updated area 301B is an image in a dotted frame.

[00251] As shown in FIG. 9D and FIG. 9E, the position of the target face in the image captured by the front camera 193-1 changes, but the electronic device 100 still displays the target face at the center position of the area 301B.

[00252] After some time, if the image captured by the front camera 193-1 corresponding to the area 301B does not include the target object, the electronic device 100 may stop tracking the target person. In some embodiments, electronic device 100 may display a prompt to the user that tracking of the target person is currently stopped. The prompt may include, but is not limited to: displaying text, displaying an icon, playing a voice, etc.

[00253] According to the embodiments shown in FIG. 9A - fig. 9E, the electronic device 100 can track a target object during multi-channel video recording to meet user requirements and improve user experience.

[00254] According to the embodiments shown in FIG. 9A - fig. 9E, after detecting that the entire image captured by the first camera includes an image of the first person (for example, the face image in FIG. 9A to FIG. 9E), the electronic device may display a preview image in the first area (for example, area 302B Fig. 9A-Fig. 9C). Then, if the electronic device detects that the position of the first person image in the entire image captured by the first camera changes, the electronic device updates the preview image in the first area. The preview image displayed in the first area before updating is obtained by cropping the entire image captured by the first camera and includes the first person image. The preview image displayed in the first area after updating is obtained by cropping the entire image captured by the first camera and includes the first person image.

[00255] For example, for the preview image displayed in the first area before updating, refer to the preview image displayed in area 301B in FIG. 9A or FIG. 9B, and for the preview image displayed in the first area after updating, refer to the preview image displayed in area 301B in FIG. 9C.

[00256] In some embodiments, the method by which the electronic device performs cropping to obtain a preview image displayed in the updated first area may be as follows: ensuring that the position of the first person image in the updated first area is the same as the position of the first person image faces in the first area before updating. In this way, it can be ensured that the position of the face in the first region is fixed.

[00257] In some embodiments, the electronic device performs cropping using the position of the first person image in the entire image captured by the first camera as the center to obtain a preview image displayed in the updated first area, as shown in FIG. 9A. This can keep the face displayed in the center of the first area while tracking the face.

[00258] In some other embodiments of the present application, upon detecting that the entire image captured by the first camera includes an image of the first person, the electronic device may trigger the second camera. The second camera's framing range is greater than the first camera's framing range, and the first person is within the second camera's framing range. The electronic device may then update the preview image displayed in the first area. The preview image displayed in the first area after updating is obtained by cropping the entire image captured by the second camera and includes the first person image. This way, you can ensure that when tracking an object, the camera switches to expand the tracking range.

[00259] In some embodiments, the first camera is a front camera or a rear camera. Thus, both the front camera and the rear camera can be used to track objects.

[00260] In this embodiment of the present application, after the electronic device 100 enters the "multi-channel video mode", when adjusting the framing range of the working camera in the preview area, the electronic device 100 may additionally prompt in picture-in-picture mode, user of the position of the preview image displayed by the working camera in the preview area in the captured entire image. This way the user can recognize the entire image.

[00261] FIG. 10A-1 - fig. 10B-2 shows an example scenario in which the electronic device 100, in picture-in-picture mode, prompts the user to position a preview image displayed by the production camera in the preview area of the captured entire image.

[00262] See FIG. 10A-1 - fig. 10B-2. The user interfaces 81 shown in FIG. 10A-1 - fig. 10B-2 are preview interfaces displayed after the electronic device 100 enters the “multi-channel video mode”. For each control in the preview interface, see the corresponding descriptions of the user interface 41 shown in FIG. 6A. The details are not repeated here.

[00263] As shown in FIG. 10A- 1 - fig. 10B-2, a window 308 may be displayed on the user interface 81. The window 308 may be displayed floating on an image displayed in the area 301A. The window 308 may be used to prompt the user to the position of the preview image displayed in the current area 301A within the entire image captured by the corresponding wide-angle rear camera 193-3.

[00264] As shown in FIG. 10A-1 - fig. 10B-2, an image captured by the wide-angle rear camera 193-3 corresponding to the area 301A can be displayed in the window 308, and a dotted frame is used to indicate the position of the preview image displayed in the area. 301A on the entire image captured by the camera. The window 308 may use different display forms for the portions inside and outside the dotted frame. For example, shadows may be added to the portions outside the dotted frame to further distinguish the portion that is cropped in the image a captured by the wide-angle rear camera 193-3 and which is displayed in the area 301A.

[00265] As shown in FIG. 10B-1 and FIG. 10B-2, when the position at which the preview image displayed in the area 301A is on the image a captured by the wide-angle rear camera 193-3 changes, the position in the dotted frame in the window 308 also changes accordingly.

[00266] According to the embodiments shown in FIG. 10A- 1 - fig. 10B-2, the user can know, using the window displayed in each area, the cropping range of each camera in the corresponding area and the position of the preview image currently displayed in each area in the entire image. In this way, the user can more conveniently adjust the preview image displayed in each area.

[00267] It can be understood that the picture-in-picture hint method shown in FIG. 10A-1 - fig. 10B-2 is applicable to any scenario in which the electronic device 100 adjusts the preview image displayed in each area of the preview interface mentioned in the previous embodiments.

[00268] When adjusting the preview image displayed in each area of the preview interface in the no-zoom scenario shown in FIG. 6A - fig. 6F, the electronic device 100 may, in a picture-in-picture mode, prompt the user to the position of the preview image displayed in the area 301A in the entire image captured by the camera. In this case, the position of the dotted frame in the window 308 changes when a sliding operation is performed by the user. The moving direction of the dotted frame is opposite to the direction of the sliding operation track.

[00269] When adjusting the preview image displayed in each area of the preview interface in the scaling scenario shown in FIG. 7A - fig. 7F, the electronic device 100 may, in a picture-in-picture mode, prompt the user to the position of the preview image displayed in the area 301A in the entire image captured by the camera. In this case, the size of the dotted frame is inversely proportional to the zoom factor. A larger zoom factor indicates a smaller dotted frame. The moving direction of the dotted frame is opposite to the direction of the sliding operation track entered by the user.

[00270] When autonomously adjusting the preview image in each area of the preview interface based on the position of the target object shown in FIG. 9A - fig. 9E, the electronic device may, in a picture-in-picture mode, prompt the user about the position of the preview image displayed in the area 301A in the entire image captured by the camera. In this case, the position of the dotted frame changes depending on the position of the target object in the image captured by the camera.

[00271] According to the embodiments shown in FIG. 6A - fig. 6F, fig. 7A - fig. 7F, fig. 8A and FIG. 8B and FIG. 9A - fig. 9E, the user can adjust the framing of each working chamber by performing a user operation without moving the electronic device 100, that is, when the position of the electronic device 100 does not change and adjusting the framing of one working chamber does not affect the framing of another working chamber.

[00272] In some embodiments, if the electronic device 100 detects an adjustment operation of the preview image displayed in each area of the preview interface (for example, a sliding operation, a two-finger zoom operation, or a target selection operation mentioned in the above embodiments), if the position of the electronic device changes, the electronic device may not change in response to the user's operation the way it crops the entire image captured by the camera corresponding to each area. That is, if the position of the electronic device is changed, the electronic device does not respond to the user operation used to adjust the framing of each camera in the preview area.

[00273] In some embodiments, if the position of the electronic device changes significantly, that is, the user moves or rotates the mobile phone greatly, the electronic device may have a preview image displayed in each area of the preview interface in a center-cropping manner.

[00274] Next, an embodiment of a UI will be described in which the preview image displayed in each area on the image capturing interface is adjusted during the multi-channel video recording process after the electronic device 100 turns on the “multi-channel video mode.”

[00275] In FIG. 11A - fig. 11F shows examples of UI embodiments in which the electronic device 100 adjusts, during multi-channel video recording, a preview image displayed in each area of the image capture interface.

[00276] FIG. 11A shows an example of the image capturing interface 101 displayed when the electronic device enters the video recording process after turning on the "multi-channel video mode".

[00277] As shown in FIG. 11A, the image capture interface 101 includes a preview frame 301, an image capture mode list 302, a control element 901, a control element 304, and a control element 305. For a list of image capture modes 302, control 304, and control 305, refer to the corresponding descriptions of the user interface 31. The details are not repeated here. As shown in FIG. 11A, multi-channel video mode option 302D is selected.

[00278] The image capture interface 101 may be displayed by the electronic device 100 in response to a touch operation (eg, a press operation) received on a control used for recording video. The control used for video recording may be, for example, the control 901 displayed on any user interface in FIG. 11A - fig. 11F. The control used to record video may also be called the image capture control.

[00279] As shown in FIG. 11A, the image capturing interface 101 further includes a recording time indicator 1001. The recording time indicator 1001 is used to indicate the duration during which the user displays the image capturing interface 101, that is, the duration during which the electronic device 100 begins to record video. The recording time indicator 1001 may be implemented as text.

[00280] After the electronic device 100 turns on the “multi-channel video mode,” the preview frame 301 in the image capture interface is the same as the preview frame 301 in the preview interface. For a method of composing the preview frame 301, see the corresponding descriptions of the previous embodiment in FIGS. 6A. The details are not repeated here.

[00281] In the video recording process, after the electronic device 100 turns on the "multi-channel video mode", the preview image displayed in each area of the image capturing interface can also be adjusted based on the user's operation. The manner in which the electronic device 100 adjusts, during the video recording process, the preview image displayed in each area of the image capturing interface is the same as the manner in which the electronic device 100 adjusts, in the preview process, the preview image displayed in each area of the preview interface. Refer to the previous embodiments shown in FIGS. 6A - fig. 6F, fig. 7A - fig. 7F, fig. 8A and FIG. 8B and FIG. 9A - fig. 9E.

[00282] In this embodiment of the present application, during the video recording process, after the electronic device 100 enters the "multi-channel photo mode", an image displayed on the preview interface during the video recording process can be further stored.

[00283] Specifically, in the video recording process, when the electronic device 100 is in the "multi-channel photography mode", after adjusting the preview image in each area in the preview frame, the user can choose to save the preview image in the preview frame during the video recording process, that is, save the video. For the method in which the user adjusts the preview image of each area in the preview frame, see the related content described in the previous embodiments in FIGS. 11A - fig. 11F.

[00284] For example, during a video recording process, the electronic device 100 may record, in response to a touch operation (eg, a press operation) detected on a control used for video recording, a preview image in a preview frame during the video recording process. The control used for video recording may be, for example, the control 901 displayed on any user interface in FIG. 11A - fig. 11F. The start time and end time of the video recording process are respectively the times at which two adjacent touch operations on the control element 901 are detected after the electronic device 100 turns on the “multi-channel video mode”.

[00285] In some embodiments, electronic device 100 may synthesize images displayed in all areas in a preview frame during video recording into a video file and store the video file. For example, the electronic device 100 can synthesize the arrangement method corresponding to the image displayed in the area 301A and the arrangement method corresponding to the preview image displayed in the area 302B during the video recording process into a video file, and save the video file. In this way, after adjusting the preview image of each area according to the user's requirements, the user can save the desired preview image, so that the user can have a more flexible and convenient video recording experience.

[00286] In some other embodiments, the electronic device 100 may also separately store images displayed in each area during video recording and link the stored multi-channel images.

[00287] It is understood that the user can change the way the preview interface is laid out during the video recording process. If the electronic device 100 changes the layout method of the preview interface during video recording, the layout methods of video files stored in the electronic device 100 at different periods of time may be different. This can provide the user with more flexible recording options.

[00288] After the electronic device 100 stores the preview image displayed in the preview frame as a video file, the user can view in the user interface provided by the "Gallery" the video file stored in the electronic device 100.

[00289] An embodiment of this application further provides a solution in which the electronic device is supported not to change the crop range of the selected preview area when the electronic device is moved, that is, when the position of the electronic device changes. This way, even if the position of the electronic device changes, the crop range of the selected preview area will not change.

[00290] After entering the "multi-channel video mode", the electronic device 100 may block one or more areas in the preview frame during the preview process or during the video recording process. Then, even if the physical position of the electronic device 100 changes, for example, the electronic device 100 moves, the relative position of the static object in the image displayed in the locked area in the area will remain unchanged. Thus, when the user moves the electronic device 100 to change the image displayed in another area, it can be ensured that the locked area always displays the image in a physical position in the real world, that is, in the crop range, the locked area does not change.

[00291] FIG. 12A and FIG. 12B shows an example of UI interfaces in which the viewfinder range of a selected preview area does not change when the position of the electronic device 100 changes.

[00292] FIG. 12A may be a preview interface 111 displayed in response to an operation used to block the area 301B after the electronic device 100 enters the “multi-channel video mode.”

[00293] As shown in FIG. 12A, the preview interface 111 includes a preview frame 301, an image capture mode list 302, a control 303, a control 304, a control 305, and a lock indicator 1101. The preview frame 301 includes an area 301A and an area 301B. For information about the function of each control and preview image displayed in each area of the user interface 71, see the corresponding descriptions of the user interface 41 shown in FIG. 6A. The details are not repeated here. A blocking indicator 1101 is located in the area 301B and is used to indicate that the region 301B is locked. The lock indicator 1101 may be implemented as text, an icon, or other form.

[00294] The operation used to lock area 301B may include, but is not limited to: a touch-and-hold operation performed on area 301B, a double-tap operation, a touch operation performed on a specific control (not shown in FIG. 12A ), an operation of shaking the electronic device 100, and the like.

[00295] See FIG. 12A and FIG. 12B. The user may hold the electronic device 100 to move horizontally to the left. After the electronic device 100 moves horizontally, images captured by the wide-angle rear camera 193-3 corresponding to the area 301A and the front camera 193-1 corresponding to the area 301B are updated.

[00296] In response to the left horizontal movement operation, the electronic device 100 crops the entire image captured by the wide-angle rear camera 193-3 in a cropping manner corresponding to the current area 301A, and then displays the image in the area 301A. The trimming method may be center trimming or other trimming method determined based on the user's operation.

[00297] In response to the left horizontal movement operation, the electronic device 100 stores a display method for displaying in the locked area 301B a static object in the image when the area 301B is locked without changes. A method for displaying a static object includes a size of the static object and a relative position of the static object in the area 301B. In other words, the electronic device 100 ensures that the blocked area displays an image at the same physical position in the real world, and the physical position is a physical position corresponding to a preview image displayed in the area when the area is blocked. For example, refer to FIG. 12A and FIG. 12B. After the electronic device 100 moves horizontally, the area 301B still displays an image in the same physical position. The way the clouds, buildings and roads are shown in the image remains the same, but the person in the image changes to a standing position.

[00298] According to an extended embodiment, from the user's point of view, during the movement of the electronic device 100, one or more areas can be ensured to be locked, that is, preview images in the blocked one or more areas can be ensured to always correspond to the same physical position. Thus, the user can view multi-channel images while taking multi-channel images.

[00299] It is understood that the extended embodiment can be applied to the “multi-channel video mode” preview process, the “multi-channel video mode” preview process, and the “multi-channel video mode” video recording process mentioned in the embodiments of this application. In other words, the electronic device 100 may block one or more areas in the preview frame in the “multi-channel video mode” preview process, the “multi-channel video mode” preview process, and the “multi-channel video mode” video recording process. A specific implementation can be obtained with reference to the preview process and video recording process described in the previous embodiments. The details are not repeated here.

[00300] In this embodiment of the present application, the electronic device may further adjust, after entering the “multi-channel photo mode,” the preview image displayed in each area of the preview interface. That is, the electronic device can further adjust the way the working camera is framed in the preview area in “multi-channel photo mode”.

[00301] For the manner in which the electronic device adjusts the framing of the production camera in the preview area in "multi-channel photo mode", see the section "The method in which the electronic device adjusts the framing of the working camera in the preview area in "multi-channel video mode". Refer to the relevant descriptions above. Details not described.

[00302] FIG. 13A and FIG. 13B are an example of a scenario in which after the electronic device enters the “multi-channel photo mode,” the preview image displayed in each area of the preview interface is adjusted in response to the sliding operation.

[00303] The following describes with reference to FIG. 14 illustrates how the software and hardware of the electronic device 100 in the embodiments of the present application interact to perform the framing method for multi-channel photo and video recording provided in the embodiments of the present application.

[00304] As shown in FIG. 14, after entering the “multi-channel image capture mode,” the electronic device 100 can collect data using N cameras.

[00305] Each of the N cameras outputs a frame according to the default aspect ratio of the input image and transmits the collected raw data to the corresponding ISP. The camera's default output image aspect ratio can be, for example, 4:3, 16:9 or 3:2.

[00306] The ISP is configured to convert data from the camera into an image in a standard format, such as YUV.

[00307] The display may listen to the user operation used to adjust the preview image in each area on the display, and report the user operation obtained by listening to the camera or HAL layer. The user's operation may include, but is not limited to, a sliding operation, a two-finger zoom operation and a sliding operation, a touch operation affecting a target object, and the like, which are detected in each area in the preview frame after the electronic device 100 enters the “multi-channel image capture mode” mentioned in the previous UI embodiments. For example, the display may listen for a zoom event and pass the zoom factor to the HAL layer and the corresponding camera. The display can optionally listen for a camera switch event and transmit the event to the corresponding camera. The display can listen to the sliding operation and pass the sliding operation track to the HAL layer.

[00308] The HAL layer is used to crop the image output by the ISP depending on user operations.

[00309] When the display or other component (eg, microphone) is not listening to the user operation used to adjust the preview image in each area on the display, the HAL layer crops the image output by the ISP in a center-cropping manner.

[00310] When a display or other component (eg, a microphone) listens to a user operation used to adjust the preview image in each area on the display, the HAL layer crops the image output by the ISP according to the user operation. The user operation used to adjust the preview image in each area on the display may include, but is not limited to, a sliding operation, a two-finger zoom and slide operation, a touch operation affecting a target object, and the like. are detected in each area in the preview frame after the electronic device 100 enters the “multi-channel image capture mode” mentioned in the previous UI embodiments. For the manner in which the HAL crops the image output by the ISP in accordance with user operation, see the related descriptions in the previous UI embodiments.

[00311] The HAL may then notify the ISP of the manner in which the HAL crops the image output by the ISP. The ISP performs auto exposure, auto white balance, auto focus (auto exposure, auto white balance, auto focus, 3A) processing of the cropped image depending on the cropping method, and can further perform algorithm optimization on noise, brightness and complexion of the cropped image.

[00312] The image obtained after HAL and 3A layer cropping and ISP optimization processing is transmitted to the image processing module, and the image processing module is configured to perform electronic image stabilization processing on the received image. The HAL may further notify the image processing module of how the HAL crops the image output by the ISP, so that the image processing module performs image stabilization processing on the received image based on the cropping method.

[00313] The image processing module may obtain N-channel images after processing each channel of the received images. The image processing module can stitch or overlay the acquired N-channel images onto a single-channel image according to the current layout style, and output the single-channel image to the display preview interface. In other words, the preview interface can display N-channel images in N areas according to the current layout style.

[00314] The image processing module may include an image processor, a video codec, a digital signal processor, or the like. in an electronic device 100.

[00315] In some embodiments, after the electronic device 100 enters the "multi-channel photo mode", if the display detects a touch operation detected on the image capture control, the electronic device stores the image that is output by the image processing module for the preview interface display when a touch operation is detected.

[00316] In some embodiments, after the electronic device 100 turns on "multi-channel video mode", if the display detects two touch operations detected on the image capture control, the electronic device stores the image that is output by the image processing module for the preview interface display during the period of time between two touch operations.

[00317] In the above UI embodiments, in a multi-channel video recording scenario, the area 301A or the area 301B in the preview frame 301 may be referred to as the first area, for example, the area 301A or the area 301B in FIG. 6A - fig. 6F, fig. 7A - fig. 7F, fig. 9A - fig. 9E, FIG. 10A-1 - fig. 10B-2 and FIG. 11A - fig. 11F.

[00318] A camera corresponding to area 301A or area 301B, such as a front camera or a rear camera, may be referred to as a first camera.

[00319] The sliding operation received in the area 301A or area 301B in the preview interface may be referred to as the first user operation, such as the sliding operation in FIG. 6A, FIG. 6D and FIG. 7D.

[00320] An operation detected by the electronic device at the image capture interface and indicating the start of video recording may be called a second user operation. The second user operation may be, for example, an operation performed on the image pickup control element 901, such as the operation performed on the image pickup control element 901 in FIG. 11A.

[00321] Before detecting the first user operation, the preview image displayed in area 301A or area 301B may be referred to as the first preview image, for example, the image displayed in area 301A or area 301B in the embodiments of FIGS. 6A - fig. 6F, and an image (image a2) displayed in area 301A in FIG. 7D.

[00322] After detecting the first user operation, a preview image displayed in area 301A or area 301B may be referred to as a second preview image, for example, an image (image a1 or b1) displayed in area 301A or area 301B in the embodiments of FIG. . 6A - fig. 6F, and an image displayed in area 301A in FIG. 7E.

[00323] The two-finger zoom operation adopted in the area 301 or area 301B in the preview interface may be called a third user operation, for example, the two-finger zoom operation shown in FIG. 7A.

[00324] The sliding operation adopted in the area 301 or the area 301B in the image capturing interface may be called a fourth user operation, for example, the sliding operation in FIG. 11A. After detecting the fourth user operation, the preview image displayed in the area 301A or the area 301B in the image capturing interface may be referred to as the third preview image, for example, the image displayed in the area 301A in FIG. 11A.

[00325] When the position of the electronic device is changed, the image displayed by the electronic device in the first area may be referred to as the fourth preview image.

[00326] When the electronic device detects a face in the entire image captured by the first camera, the image displayed in the first area may be referred to as the fifth preview image, for example, the image displayed in area 301B in FIG. 9A. When the position of a face detected by the electronic device changes in the entire image captured by the first camera, the image displayed by the electronic device in the first area may be referred to as a sixth preview image, such as the image shown in FIG. 9B or FIG. 9C.

[00327] When an electronic device tracks a face, if the camera is switched, the switched camera may be referred to as a second camera. In this case, the image obtained from the second camera and displayed in the first area may be referred to as the seventh preview image. When the position of a face detected by the electronic device changes in the entire image captured by the second camera, the image displayed by the electronic device in the first area may be referred to as the eighth preview image.

[00328] An operation detected by the electronic device at the image capture interface and indicating that video recording has stopped may be referred to as a fifth user operation. The fifth user operation may be, for example, an operation performed on the image pickup control element 901, such as the operation performed on the image pickup control element 901 in FIG. 11B - FIG. 11F.

[00329] The video file playback operation that is detected by the electronic device may be referred to as a sixth user operation. An interface that is located in an electronic device and that is used to play a video file may be referred to as a playback interface.

[00330] In a scenario in which the position of the electronic device is changed and the crop range of the selected preview area is not changed, the operation used to block the area may be referred to as the seventh user operation. The seventh user operation may be, for example, a touch-and-hold operation or a double-tap operation performed in the area 301B. After the area is locked, the operation detected by the electronic device indicating the start of video recording may be referred to as the user's eighth operation. The eighth user operation may be, for example, a pressing operation performed on the image capturing control element 901 in FIG. 12B.

[00331] After detecting the seventh user operation and before changing the position of the electronic device, the preview image displayed in the area 301A or area 301B may be referred to as the ninth preview image, for example, the image displayed in the area 301A in FIG. 12A. After changing the position of the electronic device, the preview image displayed in the area 301A or the area 301B may be referred to as the tenth preview image, for example, the image displayed in the area 301A in FIG. 12B.

[00332] Based on the electronic device 100 and the UI embodiments described in the previous content, the following embodiment describes a framing method for recording multi-channel video provided in this application. As shown in FIG. Method 15 may include the following steps.

[00333] Phase 1 (S101 to S105): Enable "multi-channel video mode".

[00334] S101: The electronic device 100 starts the camera.

[00335] For example, electronic device 100 may detect a touch operation (eg, a click operation on icon 220) performed on camera icon 220 shown in FIG. 3A, and launch the camera in response to the operation.

[00336] S102: The electronic device 100 detects the user's operation of selecting the "multi-channel video mode".

[00337] For example, the user operation may be a touch operation (eg, a press operation) in the multi-channel video mode embodiment 302D shown in FIG. 3B or FIG. 3D. The user operation may also be another type of user operation, such as a voice instruction.

[00338] This is not limited to user choice. The electronic device 100 may select "multi-channel video mode" by default after starting the camera.

[00339] S103: The electronic device 100 runs N cameras, where N is a positive integer.

[00340] In particular, the electronic device may have M cameras. M ≥ 2, M ≥ N and M is a positive integer. N cameras can be a combination of front camera and rear camera. Alternatively, the N cameras can be any combination of a plurality of cameras: a wide-angle camera, an ultra-wide-angle camera, a long-angle camera, or a front-facing camera. The method of combining cameras from N cameras is not limited in this application.

[00341] N cameras may be selected by the electronic device as default. For example, an electronic device by default includes a front camera and a rear camera. Alternatively, N cameras can be selected by the user. For example, the user can select from the More mode option which cameras should be turned on.

[00342] S104: The electronic device 100 captures images using N cameras.

[00343] S105: The electronic device 100 displays a preview interface, wherein the preview interface includes N areas, and part or all of an image captured by each of the N cameras may be displayed in one of the N areas.

[00344] As shown in FIG. 6A, the preview interface includes an area 301A and an area 301B. An area 301A displays a partial image captured by the rear camera, and an area 301B displays a partial image captured by the front camera. In this case, N=2, and N cameras are the rear camera and the front camera.

[00345] The images respectively displayed in the N areas may be called preview images. The preview image displayed in an area can be obtained by cropping the entire image captured by the camera corresponding to the area.

[00346] The preview interface shown in FIG. 6A is used as an example. The preview image displayed in the area 301A can be obtained by the electronic device by cropping the entire image captured by the rear camera, and the preview image displayed in the area 301B is obtained by the electronic device by cropping the entire image captured by the front camera. Specifically, the center position of the preview image displayed in the area 301A may coincide with the center position of the entire image captured by the rear camera, and the center position of the preview image displayed in the area 301B may coincide with the center position of the entire image captured by the front camera. In this case, the preview images displayed in the area 301A and area 301B are cropped at the center.

[00347] At a factor of 1x, the size of the cropping area of the preview image displayed in the area 301A and cropped from the entire image captured by the rear camera may be the same as the size of the area 301A. Likewise, at a factor of 1x, the size of the cropping area of the preview image displayed in the area 301B and cropped from the entire image captured by the front camera may be the same as the size of the area 301B.

[00348] It is possible that when the zoom factor of a camera of N cameras is reduced to, for example, 0.7X, the preview image displayed by the camera in the area corresponding to the camera may be the entire image captured by the camera. For example, the user can reduce the zoom factor by performing a two-finger pinch operation on the area 301A to view the entire image captured by the rear camera in the area 301A. The two-finger pinch operation can also be called the two-finger pinch operation.

[00349] This is not limited to the horizontal split screen method shown in FIG. 6A. There may be many ways to arrange the area 301A and the area 301B in the preview interface, such as a picture-in-picture method. This is definitely not limited in this application.

[00350] Phase 2 (S106 and S107): Adjusting the camera crop range in the preview interface.

[00351] S106: The electronic device 100 detects the first operation of the user in the first area. The first region may be one of the N regions, the first preview image may be displayed in the first region, and the first preview image is obtained by cropping the entire image captured by the first camera.

[00352] The preview interfaces shown in FIG. 6A and FIG. 6B are used as examples. The first area may be an area 301A, the first preview image may be a preview image displayed in the area 301A, and the first camera may be a rear camera. In this case, the user's first operation may be a sliding operation in the area 301A, such as a left sliding operation or a right sliding operation. The first user operation may also be another type of user operation, such as a voice instruction for area 301A.

[00353] S107: The electronic device 100 displays the second preview image in the first area. The second preview image is also obtained by cropping the entire image captured by the first camera. In the entire image captured by the first camera, the position of the second preview image is different from the position of the first preview image.

[00354] The preview interfaces shown in FIG. 6A - fig. 6F are used as examples. When a left sliding operation is detected in the area 301A, compared with the first preview image, the center position of the second preview image displayed in the area 301A deviates from the center position of the first preview image and is no longer the center position. of the entire image captured by the rear camera. Thus, the user can change, using a sliding operation, the crop range represented by the rear camera in the area 301A.

[00355] Specifically, if the user's first operation is a left-slide operation, the second preview image is closer to the right edge of the entire image captured by the first camera than the first preview image. As shown in FIG. 6A - fig. 6C, a preview image displayed in the area 301A shown in FIG. 6B is closer to the right edge of the entire image captured by the rear camera than the preview image displayed in the area 301A shown in FIG. 6A. Thus, the user can view, by performing a left sliding operation in the area 301A, an image closer to the right edge of the entire image captured by the rear camera, for example, turn on the right object in the entire image captured by the rear camera appears in the area 301A.

[00356] Specifically, if the user's first operation is a right-slide operation, the second preview image is closer to the left edge of the entire image captured by the first camera than the first preview image. As shown in FIG. 6D - fig. 6F is a preview image displayed in the area 301B shown in FIG. 6F is closer to the left edge of the entire image captured by the front camera than the preview image displayed in the area 301B shown in FIG. 6D. Thus, the user can view, by performing a right sliding operation in the area 301B, an image closer to the left edge of the entire image captured by the front camera, for example, cause the left-sided object in the entire image captured by the rear camera to appear in the area 301A.

[00357] The second preview image may be the same size as the first preview image. The center position of the first preview image may be the same as the center position of the entire image captured by the first camera.

[00358] When the user's first operation in the first area occurs, the preview image in the first area changes from the first preview image to the second preview image, but the cropping range of the preview image in the other area in the preview interface does not change. In other words, when detecting the first operation of the user on the entire image captured by another camera (which may be called the second camera) of the N cameras, the position of the preview image B is the same as the position of the preview image A. Preview image A is a preview image displayed in another area (which may be called the second area) before the user's first operation occurs, and preview image B is a preview image displayed in the second area after the user's first operation occurs . In this way, the user can separately adjust the crop range presented by a camera in the preview interface without affecting the crop range presented by another camera in the preview interface.

[00359] After the user's first operation in the first area, that is, after the user adjusts the crop range of the first camera in the preview interface, the user can further adjust the crop range of the other camera in the preview interface. For example, the electronic device may detect a user's operation, such as sliding left or right, in another area (which may be referred to as a second area) and change the preview image displayed in the second area from preview image C to preview image D. In the entire image captured by the second camera, the position of the preview image D is different from the position of the preview image C. Thus, the user can change, using a user operation such as sliding left or sliding right in the second region, the crop range represented by the second camera in the second region.

[00360] Phase 3 (S108 and S109): Video recording.

[00361] S108: The electronic device 100 detects the second operation of the user. The second user operation is a user operation indicating the start of video recording, for example, a clicking operation on the control 303 shown in FIG. 6A.

[00362] S109: The electronic device 100 starts to record video and displays an image capturing interface, wherein the image capturing interface also includes N areas.

[00363] During the video recording process, the user can also adjust, by performing a user operation such as sliding left or right, the crop range presented by the camera in the image capturing interface. The specific process is similar to that of the user adjusting the camera crop range in the preview interface. Likewise, when the electronic device detects a user operation (such as a left slide operation or a right slide operation) performed in the first region, in the entire image captured by the first camera, the position of the preview image displayed in the first region is different from the position of the preview image. previously displayed in the first area. Here, the previous means that before the electronic device detects a user operation (for example, a left slide operation or a right slide operation) in the first area.

[00364] After adjusting the camera crop in the preview interface, the user can further adjust, using a left slide operation or a right slide operation, the crop range presented by the camera in the image capture interface. Specifically, the electronic device may detect a left sliding operation or a right sliding operation (which may be referred to as a fourth user operation) in the first area of the image capture interface and display a third preview image of the first camera in the first area. The third preview image is obtained by cropping the entire image captured by the first camera. In the entire image captured by the first camera, the position of the third preview image is different from the position of the second preview image.

[00365] Phase 4 (S110 to S113): Record video and play back video file.

[00366] S110: The electronic device detects a user operation indicating a stop of video recording, such as a click operation on the control element 303 shown in FIG. 6A. The user operation may be referred to as the fifth user operation.

[00367] S111: The electronic device stops recording video and creates a video file.

[00368] In particular, each frame of an image in a video file includes a preview image displayed in each area. In particular, stitching processing may be first performed on the preview image displayed in each region.

[00369] S112: The electronic device detects a user operation (which may be referred to as a sixth user operation) to open a video file.

[00370] S113: The electronic device displays a playback interface, wherein the playback interface also includes N areas.

[00371] It can be learned that according to the framing method for recording multi-channel video presented in this embodiment of the present application, the user can separately adjust during multi-channel image shooting the framing presented by each working camera in the preview frame, so that the framing of each working cameras did not influence each other to avoid the problem that changing the framing of a working camera causes a change in the framing of another working camera.

[00372] In addition, the framing method for recording multi-channel video provided in this embodiment of the present application may further provide a face tracking function. Specifically, when the electronic device detects that the entire image captured by the first camera includes an image of the first person, the electronic device may display a fifth preview image in the first area. The fifth preview image is obtained by cropping the entire image captured by the first camera, and the fifth preview image may include an image of the first person. When the electronic device detects that the position of the first person image in the entire image captured by the first camera changes, the electronic device displays a sixth preview image in the first area. The sixth preview image is obtained by cropping the entire image captured by the first camera, and the sixth preview image also includes the first person image.

[00373] The position of the first person image in the sixth preview image may be the same as the position of the first person image in the fifth preview image. The first person image may be in a central area of the fifth preview image.

[00374] To further expand the trackable range of a face, when the electronic device detects that the entire image captured by the first camera includes an image of the first person, the electronic device may trigger the second camera. The second camera may be a wide-angle camera or an ultra-wide-angle camera, and the cropping range of the second camera is larger than the cropping range of the first camera. The first face is within the second camera's framing range. In this case, the electronic device may display the seventh preview image in the first area. When the electronic device detects that the position of the first person image in the entire image captured by the second camera changes, the electronic device displays an eighth preview image in the first area. The seventh preview image is obtained by cropping the entire image captured by the second camera, and the seventh preview image includes the first person image. The eighth preview image is obtained by cropping the entire image captured by the second camera, and the eighth preview image includes the first person image.

[00375] The position of the first person image in the seventh preview image may be the same as the position of the first person image in the eighth preview image. The first person image may be in a central area of the seventh preview image.

[00376] The face tracking function is applicable to a front-side shooting scenario or applicable to a rear-side shooting scenario. That is, the first camera may be a front camera or may be a rear camera.

[00377] In addition, the framing method for recording multi-channel video provided in this embodiment of this application may further provide a function for adjusting the framing when scaling. In particular, the electronic device may further detect a third user operation before detecting the first user operation. A third user operation may be used to increase the zoom factor, such as a user operation where two fingers move from pinching to stretching. In response to the third user operation, the electronic device may enlarge the first preview image and display the enlarged first preview image in the first area. It can be understood that if the size of the first preview image is the same as the size of the first area at 1x speed, the enlarged first preview images cannot be completely displayed in the first area. The electronic device may display a partial image of the first preview image in a first area, and the partial image may be located in a central area of the first preview image.

[00378] In the framing method for recording multi-channel video provided in this embodiment of this application, when the electronic device detects the first operation of the user, if the position of the electronic device does not change, the electronic device displays a second preview image of the first camera in the first area. In other words, the electronic device adjusts the cropping range of the camera in the preview interface based on the user's first operation only when the position of the electronic device does not change. Upon detecting a first operation by the user, if the position of the electronic device is changed, the electronic device may display a fourth preview image of the first camera in the first area. The fourth preview image may be obtained by cropping the entire image captured by the first camera, and the center position of the fourth preview image coincides with the center position of the entire cropped image of the first camera. In other words, when the position of the electronic device is changed, the electronic device may not adjust the cropping range of the camera in the preview interface based on the first user operation detected at that time, so that the user changes the optical framing by adjusting the position of the electronic device.

[00379] For content that is not mentioned in the method embodiment of FIG. 15, refer to the above UI embodiment. The details are not repeated here.

[00380] The above description represents only specific implementations of this application, but it is not intended to limit the scope of protection of this application. Any change or substitution readily detectable by one skilled in the art within the technical scope disclosed in this application shall/should fall within the scope of protection under this application. Therefore, the scope of protection of the present application should correspond to the scope of protection of the claims.

Claims (54)

1. A framing method for recording multi-channel video, applied to an electronic device having a display and M cameras, where M ≥ 2 and M is a positive integer, the method comprising: electronically enabling N cameras, where N ≤ M and N is a positive integer; capturing images by an electronic device using N cameras; displaying, by the electronic device, a preview interface and a portion or all of an image captured by each of the N cameras, wherein the preview interface comprises N regions, and a portion or all of an image captured by each of the N cameras is displayed in one of the N regions; detecting by the electronic device a first operation of the user in the first area, wherein the first area is one of the N areas, the first preview image is displayed in the first area, and the first preview image is obtained by cropping the entire image captured by the first camera; displaying, by the electronic device, a second preview image in a first area, wherein the second preview image is also obtained by cropping the entire image captured by the first camera, and in the entire image captured by the first camera, the position of the second preview image is different from the position of the first preview image; detection by the electronic device of a second operation by the user; And starting the video recording electronic device and displaying an image capturing interface, wherein the image capturing interface contains N areas; wherein the electronic device displaying a second preview image of the first camera in the first area comprises: when a first user operation is detected, if the position of the electronic device does not change, the electronic device displaying a second preview image of the first camera in the first area; And the method further comprises: upon detecting a first user operation, if the position of the electronic device changes, displaying by the electronic device a fourth preview image of the first camera in the first area, wherein the fourth preview image is obtained by cropping the entire image captured by the first camera, and a center position of the fourth image The preview coincides with the center position of the entire cropped image of the first camera. 2. The method of claim 1, wherein the first user operation comprises a sliding operation, and in the entire image captured by the first camera, the direction in which the center position of the first preview image points to the center position of the second preview image is opposite to the sliding direction of the sliding operation . 3. The method of claim 2, wherein if the user's first operation is a slide left operation, the second preview image is closer to the right edge of the entire image captured by the first camera than the first preview image. 4. The method of claim 2 or 3, wherein if the user's first operation is a right-slide operation, the second preview image is closer to the left edge of the entire image captured by the first camera than the first preview image. 5. Method according to any one of paragraphs. 1-4, in which the center position of the first preview image coincides with the center position of the entire image captured by the first camera. 6. Method according to any one of paragraphs. 1-5, wherein the first preview image is the same size as the second preview image. 7. Method according to any one of paragraphs. 1-6, additionally containing: further detecting by the electronic device a third operation of the user before detecting the first operation of the user; And electronically enlarging the first preview image and displaying the enlarged first preview image in a first area. 8. Method according to any one of paragraphs. 1-7, additionally containing: detecting by the electronic device a fourth operation of the user in the first area of the image capturing interface; And displaying, by the electronic device, a third preview image of the first camera in a first area on an image capture interface, wherein the third preview image is obtained by cropping the entire image captured by the first camera, and in the entire image captured by the first camera, the position of the third preview image is different from the position second preview image. 9. Method according to any one of paragraphs. 1-8, additionally containing: detecting, using the electronic device, that the entire image captured by the first camera contains an image of the first person; displaying, by the electronic device, a fifth preview image in the first area, wherein the fifth preview image is obtained by cropping the entire image captured by the first camera, and the fifth preview image includes an image of the first person; detecting, by an electronic device, a change in the position of the image of the first person in the entire image captured by the first camera; And displaying, by the electronic device, a sixth preview image in the first area, wherein the sixth preview image is obtained by cropping the entire image captured by the first camera, and the sixth preview image includes an image of the first person. 10. The method of claim 9, wherein the position of the first person image in the sixth preview image is the same as the position of the first person image in the fifth preview image. 11. The method of claim 9 or 10, wherein the first person image is in a central region of the fifth preview image. 12. Method according to any one of paragraphs. 1-8, additionally containing: detecting, using the electronic device, that the entire image captured by the first camera contains an image of the first person; electronically turning on a second camera, wherein the framing range of the second camera is greater than the framing range of the first camera, and the first person is within the framing range of the second camera; displaying, by the electronic device, a seventh preview image in the first area, wherein the seventh preview image is obtained by cropping the entire image captured by the second camera, and the seventh preview image contains an image of the first person; detecting, by means of an electronic device, a change in the position of the image of the first person in the entire image captured by the second camera; And displaying, by the electronic device, an eighth preview image in the first area, wherein the eighth preview image is obtained by cropping the entire image captured by the second camera, and the eighth preview image includes an image of the first person. 13. The method of claim 12, wherein the position of the first person image in the seventh preview image is the same as the position of the first person image in the eighth preview image. 14. The method of claim 12 or 13, wherein the first person image is in a central region of the seventh preview image. 15. Method according to any one of paragraphs. 9-14, in which the first camera is a front camera or a rear camera. 16. Method according to any one of paragraphs. 1-15, wherein the method additionally contains: detection by the electronic device of a fifth user operation; stopping the electronic video recording device and generating a video file; detection by the electronic device of the user's sixth operation with the video file; And displaying, by the electronic device, a playback interface, wherein the playback interface comprises N areas. 17. A framing method for recording multi-channel video, applied to an electronic device having a display and M cameras, where M ≥ 2 and M is a positive integer, the method comprising: electronically enabling N cameras, where N ≤ M and N is a positive integer; capturing images by an electronic device using N cameras; displaying, by the electronic device, a preview interface and a portion or all of an image captured by each of the N cameras, wherein the preview interface comprises N regions, and a portion or all of an image captured by each of the N cameras is displayed in one of the N regions; detecting by the electronic device a seventh operation of the user in the first area; detecting by the electronic device a change in the position of the electronic device; display by the electronic device of a ninth preview image in a first area, wherein the cropping range of the ninth preview image is the same as the cropping range of the tenth preview image, the tenth preview image is an image displayed in the first area before changing the position of the electronic device, the ninth preview image a preview image is obtained by cropping the entire image captured by the first camera after changing the position of the electronic device, and a tenth preview image is obtained by cropping the entire image captured by the first camera before changing the position of the electronic device; detection by the electronic device of the eighth operation of the user; And starting the video recording electronic device and displaying an image capturing interface, wherein the image capturing interface contains N areas. 18. An electronic imaging device comprising a display, M cameras, a touch sensor, a memory, one or more processors, a plurality of applications and one or more programs, where M ≥ 2, M is a positive integer, said one or more programs stored in memory and, when said one or more processors execute said one or more programs, the electronic device is able to implement the method according to any one of claims. 1-17. 19. A computer framing device for recording multi-channel video, comprising a memory, a processor, and a computer program that is stored in the memory and can be executed on the processor, wherein when the processor executes the computer program, the computer device is able to implement the method according to any one of claims. 1-17. 20. A computer-readable storage medium containing instructions, wherein, when the instructions are executed on an electronic device, the electronic device allows the method of any one of claims to be performed. 1-17.

Images